We've been trying to do stuff like that for a long time, e.g., the impact of smartphones. My understanding though is that such changes are so widespread it's really hard to have a meaningful control group in the same cohort etc.
this post was submitted on 03 Aug 2026
56 points (92.4% liked)
Ask Lemmy
40928 readers
1833 users here now
A Fediverse community for open-ended, thought provoking questions
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, toxicity and dog-whistling are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !uspolitics@lemmy.world
7) No Hit-and-Run questions.
Please don't delete your post for no apparent reason. If you plan on deleting a question later, say so in the post, or if you feel that you have a good reason to remove it, message a mod beforehand. It's not fair to the ones who took their time to answer, and it's not in the spirit of the community.
8) No Bots.
Posts or comments from bots, LLM's, AIs, Neural Networks, Transformers, or Marvin the Paranoid Android are not welcome in AskLemmy. Real humans only please.
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
founded 3 years ago
MODERATORS
Explain how that increases shareholder value?
See Goodhart's law: “When a measure becomes a target, it ceases to be a good measure”.
If LLMs are judged by some specific metric meant to track their negative impact, they’ll adapt to make the metric look good without improving the underlying impact.
Great example of Goodhart:
I used to work at a Verizon store, and we were rated by the amount of accessories we could sell with each phone. In order to boost that number, everyone tried to add on a bunch of cheap phone accessories (clearance items and screen protectors) to drive that number up.
Our goal was more than three, but once we figured out how to sell 5 or more for less than $20, they changed it to total cost of accessories per phone.
It’s too late to record a baseline, so any metrics will need to work retrospectively anyway.
There's still a bunch of us that refuse to use it.
There are a lot of things we should urgently do for our own good. So no, we're not going to
Last I heard we don't even know how to measure that in the first place. As my intro to psychology class said IQ tests are a reliable measure, but what they measure nobody knows. (which is to say if you take the test more than once you will score about the same every time)
We have better idea now about what it measures. For example about 35% of differences in IQ scores are associated with working memory capacity. And we have very specific tests to measure working memory. There are more very specific parameters that are correlated with IQ that we can measure. We know quite well what IQ actually is but it's a mix of many different things and not a simple parameter indicating who's smart and who's not.
The word I've heard for “reliable” is precise.
If a test meaures what it's supposed to measure, it's accurate.
I took the class 30 years ago so my memory of exactly words were used is untellable. The point is memorable and I believe is correct.
We should but ive been tracking people I know who are addicted to it and I saw a mental decline instantly. It doesn't take a lot of experimenting to show it makes you an idiot, not using your brain will do that.
I'll be the old man yelling at cloud who refuses to use it while the rest of the world straps on bezos vision for 79.95 a month to go to work typing prompts.
I don't think that's a very compelling investment thesis.
If you want to measure seriously, you shouldn't jump to interpretations early.
Maybe in the past when science was still a thing. It's all money and power now.
don't worry, it'll let us know how dumb we've become
How would they avoid the brain damage enough to understand it?