I still can’t believe that his son was the WSJ journalist who was beheaded by ISIS.
Roughly citing Taleb: in a way, we have managed, indeed, to create the utopia that people and computers think alike.
...though we didn't manage to bring about that machines think like people, but exactly the opposite.
AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.
fluency gets mistaken for understanding
That’s it. I am going to borrow that phrase.
And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?
The words to describe it are hard. The “Elizabeth Holmes Complex” in You Can See Everything pretty much sums it up.
And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?
Call me cynical if you will, but I think it's more that Silicon Valley values short term profit over integrity. They know the limitations of what they are selling, but if it makes money, that drives everything.
I don't think they care about limitations (if even they can understand them, let alone spend time assessing), they are only in for the quick buck this quarter.
Source: have worked for normal american company.
Steal it freely. I think the mindset is less about valuing fluency than treating confidence as evidence. Holmes sold a story so convincingly that asking whether the machine worked became almost rude. Now we’re doing it again, except the machine can write its own pitch deck.
Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs' limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.
In case anyone is interested, here's an article I really like that very well describes how LLMs are not like all other tools, in particular how they're are fundamentally different than tools like a drill, and how this difference is bad actually: https://deadsimpletech.com/blog/no-such-thing-as-just-a-tool
Not disagreeing that an idiot with a drill is also a disaster, I just think there are some interesting differences worth lingering on too!
Interesting read. I agree with the overall analysis. I don't agree with the premise that calling something a tool somehow implies that its use is neutral. Of course it isn't.
The article fundamentally agrees that LLMs are tools. Just that being a tool comes with a lot of luggage and indirectly shapes human behavior. We certainly ought to think about what kind of tools we want to create and what their effects on society are.
I think the frasing the article critiques is saying that something is "just a tool" and not saying that something is "a tool", as it agree with you that the latter doesn't imply the same neutrality as the first.
Writing this comment I realised how hard it is to tell whether "just" is part of the quote or not without using quotation marks, so haha that can sure be confusing.
That was a really interesting article with ideas that were new to me. Thanks for sharing it.
very well
I stopped reading after a few paragraphs. No idea what the author wanted to say. Reference to old philosophers is cool, but first you need to explain WHAT you're trying to say, and only then pour down all that philosopher gibberish onto reader.
It's not that long, but I agree that it does not get to the point, just ramble about how tools have imperfections. Could have been way better.
In a nutshell; the tool becomes a part of you, and thus limits your options.
Or so I read it.
I generally think most philosophy is overly academic wank written by people who desperately need to go outside but I also think the author of that article does a very good job laying out exactly what they're trying to say and why it matters. You might actually learn a thing or two if you bothered to read it.
"A fool with a tool is still a fool" - Grady Booch (father of UML)
The quote is from 2018. Back then most neural networks were still mostly single purpose - far from today’s all-in-one package. Text generation was barely working at all.
The underlying problems are still the same. Transformer models do not have an inkling of intelligence, and they still don't have an internal model of the world around them. Creativity is also non-existent, which is a hard requirement if you want these things to actually create something new instead of rehashing what already exists.
There was no rehashing in 2018. What you did was you trained your own (local) model on some data to help you work. For example, a grad student would painstakingly mark cells in em-scans for weeks and even months, now they could do it for a day, use that result to train a neural network and only supervise the job done. And the job wiuld take minutes instaid of weeks or months.
There were no llms in 2018, IIRC the google/deepmind paper was from 2019 (can be wrong here).
Source: built AI training app in 2018 for science company.
they still don't have an internal model of the world around them
This has been shown repeatedly to not be correct since 2023.
That's literally how transformers turned out to have been working so well. They build world models and bags of heuristics fitting the training data to extrapolate from.
It's almost surprising you managed to use the correct term for the tech but then managed to misrepresent it so egregiously.
You really think that an Othello board could represent the world? Talk about being delusional. This is pathetic. The subheadline: "OTHELLO-GPT USUALLY PREDICTS LEGAL MOVE" says it all - it cannot have a representative internal world model, because in that case the "USUALLY" would go away, as anyone who has played othello for longer than 10 minutes will tell you - and we are talking about a game with very simple rules here, the complexity does not even reach chess - and people expect these things to spit out coherent and valid solutions from target selection in wars to the color their bedroom walls should be painted in.
Edit: I really have to add here the following excerpt (percentages are the rate of invalid moves as the top choice):
The error rate is 0.01% for Othello-GPT trained on the synthetic dataset and 5.17% for Othello-GPT trained on the championship dataset. For comparison, the untrained Othello-GPT has an error rate of 93.29%.
So even if you just feed them real world data without completely synthesizing it, 1 in 20 moves are invalid in a very simple (rule-side) game. If you do not give them a whole lot of played games as a basis, it fails in over 93% of cases (not at making a GOOD move, just at making any valid move!), which is probably very close to a random guess for a move. Something that has even an inkling of an internal world view would be able to adapt after being told that their move is invalid. Also, an internal world view would allow for simply dropping the rulebook onto ChatGPT as a basis, as it works with humans that can imagine.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.