this post was submitted on 02 Sep 2024
1165 points (98.5% liked)
Memes
45746 readers
1572 users here now
Rules:
- Be civil and nice.
- Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Gradient descent is a common algorithm in machine learning (AI* is a subset of machine learning algorithms). It refers to using math to determine how wrong an answer is in a particular direction and adjusting the algorithm to be less wrong using that information.
The way you phrased that perfectly illustrates the current problem AI has: In a problem space as large as natural language, there are nearly an infinite number of ways it can be wrong. So no matter how much data we feed it, there will always be some "brand new sentence" someone asks that breaks it and causes a wrong answer.
Absolutely. It's why asking it for facts is inherently bad. It can't retain information, it is trained to give output shaped like an answer. It's pretty good at things that don't have a specific answer (I'll never write another cover letter thank blob).
Now, if someone were to have the good sense to have some kind of lookup to inject correct information between the prompt and the output, we'd be cooking with gas. But that's really human labor intensive and all the tech bros are trying to avoid that.