this post was submitted on 28 Aug 2024
5 points (69.2% liked)
AI
4151 readers
1 users here now
Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.
founded 3 years ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs are totally unreliable for research. They are just probable token generators.
Especially if your looking for new data that nobody has talked about before, then your just going to get convincing hallucinations, like talking to a slightly drunk professor at a loud bar who can't ever admit they don't know something.
Example: ask a llm this "what open source software developer died in the September 11th attacks?"
It will give you names, and when you try to verify those names, you'll find out those people didn't die. It's just generating probable tokens
Solutions exist where you give the LLM a bunch of files e.g., PDFs which it then will solely base it's knowledge on
It's still a probable token generator, you're just training it on your local data. Hallucinations will absolutely happen.
This isn't training its called a RAG Workflow, as there is no training step per se