You can teach people how to use it all day long, but most still won’t use it well consistently in real life. Humans instinctively trust confident-sounding language. Most of us are also way worse at fact checking than we think. LLMs play right into humanity’s flaws, and they’re built to maximize engagement rather than help us avoid going past the tools’ limits. I don’t trust LLMs to be accurate about anything, but I still caught myself reading and failing to check Google AI overviews sometimes before I changed my default search engine to a no-AI alternative. It’s just instinctual when an “answer” is right there at the top of the page in response to your search question.
Sure, you can use an LLM to help you find sources, but at that point you might as well just use a search engine. There are search engines that provide links with actual text from each site rather than potentially hallucinated summaries.
Some search engine results are crap, yes. But even the worse search engine (minus AI overviews or whatever) gives you a setup where: (1) each piece of information has an actual source, (2) you know who the source is, and (3) you can make decisions about which information to trust accordingly. If a popular search engine puts a sketchy company’s blog at the top of the SERP, you can actually see that and choose to look father down for something more reliable. Also, if your current search engine keeps failing you, try a different one! There are many options out there that you might find more helpful than today’s Google or Bing or DuckDuckGo.
Good luck with things, truly. I think you’re going to get hurt eventually if you use LLMs for medical advice, and I genuinely don’t want that for you or anyone. Hopefully this conversation has at least made you a little more skeptical about using LLMs in certain ways.