LLMs are a money hole. They are so fucking inefficient that they can only spit out a hundred words per second on high end consumer hardware that would have be considered a supercomputer 20 years ago. And the fact that those words are a likely to be a lie as they are truth means you need to burn more coal to get it to do it's own fact checking.

Maybe in 20 years when we can pack a couple of exaflops into a phone llms will make sense as a swiss army knife solution.