Adversarial attacks on training data for LLMs is in fact a real issue. You can very very effectively punch up with regards to the proportion of effect on trained system with even small samples of carefully crafter adversarial inputs. There are things that can counter act this, but all of those things increase costs, and LLMs are very sensitive to economics.
Think of it this way. One, reason why humans don't just learn everything is because we spend as much time filtering and refocusing our attention in order to preserve our sense of self in the face of adversarial inputs. It's not perfect, again it changes economics, and at some point being wrong but consistent with our environment is still more important.
I have no skepticism that LLMs learn or understand. They do. But crucially, like everything else we know of, they are in a critically dependent, asymmetrical relationship with their environment. The environment of their existence being our digital waste, so long as that waste contains the correct shapes.
Long term I see regulation plus new economic realities wrt to digital data, not just to be nice or ethical, but because it's the only way future systems can reach reliable and economical online learning. Maybe the right things happen for the wrong reasons.
It's funny to me just how much AI ends up demonstrating non equilibrium ecology at scale. Maybe we'll have that self introspective moment and see our own relationship with our ecosystems reflect back on us. Or maybe we'll ignore that and focus on reductive world views again.
I had a friend for many years who would do this. To be clear, this person was otherwise a decent friend and I had good times with them. But they would constantly declare, loudly, to everyone, how fat they were. They would make constant comments on how fat, their relatives were. They'd insist that other people were making special arrangements for them because of their fatness.
No matter how many times people would assure this person that we largely did not care or consider their weight as any factor in hanging out with them or interacting with them, they would deny it. No matter how many times I or anyone else carefully suggested that there may be some value in speaking to a therapist about their anxiety around their weight, they would not listen.
This same person would also complain how much fat shame society as a whole inflicts. But they refused to acknowledge their own.
It is sad, and infuriating, and it eventually pushed me and many other people away.