80
Tools we can use to poison AI and fight back
(lemmy.today)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 29 Oct 2026
80 points (95.5% liked)
Fuck AI
8598 readers
1744 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
Rules:
- Relevant posts only.
- No bigotry.
- This isn't a place to talk about the cons and (supposed) pros of AI for different use cases. This is /c/fuck_ai .
- Especially no AI advocacy.
- Don't make any posts that are just AI content with no context unless the point of your post is obvious from content. (Don't just post slop advertisements or slop political cartoons. At least make your point about it clear so we know you aren't just trolling.)
- Venting is part of the purpose of this community, but don't aim frustration or accusations at other users.
- These rules are a living document that may change in the future.
founded 2 years ago
MODERATORS
FWIW, while iocaine does generate copious amounts of garbage, it is never going to poison LLM training data: it's trivial to filter iocaine-generated garbage out pre-training. The garbage is there for two reasons:
Not the models, the crawling queue. Place an identifiable substring into every generated URL, and you can catch any crawler that works off of a queue collected by cheaper crawlers.
It's not really a poisoning tool - it originally started with that goal, but that goal has changed a loooong time ago -, it's more bot detection & mitigation nowadays, the garbage is just one of the tools it achieves this goal with.
But while I'm here, I'd like to mention Alun Jones' fakejpeg (or my rust port): a library that can help you generate structurally legit-ish JPEGs, files that most decoders will happily display, but with entirely random content. Generating them is very cheap. How effective it is in poisoning? I don't know. But I find great delight in looking at the random noise.