The only AI detection for text that supposedly works, and isn't public yet, is Anthropic's watermarking.

And even once it's public, it can only reliably say that a text has been created or heavily edited by Claude specifically. It can never rule out that it's been AI-generated in general.

Other AI companies might (be forced to) follow suit in the future; if so you could check them off one by one, but there will always be AI models that won't have watermarks. So even then only the most lazy slop-posters will be caught (granted, I still think that will help).

You're talking about social rules to restrict people (and bots) from what they can post. That can be an idea to pitch to mods of lemmy and piefed communities, but isn't something to do with piefed as a software.

Sadly, these AI detectors are notoriously unreliable. To the point they're completely useless for automatic content filtering in bulk. Also rarely Free and Open-Source. Even the "ai-detector sites" I tried aren't really all that great. Though I welcome suggestions in case someone knows a good (free) one.

Some AI companies said they're doing watermarking. And I think that'd solve the issue. But then they probably won't disclose how the watermarking works, so we're not going to be able to use that one, either.

I don't see any substantially better solution, than what Rimu already implemented...

It'd be great if we had that, though. And I guess we'd find some people to implement it if someone comes up with a feasible solution.

(Preferably a library(?) or maybe a scientific paper or an algorithm / NLP / machine learning approach we can implement ourselves. Main point: It has to have a low false positive rate, ideally a good detection rate. Has to run on whatever we can afford to run it on. And if you ask me, we better not use any big tech cloud services, like Microsoft Azure AI detector 😅)

• finally copy-paste part of the text in a couple of ai-detector sites.

This won’t be reliable at all, those kind of sites give false positives all the time since you use AI to “detect” AI.

I guess checking for em-dashes and common sentences like “why this works” can sometimes be an indication, but I don’t think there is an easy way to reliably automate a process like that.

If your instance has rules against LLM content just report the domains to your admin and they can blacklist them (alternatively, if the content is coming from a federated instance they can blacklist instances that allow slop).

Read more, especially offline and stuff that was written prior to 2020. You'll start to notice that the tropes of LLM-generated text stick out like a sore thumb.