145
Internet Watch Foundation reports huge rise in AI child sexual abuse material
(www.theguardian.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 05 Oct 2026
145 points (96.8% liked)
Technology
88607 readers
5013 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
The companies that produce these images should be prosecuted for each and every one. They must have safeguards against stuff like this out go out of business.
This is the pretext for taking away individual's rights to general computing -- because once all the providers have guard rails and are locked out, individual users with local hardware are the last source for 'illegal content'. "We have to scan everything you do on your local computer, or you could be doing something we don't approve of". https://lemmy.world/post/52743759 <-- see this story up on the front page just now. She (foolishly) thought her prompts in OpenAI were private to her, and now she's charged with "sending a threat in a way that others can read" -- we won't be able to use our computers for private diaries or planning anymore the more they get locked down to only 'approved' data and programs.
And remember, it starts with CSAM, and then it moves on to "illegal content", then "terrorist content" -- and how many times has the Trump said "if you are against the president and the laws I'm enforcing, you must be a terrorist?" ....
Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.
The Four Horsemen of the Infocalypse - terrorists, pedophiles, drug dealers, and money launderers
But enough about the president...
Sorry, what? The other side of this coin is not regulating companies like OpenAI and them using their enormous level of influence to push whatever they want. When a large part of the population uses these platforms, and any (political) query always gets replied to with an answer that fits what they want to achieve, what happens?
The potential power these AI companies hold is horrifying. They absolutely should be regulated.
No it isn't.
Fine, as long as you agree to prosecute also all companies that produce software to work with images (or generate them without using AI), every company that produce software that can be used to create 3d models and then the renderer that get these models and render them into photorealistic images.
Then you need to go after everyone who produces plugins fot these softwares. And then you need to go to every open source software that do the same thing and every person who contribute to them.
And maybe even hardware vendors that sell graphics tablets for drawing.
Sometime it seems that, especially with AI, people think that the solution is to ban the tool and not to punish who use it to do something illegal.
True, AI make it extremely easy to create such horrific images but AI is not the first tool to do so, it make only faster. Back at the time there were entire Usenet groups dedicated to fake nude/xxx images of persons, both celebrities and normal people, but we have not banned internet, we simply prosecuted (when/if caught) who created the images.
Yeah, that these images are repulsive, but prosecute the companies that make tools that can also generate them was like to prosecute a phone company because someone use a phone to plan and commit an homicide.
Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.
I was thinking of how Grok in particular was just open to generating these sorts of images without any guardrails. In my mind that was similar to a company producing deadly chemicals without any guardrails for preventing it from poisoning everyone around.
What companies? Only grok had serious problems (which are fixed by now, supposedly). Rest of the companies models cannot generate such stuff, this is all done with custom models by individuals.
This is really important for people to understand.
Powerful open weight models are already out there. Anyone can download them and run them. There is no possibility for government control of AI content without North Korean style internet controls.
Politicians and corporations will absolutely start trying to push for more controls. They will tell you to "think of the children" and they will use this to take power for themselves, knowing full-well that they can't actually meaningfully prevent this from happening. We need people to understand that the push for control here has nothing to do with morality or protecting anyone.