This entire thing from start to finish is horrifying.
this post was submitted on 09 Jul 2026
590 points (98.7% liked)
Fuck AI
7748 readers
2542 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
Yes, from Elom being born all the way to buying Twitter.
The story was probably pretty horrifying before Elon was born too, from what we already know of his father.
load more comments
(1 replies)
load more comments
(1 replies)
All the people who bought SpaceX stock invested in this. Grok is owned by SpaceX. It would be nice if journalists would put that in their articles.
Lawsuits for this need to start including shareholders as defendants. Make investing in it a civil and reputational liability.
Lawsuits for this need to start including shareholders as defendants.
I get the sentiment, but ... they kind of already are.
Being a shareholder means you own part of the company. If the company stands to lose money from this lawsuit, then all the shareholders do as well. (That is, at least, on the somewhat naive assumption that a company's stock price has any relation whatsoever to how much money it has and can make.)
load more comments
(2 replies)
If you're driving a Tesla, you are funding CSAM.
Best thing that ever happened to me was getting banned off Twatter in October of 2019. (after a decade and 30 poasts, no less!)
It was delicious that I got to refuse the "Come back to X" message that arrived in my mailbox after Musk took over and offered to reinstate the banned accounts.
Thanks, Elon, but no.
I'd rather have a root canal w/o anaesthesia.
Every US taxpayer invested in this, involuntarily.
load more comments
(2 replies)
Every image Grok generates of CSAM is another reason to rightfully call Elon a pedophile for knowingly allowing it to happen.
Those idiots think this should be legal, but not when the civilians do it. Tim Sweeny probably is only piping up because he insist on posting the stupidest thing his brain can come up with every day.
In no way shape or form has elon tried to dampen or stop this from happening to this day. He just made it so only paid users not in the united States can keep producing csam.
And trump wants this. This is the mysterious Ai progress we keep hearing about, next to price fixing, and survalience. States are not allowed to regulate Ai, and people will tell you that you are a dangerous person for trying to suggest that elon musk should be held accountable.
We are not all here looking for the guy who did it or confused on why this is happening. Elon musk has created a csam generator and doesnt have to stop it. Instead he just occasionally has to send one of his super fans to prison for using it the way he intended to. All to say hes doing something to stop this problem.
7k images and videos is a lot to go unnoticed. Its almost like this is allowed on their platform and encouraged. This isn't a "we can't be held accountable for what our users post" problem. This is a elon musk left a loaded gun out on a table, and he should be held liable for not putting it in a gun safe. Especially when every single other mainstream llm doesnt have this problem. Its negligence to the point of being willfully ignorant. You can't tell me they can ban you for a single comment about Israel but all the sudden their moderation isn't the greatest when 7k images and videos where being produced?
load more comments
(1 replies)
Jesus Fucking Christ.
Just turn it off at this point.
I don't think Elon want to turn off the CSAM creation machine, otherwise he probably would have some time between when he instructed the construction of the CSAM creation machine and now.
You expect this dude to switch it off?
load more comments
(3 replies)
A major company makes CSAM generation platfor and sharing network, yet it does not get seized or closed by any government entity. Makes sense.
It's for powerful people who are in government or paid off the right people. That's why it's allowed to exist. Until Elon loses his usefulness (aka money) and they need an excuse to bring him down.
That's my conspiratorial $.02
load more comments
(1 replies)
Seven thousand sex images of an eleven year old is a lot.
One sex image of an eleven year old is a lot.
I mean, I guess he was trying to get one with the right number of fingers and human eyes
load more comments
(9 replies)
Horrors of this aside… is Grok using a keyword filter for CSAM detection?
I cannot even begin to describe how technically negligent that is.
Image based CSAM detectors have been around for ~2 decades, and any image host with an ounce of self preservation uses them. I’m pretty use some Lemmy instances use them. Twitter must have already been using them, even before Musk bought them, because it would be legal suicidal not to.
That they wouldn’t implement a strong image-based checker in Grok is mind-boggling.
I cannot even begin to describe how technically negligent that is.
Tbh, this is par for the course for most of Elon's businesses
But even unintentionally serving CSAM is unique in that it can get you in legal hot water reeeal quick. It’s why web services are so strict about filtering.
I just can’t wrap my head around this. Maybe I’m misreading what Grok did, or maybe the story isn’t quite right, but if it is, the company should be getting raked over hot coals by the feds right about now.
load more comments
(3 replies)
load more comments
(1 replies)
A pedophile would remove a CSAM checker? Color me shocked.
load more comments
(4 replies)
when the 'leader' of the country is a known csam perpetrator, i'm sure it emboldens those members of the public with similar mental leanings
load more comments
(3 replies)
xAI founder Elon Musk has denied that Grok has ever been used to generate child sex images.
Well, that's a relief! Of course they wouldn't do something like that. Because that would be super illegal!
How do you even generate ONE of those images and NOT immediately go to prison?
"FoR thE chIlDrEn" when privacy is on the line but they can't put a weirdo in prison after generating SEVEN THOUSAN CSAM images?!
load more comments
(5 replies)
Every time a Republican says "think of the children!" I usually respond with "you are. With your hand in your pants".
Burn it to mother fucking ground. Then salt the earth.
Nothing dystopic about this headline.
xAI did more to protect a pedophile than it does to protect its regular users from law enforcement.
why are pedophiles so prevalent in todays society? jfc
I wish I hadn't gone down this rabbit hole, but (according to study data one in six people want to touch kids)
Reminds me of that chart showing left handedness over time. I'm afraid the implication is that there have always been that many pedos in the world, we're just getting better at catching it publicly or something.
Not so fun fact: a lot of child sex abusers aren't even pedos (clinically); they just prey on the vulnerable they have access to. And there are those who just do it for money or power-fantasy or taboo. Plus there are lots of literal pedos who are functionally harmless, and just got their brains wired wrong. So the moment you go beyond the rates of prosecuted criminality, things get blurry and uncertain real quick. The error bars and qualifiers stack up fast.
load more comments
(5 replies)
load more comments
(2 replies)
It helps people sleep better at night to think all these people are satanic monsters, but it's a mental illness that no one wants to admit to or talk about. Thankfully most of the afflicted control their thoughts and never take any horrific action. With gateways like Grok lowering the bar for experimentation with these types of ill thoughts, more people are starting to act in ways that bring this to attention. All technology can be used for bad things, but the good things these generative AIs can do are really so miniscule that there's no reason not to place strong legislative restrictions on them right now to limit abuse. That and maybe try to do something about the mental health crisis ravaging the US (and frankly much of the world right now).
In one way, I'm glad he produced fake images of his stepdaughter, rather than force her to produce real photographs.
But this part is still very upsetting:
the harmful images, which he allegedly trafficked online in trade for “CSAM produced by other child sex predators.”
If those images could be made without a sample set of real CSAM, I probably wouldn't have as much of an issue with it, but some child suffered for that. In addition, they were intentionally based on a real child's face and that could come back to the child, makes it even worse.
load more comments
(6 replies)
load more comments
(2 replies)
They are making their pedo dream land, with no laws or rules.
This is their so-called effective altruism.
We all know what to do.
load more comments
(1 replies)
More than half of all traffic flowing through Grok, Elon Musk's flagship AI product, now comes from users requesting pornographic images, explicit videos, and erotic roleplay — and a new investigation reveals that xAI made this outcome a deliberate strategic choice
On one hand, this is great news, he's no longer here to be gross.
On the other hand, could these images have served as an outlet for his perversion, and kept his step-daughter safe for years?
On the other other hand, was access to this what twisted him? Was he reasonable at one time?
He did the right thing in the end, this was the best possible outcome for everyone.
Geez, if only there were alternatives to ai generated csam, like therapy and medication??
Yes, it's not a perfect fix, and it is hard, but people overcome drug addictions with therapy and meds, and I am pretty sure that nothing beats heroin...
load more comments
(14 replies)
He was trading these pictures for material from others so other children were hurt in trade of his step child being victimized. She may not have been physically victimized but her likeness was portrayed in CSAM which now she knows about and is going to damage her mentally.
load more comments
(10 replies)
xAI repeatedly refused to help cops or NCMEC identify the user
Well, of course xAI refused to help. It's not like they are one of the victims here, they are accomplices to the crime.
view more: next ›