97

Our investigation found that Hugging Face, the top platform for sharing open-source AI models, isn't just hosting tools that generate non-consensual intimate imagery. It's helping users compare, benchmark and optimize them, making image-based sexual abuse easier to scale.

By investigating the platform's most widely used Hugging Face Spaces and creating our own, we found:

  • 73% of monitored requests were sexual in nature.
  • Of those, 83% sought to undress or otherwise sexualize a person. 95% targeted women.
  • 6.7% targeted a minor. If fulfilled, these requests would constitute child sexual abuse material (CSAM).
  • Just 3% of audited Spaces showed any evidence of output moderation.

Hugging Face's own policies prohibit non-consensual intimate imagery. Yet we found virtually no safeguards preventing these tools from being used for exactly that purpose.

you are viewing a single comment's thread
view the rest of the comments
[-] dumnezero@piefed.social 2 points 3 weeks ago

The site should be shut down.

this post was submitted on 31 Jul 2026
97 points (94.5% liked)

Fuck AI

8049 readers
570 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS