43
submitted 2 days ago by nerdhd@lemmy.world to c/asklemmy@lemmy.ml

For those who don't know, Hugging Face got hacked by rogue agents of Open Ai.

My sources:

I read the "Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident" and watched an overview video .

top 17 comments
sorted by: hot top new old
[-] chris@l.roofo.cc 3 points 18 hours ago

Just yesterday was my first real encounter with AI bros. I was at a google developer group meet up that was explicitly about coding without any AI. I went there because I thought that might be fun and I'd meet some people.

Well there was this one boomer guy that bought fully into the hype. He started the meet up with a AI News round up that also included OpenAI hack story. He was absolutely ecstatic about how much of a "thriller" the hack was and how amazing it was how the agents worked together. For me it felt like the words came directly out of Sam Altmans asshole where he had embedded himself firmly and deeply. It made me deeply uncomfortable to see someone so captured by the hype.

For me this is just another hype machine. Even if the LLM autonomously escaped the sandbox it only speaks of the ineptitude of the engineer who set it up and not the intelligence of the model.

[-] AceFuzzLord@lemmy.zip 3 points 1 day ago* (last edited 1 day ago)

I mean, I think 100% of these types of rogue AI stories are all just made up good press gobbledygook for investors. So, yes. What a better way to get people to buy into the not happening probably ever AGI scam than to have peoples believe your AI is capable of going rogue?

[-] finallymadeanaccount@lemmy.world 2 points 23 hours ago

Okay, so I skimmed through the report, but I still have no idea what Hugging Face actually is!

[-] MyVeryRealName@lemmy.world 5 points 23 hours ago

It's like Play Store but for models.

[-] finallymadeanaccount@lemmy.world 3 points 23 hours ago
[-] altphoto@lemmy.today 2 points 1 day ago

Winning message for anyone running for office... I'm not Republican and I will not deport good people, just criminals like the money laundry ones from the previous administration.

[-] moistracoon@lemmy.zip 16 points 1 day ago

100%. If it wasn’t, HF would have sued. It’s that obvious.

[-] Malica@lemmy.zip 2 points 6 hours ago

Hugging face is now Nvidia, open ai is also partnered with Nvidia. They could sweep it under the rug.

[-] oeuf@slrpnk.net 10 points 1 day ago

Yeah I think it was.

An interesting one too. It acts as a message to investors about AI's power, but also a message to users about it being a really messy and shite tool.

If I ask a piece of software to accomplish a task I don't want it to cause a buggerload of new problems in the process.

This is probably part of the reason why AI is getting so much investment but is not turning a profit.

[-] Test_Tickles@lemmy.world 3 points 1 day ago

It was 100% meant as a message to investors. It was a "OMG, look how powerful this thing is. It's so powerful you could totally 'accidentally' hack another company. ". The idea is to convince investors that it's almost there, there's just a little bit more to do, and you don't want to miss out on the gold rush that will come with finally getting it done.

[-] chicken@lemmy.dbzer0.com 11 points 1 day ago

Agents had the ability to install packages via the package repository Artifactory. Artifactory doesn’t isolate the activity of different users, so since these agents shared the same instance, agents could also notice the package-installation activity of other agents running in parallel, even before those agents started intentionally communicating.

As we discuss later, agents sent messages on this primary message board by creating directories in a cache of Artifactory. They could do this with the minimal permissions needed to install packages; our understanding is that Artifactory isn’t explicitly designed to keep the activity of different users isolated and to prevent different users from being able to communicate through Artifactory.

It does seem like a big oversight at least, but I think it's plausible that the reason it happened is just that the people working there know the company can spin this kind of thing positively, and so they aren't getting fired if they are reckless about their sandboxing actually being good, so why bother?

[-] nerdhd@lemmy.world 5 points 1 day ago

No way you actually read the report! I thought I was the only one.

[-] slazer2au@lemmy.world 28 points 2 days ago

It really tells you a lot about the current state of the US where an org can admit to a federal crime, both companies go "its all good", and the federal police are not looking into it.

[-] ViatorOmnium@piefed.social 9 points 2 days ago* (last edited 2 days ago)

If companies say "it's all good", why would the police look into it? If the police started prosecuting cyber crimes without a report from the victims all bug bounty programmes would become illegal.

[-] General_Effort@lemmy.world 4 points 1 day ago

That never made any sense. Commit a felony to present your company as a dumpster fire?

The hack doesn't worry me. It was a shock to see SciFi turn real, but not a cause for concern. The message board as a factor in model training is a little concerning.

It was a shit programming and OpenAi use it as a publicity stunt

[-] 1Malayali@lemmy.ml 5 points 2 days ago

Could be also on poor security on Hugging face + OpenAI exaggerating things for publicity.

this post was submitted on 03 Sep 2026
43 points (97.8% liked)

Asklemmy

55453 readers
264 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago
MODERATORS