128

cross-posted from: https://feddit.online/c/tech@feddit.online/p/2125899/chatgpt-helped-sadistic-school-shooter-build-3d-printed-weapons

OpenAI’s chatbot fueled the Tumbler Ridge killer’s plans for making gun accessories and torturing victims, our investigation reveals.

you are viewing a single comment's thread
view the rest of the comments
[-] lillardfair@lemmy.world 26 points 1 day ago

Initially I was a little knee jerky to the title and the 1st couple paragraphs. AI sucks, but 3D printing weapons accessories should not be on its face a crime and there's a lot of unnecessary hand wringing around it. Also, I know the chatbots are always chatbots reporting home, but immediately reporting someone to the authorities for discussing 3d printed accessories and spring strengths is an invasion of privacy in my book.

However, in this case OpenAI was definitely being negligent. The first account gets banned for “scenarios involving gun violence” they don't bring it to authorities and then sit on it after they connected it after the fact to the shooter. And that shooter used the 2nd account to both solve the gun accessory improvements while also playing out "hypothetical" shooter scenarios ringing any alarm bells is crazy.

[-] grue@lemmy.world -2 points 1 day ago* (last edited 1 day ago)

However, in this case OpenAI was definitely being negligent. The first account gets banned for “scenarios involving gun violence” they don’t bring it to authorities and then sit on it after they connected it after the fact to the shooter. And that shooter used the 2nd account to both solve the gun accessory improvements while also playing out “hypothetical” shooter scenarios ringing any alarm bells is crazy.

What legal responsibilities against "negligence" should the software have had if he had used a local LLM instead?

If the answer is "none," why should a cloud-hosted LLM be treated differently?

If the answer isn't "none," why should we accept that infringement of private property rights?

[-] Natanael@infosec.pub 1 points 21 hours ago* (last edited 14 hours ago)

Why should a bar owner call the police if you commit a crime in their bar, while they do nothing if you're not in the bar, doing a crime in your home?

Simply because in the former case they observed it in a space they have a personal responsibility over.

Which is why if you want privacy when using cloud servers and shit, you should use end to end encryption or only use services from companies you trust (not a lot these days 🤷).

And yes there's a lot of conflicting precedence. Your landlord doesn't have such a responsibility, because your home is a private space even if you don't technically own it. But we have no comparable situation online, unless you literally go for co-location by buying physical hardware sitting in a rack of the hosting company. The online services which don't do proactive monitoring does it because they're so rarely used for crime or because it's contribution is negligible.

ChatGPT et al also stands out significantly over other online services like Google Docs or file sharing because it inherently is built around the capability to understand semantics and know what you're talking about. It's unreasonable to expect Google Docs to recognize what you're writing about in a document. But asking for help to do crime is like the difference between talking about crime in a corner with your buddy in the bar which the bartender might not notice, versus going up to the bartender asking him to help you plan crimes

[-] lillardfair@lemmy.world 7 points 1 day ago

I get your point, but a cloud llm is a service and one that makes no real promise of privacy to begin with. They are always logging your data to improve and identify improper usage. If you make an admission of intended violence to a therapist, let alone a cloud based service, they have an obligation to report it to authorities. I'm not advocating for a nanny state, but if the intent is put put into public or 3rd party space and a conclusion of violence can reasonably be drawn, its the service's responsibility to report.

If the answer isn't "none," why should we accept that infringement of private property rights?>

If you are concerned about your privacy, run a home based llm and are using it to plot violence, the records would be evidence in a trial, just like a handwritten journal. There's not an expectation that it reports you, because internet connection isn't a required aspect of the system.

[-] grue@lemmy.world -1 points 1 day ago

I get your point, but a cloud llm is a service and one that makes no real promise of privacy to begin with. They are always logging your data to improve and identify improper usage. If you make an admission of intended violence to a therapist, let alone a cloud based service, they have an obligation to report it to authorities.

So because they claim the right to log it, they have an obligation to report it? Would a cloud LLM service that claimed not to log be absolved of that obligation, or should such a service not be allowed to exist?

this post was submitted on 19 Nov 2026
128 points (88.6% liked)

Technology

89921 readers
3796 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS