685

What just happened? Another incident has taken place that illustrates the need to be careful what you tell AI. A Florida woman is facing felony charges after she used Claude as a diary and allegedly wrote that she planned to "shoot up" the Sheriff's office. After a human reviewer examined the statements, they were reported to police.

According to the arrest report, Carli Michelle Heller, of Bonita Springs, Florida, wrote on September 26 that she would attack the Sheriff's office. She later said that she uses Anthropic's chatbot like a "diary."

Claude's safety systems flagged the entry and it was escalated to a human reviewer. After deciding it was a credible threat, the reviewer reported it to law enforcement.

The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury.

Deputies identified Heller and visited her home. She was detained without incident before an LCSO intelligence detective took over the investigation.

Heller faces a charge of making a written threat of violence under Florida law. Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism. The communication must be made in a manner in which another person may view it.

Anthropic isn't going to be taking any chances when it comes to anything it deems a potential threat. Last month, it was reported that OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.

The shooter, eighteen-year-old former pupil Jesse Van ⁠Rootselaar, had previously been flagged by OpenAI's safety team for her conversations about gun violence, but OpenAI never alerted police because the conversations did not meet the threshold for legal referral.

In June, Florida also sued OpenAI and Altman, alleging that ChatGPT had contributed to real-world harms, including the 2025 Florida State University shooting.

The latest incident is another reminder to think before you enter something into a chatbot that could get you into trouble. It's certainly not a private diary whose contents are for your eyes only.

Reports last month revealed that human contractors reviewing Microsoft Copilot's image editor can see users' prompts, uploaded photos and AI-generated edits. Documents show that some of those assignments contain sexual, disturbing or potentially illegal material, though the reviewers are not there to flag the content – only to assess whether the output is accurate.

you are viewing a single comment's thread
view the rest of the comments
[-] iuseasahibtw@ani.social 24 points 16 hours ago

Self host if you're gonna use AI, in fact, self host whenever possible. There are numerous examples of companies using centralized data to sell, report to police, or even having it fall into the hands of hackers.

I really think people think that all data input to a website is actually stored locally, nope, don't be dumb.

[-] A_Random_Idiot@lemmy.world 7 points 8 hours ago

Self host if you’re gonna use AI

or, you know, Don't fucking use AI period cause its fucking stupid, and you don't need to be consuming the power of the fucking sun to make a journal.

[-] RumRunningDevil@lemmy.zip 1 points 2 hours ago

Fully this.

In my day to day life it improves nothing. I certainly could write a complicated harness over a local model to get it to automate a ton of my day to day tasks but... Why?

Why would I do that? Regular deterministic tools and regular programming languages already give me the ability to automate the stuff that is truly tedious. Aside from that most of the tasks that people seem to use it for are tasks were the friction of doing them is were all the benefit lies.

People using this shit for journaling or taking notes is INSANE.

[-] percent@infosec.pub 1 points 3 hours ago

How much power do you think local inference actually consumes?

[-] kestrel7_7@lemmy.world 2 points 2 hours ago* (last edited 2 hours ago)

Local AI solves the power/water problem but it doesn’t solve the main “fucking stupid waste of time” problem.

[-] KillerWhale@orcas.enjoying.yachts 3 points 8 hours ago

Can someone actually self host a reasonable model on a standard PC?

[-] percent@infosec.pub 2 points 3 hours ago

Yes. Chinese labs keep improving small, open-weight models. IIRC, Qwen3.8-27B benchmarks are comparable to frontier models that were released less than a year ago.

I run that model on my RTX 5060 Ti 16GB using ExLlamaV3. Though, I'm not sure if that qualifies as "standard PC" hardware as it now costs more than 2x the price I paid a year ago :/

[-] leaf_skeleton@lemmy.world 1 points 5 hours ago* (last edited 5 hours ago)

Well if you temper your expectations sure. Can't expect frontier performance from a average gaming pc, but it is enough to do a lot more than you think probably. This video on the topic I found really informative: https://youtu.be/ydFikMBJG1g EDIT: Also I've been using gemma4:31b from duck.ai lately that I've found is excellent for almost everything I use AI for. Except maybe long context.

[-] iuseasahibtw@ani.social 1 points 7 hours ago

Depends on what you need. You can get away with hosting QWEN 27B on a laptop with about 64 GB or RAM and a dedicated GPU. You'll be using mostly system RAM, not VRAM, so generation would be slow, but not unbearable.

Good for creating short stories and other creative work when paired with a front end that can handle character profiles, world building, and has memory recall.

It's better to build your own server and set it up so you, and only you, can remotely access it.

[-] kestrel7_7@lemmy.world 2 points 2 hours ago

Meanwhile, my luddite ass is still writing short stories on my typewriter

[-] calcopiritus@lemmy.world 4 points 6 hours ago

standard pc

64GB of ram on a laptop

[-] CrimeIsLegalNow@ani.social 1 points 6 hours ago

That cost me $150 in 2020

[-] IamMoonPie@lemmy.world 9 points 12 hours ago

Better yet… just don’t us AI

[-] adhdsergio@lemmy.world 4 points 12 hours ago

I mean, first, don't try to shoot up anything

this post was submitted on 05 Oct 2026
685 points (99.6% liked)

Technology

88607 readers
4337 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS