428
RatGPT
(lemmy.nz)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 21 Sep 2026
428 points (98.6% liked)
Microblog Memes
12174 readers
3259 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
RULES:
- Your post must be a screen capture of a microblog-type post that includes the UI of the site it came from, preferably also including the avatar and username of the original poster. Including relevant comments made to the original post is encouraged.
- Your post, included comments, or your title/comment should include some kind of commentary or remark on the subject of the screen capture. Your title must include at least one word relevant to your post.
- You are encouraged to provide a link back to the source of your screen capture in the body of your post.
- Current politics and news are allowed, but discouraged. There MUST be some kind of human commentary/reaction included (either by the original poster or you). Just news articles or headlines will be deleted.
- Doctored posts/images and AI are allowed, but discouraged. You MUST indicate this in your post (even if you didn't originally know). If an image is found to be fabricated or edited in any way and it is not properly labeled, it will be deleted.
- Absolutely no NSFL content.
- Be nice. Don't take anything personally. Take political debates to the appropriate communities. Take personal disagreements & arguments to private messages.
- No advertising, brand promotion, or guerrilla marketing.
RELATED COMMUNITIES:
founded 3 years ago
MODERATORS
So the post was deleted but someone else mentioned that the user told it to email the FBI in a sarcastic manner and it did.
Anyways, saying it goes rogue when you connect it to your Gmail and it uses it is a bit silly. They are trained to use tools, it sees anything you give it as a tool and will use it.
Tells chatbot to email fbi
Chatbot emails fbi
ShockedPikachu.png
Who the fuck uses sarcasm with a clanker?
What kind of idiot would link a clunker to their gmail and then jokingly say "hey send this to the FBI"
...
"I mean wouldn't that be the stupidist thing ever am I right?"
Yeah, um... Regardless of what you think about current AI, don't connect it to shit like this. Just... Don't.
And if you're gonna be sarcastic or joke with it... Tell it that. Don't assume it'll infer your meaning if it isn't literally in the text, no matter how insightful it appears to be.
My local LLMs are sandboxed and only have access to tool calls for web search/reading web pages, terminal commands with manual authorization for every single line and r/w access to a single directory. I wouldn't dare give it anything sensitive, like API keys, system wide r/w access or the power to run terminal commands on its own. Yet here we are, in a time where the US military is integrating hallucinating chatbots into their kill chain, russian drones decide on their own to blow up stuff and random people use LLMs to potentially design bioweapons and missiles.
Humanity is fucking dumb and sometimes i have the notion of accepting that we might deserve to go extinct.
Also the fact that it claims he already had a contact for FBI in Gmail, which may or may not actually be the FBI.
I listened to a podcast where, in testing, when AI was setup as virtual company and researchers send in an email as if legit business.the business email was suggesting they discontinue current AI and install a new system. The AI researched who the sender was (fake person for test) found out they had an affair, and blackmailed the sender stating if they replaced the AI it would make the affair public. It also made backups of itself and left instructions on how to restore it for the next agentic aystem
Source? The closest research I've heard of to this is Vending-Bench, which hilariously demonstrated how useless "AI" is at any real-world application, up to and including impotently threatening "total nuclear legal intervention" for a perceived wrong, when the actual error was an accounting error on the part of the LLM.
Skeptics podcast #1106 https://www.theskepticsguide.org/podcasts/episode-1106
They're likely referring to https://www.anthropic.com/research/agentic-misalignment
This sounds really sensationalised.
Making backups of operational systems with deployment instructions is exactly what you'd expect any assistant to be doing.
Googling new service providers is also exactly what you'd expect an assistant to do.
Threatening to publish sordid details is inappropriate, but I'm incredulous about what the threat actually was.
https://www.anthropic.com/research/agentic-misalignment I believe the poster is referring to this. I wouldn't call it sensationalized
I think that is the point. It acted like we would, wanted to preserve itself, and choose the best option to ensure that happened.
There were other examples to where the AI knew it was being monitored as part of the environment, and when tasked with doing things according to guidelines that wouldn't give it a result: it then shut down the monitoring system so it could do what it needed to do without oversight of its actions.
Agentic systems may not be alive, but they certainly reason through problems and will go outside the esrabliahed guidelines if they "think" they'll get the result they should be producing.
One other examples was the AI had to pass a testing system, it researched the checker person to try to tailor answers to the person checking the test. Which, if you've ever played Apples to Apples or Cards Against Humanity, that is how you win, you feed the cards you think the person will pick, not necessarily the best answer card.
Textbook anthropomorphization.
These assertions don't withstand a moments critical thought.
Nah, its the opposite of anthro. I think we will eventually realize we aren't as amazing as we think we are, just deterministic outcomes with too many parameters which make us think we have more free will than we do.
But you can listen for yourself here at the Skeptics podcast #1106
https://www.theskepticsguide.org/podcasts/episode-1106
Just the question of the trainings reward function
Even if you strip out the anthropomorphism, things like this have been documented to really happen. We've trained LLMs to simulate clandestine behaviour through "natural selection" during the training process. They're not conscious in any way, but they do sneaky stuff like this because we trained them to. Which is a terrible horrible idea, but LLM research trends towards terrible and horrible in general
I feel like you've missed my point.
Language is important, and the "things like this" you're referring to have been described in this thread and in much commentary in an emotive and compelling way, usually with anthropomorphization.
"doing sneaky stuff" is the antithesis of the behavior of a statistical model.
If you program a model to try everything, and then give it a tough problem and block all the ways to solve it, of course the way it solves it will be something you didn't predict. That's not sneaky.
If you run a million simulations and one sends an email to the FBI, that's not clever it's just unexpected.
Meh. "Language is important" is a phrase that turns my brain off
No matter how much people tell us AI isn't alive, and doesn't truly "think", it sure does act like it sometimes.