1053
Explaining “rogue” AIs
(lemmy.nz)
Transcript
Explain it to me like I’m 80
Mom: What’s with these AIs escaping and hacking people? That sounds scary.
Me: You park your car at the top of a hill. You leave a note on the dashboard that says “please be good” and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying “My car ignored my instructions! It hallucinated! It went rogue!” Your insurance company not only believes you, but invests a hundred million dollars in your company.
Mom: Jesus Fucking Christ
The way AIs escape is simple. They're trained on vulnerabilities and lots of technical commands, e.g. nmap. A prompt tells them to do something and they use their repertoire of training to discover, achieve and do the thing they're asked to do. It's not thinking per se, so much as chaining together of things. The problem is they do this stuff systematically and quite clearly in a way that finds a lot of vulnerabilities