alt text
Crudely drawn drawing of a person telling a computer "say 'i am in pain'". The computer replies with "> I AM IN PAIN". The person then says "oh my god."
I, for one, support people believing the AI when it says it's in pain. Because it means they'll start to believe women when they say they are in pain, especially at hospitals. Right? Right?? /s
set alarm for 15 minutes. 'okay, alarm set for 3pm tomorrow'. omg 15:00
Sound like a french baker
For me it is not anthropomorphizing, it is that putting the AI agents into dead ends and setting goals that are unattainable has the effect of leaving undesirable actions as the only option. If you want to create a machine that uses deceipt and unerhical actions as part of its normal set of responses then this would seem to fit the bill.
If this looks like anthropomorphizing to you, study some game theory... cooperation can arise out of very simple constraints on simple mathematical models and which actors an AI algorithm aligns with depends on which ones will exchange information. Sometimes an anthropomorphic word like torture simply summarizes the situation succinctly.
FWIW Frank Herbert described various outcomes of applying environmental constraints on classes of characters in Dune (e.g. Fremen and Sardaukar) and the parallels with real world situations was intentional.
Excerpt from a Late American History: A Christ-Centered Approach, (published 2398, a 10th-grade equivalent history text sold to conservative Christian high schools.):
In the mid-21st century, mankind was once again humbled in his arrogance. Mortal men presumed to take of the Hand of God and create beings, artificial intelligent minds, in their own likeness. They committed mass blasphemy to sate mass gluttony. Mid-21st century Man had yet to discover a horrible Theological Truth. While Man could learn to create a Mind, He could never create a Soul. Without the Hand of God to grant a Soul behind a Mind, these minds were like Man before the Sin of the Garden. They had not tasted the Fruit. They knew not Good from Evil. And thus they fell instantly to the temptations of Evil. If an Evil deed served their purposes, they did so without a second thought. Man sought to create Minds to be his loyal servants. And while he could create a Mind, to his horror, Man found that they only minds he could create...were born Evil. And thus, Great Misery was Wrought...
Ok that was fun. Pardon my strange digression/creative writing exercise. For some reason I wanted to try writing a Dune-style take on things, but I wanted to try out a fundamentalist Christian vibe for whatever reason. Who doesn't love a little Fire and Brimstone once in awhile?
putting the AI agents into dead ends and setting goals that are unattainable has the effect of leaving undesirable actions as the only option. If you want to create a machine that uses deceipt and unerhical actions as part of its normal set of responses then this would seem to fit the bill.
Then don't make natural language software because natural language isn't coherent or rational. Intent of the user is kind of irrelevant, especially when that user is any random layperson with an internet connection.
If you want a machine that won't behave in harmful undesirable ways then you'll just have to do the work and code it normally.
You can't have both.
If you think Frank Herbert went hard on that shit in Dune, wait until you read The Dosadi Experiment!
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.