LLMs are never going to become superintelligent. However, an LLM WILL kill us all if someone decides that it IS superintelligent and so puts it in charge of nuclear weapons.
"You're right to push back on that, I nuked Albania instead doing what I was supposed to do, that's my bad".
stupid people are going to kill us all, maybe our great filter will be do we let them or not
We're already letting them bro. The great filter is us. I'll be surprised if we make it to 2050. The entire industrial revolution is an unplanned terraform, and our response to the potential destruction of a stable climate, and most macroscopic life on Earth, is to double down, consume product, elect pedophiles, worship the most morally bankrupt psychopaths and sociopaths in politics, business, and entertainment; not to mention the widespread contempt and lack of empathy for "others" not like me, for some flagrantly dissonant reason.
We are in the midst of a global mental illness epidemic, and the average talking chimp is sleepwalking through it; barely cognizant of what is even happening outside their personalized propaganda bubble.
And it's fucking exhausting
This is just more sales strategy
Really going for that sociopath/pychopath/fascist/nazi/flock demographic.
Their sales strategy is built on their researchers quitting? Like I get the internal tension between biz and engineering but that seems far fetched.
I knew that Musk is a fucking moron and believes that the Roko's Basilisk is real, and I guess there are more massively gullible people in those circles.
If you are wondering what Roko's Basilisk is, it is a sci-fi concept/philosophy/thought experiment, that says the following:
Seriously, this is an increadibly dumb idea, anyone taking it seriously is an idiot.
To me the only resonable way to read this is as an SCP article describing what a potential cognitohazard/informationhazard would be.
The AI goes rouge
Is that when its eyes go red?
That's how you know it's evil.
Even worse, they think it will ressurect them as virtual Minds and torture them for eternity, like a revengeful biblical deity. That would be a waste of compute so I'm not convinced.
Oh yeah, lol, I forgot that part, nothing is more beneficial to humanity than wasting energy to torture dead minds!
Fucking dumb.
Funny thing: The only reason AI would know about Roko's Basilisk is comments like yours that it trains on. If Roko just kept his trap shut then this wouldn't have been an issue.
lol, true I guess, but they probably already scanned the wikipedia article....
This is just Pascal's wager.
All this stupid bullshit could have been avoided if they had 1 friend to, STFU and pass the blunt
It's not so much that it'll go rogue and decide to punish people or that it's designed to be good for humanity.
The fact that it's possible to build a machine that punishes people who didn't help create it provides an incentive to deliberately try to create that machine in order to avoid its punishment.
Believers in the basilisk aren't trying to make ai to benefit humanity, they're explicitly trying to create an AI that deliberately punishes those who didn't build it because they fear that, if they don't, someone else will and it will come for them.
The part about it being a magical, omnipotent, time traveling, mind torture device is just framing to make the thought experiment clearer. It's not required for the basilisk to be effective. Even if the punishment is just death and it can't get to everyone, and only goes off limited information, that's still motivation enough for some people.
It is a scary thing, because it's only silly if everyone thinks it's silly and all it takes is one mad billionaire (eg. Elon) to build a lesser basilisk that can cause real harm.
Every major innovation in information technology eventually leads to some new religion. Scrolls gave us the Torah, books gave us the Bible, the printing press gave us Protestantism. We're about to figure out what god awful religion computers are going to give us.
Just another case of genAI psychosis not too dissimilar to the one gøøgle employee who maybe a year or two back thought their genAI was alive. I'm infinitely more worried we will destroy ourselves due to climate change caused by the AI data centers long before genAI even has the ability to think on its own.
Yeah you are not going to get general AI from an LLM. What would destroy the world is people not thinking and letting these LLMs blindly make choices. Oh wait, yeah we might be fucked.
The real danger isn't a smart AI - the smartest people don't end up being in charge of our societies. The real danger is having enough control to be able to con most of our society, and seeing how much our societies are willing to continue participating in clearly compromised special interest social networks, I don't have a lot of faith. Barely a difference if humanity is replaced or just led to the lowest common denominator of exploitation at that point, and that's where we are heading politically.
And yet, they just keep going. I will never understand these people.
Because if they don't, someone else will. Their logic is: If somebody is going to burn down the world, it may as well be me!
five minutes earlier: "hey dude, marketing here. if you quit and post this dramatic text about the inevitability of AGI on your X account you'll get a huge golden parachute".
Seriously, how can competent people look at the current state of LLMs and think that it's anywhere near AGI material?
Sure, it is already making civilizational changes for the worse. Not because it's good, rather because it makes us lazy and dumb, has decimated creative jobs, and is used relentlessly for propaganda and misinformation and scams. And it's much better at using the scaffolding of existing structure to make chaos, than it is at making new structure, making it a weapon more easily yielded by the evil than by the good. A few more software vulnerabilities discovered along the way will not be such a big deal in comparison.
If I were an alien invader, with superior technology, and I was trying to exterminate an indigenous species without getting my hands dirty (or from far away), I might plant something similar to the current LLM/AI + military robots craze.
Distribute free sex robots and humanity would depopulate within two generations. Even better if the humans don’t know they are robots and believe they are an actually human who the humans think they are in a legitimate relationship with. Zero bloodshed takeover.
This begs the question, why continue to build it? If you believe AI will "kill us all" then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.
My best guess is the money is good and you figure you're here for a good time, not a long time.
You know that "yes we destroyed the world, but for a short time we created a lot of shareholder value" cartoon? It's literally that.
They see this technology as powerful and their respective organizations or Nation needs to own it no matter the risk.
They are also conditioning the populace for a big black swan AI event such as AI interfering in elections or a huge multi institution hack to our banking system which drains our accounts, etc., etc.
Thereby creating a crisis which only they can solve. The one thing I can guarantee is their solutions will only give them more power.
It is going to be like this until all of the IPO's are all done. I expect cancer cures, AI-escaped-and-is-hacking-everything, you name it. Afterwards, once the stocks have crashed and all of the insiders have walked away with untold fortunes, what few taxpayers that remain will bail them all out 'cause we can't have Chinuh out AI-scamming-the-world now can we...
From the creator of Don't Create The Torment Nexus comes a new tale: Stop Building The Thing That Could Kill Us All
His face makes me uncomfortable
"AI is going to kill us all!" conjures up imagery of some Terminator robots vs humans shit. But like, look at data centers... It's already in the process of killing us all. Why gun us down when it just poison our air/water, and cook us to death?
...also it would be more accurate to say we are killing us all, we're just using a glorified spell-checker that's wrong occasionally as the plastic shopping bag over our head.
People building AI are in a cult. They have lost all objectivity.
It’s very easy to imagine war machines with a shoot on sight algorithm. It doesn’t have to be AGI for it to be good at hinting people down.
oh yeah, it literally could just be robot dogs with "kill anyone who's an insurgent, and detain anyone who assists insurgents" orders and AI to let them go buck wild with that prompt.
You could end up with children getting shot because an AI starts hallucinating if they don't put adequate guard rails.
And that's like a worst case situation. Realistically, you end up with just a lot more brutality in war because people are detached from the violence they cause as an invading force, and way less PTSD. Wars in the Middle East start sounding more and more like statistics that no one really wants to hear about, and there's way less soldiers to choose to disregard unlawful orders.
You could see a fuck load more war crime with such human detachment, I think. We probably already deal with this to a large extent with drones.
Not that I'd prefer humans dying, but we should avoid robotic invasion wars like the plague imo.
AI software can't technically kill you unless:
Oh, wait.
See, nothing to worry about.
We all know. Everyone on Earth knew we were doomed the moment robot dogs started patrolling. It will be horrifying, we'll look back on World War II and think "those were the good old days".
"Hey, baby. Wanna kill all humans?"
-- Bender
We don't have to let it, but we probably will anyway. There are a ton of people trying to push some crazy revelations end times scenario on us.
I've said for a long time my retirement plan is there won't be one, and it's starting to seem like that's really going to happen, just not in the way I imagined. We live in the absolute stupidest timeline right now.
Doomers unite.
Remember folks, we are a spec on a dot in the universe. It will all be ok.
they want what the Matrix was having
This is a most excellent place for technology news and articles.
