534
RatGPT
(lemmy.nz)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 21 Sep 2026
534 points (98.4% liked)
Microblog Memes
12174 readers
2884 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
RULES:
- Your post must be a screen capture of a microblog-type post that includes the UI of the site it came from, preferably also including the avatar and username of the original poster. Including relevant comments made to the original post is encouraged.
- Your post, included comments, or your title/comment should include some kind of commentary or remark on the subject of the screen capture. Your title must include at least one word relevant to your post.
- You are encouraged to provide a link back to the source of your screen capture in the body of your post.
- Current politics and news are allowed, but discouraged. There MUST be some kind of human commentary/reaction included (either by the original poster or you). Just news articles or headlines will be deleted.
- Doctored posts/images and AI are allowed, but discouraged. You MUST indicate this in your post (even if you didn't originally know). If an image is found to be fabricated or edited in any way and it is not properly labeled, it will be deleted.
- Absolutely no NSFL content.
- Be nice. Don't take anything personally. Take political debates to the appropriate communities. Take personal disagreements & arguments to private messages.
- No advertising, brand promotion, or guerrilla marketing.
RELATED COMMUNITIES:
founded 3 years ago
MODERATORS
Source? The closest research I've heard of to this is Vending-Bench, which hilariously demonstrated how useless "AI" is at any real-world application, up to and including impotently threatening "total nuclear legal intervention" for a perceived wrong, when the actual error was an accounting error on the part of the LLM.
Skeptics podcast #1106 https://www.theskepticsguide.org/podcasts/episode-1106
They're likely referring to https://www.anthropic.com/research/agentic-misalignment
Man, they sure did bury the lede on how the models were being given the goal of "american competitiveness", and the company assigned the blame for the simulated shutoffs as being replacement with a foreign-developed LLM. That, along with the fact that anthropic released this themselves, plus the fact that they did so as (at that time) the primary LLM provider to the US government, and only seven months later they were blackballed by trump for supposedly refusing to grant full autonomy to their systems, tells quite the story: it seems clear that, in the article you linked, they were gently warning the government, while pointing out how "look! The reason the AI blackmailed the guy was because he wasn't patriotic enough!!!"
I don't trust their motivations, and am not going to believe their LLM's supposed "thought process" for shit, because it's still nothing more than a Chinese room. You're just asking the Chinese room to generate "justifications" related to the responses it gives, which are still only generated responses, not "thoughts".
The American competitiveness angle is definitely.. well an interesting choice; I also was taken aback by that. Ignoring some of the posturing along those lines I find the post itself interesting.
If you think the Chinese room idea is valid we probably just fundamentally disagree and that's OK.
Fundamentally disagree that an LLM is nothing more and nothing less than a very advanced next-word-prediction algorithm, you know, the scientific basis of an LLM?
I was using "Chinese Room" to indicate that it's a black box, and even the developers are incapable of pinpointing the statistical basis behind any given response, despite it being a stochastically-generated choice from an ultimately deterministic algorithm.
I.e. are you claiming that LLMs have attained sapience as a purely emergent property?
I claim ignorance as to whether they have or not, but I am fully on board with intelligence as an emergent property and believe that there is no reason a machine can't think, yes.
Understand: I agree wholeheartedly with the idea of intelligence as an emergent property (or I wouldn't have brought it up), and don't think it impossible to achieve AGI. I do contend that this route, of nothing but token input without true correlative context, is a non-starter for such. Making something better and better at predicting what comes next is not going to suddenly create a jump to application in unrelated fields or grant context. Statistical correlation is insufficient to generate actual meaning, no matter how many times you provide feedback on the inference. It doesn't have any actual connection to anything other than text (or hex codes, or other such tokens). If constant hallucinations (demonstrating the lack of any understanding of context) are insufficient to prove this to you, I suppose there is a fundamental difference in the way you understand how LLMs function.
I understand fairly well how LLMs work, but I don't think we understand the conditions for the emergence of intelligence or thought enough to conclude that "learning to predict what comes next" is not sufficient to create some form of intelligence, that's all. [Edit: if we determine that that turns out to be sufficient I will be surprised] That uncertainty is sufficient to make me agnostic on the subject and that stance does have an effect on my actions, for example I'm never mean to an LLM.
I'm only mean to LLMs when they're being used to pose online as a troll. Given that that's the only time I ever interact with an LLM anymore, though...
Either way, emerging subintelligence or not, they're being used in ways such that they are, all of them, a scourge on the planet and on humans' abilities to think for themselves, and should be eradicated and banned for those reasons alone.
I agree that they pose serious immediate issues regardless of thinking or not