124
top 14 comments
sorted by: hot top new old
[-] lemmyng@piefed.ca 20 points 15 hours ago

Very much. That's why generative AI needs to create tests before it writes code. It doesn't know the answer (it can't know anything), so instead the agent creates the tests to define the shape of the answer, and then the generative system keeps regenerating the whole output with variations until it fits the answer.

It's as if you baked a cake for your kid's 10th birthday, realized that you only added 9 candles, and threw out the whole cake to make a new one. The new one has 10 candles, is perfect, but you're looking at it from the wrong side so it looks upside down compared to the cookbook. In the garbage it goes, gotta make a new cake!

[-] dandi8@fedia.io 22 points 19 hours ago

I was always convinced that the only reason we didn't have this kind of tech is that it would just be prohibitively expensive to use.

Everyone hails transformers and attention heads as this huge breakthrough, but I'm here scratching my head how that's a breakthrough when we're just brute forcing through the problem...

[-] MattBlackAlien@lemmy.world 30 points 18 hours ago* (last edited 18 hours ago)

Cory Doctorow explains it quite well in his podcast. The 'innovation' is the replacement of the problem domain model (in earlier machine learning systems) with the brute force. This allows the billionaires/ruling-class/fascists to do away with troublesome experts (needed to create the model, but who may have 'ethics' and can say 'no') and just throw money at it.

[-] NathanRanch@lemmy.zip 20 points 21 hours ago

That's why it works on business majors

[-] Wytch@lemmy.zip 26 points 22 hours ago

My brain does something similar when I'm trying to remember something. I just go alphabetically, hoping the first letter of the word or name I'm trying to recall will trigger the memory. It works more often than not. Brute force the memory bank

[-] Malica@lemmy.zip 1 points 1 hour ago

This sounds like a promising ADHD hack

[-] agentTeiko@piefed.social 5 points 22 hours ago

But unlike the mind uses probability vs recall to find the next word.

[-] DacoTaco@lemmy.world 6 points 14 hours ago* (last edited 14 hours ago)

I hate to be that guy, and i hate ai as much as the next, but an llm is a glorified, large neural network that is trained to handle text. Much like an embedding modal of a vector database. Those work exclusively on probability and weights, not recall ( and have existed pre-gpt boom)

That said, current ai is bruteforcing an issue like never before and its done so inefficiently its crazy...
Fucking. Ai. Bubble. BURST

[-] makeshift0546@lemmy.today 1 points 17 hours ago

No. Not at all. Like, not even close. This is absurdly wrong.

[-] dontbelievethis@sh.itjust.works 5 points 15 hours ago
[-] TranquilTurbulence@lemmy.zip 3 points 11 hours ago

I don’t get it either. Does an LLM spit out a million answers but it only shows me one?

[-] pinball_wizard@lemmy.zip 7 points 10 hours ago* (last edited 2 hours ago)

Yes. You can watch the wasteful iterations in a locally run AI.

It will take time to "tell" itself things that only a sleepy toddler would need to be told. And it may have to pause to "remind" itself of those things, later, if it does not "forget".

It is really interesting the way brute-forcing through a space with a giant pile of associations can achieve some things that look like intelligence (to folks who fail the Turing test.)

Edit: Adding various air-quotes to emphasize that these things don't think, per comment below.

That's not how it works at all. You are talking about "thinking" models, which are just models prompting themselves.

LLMs are fancy next word predictors. It's just returning what mathematically is the next likely word given their training set (really token since it doesn't actually understand words).

[-] pinball_wizard@lemmy.zip 1 points 2 hours ago* (last edited 2 hours ago)

I'm not sure what part of my "explain like I'm five " version you're taking issue with enough to correct me. You may want to clarify if you feel I've misinformed.

To my read, you just restated what I was trying to make more accessible.

Edit: I added some air quotes to help clarify that the terms I used are for illustration only.

this post was submitted on 30 Oct 2026
124 points (97.7% liked)

Showerthoughts

44304 readers
556 users here now

A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. The most popular seem to be lighthearted clever little truths, hidden in daily life.

Here are some examples to inspire your own showerthoughts:

Rules

  1. All posts must be showerthoughts
  2. The entire showerthought must be in the title
  3. No politics
    • If your topic is in a grey area, please phrase it to emphasize the fascinating aspects, not the dramatic aspects. You can do this by avoiding overly politicized terms such as "capitalism" and "communism". If you must make comparisons, you can say something is different without saying something is better/worse.
    • A good place for politics is c/politicaldiscussion
  4. Posts must be original/unique
  5. Adhere to Lemmy's Code of Conduct and the TOS

If you made it this far, showerthoughts is accepting new mods. This community is generally tame so its not a lot of work, but having a few more mods would help reports get addressed a little sooner.

Whats it like to be a mod? Reports just show up as messages in your Lemmy inbox, and if a different mod has already addressed the report, the message goes away and you never worry about it.

founded 3 years ago
MODERATORS