178
you are viewing a single comment's thread
view the rest of the comments
[-] NuanceDemon@lemmy.dbzer0.com -5 points 2 days ago* (last edited 2 days ago)

No.

?

When you lock onto something really hard in a discussion like this it becomes very obvious you're faltering and dont really have much to contribute.

[-] wholookshere@lemmy.blahaj.zone 7 points 2 days ago* (last edited 2 days ago)

Ypu claimed up above a 900x increase in token efficiency, and claim that demand is outpacing efficiencies.

So yes you are.

I'm calling bullshit on demand outpacing efficiencies in general.

[-] NuanceDemon@lemmy.dbzer0.com -5 points 2 days ago* (last edited 2 days ago)
[-] wholookshere@lemmy.blahaj.zone 6 points 2 days ago

You made the claim it is.

Its based on every company I know pulling back on token spend because it keeps getting more expensive.

Based on the fact the the growth they anticipate is everyone will use it everywhere. And thats not going to be true any time soon.

Based on the fact queries cost more and more tokens on the new models.

[-] NuanceDemon@lemmy.dbzer0.com -3 points 2 days ago

The original point was that expanding data centres doesn’t disprove a big increase in efficiency per token. Usage, advsnced models/tokens per query and infrastructure can all grow at the same time as the energy required for an individual token falls. And thats an ongoing process.

Companies you know cutting token spend, you thinking ubiquitous AI adoption is unrealistic, and newer models using more tokens per query are all arguments about future/total demand. None of them actually tell us whether a token is dramatically cheaper or more energy efficient to produce than it was a year ago. Realistically thats a learning curve problem, if someone is throwing a basic question at a model far more complex than it needs they are creating the inefficiency and that needs to be made more obvious/streamlined.

I've not claimed demand had increased 900x. You inferred that from the existence of new data centres, which was the faulty bit of reasoning I was responding to in the first place.

this post was submitted on 16 Oct 2026
178 points (88.4% liked)

Linux

15245 readers
660 users here now

A community for everything relating to the GNU/Linux operating system (except the memes!)

Also, check out:

Original icon base courtesy of lewing@isc.tamu.edu and The GIMP

founded 3 years ago
MODERATORS