547

Sam Altman:

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data center.

But from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time.

Like you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,

And somehow many people's intuition is the opposite of that

TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"

top 50 comments
sorted by: hot top new old
[-] BetaBlake@lemmy.world 6 points 2 hours ago

This fucking guy needs to suck a tailpipe

[-] PerogiBoi@lemmy.ca 5 points 2 hours ago* (last edited 2 hours ago)

Sam Altman is an example of a terrible allocation of resources. Think of how much oxygen and dihydrogen monoxide he consumes? And for what? He just needlessly produces carbon dioxide in record amounts. The elementary particles that make up the sack of biotic matter that calls itself Samuel would be better suited for other applications. Agriculture comes to mind.

[-] Formfiller@lemmy.world 5 points 2 hours ago

Altman existing is a terrible waste of resources

[-] bstix@feddit.dk 5 points 2 hours ago

Why does this 41 year old man speak the valley girl accent?

[-] OldChicoAle@lemmy.world 5 points 2 hours ago

Don't fucking talk to me about scare resources, billionaire.

[-] PhoreTwunny@lemmy.world 1 points 1 hour ago

Off with his head!

[-] umbrella@lemmy.ml 18 points 9 hours ago

letting sam altman (or billionaires for that matter) have all the money from our work is a poor allocation of resources.

[-] weps@lemmy.world 5 points 8 hours ago

It's true what he says and not just about RAM but about anything you own.

My car isn't driving most of the time. My drill isn't drilling most of the time and my oven is off most of the time.

That's a huge waste of resources in a macro economic kind of way.

You can't argue with the correctness of his statement. You need other arguments. These arguments exist.

Right, so the logical response would be to collectively own them. But that's not what this parasite wants.

[-] weps@lemmy.world 2 points 1 hour ago

I like the idea of collectively owning the computing power!

Would be nice to be able to buy part of a datacenter instead of renting it.

[-] sartalon@lemmy.world 3 points 2 hours ago

Defending that an argument CAN be true in an extremely narrow subset is an example of a really stupid argument, and only highlights the stupidity of the original argument.

[-] weps@lemmy.world 1 points 1 hour ago

I didn't mean to imply a narrow subset. Pretty much everything I own is idle and unused most of the time.

I don't think I understand what you're saying, sorry.

[-] Saledovil@sh.itjust.works 3 points 2 hours ago

You can’t argue with the correctness of his statement. You need other arguments. These arguments exist.

Here's a counterargument: The resources wouldn't be scarce if his company didn't buy all of it for exetremely questionable gain. (Three years into the bubble, and AI compute is still being sold at a subsidized rate. You'd think if enough genuine demand existed to justify the buildout, you'd have to pay dearly for any AI use.

[-] plissken@piefed.social 5 points 9 hours ago

Finally coming out of the bloody closet. Frontier labs and Nvidia are in death dance.

The latter sells mostly to the former, but their growth story needs local inference to keep up with valuation. Nvidia could reduce prices on a whim and boost local inference, but that would make its investment in frontier labs lose too much.

Frontier labs meanwhile need public markets money, and their story really needs local inference to be more expensive/extremely worst than what they offer.

One narrative takes money away from.one side and puts it in the pockets of the other.

[-] Wirlocke@lemmy.blahaj.zone 5 points 11 hours ago

But buying up the world's silicon wafers that you don't even have the ability to turn into chips is a much better use of resources, right Sammy?

[-] iocase@lemmy.zip 16 points 16 hours ago

Please don't run AI for free on your own workstation 😭 it's a very bad use of your computer 😥

[-] possiblylinux127@lemmy.zip 4 points 12 hours ago

OpenAI is realizing they might be in trouble

[-] ArmchairAce1944@discuss.online 9 points 15 hours ago

Fuck you, Sam.

[-] SparroHawc@lemmy.zip 27 points 19 hours ago

And who made those resources scarce, Sam? WHO MADE THEM SCARCE???

also screw you for trying to make the answer to 'How should those resources be allocated?' be 'In the way that best enriches me personally'.

[-] zarkanian@sh.itjust.works 9 points 16 hours ago

It kind of blows my mind how our society is set up to give the most power to the worst people.

[-] joeshmoe@infosec.pub 2 points 15 hours ago

I think it has to be with the way all the media channels ( controlled by the rich in power) essential brainwash people into not acting. Money and capitalism slowly corrupted the process of democracy and will see after Nov 3 if there is away to hold the rich in check.

[-] kat_angstrom@lemmy.world 5 points 14 hours ago
[-] stylusmobilus@aussie.zone 4 points 12 hours ago

We don’t

One country in particular forces this upon us.

[-] Redvenom@retrolemmy.com 12 points 17 hours ago

you are not getting it, if I have all the ram and I'm just going to charge you the amount I decided for you to be able to perform the most mundane tasks, I can't believe you are not grasping the benefits of this business model

[-] iocase@lemmy.zip 5 points 16 hours ago

If

The "hoard all the RAM" business model is already breaking

[-] LeftReddit2@lemmy.world 13 points 19 hours ago

Never felt so proud to have a Local LLM in my router, yes my router of all things... my router which is an old and downgraded Mac Mini I had lying around.

[-] bold_atlas@lemmy.world 16 points 20 hours ago* (last edited 20 hours ago)

"Raping your own siblings at home is terribly inefficient when we have private islands where we can keep and rape other people's siblings."

[-] mefisdo_dot_info@lemmy.ca 10 points 20 hours ago

"OpenRape automates your raping needs in efficient and industrialized format. Our rapecenters will be built around the country to support the growing number of rape requests. We train our rape agents on real life input (wars etc.). You can be sure they never go rogue (unless we prompt them to)."

[-] capital5@discuss.tchncs.de 19 points 21 hours ago

Fucking idiot is too stupid to realize that local DRAM can be used for useful shit, as opposed to whatever he wants to use it for.

[-] filcuk@feddit.uk 8 points 21 hours ago* (last edited 21 hours ago)

Too stupid? Doubt it. He says what he needs to profit his company and himself.
Idiots are any people actually listening.

* Well, that's overly harsh. Not everyone is a techie, can't expect the average person to know what this means.

[-] BlakeFox808@lemmy.world 10 points 19 hours ago

There is a national park in Kentucky called Blue Heron that has an outdoor museum of a company owned coal town. Residents were paid in scripts that could only be spent at the company store. Once the lands resources were taken, the company moved on and the town died. This is the America the wealthy always wants. https://www.nps.gov/biso/learn/historyculture/blueheron.htm

[-] empireo223@sh.itjust.works 14 points 21 hours ago

Yeah no. I will hoard all the computing resources I can. Fuck you Altman.

[-] LazyOldPervert@lemmus.org 23 points 23 hours ago

Fuck this loser piece of shit

load more comments (2 replies)
[-] hotdogthud@lemmy.world 16 points 22 hours ago

we lost Captain Picard yesterday, yet this lazy-eyed cardboard human gets to keep using oxygen. there is no justice in this world.

[-] eestileib@sh.itjust.works 13 points 22 hours ago

Oh BROTHER this does this guy suck!

[-] AdolfSchmitler@lemmy.world 21 points 1 day ago

CEO of Pizza Hut says making pizzas at home is a terrible allocation of resources.

[-] humanspiral@lemmy.ca 21 points 1 day ago

Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”

Guy with the spying infrastructure in place to steal your product when renting his product, says you escaping his ability to spy is waste of resources.

[-] wonderingwanderer@sopuli.xyz 21 points 1 day ago

actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time.

Why is it terrible for us plebeians to have our own RAM, huh?

Like you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment

WHY IS IT SUPPLY-CONSTRAINED, ALTMAN? WHY IS THERE CURRENTLY A RAM SHORTAGE IN THE FIRST PLACE?!?

Nobody wants the fucking cloud and that's why major tech companies are forcing it on them without asking, and burying the opt-out if it's offered at all.

And somehow many people's intuition is the opposite of that

Gee I wonder why our intuitions don't align with your "Give me everything and have nothing" philosophy...

[-] lightnsfw@reddthat.com 43 points 1 day ago

Sam Altman is a terrible utilization of scarce resources.

I want to use ram for things unrelated to AI you fucking prick.

load more comments (2 replies)
[-] wrinkledoo@sh.itjust.works 4 points 18 hours ago

I don't think anyone should, but if Sam gets to then it should be fair game for everyone because fuck him.

[-] NocturnalMorning@lemmy.world 9 points 21 hours ago

Ahh, right, I forgot we barely survived before AI came along and took over our lives and infected the entire internet with AI slop...oh wait, no...turns out that's not true. Before AI we were perfectly fine.

[-] LiveLM@lemmy.zip 19 points 1 day ago

Shovel seller vehemently against you building your own shovel

[-] thedeadwalking4242@lemmy.world 11 points 23 hours ago

This IS the same argument use for why trains are better then cars.

Maybe your infra needs to become public domain then Sam :)

[-] seagull@lemmy.world 11 points 22 hours ago

It's basically just the argument for socialism, but perverted so that HE owns and controls everything instead of the people/state.

Monolithic control over an industry in the name of efficiency is only possible with checks and balances to keep it running in the public interest. Otherwise it's just a monopoly.

I'm all for building up high speed rail in the US, but if we were going to give Sam Altman a blank check to do it, no fucking thanks

load more comments (1 replies)
[-] ExtraJudgement@lemmy.world 35 points 1 day ago* (last edited 1 day ago)

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.

We don't need them even without local inference. There was already more than enough total global compute for the most valuable use cases of LLMs (research, development, admin). The datacenter build-up is almost entirely fueled by utterly unrealistic expectations of future capabilities. Before and now the case for local inference is a matter of access, not capacity.

But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

Utilitarianism like this is a disease. By the same logic, it's inefficient that we allow other species of animals to exist and consume usable energy. Hell, why stop at other species? It's inefficient to allow humans to exist - let's kill all humans!

Now, I know that's not what he said, the point was to show that when someone uses utilitarianism as a serious argument, they are no longer worth listening to.

Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,

The supply is only constrained because you keep hoarding more than you need. Maybe it's time for some communization? So communities where data centers are built get most if not all of the profits from it?

load more comments (3 replies)
load more comments
view more: next ›
this post was submitted on 30 Oct 2026
547 points (97.9% liked)

LocalLLaMA

5501 readers
1213 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.

Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.

founded 3 years ago
MODERATORS