Technology

The price of creating and shipping the ram has not gone up, tho. People just saw the rarity and decided to jack the everloving shit out of the price of stock they already held.

About the only upside to this that I can think of is that maybe, just maybe, programmers will start being more frugal with their memory usage. Everything else just sucks.

Well, the current trajectory points to:

• LLM capabilities topping out.

• All the tooling around them not keeping up anyway.

• Actual “AGI” being distant and completely unrelated to contemporary models.

• Inference costs plummeting.

The last one is critical.

Right this second, you can run Minimax H3 on a desktop for the tiny fraction of the compute/RAM OpenAI Sora took. And it’s better.

In a month, it will be ~8X faster.

You can run DeepseekV4 flash, dirt cheap, and get what Claude was less than a year ago. And it’s gonna spread to every host out there, to systems like Cerebas ASICs that don’t even need HBM.

So… Even if you’re an AI acolyte. And we go with that for the sake of argument…

We don’t actually need all that RAM for hosting generative models?

I’m very interested to see what happens to all these datacenters over the next two-three years.

They spent all this money on something that’s gonna be cheap as dirt to run, largely run locally, and that won’t need GPUs once bitnet takes off, sooo… they can’t make money off that.

What happens then?

What happens to all those Stargate RAM wafers, and excess datacenters?

I still believe that half this swell is artificial, supported by an entire greedy industry that is blatantly price-gouging. Yes there's a real boom, but just like egg producers who artificially inflated their prices during the egg crisis well beyond the new stress point, the same thing is happening here. We're all being fucked and swindled at every possible opportunity.

They say those who actually made fortunes during the gold rush were the ones selling the pickaxes.

Maybe I should get into the guillotine business...

It should be noted that they haven't become harder or more expensive to make. They just cost more.

Every stars are aligned. We are At the top level of capitalism greed. For decades tech companies have piled up as much cash as possible sucking every dime selling their product. Now they want to rent their service instead. The best to do that is to host the service on a super computer, the user having only a low power terminal. They deliberately crippled the os to use the maximum ram and said we need to update our computer for ai and other things most don’t want, don’t need and don’t have the money to pay for it. The best move is to exchange their huge pile of cash to drain the whole market to build data centres. They now want everyone to become dependant on ai and pay them a significant part of our salary to satisfy their shareholders.

We have and use way more RAM than in 2007

Gonna upgrade my server with another 16gb of ddr3 soon.

£30.

Almost like it was planned to prop up a noncompetitive business model.

Once again, thanks Madoff Altman for buying up all the chip supply just to monopolize it. I'm never gonna let that go.

Surely this will make them finally realize it is unsustainable to demand consumer to upgrade their hardware every few years?... Right? Right??

Just wait till the bubble bursts.

Gordon Moore is turning in his grave

For all the reasons I despise Sam Altman, this is the primary reason. It was shrewd of him to lock up the entire market, but that doesn't make it any less sociopathic. The entire world is negatively affected by this. What an asshole.