186
IBM CEO says open weight models are now irresistibly good and cheap on-prem
(www.theregister.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Oct 2026
186 points (95.6% liked)
Technology
89066 readers
3277 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
Maybe I'm just sleep deprived, cynical, or thinking too deep into it, but I don't even like how they are using the words "on-prem" throughout the article instead of simply saying they're running local LLMs. Seems like such a weird choice of wording that is meant to subtly steer less informed people away from looking into alternatives to the subscription based LLM services, as most casual people wont associate it as the same thing and ignore it and move on. Even if that's the correct terminology for that specific field, I feel like most people would just naturally say "Yes, we are running the LLM servers locally here" as that's the only way I've ever heard people say it even online.
For a company "on-prem" might not mean the same as "local". You might run them in your company data center or in a colocated server (rented space in a data center). In either of those cases, the data center might be physically close to you, but it could be on a different continent.
"On-prem" implies that the company has physical access/control of the server.
Ah okay thank you for clearing that up for me. Makes me feel a bit less crazy now haha it was a bit off-putting with the amount of times "on-prem" was used here!
"On-premises" as it refers to enterprise hw/sw, has been a phrase much longer than "local LLM"
Even though everyone moved to cloud, most companies keep some portion of their infrastructure on-prem, like prod env in the cloud and on-prem test env/backups, or vice versa
Maybe most consumers wouldn't recognize the phrase, but industry professionals certainly would
It was written by Claude