1162
you are viewing a single comment's thread
view the rest of the comments
[-] Soleos@lemmy.world 1 points 2 days ago

The article from Anthropic describes how a small agentic model~15-50gb can be distributed on an inference server hosted across a network of 10-20 IoT devices like smart-TVs, which can have up to 4gb RAM--higher end IoT appliances can also have 1-4GB RAM to hold a meaningful shard of a 30B model.

this post was submitted on 15 Oct 2026
1162 points (97.5% liked)

Fuck AI

8533 readers
1908 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

Rules:

founded 2 years ago
MODERATORS