525
you are viewing a single comment's thread
view the rest of the comments
[-] it_depends_man@lemmy.world 4 points 3 days ago

If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use.

Hm, I don't see the harm in powering local models with solar.

[-] Klear@piefed.world 5 points 3 days ago

Depends. Is it solar energy that started production to power these models? Great! If not, then you're still consuming power and the difference will have to be made somewhere, likely by burning more fossil fuels.

[-] it_depends_man@lemmy.world 5 points 3 days ago

Oh yeah, I mean my own personal solar modules in my backyard. I agree it's not that easy to say "solar exists, checkmate doubters", that would be silly.

[-] Klear@piefed.world 2 points 3 days ago

OK, that is fine. I've seen a lot of people saying stuff like "Me mining crypto doesn't matter because I live next to a wind farm" so I'm a bit wary.

[-] floofloof@lemmy.ca 2 points 3 days ago

Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.

this post was submitted on 15 Oct 2026
525 points (97.8% liked)

Technology

88854 readers
4849 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS