25
llmfit - find best model that runs on your computer (github.com)
submitted 6 months ago by vermaterc@lemmy.ml to c/fosai@lemmy.world
3 comments fedilink hide all child comments

"A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine."

top 3 comments
sorted by: hot top new old
[-] Acklavidian@lemmy.world 13 points 6 months ago

I don't know about that username tho.

[-] ThePowerOfGeek@lemmy.world 7 points 6 months ago

Yeah, I didn't see the 's' at first and imagined the code's output screamed at you about gay frogs and wokeness if you selected certain LLMs.

Seems like a really good idea though, and I could definitely find this useful.

[-] idkman@lemmy.dbzer0.com 2 points 6 months ago* (last edited 6 months ago)

Its a nice utility, but I'm unsure how the "score" is evaluated. Probably outdated too, cause I have gemma3 q8 installed(for the sake of having one locally), and it didn't detected it.

this post was submitted on 25 Feb 2026
25 points (85.7% liked)

Free Open-Source Artificial Intelligence

4816 readers
27 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 3 years ago
MODERATORS
Blaed@lemmy.world
fosai@lemmy.world