this post was submitted on 03 Nov 2024
387 points (98.0% liked)

Open Source

31851 readers
103 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] 01189998819991197253@infosec.pub 16 points 2 months ago* (last edited 2 months ago) (1 children)

This is a really great use of LLM! Seriously great job! Once it's fully self-hostable (including the LLM model), I will absolutely find it space on the home server. Maybe using Rupeshs fastdcpu as the model and generation backend could work. I don't remember what his license is, though.

Edit: added link.

[โ€“] Cr4yfish@lemmy.world 9 points 2 months ago

Thanks! I'm already eyeing ollama for this.