this post was submitted on 20 May 2024
66 points (98.5% liked)
Funhole
1069 readers
127 users here now
Welcome to Funhole! The first and only hole on SDF exclusively for fun content! Are you a content creator? Then come post your content and join the fun!
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Kind of, it's a standalone system with the hardware integrated - kinda like Google Coral with a Raspberry Pi.
Not really, sorry - I haven't gone too deep into LLMs beyond simple use cases. I've only really used llama.cpp myself.