6
What's the next gen AI tech you're using or experimenting with? (lemmy.world)
submitted 4 months ago by venusaur@lemmy.world to c/fosai@lemmy.world
24 comments fedilink hide all child comments

LLM’s are not the end all be all. What other AI tech are you all using? Something generative? Something else?

you are viewing a single comment's thread
view the rest of the comments
[-] N0tTr0xy@lemmy.dbzer0.com 2 points 4 months ago

All modern GPU drivers support Vulkan, at least on Linux. I don’t know how bad Vulkan does in comparison to CUDA, since I’ve never used that stuff. The bigger issue is software-side support. Ollama, llama-cpp and KoboldCPP all support Vulkan by now. ComfyUI doesn’t seem to support it.

[-] venusaur@lemmy.world 1 points 4 months ago

Thanks! I’ve been using llama.cpp but not married to it. What’s your opinion on used machines? Presumably risky to get a used GPU or they don’t really just fail?

this post was submitted on 02 May 2026
6 points (65.0% liked)

Free Open-Source Artificial Intelligence

4816 readers
27 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 3 years ago
MODERATORS
Blaed@lemmy.world
fosai@lemmy.world