-38
top 17 comments
sorted by: hot top new old
[-] Jakeroxs@sh.itjust.works 12 points 3 weeks ago

I'm confused as to why one would do this.

[-] sebastiancarlos@lemmy.sdf.org -1 points 3 weeks ago* (last edited 3 weeks ago)

What in particular? Maybe I can tell you.

My initial use case was testing graphrag locally, which might become relevant at work later on, so I generalized the thing I did to get it working through an agent subscription. Actually that usage is public too: https://github.com/sebastiancarlos/graphrag-faaah

[-] Jakeroxs@sh.itjust.works 7 points 3 weeks ago* (last edited 3 weeks ago)

What's the advantage/point vs just using an extension like Kilo or similar? What "reuse" is possible by saving the prompt/responses via text file?

[-] sebastiancarlos@lemmy.sdf.org 2 points 3 weeks ago* (last edited 3 weeks ago)

Well, the main reason why I post my projects is for people to tell me what alternatives I'm missing, so thanks for that.

I'm actually not that familiar with Kilo, but I believe it's an agent/IDE-extension, and that you can use different providers for it, including coding agents (I think this is what you were referring to.)

So basically my use case is more niche. I just had an external tool (Graphrag) that only worked with an LLM API, and I had just an agent subscription, so i built an agnostic protocol via the filesystem to make them work together.

It's agnostic because you can have any tool on one side (which expects an OpenAI-like LLM API), and any LLM on the other side (which can be an agent subscription).

Nothing in Kilo would have allowed me to get Graphrag working, I think.

[-] Jakeroxs@sh.itjust.works 2 points 2 weeks ago

So how does it connect to any LLM without using their API?

Yes though Kilo was my example since they built a lot of support for other providers, though coding specific of course.

[-] sebastiancarlos@lemmy.sdf.org 0 points 2 weeks ago* (last edited 2 weeks ago)

So how does it connect to any LLM without using their API?

Well, the typical use would be by local Agent subscription. But in theory any LLM could work, so long as it's made to follow the filesystem protocol that faaah expects.

There's a video in the repo with an example of how it works, plus a diagram.

[-] SnoopSqueak@lemmy.today 4 points 3 weeks ago

I think you lost most of us at "AI agent".

[-] sebastiancarlos@lemmy.sdf.org 5 points 3 weeks ago

Yeah, I don't like agents either, so I'll take it. This just solved a real problem I had, so I went ahead and shared it

[-] vext01@feddit.uk 2 points 2 weeks ago

So it's a proxy? What's the advantage of this? It implies you save money somehow, I think.

[-] sebastiancarlos@lemmy.sdf.org 0 points 2 weeks ago* (last edited 2 weeks ago)

Yes. The idea is that you can have any tool on one side (which expects an OpenAI-like LLM API, which is a bit of a de facto standard), and any LLM on the other side (which can be an agent subscription).

I used this, for example, to test GraphRAG locally (which is designed to make a lot of LLM API calls) by piping it to an agent subscription I already had (and not needing to buy expensive API tokens for the low volume I needed).

[-] vext01@feddit.uk 3 points 2 weeks ago

So it's an adapter. I see.

[-] one_old_coder@piefed.social 2 points 2 weeks ago
[-] sebastiancarlos@lemmy.sdf.org 1 points 2 weeks ago* (last edited 2 weeks ago)

It's not, but some AI was used for the code. I think vibe coding it would have produced a very different (and larger) code base. What makes you think it's vibe coded?

[-] one_old_coder@piefed.social 0 points 2 weeks ago

What makes you think it’s vibe coded?

"some" AI was used for the code.

[-] sebastiancarlos@lemmy.sdf.org 2 points 2 weeks ago* (last edited 2 weeks ago)

Do you think rather than AI was used for most of the code? I don't think it was.

If what you're saying is that "vibe-coded" applies when "some AI was used", and that it's a bad thing, that's a valid opinion that I might agree with in some contexts (like an ethical one).

[-] bookmeat@fedinsfw.app -5 points 3 weeks ago

Lots of hate here for computing tools. I don't think I have a use case for this, personally, but it's nice to see a creative solution to modern problems.

this post was submitted on 08 Aug 2026
-38 points (18.3% liked)

Programming

28283 readers
128 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS