Selfhosted

61425 readers

742 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Selfhosted coding assistant? (midwest.social)

submitted 7 months ago* (last edited 7 months ago) by wasp_eggs@midwest.social to c/selfhosted@lemmy.world

28 comments fedilink hide all child comments

I'd like to set up a local coding assistant so that I can stop using Google to ask complex questions to for search results.

I really don't know what I'm doing or if there's anything that's available that respects privacy. I don't necessarily trust search results for this kind of query either.

I want to run it on my desktop, Ryzen 7 5800xt + Radeon RX 6950xt + 32gb of RAM. I don't need or expect data center performance out of this thing. I'm also a strict Sublime user so I'd like to avoid VS Code suggestions as much as possible.

My coding laptop is an oooooold MacBook Air so I'd like something that can be ran on my desktop and used from my laptop if possible. No remote access needed, just to use from the same home network.

Something like LM Studio and Qwen sounds like it's what I'm looking for, but since I'm unfamiliar with what exists I figured I would ask for Lemmy's opinion.

Is LM Studio + Qwen a good combo for my needs? Are there alternatives?

I'm on Lemmy Connect and can't see comments from other instances when I'm logged in, but to whomever melted down from this question your relief is in my very first sentence:

to ask complex questions to for search results.

you are viewing a single comment's thread
view the rest of the comments

[–] perry@aussie.zone 8 points 7 months ago (3 children)

Qwen coder model from Huggingface, following the instructions there to run it in llama.cpp. Once that’s up: OpenCode and use the custom OpenAI API to connect it.

You’ll get far better results than trying to use other local options out of the box.

There may be better models potentially but I’ve found Qwen 2.5 etc to be pretty fantastic overall, and definitely a fine option beside Claude/ChatGPT/Gemini. I’ve tested the lot and it’s usually far more down to instruction and AGENTS.md instructions/layout than it is down to just the model.

[–] madcaesar@lemmy.world 3 points 7 months ago

Do you mind sharing your agents md?

[–] 70k32@sh.itjust.works 1 points 7 months ago

This. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me.