view the rest of the comments
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
-
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
I'm probably the only one here that looks at the stupid prices of hardware (RAM, GPUs, drives etc) as a fun challenge. As in "OK...shit's expensive...what's the MOST I can do with the LEAST?".
I think that comes from spending time in the lowspecgamer culture, where folks (hello!) will literally recode the game engine, bridge motherboard pins with paperclips and drill holes into the PC before buying new hardware.
For example, I specced out a (very decent) "sneakernet" / internet mirror for myself, as an intellectual exercise...and every time I run the numbers, they go from 8TB on the low end to 16TB on the high.
That includes mirroring somewhere around 3-5yrs of YouTube videos (in glorious 540-720p).
I can (and do) host an obscene amount of stuff on a SBC with a 256GB M.2.
Given narrow jobs like DNS, VPN, media, sync, search and automation and you can do a stupid amount with pi4 4GB.
Same thing with LLMs. People try to solve the problem of LLMs with bigger models, bigger GPUs etc...and I'm over here thinking "actually, the LLM is really just the mouthpiece; everything else around it is just good old programming".
Memory, search, STT and TTS, OCR, file tools...none of that needs to live in the model or chew up a GPU...and once normal software handles that stuff, the question becomes: how small can the LLM be and still be useful middleware?
Turns out...pretty fucking small.
Honesty, I don't think prices are coming down any time soon (RAM, 8TB NVMe drives, Threadrippers, 25GbE gear...hell, I saw a Blackwell yesterday on "sale" for $15K USD) so we might need to get creative.
Personally, I'm building towards resilience and independence. My next DIY will be the solar system... and because I'm paring down my homelab significantly, I can get away with a micro-system for around $2K.
Do wish hard drives were cheaper tho. Might have to go back to my "DVD as back up server" idea.
TL;DR: the only way to win is not to play the game...or at least, play it by your own rules.
Not really. As far as server equipment, I like to ride the top of equipment using DDR3. I can get DDR3 cheap. Sure, it's not cutting edge, but it works nicely for my purposes. Now I did provision a box that uses DDR4 which is expensive; $437 USD expensive. I'm now trying to get over the sticker shock of a 5090 GPU so I can use it as a local AI machine. The box came with 32 GB ram, so I topped it off with another 96 GB RAM