Selfhosted

61544 readers

747 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

-55

Can local LLMs be as useful and insightful as those widely available? (discuss.online)

submitted 1 year ago* (last edited 1 year ago) by Brylant@discuss.online to c/selfhosted@lemmy.world

25 comments fedilink hide all child comments

Why do people host LLMs at home when processing the same amount of data from the internet to train their LLM will never be even a little bit as efficient as sending a paid prompt to some high quality official model?

inb4 privacy concerns or a proof of concept

this is out of discussion, I want someone to prove his LLM can be as insightful and accurate as paid one. I don't care about anything else than quality of generated answers

you are viewing a single comment's thread
view the rest of the comments

[–] splendoruranium@infosec.pub 23 points 1 year ago

Why do people host LLMs at home when processing the same amount of data from the internet to train their LLM will never be even a little bit as efficient as sending a paid prompt to some high quality official model?
inb4 privacy concerns or a proof of concept this is out of discussion, I want someone to prove his LLM can be as insightful and accurate as paid one. I don’t care about anything else than quality of generated answers

If you ask other people for their reasoning and opinions, it doesn't really make any sense to put something "out of the discussion", does it? :P

But no, if you have no qualms about sharing your innermost feelings, sexual preference or illegal plans with those that have an explicit desire to exploit that information then there is little reason to attempt something as complicated and wasteful as self-hosting your own LLMs.