41
How many proper open-source LLMs are there?
(palaver.p3x.de)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 01 Sep 2026
41 points (93.6% liked)
LocalLLaMA
5104 readers
16 users here now
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
founded 3 years ago
MODERATORS
Nemotron is a fairly significant model family in this space, IIRC. e.g. here's one of the recent releases: https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
Edit: Not fully open -- see thread below.
Huh. It doesn't come with all the datasets, though. Does it? The model card contains a long list of "Private Non-publicly Accessible Datasets", both by NVIDIA and by third parties. And some of the stuff just says "Undisclosed".
Huh. I thought they were fully open. I missed that. Most of the data sets and methodology is open though. (Maybe I'm remembering an older model? Or maybe I just fell for their marketing a while back... 😔️)
NVIDIA's own proprietary stuff looks largely like machine translation examples, and some sort of game logs (Sudoku and Minesweeper 🤨️), plus a few things I'm not quite sure I understand ("Multitool Typewriter Hard"? Is that for OCR maybe? Edit: or maybe they mean 'multitool' in an agentic sense... and that's for tool call reasoning?).
The third-party stuff is these six entries:
I wonder how hard it would be to rebuild something equivalent that is fully open. 🤔️
Sudoku and Minesweeper could very well be some internal project names and have nothing to do with what the words mean. I have no clue.
Seems to me their announcements ooze with marketing speech. I bet they put it all in one sentence to mislead about the datasets. Put a comma there and omitted the word "partly". It's technically borderline correct. I'll have to read up on it, whether that's a good amount of data, or just some tiny fraction. It's not looking good, though.
It could be, but using the games as logical puzzle solver/reasoning tests might have value -- I don't know.