90
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 08 Oct 2026
90 points (83.1% liked)
Open Source
49520 readers
293 users here now
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
- !libre_culture@lemmy.ml
- !libre_software@lemmy.ml
- !libre_hardware@lemmy.ml
- !linux@lemmy.ml
- !technology@lemmy.ml
Community icon from opensource.org, but we are not affiliated with them.
founded 7 years ago
MODERATORS
A human doing a clean room reimplementation is not supposed to have seen the original source code for something they are reimplementing. If that source code is in the training data for the LLM, that seems like a similar situation.
Except that they are separated. The clean side (model + implementors) doesnt have the original source code. The dirty side is the training room, which does have original source.
The model that you download from huggingface is basically the notebook passed between the two rooms, and as far as im aware, the model doesnt have the actual training data in it, just enough statistics to "hallucinate" something close.