89
Can gzip be a language model?
(nathan.rs)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 18 Jun 2026
89 points (97.8% liked)
Programming
28304 readers
298 users here now
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
- Follow the programming.dev instance rules
- Keep content related to programming in some way
- If you're posting long videos try to add in some form of tldr for those who don't want to watch videos
Wormhole
Follow the wormhole through a path of communities !webdev@programming.dev
founded 3 years ago
MODERATORS
This is precisely why LLMs and AI are 99% a scam.
AI is the minimum value of a well structured dataset obtained by a destructive, hallucinatory compressor that is MAXIMALLY inefficient with inefficiency increasing nonlinearly as a model gets bigger... while it does demonstrate power, this observation that a well structured, QC'd, properly curated dataset reveals a latent intelligence in good data clearly points to functional programming, relational programming and the profession of the librarian and archivist as the directions where the genesis point of intelligence can be pursued, not these bullshitting AI's which demonstrate a degraded truth in a stupendously hamfisted, wasteful way that sends amateurs looking hopelessly looking in the wrong direction.
In otherwords, the algorithm and model are worthless, costly junk, it is the well structured, large high quality dataset and the humans that maintain and contextualize it that are precious.
Scientists could have told computer people this was true a long time ago if they had listened.