161
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 21 Sep 2026
161 points (91.7% liked)
Open Source
49130 readers
1034 users here now
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
- !libre_culture@lemmy.ml
- !libre_software@lemmy.ml
- !libre_hardware@lemmy.ml
- !linux@lemmy.ml
- !technology@lemmy.ml
Community icon from opensource.org, but we are not affiliated with them.
founded 7 years ago
MODERATORS
Brother, I don't think you know what a large language model is if you think it being trained on a human lifespan's worth of audio transcripts isn't enough.
Its job is NLP. It is an LLM, if not as general-use as something like ChatGPT.
LLM is a subset of NLP. All LLMs are NLP but not all NLP are LLMs. To be more precise, LLM is a method of achieving NLP while NLP is the goal. Whisper is just a specialised speech-to-text engine. It doesn't have the text reasoning engine that is the core of LLMs. Yes, it has a dataset to inform it's encoder and decoder, but that doesn't make it an LLM. If you strip out the encoder, then you're getting closer.
That's flat-out not true. BERTs, for example, are LLMs and are encoder-only, just like GPTs are decoder-only. Whisper is trained on a large corpus of text and does NLP tasks. That's all it is to be an LLM.
A transformer model being encoder-only, encoder-decoder, or decoder-only has fuck-all to do with whether it's an LLM. In fact, it being a transformer model at all isn't required for it to be an LLM.
BERT is a special case. The academic consensus is rightly considering it an LLM since it operates on text but the industry doesn't consider it an LLM since LLM in its colloquial meaning has drifted to mean a model generating text (which BERT doesn't). Whisper is not an LLM since it's working on audio, so it is an Automatic Speech Recognition model (ASR).
Text in = LLM in academic circles (BERT and GPT)
Text in, text out = LLM in all circles (GPT only)
Audio in, text out ≠ LLM (Whisper)
Now, we can argue whether we want to accept the colloquial meaning of LLM, but the fact is that Whisper is not an LLM. And neither ASR nor BERT causes even a fraction of the damage GPT is doing, but that's another discussion.