1087
you are viewing a single comment's thread
view the rest of the comments
[-] boonhet@sopuli.xyz 4 points 3 days ago

even though it is worthless whenever next model version is released.

For most version releases I actually doubt that, I'm pretty sure they just keep training the model and release checkpoints every few months. Architectural changes, however, will indeed invalidate the previously trained models, and occasionally they have to do that to keep up with the competition.

But if you do architectural changes even just once a year, that means you'd have to depreciate those training costs over just that one year to be truthful. Meaning they might as well be losses rather than depreciating capital investments.

[-] humanspiral@lemmy.ca 2 points 3 days ago

There is a genuine "training corpus" that is an accumulated asset and grows and feeds new models. The vast majority of training cost, that should be expensed, is the training time compute. Neither of these are expensed. There was about 13 major US model releases in September. At least 7 of these replaced a 1 month old previous model family. Open AI gpt sol went from 5.6 to 6 to 6.1 in about 2 months.

Fast model releases not only lock in structural losses, they juice revenue growth illusions. Model use rate generally drops by 66% 4 weeks after release, because of competition, and a surge of use on release for evaluation.

[-] driving_crooner@lemmy.eco.br 2 points 3 days ago

New models are trained on older models, so even if the older model is not longer at par, without it the new model couldn't exists

this post was submitted on 20 Oct 2026
1087 points (99.5% liked)

Technology

89039 readers
3988 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS