880
you are viewing a single comment's thread
view the rest of the comments
[-] relic_@piefed.world 4 points 2 days ago

Yes but that's related to LLMs specifically, not backpropagation. There's plenty of ML paradigms that use backprop and have continual learning setups.

Backprop is the process of how the weights are updated.

[-] PurpleClouds@lemmy.world 1 points 1 day ago

Well to be precise the pretraining is prevented by this but the online post training does have this issue. The reinforcement learning trials show some sort of automation but I am not aware of any unsupervised methods that have been as successful as the latest batches of llms — haven’t been in this field for a while so honestly dunno.

this post was submitted on 10 Oct 2026
880 points (99.0% liked)

Programmer Humor

33583 readers
1805 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 3 years ago
MODERATORS