214
you are viewing a single comment's thread
view the rest of the comments
[-] Artisian@lemmy.world 22 points 4 days ago

Cool; walk me through attention layers plz.

[-] afk_strats@lemmy.world 27 points 4 days ago

Yeah. It's some if statements and some loops but with CUDA and matrix multiplication

[-] Artisian@lemmy.world 13 points 4 days ago

Great; that describes all functions, so we've nothing to worry about.

[-] embed_me@programming.dev 26 points 4 days ago

No no we still gotta worry about people in power allowing the worst possible use of technology at everyone's expense for personal gain..

So same old

[-] NotAnOtter@lemmus.org 6 points 3 days ago* (last edited 3 days ago)

Please explain what this one specific weight is, and why that value shouldn't be higher or lower.

[-] onlinepersona@programming.dev 0 points 1 day ago

Explain to me how a weight = an IF statement or a FOR loop

[-] leo@sh.itjust.works 11 points 4 days ago* (last edited 4 days ago)
[-] NotAnOtter@lemmus.org 3 points 3 days ago

GPT is basically a machine that builds machines.

We understand how the machine builder works. We don't understand how the output of the machine works. Like mechanically we understand each individual sub-component works e.g. a single matrix multiplication, but we don't understand why specific weights are the value they are, or the broader macrostructure.

I don't think you realize that acting like "No we actually do understand how it works" just reveals that you don't understand the question, it does not show that the question has an answer.

this post was submitted on 08 Oct 2026
214 points (88.8% liked)

Programmer Humor

33571 readers
1682 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 3 years ago
MODERATORS