TechTakes

1441 readers

31 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

657

Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie (www.nytimes.com)

submitted 6 months ago by dgerard@awful.systems to c/techtakes@awful.systems

243 comments fedilink hide all child comments

archive https://archive.ph/is57b

you are viewing a single comment's thread
view the rest of the comments

[–] exanime@lemmy.today 11 points 6 months ago (2 children)

Because a machine that "forgets" stuff it reads seems rather useless... considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

[–] EatATaco@lemm.ee -1 points 6 months ago (1 children)

Chat GPT had the book entirely memorized

I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

[–] TachyonTele@lemm.ee 12 points 6 months ago

They're auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn't reproduce the correct word matches, it failed.