432
you are viewing a single comment's thread
view the rest of the comments
[-] Wildmimic@anarchist.nexus 1 points 29 minutes ago* (last edited 12 minutes ago)

You really think that an Othello board could represent the world? Talk about being delusional. This is pathetic. The subheadline: "OTHELLO-GPT USUALLY PREDICTS LEGAL MOVE" says it all - it cannot have a representative internal world model, because in that case the "USUALLY" would go away, as anyone who has played othello for longer than 10 minutes will tell you - and we are talking about a game with very simple rules here, the complexity does not even reach chess - and people expect these things to spit out coherent and valid solutions from target selection in wars to the color their bedroom walls should be painted in.

Edit: I really have to add here the following excerpt (percentages are the rate of invalid moves as the top choice):

The error rate is 0.01% for Othello-GPT trained on the synthetic dataset and 5.17% for Othello-GPT trained on the championship dataset. For comparison, the untrained Othello-GPT has an error rate of 93.29%.

So even if you just feed them real world data without completely synthesizing it, 1 in 20 moves are invalid in a very simple (rule-side) game. If you do not give them a whole lot of played games as a basis, it fails in over 93% of cases (not at making a GOOD move, just at making any valid move!), which is probably very close to a random guess for a move. Something that has even an inkling of an internal world view would be able to adapt after being told that their move is invalid. Also, an internal world view would allow for simply dropping the rulebook onto ChatGPT as a basis, as it works with humans that can imagine.

this post was submitted on 17 Nov 2026
432 points (97.8% liked)

Technology

89881 readers
3801 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS