7
top 5 comments
sorted by: hot top new old
[-] popcar2@programming.dev 5 points 2 years ago

I low-key wish there were a separate AI leaderboard. It would be really interesting to see how fast bots can actually solve a problem as soon as it goes up, and it'd be nice to compare that to last year.

[-] soulsource@discuss.tchncs.de 4 points 2 years ago

Honestly, I'd be very surprised if AI could even solve those problems.

The only AI I've heard of that might eventually be able to actually solve problems is OpenAI's Project Q, and that one isn't public yet. The publicly available AI tools can just repeat things they have already seen online (with a rather large chance of repeating it wrong due to their lossy nature). So, unless the riddles exist somewhere online in a reasonably similar form, I'd expect the chatbots to fail at solving them.

(They can, however, help a human developer solve them quicker than the developer could without AI assistence.)

[-] armchair_progamer@programming.dev 0 points 2 years ago

Whoever makes the Advent of Code problems should test all them on GPT4 / other LLMs and try to make it so the AI can't solve them.

[-] kakes@sh.itjust.works 3 points 2 years ago

That class of problems is small, and shrinking, and would block out any newer programmers from entering.

[-] Sigmatics@lemmy.ca 2 points 2 years ago

Is it though? Has someone tried with some of the past problems?

this post was submitted on 14 Nov 2023
7 points (100.0% liked)

Advent Of Code

1243 readers
1 users here now

An unofficial home for the advent of code community on programming.dev! Other challenges are also welcome!

Advent of Code is an annual Advent calendar of small programming puzzles for a variety of skill sets and skill levels that can be solved in any programming language you like.

Everybody Codes is another collection of programming puzzles with seasonal events.

EC 2025

AoC 2025

Solution Threads

M T W T F S S
1 2 3 4 5 6 7
8 9 10 11 12

Visualisations Megathread

Rules/Guidelines

Relevant Communities

Relevant Links

Credits

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

console.log('Hello World')

founded 3 years ago
MODERATORS