2
One thing that stood out to me was that none of their agents performed well on boxing or pong, but in my experience, these are the two easiest tasks in the entire Atari suite. They're the games I use as quick sanity checks. How did they manage that?