Best 100-episode average reward was 6099.53 ± 376.53. (Centipede-ram-v0 does not have a specified reward threshold at which it's considered solved.)
Algorithm
This evaluation was generated by running trpo-gae-v0.
Comment on GitHub