Gym

Algorithms Atari Box2D Classic control MuJoCo Robotics Toy text EASY Third party environments

Classic control

Control theory problems from the classic RL literature.

Acrobot-v1

Swing up a two-link robot.

CartPole-v1

Balance a pole on a cart.

MountainCar-v0

Drive up a big hill.

MountainCarContinuous-v0

Drive up a big hill with continuous control.

Pendulum-v0

Swing up a pendulum.

Algorithms

Learn to imitate computations.

Copy-v0

Copy symbols from the input tape.

DuplicatedInput-v0

Copy and deduplicate data from the input tape.

RepeatCopy-v0

Copy symbols from the input tape multiple times.

Reverse-v0

Reverse the symbols on the input tape.

ReversedAddition-v0

Learn to add multi-digit numbers.

ReversedAddition3-v0

Learn to add three multi-digit numbers.

Atari

Reach high scores in Atari 2600 games.

AirRaid-ram-v0

Maximize score in the game AirRaid, with RAM as input

AirRaid-v0

Maximize score in the game AirRaid, with screen images as input

Alien-ram-v0

Maximize score in the game Alien, with RAM as input

Alien-v0

Maximize score in the game Alien, with screen images as input

Amidar-ram-v0

Maximize score in the game Amidar, with RAM as input

Amidar-v0

Maximize score in the game Amidar, with screen images as input

Assault-ram-v0

Maximize score in the game Assault, with RAM as input

Assault-v0

Maximize score in the game Assault, with screen images as input

Asterix-ram-v0

Maximize score in the game Asterix, with RAM as input

Asterix-v0

Maximize score in the game Asterix, with screen images as input

Asteroids-ram-v0

Maximize score in the game Asteroids, with RAM as input

Asteroids-v0

Maximize score in the game Asteroids, with screen images as input

Atlantis-ram-v0

Maximize score in the game Atlantis, with RAM as input

Atlantis-v0

Maximize score in the game Atlantis, with screen images as input

BankHeist-ram-v0

Maximize score in the game BankHeist, with RAM as input

BankHeist-v0

Maximize score in the game BankHeist, with screen images as input

BattleZone-ram-v0

Maximize score in the game BattleZone, with RAM as input

BattleZone-v0

Maximize score in the game BattleZone, with screen images as input

BeamRider-ram-v0

Maximize score in the game BeamRider, with RAM as input

BeamRider-v0

Maximize score in the game BeamRider, with screen images as input

Berzerk-ram-v0

Maximize score in the game Berzerk, with RAM as input

Berzerk-v0

Maximize score in the game Berzerk, with screen images as input

Bowling-ram-v0

Maximize score in the game Bowling, with RAM as input

Bowling-v0

Maximize score in the game Bowling, with screen images as input

Boxing-ram-v0

Maximize score in the game Boxing, with RAM as input

Boxing-v0

Maximize score in the game Boxing, with screen images as input

Breakout-ram-v0

Maximize score in the game Breakout, with RAM as input

Breakout-v0

Maximize score in the game Breakout, with screen images as input

Carnival-ram-v0

Maximize score in the game Carnival, with RAM as input

Carnival-v0

Maximize score in the game Carnival, with screen images as input

Centipede-ram-v0

Maximize score in the game Centipede, with RAM as input

Centipede-v0

Maximize score in the game Centipede, with screen images as input

ChopperCommand-ram-v0

Maximize score in the game ChopperCommand, with RAM as input

ChopperCommand-v0

Maximize score in the game ChopperCommand, with screen images as input

CrazyClimber-ram-v0

Maximize score in the game CrazyClimber, with RAM as input

CrazyClimber-v0

Maximize score in the game CrazyClimber, with screen images as input

DemonAttack-ram-v0

Maximize score in the game DemonAttack, with RAM as input

DemonAttack-v0

Maximize score in the game DemonAttack, with screen images as input

DoubleDunk-ram-v0

Maximize score in the game DoubleDunk, with RAM as input

DoubleDunk-v0

Maximize score in the game DoubleDunk, with screen images as input

ElevatorAction-ram-v0

Maximize score in the game ElevatorAction, with RAM as input

ElevatorAction-v0

Maximize score in the game ElevatorAction, with screen images as input

Enduro-ram-v0

Maximize score in the game Enduro, with RAM as input

Enduro-v0

Maximize score in the game Enduro, with screen images as input

FishingDerby-ram-v0

Maximize score in the game FishingDerby, with RAM as input

FishingDerby-v0

Maximize score in the game FishingDerby, with screen images as input

Freeway-ram-v0

Maximize score in the game Freeway, with RAM as input

Freeway-v0

Maximize score in the game Freeway, with screen images as input

Frostbite-ram-v0

Maximize score in the game Frostbite, with RAM as input

Frostbite-v0

Maximize score in the game Frostbite, with screen images as input

Gopher-ram-v0

Maximize score in the game Gopher, with RAM as input

Gopher-v0

Maximize score in the game Gopher, with screen images as input

Gravitar-ram-v0

Maximize score in the game Gravitar, with RAM as input

Gravitar-v0

Maximize score in the game Gravitar, with screen images as input

IceHockey-ram-v0

Maximize score in the game IceHockey, with RAM as input

IceHockey-v0

Maximize score in the game IceHockey, with screen images as input

Jamesbond-ram-v0

Maximize score in the game Jamesbond, with RAM as input

Jamesbond-v0

Maximize score in the game Jamesbond, with screen images as input

JourneyEscape-ram-v0

Maximize score in the game JourneyEscape, with RAM as input

JourneyEscape-v0

Maximize score in the game JourneyEscape, with screen images as input

Kangaroo-ram-v0

Maximize score in the game Kangaroo, with RAM as input

Kangaroo-v0

Maximize score in the game Kangaroo, with screen images as input

Krull-ram-v0

Maximize score in the game Krull, with RAM as input

Krull-v0

Maximize score in the game Krull, with screen images as input

KungFuMaster-ram-v0

Maximize score in the game KungFuMaster, with RAM as input

KungFuMaster-v0

Maximize score in the game KungFuMaster, with screen images as input

MontezumaRevenge-ram-v0

Maximize score in the game MontezumaRevenge, with RAM as input

MontezumaRevenge-v0

Maximize score in the game MontezumaRevenge, with screen images as input

MsPacman-ram-v0

Maximize score in the game MsPacman, with RAM as input

MsPacman-v0

Maximize score in the game MsPacman, with screen images as input

NameThisGame-ram-v0

Maximize score in the game NameThisGame, with RAM as input

NameThisGame-v0

Maximize score in the game NameThisGame, with screen images as input

Phoenix-ram-v0

Maximize score in the game Phoenix, with RAM as input

Phoenix-v0

Maximize score in the game Phoenix, with screen images as input

Pitfall-ram-v0

Maximize score in the game Pitfall, with RAM as input

Pitfall-v0

Maximize score in the game Pitfall, with screen images as input

Pong-ram-v0

Maximize score in the game Pong, with RAM as input

Pong-v0

Maximize score in the game Pong, with screen images as input

Pooyan-ram-v0

Maximize score in the game Pooyan, with RAM as input

Pooyan-v0

Maximize score in the game Pooyan, with screen images as input

PrivateEye-ram-v0

Maximize score in the game PrivateEye, with RAM as input

PrivateEye-v0

Maximize score in the game PrivateEye, with screen images as input

Qbert-ram-v0

Maximize score in the game Qbert, with RAM as input

Qbert-v0

Maximize score in the game Qbert, with screen images as input

Riverraid-ram-v0

Maximize score in the game Riverraid, with RAM as input

Riverraid-v0

Maximize score in the game Riverraid, with screen images as input

RoadRunner-ram-v0

Maximize score in the game RoadRunner, with RAM as input

RoadRunner-v0

Maximize score in the game RoadRunner, with screen images as input

Robotank-ram-v0

Maximize score in the game Robotank, with RAM as input

Robotank-v0

Maximize score in the game Robotank, with screen images as input

Seaquest-ram-v0

Maximize score in the game Seaquest, with RAM as input

Seaquest-v0

Maximize score in the game Seaquest, with screen images as input

Skiing-ram-v0

Maximize score in the game Skiing, with RAM as input

Skiing-v0

Maximize score in the game Skiing, with screen images as input

Solaris-ram-v0

Maximize score in the game Solaris, with RAM as input

Solaris-v0

Maximize score in the game Solaris, with screen images as input

SpaceInvaders-ram-v0

Maximize score in the game SpaceInvaders, with RAM as input

SpaceInvaders-v0

Maximize score in the game SpaceInvaders, with screen images as input

StarGunner-ram-v0

Maximize score in the game StarGunner, with RAM as input

StarGunner-v0

Maximize score in the game StarGunner, with screen images as input

Tennis-ram-v0

Maximize score in the game Tennis, with RAM as input

Tennis-v0

Maximize score in the game Tennis, with screen images as input

TimePilot-ram-v0

Maximize score in the game TimePilot, with RAM as input

TimePilot-v0

Maximize score in the game TimePilot, with screen images as input

Tutankham-ram-v0

Maximize score in the game Tutankham, with RAM as input

Tutankham-v0

Maximize score in the game Tutankham, with screen images as input

UpNDown-ram-v0

Maximize score in the game UpNDown, with RAM as input

UpNDown-v0

Maximize score in the game UpNDown, with screen images as input

Venture-ram-v0

Maximize score in the game Venture, with RAM as input

Venture-v0

Maximize score in the game Venture, with screen images as input

VideoPinball-ram-v0

Maximize score in the game VideoPinball, with RAM as input

VideoPinball-v0

Maximize score in the game VideoPinball, with screen images as input

WizardOfWor-ram-v0

Maximize score in the game WizardOfWor, with RAM as input

WizardOfWor-v0

Maximize score in the game WizardOfWor, with screen images as input

YarsRevenge-ram-v0

Maximize score in the game YarsRevenge, with RAM as input

YarsRevenge-v0

Maximize score in the game YarsRevenge, with screen images as input

Zaxxon-ram-v0

Maximize score in the game Zaxxon, with RAM as input

Zaxxon-v0

Maximize score in the game Zaxxon, with screen images as input

Box2D

Continuous control tasks in the Box2D simulator.

BipedalWalker-v2

Train a bipedal robot to walk.

BipedalWalkerHardcore-v2

Train a bipedal robot to walk over rough terrain.

CarRacing-v0

Race a car around a track.

LunarLander-v2

Navigate a lander to its landing pad.

LunarLanderContinuous-v2

Navigate a lander to its landing pad.

MuJoCo

Continuous control tasks, running in a fast physics simulator.

Ant-v2

Make a 3D four-legged robot walk.

HalfCheetah-v2

Make a 2D cheetah robot run.

Hopper-v2

Make a 2D robot hop.

Humanoid-v2

Make a 3D two-legged robot walk.

HumanoidStandup-v2

Make a 3D two-legged robot standup.

InvertedDoublePendulum-v2

Balance a pole on a pole on a cart.

InvertedPendulum-v2

Balance a pole on a cart.

Reacher-v2

Make a 2D robot reach to a randomly located target.

Swimmer-v2

Make a 2D robot swim.

Walker2d-v2

Make a 2D robot walk.

Toy text

Simple text environments to get you started.

Blackjack-v0

Play Blackjack against a computer dealer

FrozenLake-v0

Find a safe path across a grid of ice and water tiles.

FrozenLake8x8-v0

Find a safe path across a grid of ice and water tiles.

GuessingGame-v0

Guess close to randomly selected number

HotterColder-v0

Guess close to a random selected number using hints

NChain-v0

Traverse a linear chain of states

Roulette-v0

Learn a winning strategy for playing roulette.

Taxi-v3

As a taxi driver, you need to pick up and drop off passengers as fast as possible.

Robotics

Simulated goal-based tasks for the Fetch and ShadowHand robots.

FetchPickAndPlace-v1

Lift a block into the air.

FetchPush-v1

Push a block to a goal position.

FetchReach-v1

Move Fetch to a goal position.

FetchSlide-v1

Slide a puck to a goal position.

HandManipulateBlock-v0

Orient a block using a robot hand.

HandManipulateEgg-v0

Orient an egg using a robot hand.

HandManipulatePen-v0

Orient a pen using a robot hand.

HandReach-v0

Reach a pose using a robot hand.