A comprehensive list of categorized reinforcement learning environments.
Started and maintained by Andrew Szot and Youngwoon Lee.
Two other resources for RL environments:
Environments are listed alphabetically.
|
Assistive-gym
|
| Dexterous Gym
|
| DoorGym
|
| FurnitureSim
|
|
Gym Gazebo 2
|
Gym Ignition
| |
|
IKEA Furniture Assembly
|
|
Meta-World
|
| CALVIN
|
| Playroom
|
| RAISIM
|
|
RLBench
|
| Robosuite
|
| Roboschool
|
| Rex-Gym
|
|
Bomberland
|
|
Coin-Run
|
|
Gym Retro
|
|
Holodeck
|
|
MarLÖ : Reinforcement Learning + Minecraft
|
|
Minecraft
|
|
PHYRE
|
|
Soccer Simulator
|
|
StarCraft 2
|
SuperMario
| |
TorchCraft
| |
|
VizDoom
|
|
Meta-World
|
Multiworld
| |
| CALVIN
|
| Playroom
|
| RoboDesk
|
|
RLBench
|
|
DeepMind Control Suite
|
|
OpenAI Gym Atari
|
|
OpenAI Gym Classic
|
|
OpenAI Gym Mujoco
|
|
OpenAI Gym Robotics
|
|
Unity Agents
|
|
PettingZoo
|
|
Cartpole Generalization
|
|
Natural RL Environment
|
|
DMControl Generalization Benchmark
|
|
Procgen
|
|
Animal-AI Testbed
|
|
Crafter
|
|
DeepMind Lab
|
|
gym-maze
|
|
gym-minigrid
|
|
gym-miniworld
|
|
Obstacle Tower
|
|
AI2THOR
|
|
Gibson
|
|
Habitat
|
|
HoME: a Household Multimodal Environment
|
|
House3D
|
|
MINOS
|
|
Nvidia ISAAC simulator
|
|
VirtualHome
|
|
Massive Multi Agent Game Environment
|
|
Multi-agent Particle Environment
|
|
OpenAI Multi-Agent Competition Environments
|
|
OpenAI Multi-Agent Hide and Seek
|
|
RoboSumo
|
|
SUMO-RL
|
|
Assistive-gym
|
DeepMind AI Safety Gridworlds
| |
|
Safety Gym
|
|
Autonomous Vehicle Simulator
|
|
BARK-ML
|
|
CARLA
|
|
DeepDrive Self Driving Car Simulator
|
|
DeepMind StreetLearn
|
|
DeepGTAV v2
|
|
DuckieTown
|
|
Highway-Env
|
|
SVL Simulator
|
|
TORCS
|
|
Full Body Muscle Simulator
|
|
Osim-rl
|
| Roboschool
|
|
Jericho
|
TextWorld
|
Reco Gym
| |
RecSim
| |
|
Gym-ANM
|
The list is not comprehensive, so please let us know if there is any environment that is missing, miscategorized, or needs a different description or image. Please submit an issue or open a pull request.
198 followers · starred Jul 2025
93 followers · starred May 2023
64 followers · starred Aug 2026
3 followers · starred Feb 2023
A comprehensive list of categorized reinforcement learning environments.
Started and maintained by Andrew Szot and Youngwoon Lee.
Two other resources for RL environments:
Environments are listed alphabetically.
|
Assistive-gym
|
| Dexterous Gym
|
| DoorGym
|
| FurnitureSim
|
|
Gym Gazebo 2
|
Gym Ignition
| |
|
IKEA Furniture Assembly
|
|
Meta-World
|
| CALVIN
|
| Playroom
|
| RAISIM
|
|
RLBench
|
| Robosuite
|
| Roboschool
|
| Rex-Gym
|
|
Bomberland
|
|
Coin-Run
|
|
Gym Retro
|
|
Holodeck
|
|
MarLÖ : Reinforcement Learning + Minecraft
|
|
Minecraft
|
|
PHYRE
|
|
Soccer Simulator
|
|
StarCraft 2
|
SuperMario
| |
TorchCraft
| |
|
VizDoom
|
|
Meta-World
|
Multiworld
| |
| CALVIN
|
| Playroom
|
| RoboDesk
|
|
RLBench
|
|
DeepMind Control Suite
|
|
OpenAI Gym Atari
|
|
OpenAI Gym Classic
|
|
OpenAI Gym Mujoco
|
|
OpenAI Gym Robotics
|
|
Unity Agents
|
|
PettingZoo
|
|
Cartpole Generalization
|
|
Natural RL Environment
|
|
DMControl Generalization Benchmark
|
|
Procgen
|
|
Animal-AI Testbed
|
|
Crafter
|
|
DeepMind Lab
|
|
gym-maze
|
|
gym-minigrid
|
|
gym-miniworld
|
|
Obstacle Tower
|
|
AI2THOR
|
|
Gibson
|
|
Habitat
|
|
HoME: a Household Multimodal Environment
|
|
House3D
|
|
MINOS
|
|
Nvidia ISAAC simulator
|
|
VirtualHome
|
|
Massive Multi Agent Game Environment
|
|
Multi-agent Particle Environment
|
|
OpenAI Multi-Agent Competition Environments
|
|
OpenAI Multi-Agent Hide and Seek
|
|
RoboSumo
|
|
SUMO-RL
|
|
Assistive-gym
|
DeepMind AI Safety Gridworlds
| |
|
Safety Gym
|
|
Autonomous Vehicle Simulator
|
|
BARK-ML
|
|
CARLA
|
|
DeepDrive Self Driving Car Simulator
|
|
DeepMind StreetLearn
|
|
DeepGTAV v2
|
|
DuckieTown
|
|
Highway-Env
|
|
SVL Simulator
|
|
TORCS
|
|
Full Body Muscle Simulator
|
|
Osim-rl
|
| Roboschool
|
|
Jericho
|
TextWorld
|
Reco Gym
| |
RecSim
| |
|
Gym-ANM
|
The list is not comprehensive, so please let us know if there is any environment that is missing, miscategorized, or needs a different description or image. Please submit an issue or open a pull request.
198 followers · starred Jul 2025
93 followers · starred May 2023
64 followers · starred Aug 2026
3 followers · starred Feb 2023