The DOI matches its DataCite record.
OpenAI Gym
Open accessAbstract
OpenAI Gym is a toolkit for reinforcement learning research. It includes a growing collection of benchmark problems that expose a common interface, and a website where people can share their results and compare the performance of algorithms. This whitepaper discusses the components of OpenAI Gym and the design decisions that went into the software.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SmartPlay takes a suite of benchmarks (Brockman et al., 2016; Hafner, 2021; Fan et al., 2022) developed over different times to best represent a broad range of difficulties and skills.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“SmartPlay follows a unified OpenAI Gym interface (Brockman et al., 2016) for all games, with text-based observations, text-based manuals with content as described in Table 1, text describing historical actions and observations covering past steps of length 'history length', and flat categorical actions.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“For instance, the Open AI Gym [77], one of the most widely used frameworks for reinforcement learning, provides multiple environments for dexterous manipulation.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [77]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“However, much current RL research works on benchmarks such as Atari (Bellemare et al., 2013) and MuJoCo (E. Todorov et al., 2012; Brockman et al., 2016), which do not have the attributes described above: they evaluate the policy on exactly the same environment it was trained on, which often does not match with real-world scenarios (Fig. 1 left column).”
From A Survey of Zero-shot Generalisation in Deep Reinforcement Learning (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Our environment implementation is based on PettingZoo [24] and OpenAI Gym [5].”
From NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds (2024) · cites this paper as [5]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 601–626 of 626
M-Learning: A Computationally Efficient Heuristic for Reinforcement Learning with Delayed RewardsPreprint
Cortes, M. S. M., Chary, C. A. P., & Perdómo, O. (2024) · Preprints.org · doi:10.20944/preprints202407.2253.v1
Speeding up hierarchical reinforcement learning using state-independent temporal skillsPreprint
Azadkhah, L., Davoodi, O., Ghazanfari, M., & Mozayani, N. (2024) · Research Square · doi:10.21203/rs.3.rs-4678044/v1
Ma, F., & Jin, X. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--47074
Interpretability in Deep Reinforcement LearningPreprint
Das, S., & Ray, R. S. (2024) · doi:10.31219/osf.io/rb4vh
On the Interpretability and Explainability of Prototype-Based Methods and Reinforcement Learning
Davoudi, O. (2024) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2024-16083
Skill Learning with Empowerment in Reinforcement Learning
Latyshev, A. K., & Panov, A. I. (2024) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661824700329
Multi-agent Deep Reinforcement Learning for Self-organized Aggregation of a Swarm of Robots
Abdelli, A., Yachir, A., & Amamra, A. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-71848-9_21
Mantaw, C. S., Prahadeeswaran, M., Karthick, V., Sumathi, C. S., & Patil, S. G. (2024) · Plant Science Today · doi:10.14719/pst.5426 · Cited by 1
Discriminator-weighted offline imitation learning with unlabeled demonstrations for robotic tasks
Zuo, G., Wu, Q., He, L., Li, J., & Yu, S. (2025) · Journal of the Chinese Institute of Engineers · doi:10.1080/02533839.2025.2517354
UAV Navigation Using Modified Neural Networks
Reja, A. H., & Hamzah, M. A. (2025) · Journal Européen des Systèmes Automatisés · doi:10.18280/jesa.580606
Reward-optimizing learning using stochastic release plasticity
Sun, Y., Liao, W., Li, J., Zhang, X., Wang, G., Ma, Z., & Song, S. (2025) · Frontiers in Neural Circuits · doi:10.3389/fncir.2025.1618506
Deep reinforcement learning for assessing route instruction usability in complex indoor spaces
Arabsheibani, R., Winter, S., & Tomko, M. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2572790
Ging-Jehli, N. R., Childers, R. K., Lu, J., Gemma, R., & Zhu, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-10518-9_23 · Cited by 2
A cascading policy learning framework for enhancing power grid resilience
Bensalah, A. S., Marir, T., Yaich, R., & Chebout, M. S. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3358
Training neural networks from scratch in a videogame leads to brittle brain encodingPreprint
Paugam, F., Pinsard, B., St‐Laurent, M., Lajoie, G., & Bellec, P. (2025) · eLife · doi:10.1101/2025.11.28.691119 · Cited by 1
An Automatic Satellite Alignment Algorithm for Satellite Antennas Based on PPO
Zhao, B., Chen, Y., & Wang, P. (2025) · International Conference on Image Processing, Intelligent Control and Computer Engineering (IPICE) · doi:10.1145/3768184.3768200
Singh, A. K., Mallampalli, K., Rangayyan, Y. M., Iyengar, R. S., & Raghavan, M. (2026) · Springer eBooks · doi:10.1007/978-3-032-06713-5_18
Salahshour, M., Shafiee, A., & Tefagh, M. (2026) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnag007
Behavior-aware deep reinforcement learning for multi-objective outpatient scheduling optimization
Wan, X., Zhang, X., Weng, W., Han, P., & Xu, X. (2026) · Scientific Reports · doi:10.1038/s41598-026-50893-5
How Reward and the Elimination of Dependence Thereon Lead Evolution to High-Bandwidth Learning
Arnold, S., Suzuki, R., & Arita, T. (2026) · Artificial Life · doi:10.1162/artl.a.464
Dual-critic constrained deceptive Q-learning for deployment-time policy protection
Pan, G., Hou, B., Chen, Y., Tian, J., & Yang, W. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01092-9
Sahu, H., & Bhandari, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01869-x
Bouafia, Z., Mededjel, M., Ghalem, B., & Mokadem, R. (2026) · Cluster Computing · doi:10.1007/s10586-026-06601-z
Neural Approximation of Vision-Controlled Systems for Reachability Analysis
Geng, Y., Sundaran, S., Huang, C., Drager, S., & Ruchkin, I. (2026) · ACM Transactions on Cyber-Physical Systems · doi:10.1145/3857793
NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds
Goel, S., Wei, Y., Lymperopoulos, P., Churá, K., Scheutz, M., & Sinapov, J. (2024) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/aola8123
Metadata
- Authors
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.01540
- OpenAlex
- W4394666657
- Cited by
- 582
- References
- 0
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 93 · 2023: 149 · 2022: 119 · 2021: 82 · 2020: 37 · 2019: 31 · 2018: 24 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- OpenAI Gym, reinforcement learning, benchmark environments, software design, algorithm comparison, research toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
