The DOI matches its DataCite record.
OpenAI Gym
Open accessAbstract
OpenAI Gym is a toolkit for reinforcement learning research. It includes a growing collection of benchmark problems that expose a common interface, and a website where people can share their results and compare the performance of algorithms. This whitepaper discusses the components of OpenAI Gym and the design decisions that went into the software.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SmartPlay takes a suite of benchmarks (Brockman et al., 2016; Hafner, 2021; Fan et al., 2022) developed over different times to best represent a broad range of difficulties and skills.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“SmartPlay follows a unified OpenAI Gym interface (Brockman et al., 2016) for all games, with text-based observations, text-based manuals with content as described in Table 1, text describing historical actions and observations covering past steps of length 'history length', and flat categorical actions.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“For instance, the Open AI Gym [77], one of the most widely used frameworks for reinforcement learning, provides multiple environments for dexterous manipulation.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [77]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“However, much current RL research works on benchmarks such as Atari (Bellemare et al., 2013) and MuJoCo (E. Todorov et al., 2012; Brockman et al., 2016), which do not have the attributes described above: they evaluate the policy on exactly the same environment it was trained on, which often does not match with real-world scenarios (Fig. 1 left column).”
From A Survey of Zero-shot Generalisation in Deep Reinforcement Learning (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Our environment implementation is based on PettingZoo [24] and OpenAI Gym [5].”
From NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds (2024) · cites this paper as [5]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 501–600 of 626
Bound Action Policy for Better Sample Efficiency
Huang, J., & Hao, Z. (2018) · Proceedings of the 2018 International Conference on Network, Communication, Computer Engineering (NCCE 2018) · doi:10.2991/ncce-18.2018.131
Better Sampling Strategy for Locomotion Control Tasks
Huang, J., & Hao, Z. (2018) · Proceedings of the 2018 International Conference on Network, Communication, Computer Engineering (NCCE 2018) · doi:10.2991/ncce-18.2018.135
Evaluating the Effectiveness of Deep Reinforcement Learning Algorithms in a Walking Environment
Neervannan, A. (2018) · Baltic Journal of Modern Computing · doi:10.22364/bjmc.2018.6.4.02
An Active Learning Framework for Efficient Robust Policy Search
Narayanaswami, S. K., Sudarsanam, N., & Ravindran, B. (2022) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3493700.3493712 · Cited by 1
Interactive language learning - How to explore complex environments using natural language?
Petrache, T.-A., Rebedea, T. E., & Trăușan-Matu, Ș. (2020) · International Joural of User-System Interaction · doi:10.37789/ijusi.2020.13.1.2
Deep learning that scales: leveraging compute and data
Camúñez, V. C. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-335426
Power Flow Adjustment for Smart Microgrid Based on Edge Computing and Deep Reinforcement LearningPreprint
Pu, T., Jiao, F., Cao, Y., Liu, Z., Qiu, C., Ji, Q., & Zhang, S. (2021) · Research Square · doi:10.21203/rs.3.rs-268782/v1
Interpretable Option Discovery Using Deep Q-Learning and Variational Autoencoders
Andersen, P., Goodwin, M., & Granmo, O. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-71711-7_11
A Model-Driven Approach to Integrated Cognition
Peters, C. (2021) · doi:10.22215/etd/2021-14605
Automating Network Operation Centers with Superhuman PerformancePreprint
Altamimi, S., Altamimi, B., Shirmohammadi, S., & Cote, D. (2021) · doi:10.36227/techrxiv.15176175.v1 · Cited by 1
Function shaping in deep learning
Urtāns, Ē. (2021) · RTU Press eBooks · doi:10.7250/9789934226854
Funkciju formēšana dziļajā mašīnmācīšanā
Urtāns, Ē. (2021) · RTU Press eBooks · doi:10.7250/9789934226847
Generative Adversarial Network for Imitation Learning from Single Demonstration
Duc, T. N., Tran, C. M., Tan, P. X., & Kamioka, E. (2021) · Baghdad Science Journal · doi:10.21123/bsj.2021.18.4(suppl.).1350
Intelligent Avatar Interaction in 3D Computer Games
Balazs, M., & Gorgan, D. (2021) · RoCHI - International Conference on Human-Computer Interaction (RoCHI) · doi:10.37789/rochi.2021.1.1.14
Proximal Policy Optimization for Radiation Source Search
Proctor, P. (2021) · doi:10.15760/etd.7657
Silicon Valley researcher, O. A. N. C., & Arslan, A. (2020) · International Journal of Advanced Research in Computer Science · doi:10.26483/ijarcs.v13i1.6801
Segmented Actor-Critic-Advantage Architecture for Reinforcement Learning Tasks
Kaloev, M., & Krastev, G. (2022) · TEM Journal · doi:10.18421/tem111-27
Arslan, A. (2022) · Scholars Journal of Engineering and Technology · doi:10.36347/sjet.2022.v10i03.001
Experimental Evaluation of Deep Reinforcement Learning Algorithms
Mrzljak, N., & Hrkać, T. (2019) · Proceedings of the Croatian Computer Vision Workshop · doi:10.20532/ccwv.2018.0003
Automating Network Operation Centers with Superhuman PerformancePreprint
Altamimi, S., Altamimi, B., Shirmohammadi, S., & Côté, D. (2021) · doi:10.36227/techrxiv.15176175
(2021) · SciPost Physics · doi:10.21468/scipost.report.2812
(2021) · SciPost Physics · doi:10.21468/scipost.report.2824
(2021) · SciPost Physics · doi:10.21468/scipost.report.2820
Reach Space Analysis of Baseline Differential Extrinsic Plasticity Control
Birrell, S. A., Abdulali, A., & Fumiya Iida, A. (2022) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.848084
Mobile-Kube: Mobility-aware and Energy-efficient Service Orchestration on Kubernetes Edge ServersPreprint
Ghafouri, S., Karami, A., Bakhtiarvand, D. B., Bigdeli, A. S., Gill, S. S., & Doyle, J. C. (2022) · doi:10.36227/techrxiv.20324841.v1
Mobile-Kube: Mobility-aware and Energy-efficient Service Orchestration on Kubernetes Edge ServersPreprint
Ghafouri, S., Karami, A., Bakhtiarvand, D. B., Bigdeli, A. S., Gill, S. S., & Doyle, J. C. (2022) · doi:10.36227/techrxiv.20324841
Inhalt Tagungsband ASIM 2022 – 26. Symposium Simulationstechnik
Breitenecker, F. (2022) · doi:10.11128/arep.19.a1900
Curriculum learning for robotic agents
Kurkcu, A. (2022) · doi:10.32657/10356/160311
Towards Identifying for Evidence of Drain Brain from Web Search Results using Reinforcement Learning
Meza, I., Murrieta, H., Alizadeh, P., & Flores, J. G. (2019) · LatinX in AI at Neural Information Processing Systems Conference (LXAI) · doi:10.52591/lxai2019120830
Zhou, C. (2022) · doi:10.17760/d20449077
Sağlam, B., Dalmaz, O., Gönç, K., & Kozat, S. S. (2022) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu55565.2022.9864786
Improving Zorro Explanations for Sparse Observations with Dense Proxy Data
Mazur, A., Artelt, A., & Hammer, B. (2022) · European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) · doi:10.14428/esann/2022.es2022-27
Exploring the Integration of Lisp into a Modern Reinforcement Learning Project Through the Use of Hy
(2022) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2022/011152022
Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement LearningPreprint
Gomrokchi, M., Amin, S., Aboutalebi, H., Wong, A. K. C., & Precup, D. (2022) · Research Square · doi:10.21203/rs.3.rs-2261000/v1
Control strategies for reactive manipulation
Haviland, J. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.236551
Arslan, A. (2022) · International Journal of Latest Engineering and Management Research (IJLEMR) · doi:10.56581/ijlera.7.2.06-12
Deep Reinforcement Learning for Tehran Stock Trading
Yousefi, N. (2022) · Indonesian Journal of Data and Science · doi:10.56705/ijodas.v3i3.53
Investigating Quantum Reinforcement Learning structure to the CartPole control task
Ngo, N. T. T., Lu, T., Quach, J. Q., & Bruza, P. (2022) · Asian Society for Precision Engineering and Nanotechnology (ASPEN 2022) · doi:10.3850/978-981-18-6021-8_or-02-0142.html
schlably: A Python Framework for Deep Reinforcement Learning Based Scheduling ExperimentsPreprint
de Puiseau, C. W., Peters, J., Dörpelkus, C., Tercan, H., & Meisen, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.04182
Malekzadeh, P., & Plataniotis, K. N. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4229967
Proceedings - 4th International Conference Business Meets Technology 2022
BMT Scientific Committee (2022) · doi:10.4995/bmt2022.2022.16007
On the intelligence of interacting autonomous robots and virtual agents
Geißelsöder, S., & Narovlyanskyy, A. (2022) · International Conference Business Meets Technology (BMT) · doi:10.4995/bmt2022.2022.15555
Soft Action Priors: Towards Robust Policy Transfer
Centa, M., & Preux, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25850
Fundamentos de Aprendizagem por Reforço
Jardim, R. R.-A. J. (2023) · doi:10.58976/9786500604368
Downing, K. L. (2023) · The MIT Press eBooks · doi:10.7551/mitpress/14723.001.0001
Alwahab, D. A. (2021) · Eötvös Loránd Tudományegyetem · doi:10.15476/elte.2021.058
Reinforcement learning for accurate two-stage pointing control of CubeSats in photometric research
Leidens, B. N., Inoue, M., Oliveira, F. A. F. D., & Junqueira, J. F. S. (2023) · STUDIES IN ENGINEERING AND EXACT SCIENCES · doi:10.54021/sesv4n1-009
Pasterk, D., & Körner, A. (2023) · SNE Simulation Notes Europe · doi:10.11128/sne.33.sn.10635
Tight Performance Guarantees of Imitator Policies with Continuous Actions
Maran, D., Metelli, A. M., & Restelli, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26089
Kaloev, M., & Krastev, G. (2023) · Research Square · doi:10.21203/rs.3.rs-3166622/v1
Boer, D. T., Elomari, Y., Mateu, C., Marín-Genescà, M., & Boer, D. T. (2023) · International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems (ECOS) · doi:10.52202/069564-0282
lilGym: Natural Language Visual Reasoning with Reinforcement Learning
Wu, A., Brantley, K., Kojima, N., & Artzi, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.512 · Cited by 1
Scaling Goal-based Exploration via Pruning Proto-goals
Bagaria, A., & Schaul, T. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/384
Jardim, R. R.-A. J. (2023) · Springer eBooks · doi:10.1007/978-3-031-37345-9_4
gym-saturation: Gymnasium Environments for Saturation Provers (System description)
Shminke, B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43513-3_11
Path exploration with random network distillation on multi-agent reinforcement learning
Charoenpitaks, K. (2019) · Chula Digiverse · doi:10.58837/chula.the.2019.162
Análisis de un robot abierto de bajo coste para docencia de aprendizaje automático
Carreras, J. B., Garcia-Barcos, J., & Martínez-Cantín, R. (2023) · doi:10.17979/spudc.9788497498609.198
EVOLUTION OF REINFORCEMENT LEARNING AGENTS USING THE GENETIC ALGORITHM
Volokyta, A., & Hereha, B. (2023) · TECHNICAL SCIENCES AND TECHNOLOGIES · doi:10.25140/2411-5363-2023-2(32)-175-184
Towards Human-Level Safe Reinforcement Learning in Atari Library
Afriyadi, A., & Utomo, W. H. (2023) · Jurnal Sisfokom (Sistem Informasi dan Komputer) · doi:10.32736/sisfokom.v12i3.1739
Pigozzi, F. (2023) · Artificial Life · doi:10.1162/artl_a_00415
Enhancing Exploration in Actor-Critic Algorithms:An Approach to Incentivize Plausible Novel StatesPreprint
Banerjee, C., Chen, Z., & Noman, N. (2023) · doi:10.36227/techrxiv.24631455.v1
Cell Tracking via Reinforcement Learning with Microscopic Image Simulator
Nagamura, T., Seno, S., Shigeta, H., Mashita, T., & Matsuda, H. (2023) · International Conference on Biomedical Engineering and Technology (ICBET) · doi:10.1145/3620679.3620682
A step toward a reinforcement learning de novo genome assemblerPreprint
Padovani, K., Xavier, R., Borges, R. C., de Carvalho, A. C. P. L. F., Reali, A., Château, A., & Alves, R. C. D. O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02649
UNLEASHING THE POWER OF ARTIFICIAL INTELLIGENCE: A COMPREHENSIVE EXPLORATION OF OPENAI
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets48603 · Cited by 1
Berhaut, P., Yaya-Oyé, I., & Albot, A. (2024) · International Journal of Machine Learning · doi:10.18178/ijml.2024.14.1.1152
Reinforcement Learning for Residential Heat Pump OperationPreprint
Schmitz, S., Brucke, K., Kasturi, P., Ansari, E., & Klement, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4715980
Recommendation: Provable Observation Noise Robustness for Neural Network Control Systems — R0/PR4
(2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr4
Review: Provable Observation Noise Robustness for Neural Network Control Systems — R0/PR3
(2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr3
Review: Provable Observation Noise Robustness for Neural Network Control Systems — R0/PR2
(2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr2
Author comment: Provable Observation Noise Robustness for Neural Network Control Systems — R0/PR1
Krish, V. (2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr1
Author comment: Provable Observation Noise Robustness for Neural Network Control Systems — R1/PR5
Krish, V. (2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr5
Decision: Provable Observation Noise Robustness for Neural Network Control Systems — R1/PR6
(2023) · Research Directions Cyber-Physical Systems · doi:10.1017/cbp.2023.5.pr6
Ökolopoly: Case Study on Large Action Spaces in Reinforcement Learning
Engelhardt, R. C., Raycheva, R., Lange, M., Wiskott, L., & Konen, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53966-4_9
Cheang, R. M. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.3.2023.tde-15022024-105731
José, M. M. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.3.2023.tde-01032024-105105
A Theory of Non-acyclic Generative Flow Networks
Brunswic, L. M., Li, Y., Xu, Y., Feng, Y., Jui, S., & Ma, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28989
Iskandar, A., & Kovács, B. (2024) · INTELIGENCIA ARTIFICIAL · doi:10.4114/intartif.vol27iss73pp163-176 · Cited by 1
Robust and scalable deep learning for cyber-physical systems
Esfandiari, Y. (2021) · doi:10.31274/td-20240329-644
Szilágyi, R. (2024) · Rendvédelem · doi:10.53793/rv.2024.1.5 · Cited by 1
(2024) · SciPost Physics Core · doi:10.21468/scipost.report.8570
(2024) · SciPost Physics Core · doi:10.21468/scipost.report.8513
The quantum cartpole: A benchmark environment for non-linear reinforcement learning
Meinerz, K., Trebst, S., Rudner, M. S., & van Nieuwenburg, E. (2024) · SciPost Physics Core · doi:10.21468/scipostphyscore.7.2.026
Isolated Q-learning for Offline Reinforcement LearningPreprint
Zhang, H., & Han, X. (2024) · Research Square · doi:10.21203/rs.3.rs-4355902/v1
Optimal Operation of Cryogenic Calorimeters Through Deep Reinforcement Learning
Angloher, G., Banik, S., Benato, G., Bento, A., Bertolini, A., Breier, R., Bucci, C., Burkhart, J., Canonica, L., D’Addabbo, A., et al. (2024) · Computing and Software for Big Science · doi:10.1007/s41781-024-00119-y
Mitigating Value Hallucination in Dyna-Style Planning via Multistep Predecessor Models
Aminmansour, F., Jafferjee, T., Imani, E., Talvitie, E. J., Bowling, M., & White, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15155 · Cited by 9
Robust Average-Reward Reinforcement Learning
Wang, Y., Velasquez, A., Atia, G., Prater-Bennette, A., & Zou, S. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15451
Metadata
- Authors
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.01540
- OpenAlex
- W4394666657
- Cited by
- 582
- References
- 0
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 93 · 2023: 149 · 2022: 119 · 2021: 82 · 2020: 37 · 2019: 31 · 2018: 24 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- OpenAI Gym, reinforcement learning, benchmark environments, software design, algorithm comparison, research toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
