The DOI matches its DataCite record.
OpenAI Gym
Open accessAbstract
OpenAI Gym is a toolkit for reinforcement learning research. It includes a growing collection of benchmark problems that expose a common interface, and a website where people can share their results and compare the performance of algorithms. This whitepaper discusses the components of OpenAI Gym and the design decisions that went into the software.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SmartPlay takes a suite of benchmarks (Brockman et al., 2016; Hafner, 2021; Fan et al., 2022) developed over different times to best represent a broad range of difficulties and skills.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“SmartPlay follows a unified OpenAI Gym interface (Brockman et al., 2016) for all games, with text-based observations, text-based manuals with content as described in Table 1, text describing historical actions and observations covering past steps of length 'history length', and flat categorical actions.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“For instance, the Open AI Gym [77], one of the most widely used frameworks for reinforcement learning, provides multiple environments for dexterous manipulation.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [77]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“However, much current RL research works on benchmarks such as Atari (Bellemare et al., 2013) and MuJoCo (E. Todorov et al., 2012; Brockman et al., 2016), which do not have the attributes described above: they evaluate the policy on exactly the same environment it was trained on, which often does not match with real-world scenarios (Fig. 1 left column).”
From A Survey of Zero-shot Generalisation in Deep Reinforcement Learning (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Our environment implementation is based on PettingZoo [24] and OpenAI Gym [5].”
From NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds (2024) · cites this paper as [5]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 101–200 of 626
DeepSynth: Automata Synthesis for Automatic Task Segmentation in Deep Reinforcement Learning
Hasanbeig, M., Jeppu, N. Y., Abate, A., Melham, T., & Kroening, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16935 · Cited by 17
Temporal-Logic-Based Reward Shaping for Continuing Reinforcement Learning Tasks
Jiang, Y., Bharadwaj, S., Wu, B., Shah, R., Topcu, U., & Stone, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16975 · Cited by 39
Inclined Quadrotor Landing using Deep Reinforcement Learning
Kooi, J. E., & Babuška, R. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636096 · Cited by 41
AI Thinking for Cloud Education Platform with Personalized Learning
Rad, P., Roopaei, M., Beebe, N. L., Shadaram, M., & Au, Y. A. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.003 · Cited by 40
Automation of membrane capacitive deionization process using reinforcement learning
Yoon, N., Park, S., Son, M., & Cho, K. H. (2022) · Water Research · doi:10.1016/j.watres.2022.119337 · Cited by 36
Towards a common implementation of reinforcement learning for multiple robotic tasks
Martínez-Tenor, Á., Fernández‐Madrigal, J., Cruz‐Martín, A., & González-Jiménez, J. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.011 · Cited by 36
Lai, K.-H., Zha, D., Li, Y., & Hu, X. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/435 · Cited by 40
Using a half cheetah habitat for random augmentation computing
Kishor, K. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19084-0 · Cited by 35
Expected Policy Gradients for Reinforcement LearningPreprint
Ciosek, K., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.1609/aaai.v32i1.11607 · Cited by 62
Correlation between artificial intelligence in education and teacher self-efficacy beliefs: a review
Bedirhan Berk, O. R. A. N. (2023) · RumeliDE Dil ve Edebiyat Araştırmaları Dergisi :/RumeliDe Dil ve Edebiyat Araştırmaları Dergisi · doi:10.29000/rumelide.1316378 · Cited by 43
Multi-Sacle Dynamic Coding Improved Spiking Actor Network for Reinforcement Learning
Zhang, D., Zhang, T., Jia, S., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19879 · Cited by 34
Li, R., & Zou, Z. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102140 · Cited by 35
Creating valid adversarial examples of malware
Kozák, M., Jureček, M., Stamp, M., & Troia, F. D. (2024) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-024-00516-2 · Cited by 34
Policy manifold search: exploring the manifold hypothesis for diversity-based neuroevolution
Rakicevic, N., Cully, A., & Kormushev, P. (2021) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3449639.3459320 · Cited by 32
TRUST-REGION BASED POLICY OPTIMIZATION FOR EFFICIENT REINFORCEMENT LEARNING
Li, H. (2023) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-li-hepfeng-2023 · Cited by 32
Advances and challenges in learning from experience replay
Neves, D. E., Ishitani, L., & Patrocínio, Z. K. G. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-11062-0 · Cited by 31
FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation
Heo, M., Lee, Y., Lee, D., & Lim, J. J. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.041 · Cited by 30
Search-Based Testing of Reinforcement Learning
Tappler, M., Cano, F., Aichernig, B. K., & Könighofer, B. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/72 · Cited by 36
Gym-Ignition: Reproducible Robotic Simulations for Reinforcement Learning
Ferigo, D., Traversaro, S., Giorgio Metta, B., & Pucci, D. (2020) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii46433.2020.9025951 · Cited by 33
Safe Reinforcement Learning via Statistical Model Predictive Shielding
Bastani, O., & Li, S. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.026 · Cited by 35
Trust Region Evolution Strategies
Liu, G., Zhao, L., Yang, F., Bian, J., Qin, T., Yu, N., & Liu, T. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014352 · Cited by 30
A structural model of student continuance intentions in ChatGPT adoption
Saxena, A., & Doleck, T. (2023) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/13839 · Cited by 37
PPO-Clip Attains Global Optimality: Towards Deeper Understandings of Clipping
Huang, N.-C., Hsieh, P.-C., Ho, K.-H., & Wu, I. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29154 · Cited by 32
Embodied Visual Active Learning for Semantic Segmentation
Nilsson, D., Pirinen, A., Gärtner, E., & Sminchisescu, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16338 · Cited by 2
Learning Control Policies for Stochastic Systems with Reach-Avoid Guarantees
Žikelić, Đ., Lechner, M., Henzinger, T. A., & Chatterjee, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26407 · Cited by 27
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
Qualitative Measurements of Policy Discrepancy for Return-Based Deep Q-Network
Meng, W., Zheng, Q., Yang, L., Li, P., & Pan, G. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2948892 · Cited by 28
Self-Supervised Attention-Aware Reinforcement Learning
Wu, H., Khetarpal, K., & Precup, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17235 · Cited by 26
Revisiting State Augmentation methods for Reinforcement Learning with Stochastic Delays
Nath, S., Baranwal, M., & Khadilkar, H. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482386 · Cited by 32
Amrouni, S., Moulin, A., Vann, J., Vyetrenko, S., Balch, T. R., & Veloso, M. (2021) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3490354.3494433 · Cited by 26
Stability Verification in Stochastic Control Systems via Neural Network Supermartingales
Lechner, M., Žikelić, Đ., Chatterjee, K., & Henzinger, T. A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20695 · Cited by 25
Survey on Evaluation of LLM-based Agents
Yehudai, A., Eden, L., Li, A., Uziel, G., Zhao, Y., Bar-Haim, R., Cohan, A., & Shmueli-Scheuer, M. (2025) · arXiv · doi:10.48550/arxiv.2503.16416 · Cited by 26
Generalization in transfer learning: robust control of robot locomotion
Ada, S. E., Uğur, E., & Akın, H. L. (2022) · Robotica · doi:10.1017/s0263574722000625 · Cited by 34
Robust Reinforcement Learning as a Stackelberg Game via Adaptively-Regularized Adversarial Training
Huang, P., Xu, M., Fang, F., & Zhao, D. X. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/430 · Cited by 25
Structure in Deep Reinforcement Learning: A Survey and Open Problems
Mohan, A., Zhang, A., & Lindauer, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15703 · Cited by 38
Boutahri, Y., & Tilioua, A. (2025) · Discover Computing · doi:10.1007/s10791-025-09544-y · Cited by 26
Evolutionary reinforcement learning of dynamical large deviations
Whitelam, S., Jacobson, D., & Tamblyn, I. (2020) · The Journal of Chemical Physics · doi:10.1063/5.0015301 · Cited by 24
Kathirgamanathan, A., Twardowski, K., Mangina, E., & Finn, D. (2020) · doi:10.1145/3427773.3427869 · Cited by 24
Conservative and Adaptive Penalty for Model-Based Safe Reinforcement Learning
Ma, Y. J., Shen, A., Bastani, O., & Dinesh, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20478 · Cited by 24
Exploration of Artificial-intelligence Oriented Power System Dynamic Simulators
Xiao, T., Chen, Y., Wang, J., Huang, S., Tong, W., & He, T. (2023) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2022.000099 · Cited by 24
Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks
von Wahl, L., Tempelmeier, N., Sao, A., & Demidova, E. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539154 · Cited by 24
Multi-Objective Evolutionary Architecture Search for Parameterized Quantum Circuits
Ding, L., & Spector, L. C. (2023) · Entropy · doi:10.3390/e25010093 · Cited by 26
Toward robust and scalable deep spiking reinforcement learning
Akl, M., Ergene, D., Walter, F., & Knoll, A. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.1075647 · Cited by 27
Task-Agnostic Exploration via Policy Gradient of a Non-Parametric State Entropy Estimate
Mutti, M., Pratissoli, L., & Restelli, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17091 · Cited by 12
Benchmarking Projective Simulation in Navigation Problems
Melnikov, A. A., Makmal, A., & Briegel, H. J. (2018) · IEEE Access · doi:10.1109/access.2018.2876494 · Cited by 26
Theoretically Principled Deep RL Acceleration via Nearest Neighbor Function Approximation
Shen, J.-H., & Yang, L. F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17151 · Cited by 26
A Brief Study of Deep Reinforcement Learning with Epsilon-Greedy Exploration
Hariharan, N., & Paavai Anand, G. (2022) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/110144 · Cited by 25
Shen, W., He, X., Zhang, C., Ni, Q., Dou, W., & Wang, Y. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411913 · Cited by 23
Mean-Variance Policy Iteration for Risk-Averse Reinforcement Learning
Zhang, S., Liu, B., & Whiteson, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17302 · Cited by 31
Exploration by Distributional Reinforcement Learning
Tang, Y., & Agrawal, S. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/376 · Cited by 22
Verifying Reinforcement Learning up to Infinity
Bacci, E., Giacobbe, M., & Parker, D. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/297 · Cited by 22
EvoJAX: hardware-accelerated neuroevolution
Tang, Y.-J., Tian, Y., & Ha, D. (2022) · GECCO Companion · doi:10.1145/3520304.3528770 · Cited by 60
Millidge, B. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kf6wc · Cited by 25
Illustrated tutorial on global optimization in nanophotonics
Bennet, P., Langevin, D., Essoual, C., Khaireh-Walieh, A., Teytaud, O., Wiecha, P. R., & Moreau, A. (2024) · Journal of the Optical Society of America B · doi:10.1364/josab.506389 · Cited by 21
Sarkar, S., Gundecha, V., Shmakov, A., Ghorbanpour, S., Babu, A. R., Faraboschi, P., Cocho, M., Pichard, A., & Fiévez, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21473 · Cited by 22
Chen, X., Diao, D., Chen, H., Yao, H., Piao, H., Sun, Z., Yang, Z., Goebel, R. G., Jiang, B., & Chang, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25864 · Cited by 24
Iterative Bounding MDPs: Learning Interpretable Policies via Non-Interpretable Methods
Topin, N., Milani, S., Fang, F., & Veloso, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17192 · Cited by 20
Optimistic reinforcement learning by forward Kullback–Leibler divergence optimization
Kobayashi, T. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.04.021 · Cited by 23
Space-Based Sensor Tasking Using Deep Reinforcement Learning
Siew, P. M., Jang, D., Roberts, T. G., & Linares, R. (2022) · The Journal of the Astronautical Sciences · doi:10.1007/s40295-022-00354-8 · Cited by 20
Explainable Reinforcement Learning via a Causal World Model
Yu, Z., Ruan, J., & Xing, D. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/505 · Cited by 40
Kim, S., Park, J. M., Yun, J.-K., & Seo, J. (2020) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.23919/iccas50221.2020.9268253 · Cited by 19
Autonomous Management of Energy-Harvesting IoT Nodes Using Deep Reinforcement Learning
Murad, A., Kraemer, F. A., Bach, K., & Taylor, G. (2019) · NORA - Norwegian Open Research Archives · Cited by 19
Robotic Table Tennis: A Case Study into a High Speed Learning System
D’Ambrosio, D. B., Jaitly, N., Sindhwani, V., Oslund, K., Xu, P., Lazic, N., Shankar, A., Ding, T., Abelian, J., Coumans, E., et al. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.006 · Cited by 31
Jet grooming through reinforcement learning
Carrazza, S., & Dreyer, F. A. (2019) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.100.014014 · Cited by 19
Adversarial Imitation Learning from Incomplete Demonstrations
Sun, M., & Ma, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/487 · Cited by 19
Proceedings of Workshop for NLP Open Source Software (NLP-OSS)
(2018) · doi:10.18653/v1/w18-25 · Cited by 19
NeuroGym: An open resource for developing and sharing neuroscience tasksPreprint
Molano‐Mazón, M., Barbosa, J., Pastor‐Ciurana, J., Fradera, M., Zhang, R., Forest, J., Lérida, J. D. P., Li, J., Cueva, C. J., de la Rocha, J., et al. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/aqc9n · Cited by 22
Off-Policy Proximal Policy Optimization
Meng, W., Zheng, Q., Pan, G., & Yin, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26099 · Cited by 30
Revisiting Maximum Entropy Inverse Reinforcement Learning: New Perspectives and Algorithms
Snoswell, A., Singh, S. P. N., & Ye, N. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308391 · Cited by 18
Same State, Different Task: Continual Reinforcement Learning without Interference
Kessler, S., Parker-Holder, J., Ball, P., Zohren, S., & Roberts, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20674 · Cited by 23
Modeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning
Li, Z., Ko, Y.-J., Putkonen, A., Feiz, S., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580640 · Cited by 18
Advances and applications in inverse reinforcement learning: a comprehensive review
Deshpande, S., Walambe, R. A., Kotecha, K. V., Selvachandran, G., & Abraham, A. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11100-0 · Cited by 17
Distributional Reinforcement Learning via Moment Matching
Nguyen-Tang, T., Gupta, S., & Venkatesh, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17104 · Cited by 17
Training a Resilient Q-network against Observational Interference
Yang, C.-H. H., Hung, I.-T. D., Ouyang, Y., & Chen, P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20862 · Cited by 34
Evaluating Deception and Moving Target Defense with Network Attack Simulation
Reti, D., Fraunholz, D., Elzer, K., Schneider, D., & Schotten, H. D. (2022) · ACM Workshop on Moving Target Defense (MTD) · doi:10.1145/3560828.3564006 · Cited by 17
Energy-Aware Adaptive Sampling for Self-Sustainability in Resource-Constrained IoT Devices
Giordano, M., Cortesi, S., Mekikis, P., Crabolu, M., Bellusci, G., & Magno, M. (2023) · International Workshop on Energy Harvesting & Energy-Neutral Sensing Systems (ENSsys) · doi:10.1145/3628353.3628545 · Cited by 24
Out of the Cage: How Stochastic Parrots Win in Cyber Security Environments
Rigaki, M., Lukáš, O., Catania, C., & Garcia, S. (2024) · Proceedings of the 16th International Conference on Agents and Artificial Intelligence · doi:10.5220/0012391800003636 · Cited by 17
Self-Adaptive Double Bootstrapped DDPG
Zheng, Z., Yuan, C., Lin, Z., Cheng, Y., & Wu, H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/444 · Cited by 19
On Principled Entropy Exploration in Policy Optimization
Mei, J., Xiao, C., Huang, R., Schuurmans, D., & Müller, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/434 · Cited by 16
Krishnan, N. N., Torkildson, E. G., Mandayam, N. B., Raychaudhuri, D., Rantala, E.-H., & Doppler, K. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2942917 · Cited by 18
Adversarial Robust Deep Reinforcement Learning Requires Redefining Robustness
Korkmaz, E. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26009 · Cited by 16
Wang, S., & Li, K. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29488 · Cited by 16
Optical Networking Gym: an open-source toolkit for resource assignment problems in optical networks
Natalino, C., Magalhães, T., Arpanaei, F., Lobato, F. R. L., Costa, J. C. W. A., Hernández, J. A., & Paolo Monti, A. (2024) · Journal of Optical Communications and Networking · doi:10.1364/jocn.532850 · Cited by 16
Employing deep reinforcement learning for machining process planning: An improved framework
Zhang, H., Wang, Y., Wang, Y., Zhang, Y., Zhou, J., Huang, B., & Zhang, S. (2024) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2024.12.010 · Cited by 17
Generation of ice states through deep reinforcement learning
Zhao, K.-W., Kao, W.-H., Wu, K.-H., & Kao, Y.-J. (2019) · Physical review. E · doi:10.1103/physreve.99.062106 · Cited by 15
Azizsoltani, H., Kim, Y. J., Ausin, M. S., Barnes, T. M., & Chi, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/273 · Cited by 16
Wang, Z., & Taylor, M. E. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/530 · Cited by 16
Learning Interpretable, High-Performing Policies for Autonomous Driving
Paleja, R., Niu, Y., Silva, A., Ritchie, C., Choi, S., & Gombolay, M. (2022) · Robotics: Science and Systems · doi:10.15607/rss.2022.xviii.068 · Cited by 15
Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies
Capobianco, R., Kompella, V. R., Ault, J., Sharon, G., Jong, S., Fox, S. J., Meyers, L. A., Wurman, P. R., & Stone, P. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12632 · Cited by 15
Estimation Error Correction in Deep Reinforcement Learning for Deterministic Actor-Critic Methods
Sağlam, B., Duran, E., Cicek, D. C., Mutlu, F. B., & Kozat, S. S. (2021) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai52525.2021.00027 · Cited by 15
Robustness and Consistency in Linear Quadratic Control with Untrusted Predictions
Li, T., Yang, R., Qu, G., Shi, G., Yu, C., Wierman, A., & Low, S. H. (2022) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3508038 · Cited by 15
Rethinking chemical research in the age of large language models
MacKnight, R., Boiko, D. A., Regio, J. E., Gallegos, L. C., Neukomm, T. A., & Gomes, G. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00811-y · Cited by 26
CoBeL-RL: A neuroscience-oriented simulation framework for complex behavior and learning
Diekmann, N., Vijayabaskaran, S., Zeng, X., Kappel, D., Menezes, M. C., & Cheng, S. (2023) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2023.1134405 · Cited by 15
Visual Transfer For Reinforcement Learning Via Wasserstein Domain Confusion
Roy, J., & Konidaris, G. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17139 · Cited by 14
Parák, R., & Matoušek, R. (2021) · MENDEL · doi:10.13164/mendel.2021.1.001 · Cited by 15
Generalization to New Actions in Reinforcement Learning
Jain, A., Szot, A., & Lim, J. J. (2020) · arXiv · doi:10.48550/arxiv.2011.01928 · Cited by 14
“All the environments were developed using the OpenAI Gym interface (Brockman et al., 2016).”
MethodSim-to-Real in Reinforcement Learning for Everyone
Vacaro, J., Marques, G., Oliveira, B., Paz, G., Paula, T., Staehler, W., & Murphy, D. (2019) · 2019 Latin American Robotics Symposium (LARS), 2019 Brazilian Symposium on Robotics (SBR) and 2019 Workshop on Robotics in Education (WRE) · doi:10.1109/lars-sbr-wre48964.2019.00060 · Cited by 13
Deep Reinforcement Learning Policies Learn Shared Adversarial Features across MDPs
Korkmaz, E. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20684 · Cited by 14
Learning Environmental Calibration Actions for Policy Self-Evolution
Zhang, C., Yu, Y., & Zhou, Z. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/425 · Cited by 13
Data-efficient Neuroevolution with Kernel-Based Surrogate Models
Gaier, A., Asteroth, A., & Mouret, J.-B. (2018) · Publication Server of Bonn-Rhein-Sieg University of Applied Sciences (Bonn-Rhein-Sieg University of Applied Sciences) · Cited by 13
Metadata
- Authors
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.01540
- OpenAlex
- W4394666657
- Cited by
- 582
- References
- 0
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 93 · 2023: 149 · 2022: 119 · 2021: 82 · 2020: 37 · 2019: 31 · 2018: 24 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- OpenAI Gym, reinforcement learning, benchmark environments, software design, algorithm comparison, research toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
