The DOI matches its DataCite record.
OpenAI Gym
Open accessAbstract
OpenAI Gym is a toolkit for reinforcement learning research. It includes a growing collection of benchmark problems that expose a common interface, and a website where people can share their results and compare the performance of algorithms. This whitepaper discusses the components of OpenAI Gym and the design decisions that went into the software.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SmartPlay takes a suite of benchmarks (Brockman et al., 2016; Hafner, 2021; Fan et al., 2022) developed over different times to best represent a broad range of difficulties and skills.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“SmartPlay follows a unified OpenAI Gym interface (Brockman et al., 2016) for all games, with text-based observations, text-based manuals with content as described in Table 1, text describing historical actions and observations covering past steps of length 'history length', and flat categorical actions.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“For instance, the Open AI Gym [77], one of the most widely used frameworks for reinforcement learning, provides multiple environments for dexterous manipulation.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [77]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“However, much current RL research works on benchmarks such as Atari (Bellemare et al., 2013) and MuJoCo (E. Todorov et al., 2012; Brockman et al., 2016), which do not have the attributes described above: they evaluate the policy on exactly the same environment it was trained on, which often does not match with real-world scenarios (Fig. 1 left column).”
From A Survey of Zero-shot Generalisation in Deep Reinforcement Learning (2023) · cites this paper as Brockman et al., 2016
In the citing paper
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
In the citing paper
“Our environment implementation is based on PettingZoo [24] and OpenAI Gym [5].”
From NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds (2024) · cites this paper as [5]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 401–500 of 626
Transferable Curricula through Difficulty Conditioned Generators
Tio, S., & Varakantham, P. R. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/543 · Cited by 5
Exploration and Exploitation in Hierarchical Reinforcement Learning with Adaptive Scheduling
Huang, Z., & Liu, Q. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230386 · Cited by 2
Reinforcement Learning for Bandits with Continuous Actions and Large Context Spaces
Duckworth, P., Vallis, K. A., Lacerda, B., & Hawes, N. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230320 · Cited by 2
Harel, Y., Pinsard, B., Boyle, J. A., Borghesani, V., Clei, M. L., Mignot, P.-H., St‐Laurent, M., Jerbi, K., & Bellec, P. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1256 · Cited by 2
A Study on Reinforcement Learning based Control of Quadcopter with a Cable-suspended Payload
Prajapati, P., Patidar, A., & Vashista, V. (2023) · Advances in Robotics - International Conference of The Robotics Society (AIR) · doi:10.1145/3610419.3610494 · Cited by 2
AngoraPy: A Python toolkit for modeling anthropomorphic goal-driven sensorimotor systems
Weidler, T., Goebel, R., & Senden, M. (2023) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2023.1223687 · Cited by 2
Otonom araçlarda derin pekiştirmeli öğrenme yöntemleri ile sollama
Köylü, F., & ATILKAN, Y. (2023) · Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.28948/ngumuh.1331354 · Cited by 2
Parameterized Projected Bellman Operator
Vincent, T., Metelli, A. M., Belousov, B., Peters, J., Restelli, M., & D’Eramo, C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29465 · Cited by 2
USN: A Robust Imitation Learning Method against Diverse Action Noise
Yu, X., Han, B., & Tsang, I. W.-H. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15819 · Cited by 2
Kuo, C. (2024) · International Journal of Automation and Smart Technology · doi:10.5875/p25fht10 · Cited by 2
Tesseract Core: Universal, autodiff-native software components for Simulation Intelligence
Häfner, D., & Lavin, A. (2025) · The Journal of Open Source Software · doi:10.21105/joss.08385 · Cited by 2
Chakraborty, S., Bedi, A. S., Tokekar, P., Koppel, A., Sadler, B. M., Huang, F., & Manocha, D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25853 · Cited by 2
Expert-guided Symmetry Detection in Markov Decision Processes
Angelotti, G., Drougard, N., & Chanel, C. P. C. (2022) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0010783400003116 · Cited by 2
Gan, Y., Zhang, Z., & Tan, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20620 · Cited by 2
Multi-Task Reinforcement Meta-Learning in Neural Networks
Shakah, G. H. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130734 · Cited by 2
graphenv: a Python library for reinforcement learning on graph search spaces
Biagioni, D., Tripp, C. E., Clark, S., Duplyakin, D., Law, J., & John, P. C. S. (2022) · The Journal of Open Source Software · doi:10.21105/joss.04621 · Cited by 2
Deep Reinforcement Learning Models for Automated Stock Trading
Singh, S., Goyal, V., Goel, S., & Taneja, H. C. (2022) · Advances in transdisciplinary engineering · doi:10.3233/atde220738 · Cited by 2
Ferigo, A., & Iacca, G. (2023) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3583133.3590531 · Cited by 3
Zhadan, A., Wu, H., Сергеевич, К. П., Zhang, Y., & Petrosian, O. (2023) · Vestnik of Saint Petersburg University Applied Mathematics Computer Science Control Processes · doi:10.21638/11701/spbu10.2023.307 · Cited by 2
Graph Neural Network Policies and Imitation Learning for Multi-Domain Task-Oriented Dialogues
Cordier, T., Urvoy, T., Lefèvre, F., & Rojas-Barahona, L. M. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.10 · Cited by 9
Experience Replay Optimization via ESMM for Stable Deep Reinforcement Learning
Osei, R. S., & Lopez, D. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150171 · Cited by 2
Learning Uncertainty-Aware Temporally-Extended Actions
Lee, J., Park, S. J., Tang, Y., & Oh, M.-H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29241 · Cited by 2
Double Buffers CEM-TD3: More Efficient Evolution and Richer Exploration
Zhu, S., Shen, C., Lü, S., Wu, J., & An, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29665 · Cited by 2
Control in Stochastic Environment with Delays: A Model-based Reinforcement Learning Approach
Yao, Z., Florescu, I., & Lee, C. (2024) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v34i1.31529 · Cited by 2
Gridworld Architecture Testbed
Kotov, A., & Vukorep, I. (2021) · eCAADe proceedings · doi:10.52842/conf.ecaade.2021.1.037 · Cited by 2
Interpolated Experience Replay for Continuous Environments
von Pilchau, W. P., Stein, A., & Hähner, J. (2022) · International Joint Conference on Computational Intelligence · doi:10.5220/0011326900003332 · Cited by 2
Virtual Robot Climbing using Reinforcement Learning
Garg, U. (2018) · doi:10.31979/etd.u9xe-s6yw · Cited by 2
Adversarial robustness of deep reinforcement learning
Qu, X. (2021) · doi:10.32657/10356/154587 · Cited by 2
Learning to Navigate Through Reinforcement Across the Sim2Real GapPreprint
Azzam, R., Chehadeh, M. S., Hay, O. A., Boiko, I. M., & Zweiri, Y. (2022) · doi:10.36227/techrxiv.20138960 · Cited by 2
Open design and validation of a reproducible videogame controller for MRI and MEGPreprint
Harel, Y., Cyr, A., Boyle, J. A., Pinsard, B., Bernard, J., Fourcade, M.-F., Aggarwal, H., Ponce, A. F., Thirion, B., Jerbi, K., et al. (2022) · doi:10.31234/osf.io/m2x6y · Cited by 2
Brain Inspired Computing: A Systematic Survey and Future TrendsPreprint
Li, G., Deng, L., Tang, H., Pan, G., Tian, Y., Roy, K., & Maass, W. (2023) · doi:10.36227/techrxiv.21837027 · Cited by 2
PAC-Bayesian Soft Actor-Critic LearningPreprint
Tasdighi, B., Akgül, A., Haußmann, M., Brink, K. K., & Kandemir, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.12776 · Cited by 6
Reverse-engineering the selfPreprint
Paul, L. A., Ullman, T. D., Freitas, J. D., & Tenenbaum, J. B. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/vzwrn · Cited by 2
Contribution to the modelling and evaluation of radio network slicing solutions in 5G
Vilà, I. (2022) · doi:10.5821/dissertation-2117-367549 · Cited by 2
Enhanced Resilience in Battery Charging through Co-Simulation with Reinforcement LearningPreprint
Seyedi, M., Sheida, K., Siner, S., & Ferdowsi, F. (2024) · doi:10.36227/techrxiv.170846720.02245839/v1 · Cited by 2
Rapid Open-World Adaptation by Adaptation Principles LearningPreprint
Xue, C., Nikonova, E., Zhang, P., & Renz, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4778438 · Cited by 2
SmartPlay: A Benchmark for LLMs as Intelligent Agents
Wu, Y., Tang, X., Mitchell, T. M., & Li, Y. (2023) · arXiv · doi:10.48550/arxiv.2310.01557 · Cited by 6
Environment Complexity and Nash Equilibria in a Sequential Social Dilemma
Yasir, M., Howes, A., Mavroudis, V., & Hicks, C. (2024) · arXiv · doi:10.48550/arxiv.2408.02148 · Cited by 1
Optimal Sizing of Integrated Community Energy Systems Considering Equity Constraints
Gehbauer, C., Wu, Y., Brown, J., & Sohn, M. D. (2022) · ASHRAE/IBPSA-USA Building Simulation Conference · doi:10.26868/25746308.2022.c025 · Cited by 1
Deep Reinforcement Learning for Tehran Stock Trading
Yousefi, N. (2022) · Journal of Novel Engineering Science and Technology · doi:10.56741/jnest.v1i02.171 · Cited by 1
Learning Noise-Induced Reward Functions for Surpassing Demonstrations in Imitation Learning
Huo, L., Wang, Z., & Xu, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25962 · Cited by 1
Benchmarking Neuromorphic Computing for Inference
Narduzzi, S., Mateu, L., Jokic, P., Azarkhish, E., & Dunbar, A. L. (2023) · River Publishers eBooks · doi:10.1201/9781003377382-1 · Cited by 1
Mukhopadhyay, R., Sutradhar, A., & Chattopadhyay, P. (2024) · International Journal of Dynamics and Control · doi:10.1007/s40435-024-01407-6 · Cited by 1
Optimal design of frame structures equipped with viscous dampers using machine learning techniques
Wen, Y., Wang, J., Xu, J., Dai, K., Shi, Y., & Sharbati, R. (2025) · Journal of Asian Architecture and Building Engineering · doi:10.1080/13467581.2025.2481244 · Cited by 1
PyDSMC: Statistical Model Checking for Neural Agents Using the Gymnasium Interface
Gros, T. P., Hartmanns, A., Hoese, I., Meyer, J., Müller, N. J., & Wolf, V. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05792-1_8 · Cited by 1
Farooq, M. U., Ahmed, N., Muneeb, M. Y., & Chen, F. (2026) · Nanoscale · doi:10.1039/d5nr04468e · Cited by 1
Deep Reinforcement Learning Agent for Playing 2D Shooting Games
Lee, D., & McNair, J. Y. (2018) · International Journal of Control and Automation · doi:10.14257/ijca.2018.11.3.17 · Cited by 1
The Temporal Singularity: Time-Accelerated Simulated Civilizations and Their Implications
Spigler, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-97676-1_20 · Cited by 1
Learning to Reweight Imaginary Transitions for Model-Based Reinforcement Learning
Huang, W., Yin, Q., Zhang, J., & Huang, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16958 · Cited by 2
State-Based Recurrent SPMNs for Decision-Theoretic Planning under Partial Observability
Hayes, L., Doshi, P., Pawar, S., & Tatavarti, H. T. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/348 · Cited by 1
Energy-efficient parking analytics system using deep reinforcement learning
Rezaei, Y., Lee, S., & Mossé, D. (2021) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3486611.3486660 · Cited by 1
Minimal neural network models for permutation invariant agents
Pedersen, J. W., & Risi, S. (2022) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3512290.3528839 · Cited by 2
Ondula, E. A., & Krishnamachari, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21649 · Cited by 1
Aprendizado por Reforço e Jogos: uma proposta focada na análise de algoritmos
da Costa, D. B., Lucca, G., & Adamatti, D. F. (2022) · Revista Brasileira de Computação Aplicada · doi:10.5335/rbca.v14i2.12500 · Cited by 1
Error driven synapse augmented neurogenesis
Perrett, A., Furber, S. B., & Rhodes, O. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.949707 · Cited by 1
Learning by Demonstration of Coordinated Plans in Multiagent Systems
Simões, M. A. C., & Nogueira, T. M. (2022) · doi:10.5753/wtdr_ctdr.2022.227372 · Cited by 1
Angelotti, G., Drougard, N., & Chanel, C. P. C. (2023) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0011633400003393 · Cited by 1
Adaptive Estimation Q-learning with Uncertainty and Familiarity
Gong, X., Lü, S., Yu, J., Zhu, S., & Li, Z. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/417 · Cited by 1
Hierarchical Apprenticeship Learning for Disease Progression Modeling
Yang, X., Gao, G., & Chi, M. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/265 · Cited by 2
Jardim, R. R.-A. J. (2023) · Springer eBooks · doi:10.1007/978-3-031-37345-9_1 · Cited by 1
BiERL: A Meta Evolutionary Reinforcement Learning Framework via Bilevel Optimization
Wang, J., Zhu, Y., Wang, Z., Zheng, Y., Hao, J., & Chen, C. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230551 · Cited by 1
CCPO: Conservatively Constrained Policy Optimization Using State Augmentation
Wang, Z., Shi, X., Ma, C., Wu, L., & Wu, J. X. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230566 · Cited by 1
Automatically Defining Game Action Spaces for Exploration Using Program Analysis
Volokh, S., & Halfond, W. G. J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v19i1.27510 · Cited by 1
Wang, R., Todd, G., Yuan, X., Xiao, Z., Côté, M.-A., & Jansen, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.830 · Cited by 17
Glover, T. E., Lind, P. G., Yazidi, A., Osipov, E., & Nichele, S. (2023) · Complex Systems · doi:10.25088/complexsystems.32.3.309 · Cited by 2
Inteligência artificial na educação: aliada ou ameaça para o professor?
da Silva, A. V. V., & Costa, A. (2024) · Cuadernos de Educación y Desarrollo · doi:10.55905/cuadv16n1-164 · Cited by 2
Jiang, Y. (2024) · Advances in transdisciplinary engineering · doi:10.3233/atde231322 · Cited by 1
Unsupervised Training Sequence Design: Efficient and Generalizable Agent Training
Li, W., & Varakantham, P. R. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29268 · Cited by 1
A Comparative Analysis of Visual Odometry in Virtual and Real-World Railways Environments
D’Amico, G., Marinoni, M., & Buttazzo, G. (2024) · Civil-comp conferences · doi:10.4203/ccc.7.8.10 · Cited by 1
The Cost of Behavioral Flexibility: Reversal Learning Driven by a Spiking Neural Network
Ghazinouri, B., & Cheng, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71533-4_23 · Cited by 1
TAVARES, M. A. A., & Veloso, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71993-6_9 · Cited by 1
Towards Unified Probabilistic Verification and Validation of Vision-Based Autonomy
Peper, J., Yan, M., Mitra, S., & Ruchkin, I. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-08707-2_11 · Cited by 1
Aguilera, M., & Bedía, M. G. (2017) · European Conference on Artificial Life · doi:10.7551/ecal_a_009 · Cited by 2
Autonomous learning of features for control: Experiments with embodied and situated agents
Milano, N., & Nolfi, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250040 · Cited by 1
Reward-Free Reinforcement Learning Algorithm Using Prediction Network
Yu, Z., Feng, Y., & Liu, L. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200744 · Cited by 1
A Stochastic Composite Augmented Lagrangian Method for Reinforcement Learning
Li, Y., Zhao, M., Chen, W., & Wen, Z. (2023) · SIAM Journal on Optimization · doi:10.1137/21m1421726 · Cited by 1
Explainable Artificial Intelligence For Robot Arm Control
Schwaiger, S., Aburaia, M., Aburaia, A., & Wöber, W. (2021) · Annals of DAAAM for ... & proceedings of the ... International DAAAM Symposium · doi:10.2507/32nd.daaam.proceedings.090 · Cited by 1
Multi-policy Grounding and Ensemble Policy Learning for Transfer Learning with Dynamics Mismatch
Lee, H.-R., Sreenivasan, R. A., Jeong, Y., Jang, J., Shim, D., & Lee, C.-G. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/440 · Cited by 1
Chen, G., & Huang, V. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/391 · Cited by 1
End-to-End Visual Obstacle Avoidance for a Robotic Manipulator using Deep Reinforcement Learning
Sanches, F. P. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.55.2021.tde-30082021-100712 · Cited by 1
Learning in Sparse Rewards settings through Quality-Diversity algorithmsPreprint
Paolo, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.01027 · Cited by 1
Kadi, H. A., & Terzić, K. (2022) · Preprints.org · doi:10.20944/preprints202212.0305.v1 · Cited by 1
Reinforcement Learning in Noise Enabled Simulated EnvironmentPreprint
Varghese, T. G., & Sherif, B. V. (2023) · Research Square · doi:10.21203/rs.3.rs-2478826/v1 · Cited by 1
Reversible and irreversible bracket-based dynamics for deep graph neural networksPreprint
Gruber, A., Lee, K., & Trask, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.15616 · Cited by 1
Viroonluecha, P. (2023) · doi:10.31428/10317/12437 · Cited by 1
CoRe Optimizer: An All-in-One Solution for Machine LearningPreprint
Eckhoff, M., & Reiher, M. (2023) · arXiv (Cornell University) · doi:10.3929/ethz-b-000658265 · Cited by 1
Network Flow Optimization Using Reinforcement Learning
Wu, C.-C. (2023) · doi:10.54337/aau547738179 · Cited by 2
Ayyalasomayajula, S. (2023) · doi:10.15760/etd.3607 · Cited by 1
Enhancing Exploration in Actor-Critic Algorithms:An Approach to Incentivize Plausible Novel StatesPreprint
Banerjee, C., Chen, Z., & Noman, N. (2023) · doi:10.36227/techrxiv.24631455 · Cited by 1
Lifelong AI-driven zero-touch network slicing
Rezazadeh, F. (2023) · doi:10.5821/dissertation-2117-404782 · Cited by 1
Controllability-Constrained Deep Neural Network Models for Enhanced Control of Dynamical Systems
Sharma, S. (2023) · doi:10.31979/etd.jhc8-t9gj · Cited by 1
Weidler, T. (2024) · Research Publications (Maastricht University) · doi:10.26481/dis.20250110tw · Cited by 1
Neural MMO 2.0: A Massively Multi-task Addition to Massively Multi-agent Learning
Suarez, J., Bloomin, D., Choe, K. W., Li, H. X., Sullivan, R., Kanna, N., Scott, D., Shuman, R., Bradley, H., Castricato, L., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2178 · Cited by 1
Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
Kapoor, S., Stroebl, B., Kirgis, P., Nadgir, N., Siegel, Z. S., Wei, B., Xue, T., Chen, Z., Chen, F., Utpala, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.11977
A Perspective on Open Challenges in Deformable Object Manipulation
McKennaa, R. P., & Oyekan, J. (2026) · arXiv · doi:10.48550/arxiv.2602.22998 · Cited by 1
Leveraging Sequentiality in Reinforcement Learning from a Single Demonstration
Chenu, A., Serris, O., Sigaud, O., & Perrin-Gilbert, N. (2022) · arXiv · doi:10.48550/arxiv.2211.04786
“We evaluate DCIL-II in five environments: the Dubins Maze environment [23], the Fetch environment [18], two variants of the Humanoid environment from the OpenAI Gym Mujoco suite [45] [46] and the Cassie Run environment based on [47].”
Improving Environment Novelty Quantification for Effective Unsupervised Environment Design
Teoh, J., Li, W., & Varakantham, P. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-4300
Metadata
- Authors
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.01540
- OpenAlex
- W4394666657
- Cited by
- 582
- References
- 0
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 93 · 2023: 149 · 2022: 119 · 2021: 82 · 2020: 37 · 2019: 31 · 2018: 24 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- OpenAI Gym, reinforcement learning, benchmark environments, software design, algorithm comparison, research toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
