OpenAI Gym
Open accessAbstract
OpenAI Gym is a toolkit for reinforcement learning research. It includes a growing collection of benchmark problems that expose a common interface, and a website where people can share their results and compare the performance of algorithms. This whitepaper discusses the components of OpenAI Gym and the design decisions that went into the software.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SmartPlay takes a suite of benchmarks developed over different times to best represent a broad range of difficulties and skills.
“SmartPlay takes a suite of benchmarks (Brockman et al., 2016; Hafner, 2021; Fan et al., 2022) developed over different times to best represent a broad range of difficulties and skills.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
SmartPlay follows a unified OpenAI Gym interface for all games, with text-based observations, text-based manuals, text describing historical actions and observations, and flat categorical actions.
“SmartPlay follows a unified OpenAI Gym interface (Brockman et al., 2016) for all games, with text-based observations, text-based manuals with content as described in Table 1, text describing historical actions and observations covering past steps of length 'history length', and flat categorical actions.”
From SmartPlay: A Benchmark for LLMs as Intelligent Agents (2023) · cites this paper as Brockman et al., 2016
OpenAI Gym provides multiple environments for dexterous manipulation.
“For instance, the Open AI Gym [77], one of the most widely used frameworks for reinforcement learning, provides multiple environments for dexterous manipulation.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [77]
The environment layer's APIs are reconfigured into standard OpenAI gym-style environments.
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
FinRL provides strategy builders with a collection of universal training environments for various trading tasks.
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
Much current RL research works on benchmarks such as Atari and MuJoCo that evaluate the policy on exactly the same environment it was trained on, which often does not match real-world scenarios.
“However, much current RL research works on benchmarks such as Atari (Bellemare et al., 2013) and MuJoCo (E. Todorov et al., 2012; Brockman et al., 2016), which do not have the attributes described above: they evaluate the policy on exactly the same environment it was trained on, which often does not match with real-world scenarios (Fig. 1 left column).”
From A Survey of Zero-shot Generalisation in Deep Reinforcement Learning (2023) · cites this paper as Brockman et al., 2016
FinRL provides strategy builders with a collection of universal training environments for various trading tasks.
“Inspired by OpenAI Gym [5], FinRL provides strategy builders with a collection of universal training environments for various trading tasks.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
The historical data APIs and live trading APIs are reconfigured into standard OpenAI gym-style environments.
“They are reconfigured into standard OpenAI gym-style environments [5].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [5]
NovelGym's environment implementation is based on PettingZoo and OpenAI Gym.
“Our environment implementation is based on PettingZoo [24] and OpenAI Gym [5].”
From NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds (2024) · cites this paper as [5]
Cites
Still being checked.
Cited by
Sorted by citations
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · see citing works
Self-citationDeep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · see citing works
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · see citing works
AutoML: A survey of the state-of-the-art
He, X. J., Zhao, K., & Chu, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,778 · see citing works
Deep Reinforcement Learning That Matters
Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685 · see citing works
Anderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187 · see citing works
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355 · see citing works
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058 · see citing works
An autonomous laboratory for the accelerated synthesis of inorganic materials
Szymanski, N. J., Rendy, B., Fei, Y., Kumar, R. E., He, T., Milsted, D., McDermott, M. J., Gallant, M., Cubuk, E. D., Merchant, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06734-w · Cited by 1,041 · see citing works
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046 · see citing works
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919 · see citing works
Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey
Zhao, W., Queralta, J. P., & Westerlund, T. (2020) · 2020 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308468 · Cited by 941 · see citing works
A survey and critique of multiagent deep reinforcement learning
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 747 · see citing works
How to train your robot with deep reinforcement learning: Lessons we have learned
Ibarz, J., Tan, J., Finn, C., Kalakrishnan, M., Pastor, P., & Levine, S. (2021) · The International Journal of Robotics Research · doi:10.1177/0278364920987859 · Cited by 570 · see citing works
Model-based Reinforcement Learning: A Survey
Moerland, T. M., Broekens, J., Plaat, A., & Jonker, C. M. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000086 · Cited by 668 · see citing works
A Closer Look at Invalid Action Masking in Policy Gradient Algorithms
Huang, S., & Ontañón, S. (2022) · The International FLAIRS Conference Proceedings · doi:10.32473/flairs.v35i.130584 · Cited by 435 · see citing works
Learning to Walk Via Deep Reinforcement Learning
Haarnoja, T., Ha, S., Zhou, A., Tan, J., Tucker, G., & Levine, S. (2019) · Robotics: Science and Systems XV · doi:10.15607/rss.2019.xv.011 · Cited by 430 · see citing works
Chen, X., Qu, G., Tang, Y., Low, S. H., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 440 · see citing works
Hasani, R., Lechner, M., Amini, A., Rus, D. L., & Grosu, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16936 · Cited by 343 · see citing works
Embodied intelligence via learning and evolution
Gupta, A., Savarese, S., Ganguli, S., & Fei-Fei, L. (2021) · Nature Communications · doi:10.1038/s41467-021-25874-z · Cited by 352 · see citing works
Duan, J., Guan, Y., Li, S. E., Ren, Y., Sun, Q., & Cheng, B. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3082568 · Cited by 336 · see citing works
Catalyzing next-generation Artificial Intelligence through NeuroAI
Zador, A. M., Escola, G. S., Richards, B. A., Ölveczky, B. P., Bengio, Y., Boahen, K. A., Botvinick, M., Chklovskii, D. B., Churchland, A. K., Claudia Clopath, A., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37180-x · Cited by 337 · see citing works
Hierarchical motor control in mammals and machines
Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274 · see citing works
Action Branching Architectures for Deep Reinforcement Learning
Tavakoli, A., Pardo, F., & Kormushev, P. S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11798 · Cited by 268 · see citing works
Character controllers using motion VAEs
Ling, H. Y., Zinno, F., Cheng, G., & van de Panne, M. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392422 · Cited by 258 · see citing works
Towards Continual Reinforcement Learning: A Review and Perspectives
Khetarpal, K., Riemer, M., Rish, I., & Precup, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13673 · Cited by 224 · see citing works
Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy optimization
Bøhn, E., Coates, E. M., Moe, S., & Johansen, T. A. (2019) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2019.8798254 · Cited by 219 · see citing works
Cellular Network Traffic Scheduling With Deep Reinforcement Learning
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11339 · Cited by 218 · see citing works
“2016) and build a novel network simulator using openAI’s gym environment (Brockman et al. 2016).”
BackgroundMethodEcoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2021) · RePEc: Research Papers in Economics · Cited by 201 · see citing works
Salvato, E., Fenu, G., Medvet, E., & Pellegrino, F. A. (2021) · IEEE Access · doi:10.1109/access.2021.3126658 · Cited by 200 · see citing works
Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning
Skolik, A., Jerbi, S., & Dunjko, V. (2022) · Quantum · doi:10.22331/q-2022-05-24-720 · Cited by 201 · see citing works
Flow: A Modular Learning Framework for Mixed Autonomy Traffic
Wu, C., Kreidieh, A. R., Parvate, K., Vinitsky, E., & Bayen, A. M. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3087314 · Cited by 198 · see citing works
A Survey of Zero-shot Generalisation in Deep Reinforcement Learning
Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14174 · Cited by 193 · see citing works
Large-Scale Traffic Signal Control Using a Novel Multiagent Reinforcement Learning
Wang, X., Ke, L., Qiao, Z., & Chai, X. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3015811 · Cited by 182 · see citing works
Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning
Li, Z., Yu, H., Zhang, G., Dong, S., & Xu, C. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103059 · Cited by 177 · see citing works
Learning to Manipulate Deformable Objects without Demonstrations
Wu, Y., Yan, W., Kurutach, T., Pinto, L., & Abbeel, P. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.065 · Cited by 181 · see citing works
Loss of plasticity in deep continual learning
Dohare, S., Hernandez-Garcia, J. F., Lan, Q., Rahman, P., Mahmood, A. R., & Sutton, R. S. (2024) · Nature · doi:10.1038/s41586-024-07711-7 · Cited by 172 · see citing works
Sample-Efficient Reinforcement Learning with Stochastic Ensemble Value Expansion
Buckman, J., Hafner, D., Tucker, G., Brevdo, E., & Lee, H. (2018) · arXiv · doi:10.48550/arxiv.1807.01675 · Cited by 161 · see citing works
Stochastic latent actor–critic: Deep reinforcement learning with a latent variable model
Lee, A. X., Nagabandi, A., Abbeel, P., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1907.00953 · Cited by 159 · see citing works
Chen, K., Wang, H., Valverde‐Pérez, B., Zhai, S., Vezzaro, L., & Wang, A. (2021) · Chemosphere · doi:10.1016/j.chemosphere.2021.130498 · Cited by 148 · see citing works
Reinforcement Learning with Quantum Variational Circuit
Lockwood, O., & Si, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7437 · Cited by 140 · see citing works
Botifoll, M., Pinto-Huguet, I., & Arbiol, J. (2022) · Nanoscale Horizons · doi:10.1039/d2nh00377e · Cited by 81 · see citing works
DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems
Zhao, X., Gu, C., Zhang, H., Yang, X., Liu, X., Tang, J., & Liu, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16156 · Cited by 125 · see citing works
Self-citationBuilding HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation
Zhang, C., Kuppannagari, S. R., Kannan, R., & Prasanna, V. K. (2019) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3360322.3360861 · Cited by 121 · see citing works
Deep active inference as variational policy gradients
Millidge, B. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102348 · Cited by 115 · see citing works
Nguyen, K., & Daumé III, H. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1063 · Cited by 115 · see citing works
Dynamic Cloth Manipulation with Deep Reinforcement Learning
Jangir, R., Alenya, G., & Torras, C. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196659 · Cited by 114 · see citing works
A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systems
Corso, A., Moss, R. J., Koren, M., Lee, R., & Kochenderfer, M. J. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12716 · Cited by 157 · see citing works
Object-sensitive Deep Reinforcement Learning
Li, Y., Sycara, K. P., & Iyer, R. (2018) · EPiC series in computing · doi:10.29007/xtgm · Cited by 110 · see citing works
Kiran, N., Pan, C., Wang, S., & Yin, C. (2019) · Journal of Communications and Networks · doi:10.1109/jcn.2019.000046 · Cited by 111 · see citing works
Nolfi, S. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/13780.003.0008 · Cited by 111 · see citing works
Variational quantum reinforcement learning via evolutionary optimization
Chen, S. Y.-C., Huang, C.-M., Hsing, C.-W., Goan, H., & Kao, Y.-J. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac4559 · Cited by 111 · see citing works
A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning
Zhou, Y., Zhang, B., Xu, C., Lan, T., Diao, R., Shi, D., Wang, Z., & Lee, W. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000522 · Cited by 106 · see citing works
Experience Replay Optimization
Zha, D., Lai, K.-H., Zhou, K., & Hu, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/589 · Cited by 104 · see citing works
Goal-Conditioned Reinforcement Learning: Problems and Solutions
Liu, M., Zhu, M., & Zhang, W. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/770 · Cited by 115 · see citing works
“…the robotics benchmarking tasks discussed in Section 3.1 with image state / goal space instead; moreover, DeepMind Lab [Beattie et al. , 2016], Deepmind Control Suite (DMC) [Tassa et al. , 2020], Atari games [Brockman et al. , 2016] and Minecraft [Johnson et al. , 2016] are also popular testbeds.”
MethodInfluentialFeature Control as Intrinsic Motivation for Hierarchical Reinforcement Learning
Dilokthanakul, N., Kaplanis, C., Pawlowski, N., & Shanahan, M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2891792 · Cited by 96 · see citing works
Discretizing Continuous Action Space for On-Policy Optimization
Tang, Y., & Agrawal, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6059 · Cited by 96 · see citing works
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3737257 · Cited by 90 · see citing works
Wang, A., Ramaswamy, V., & Russakovsky, O. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533101 · Cited by 90 · see citing works
Human-to-Robot Imitation in the Wild
Bahl, S., Gupta, A., & Pathak, D. (2022) · Robotics: Science and Systems · doi:10.15607/rss.2022.xviii.026 · Cited by 86 · see citing works
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
Song, Y., Millidge, B., Salvatori, T., Lukasiewicz, T., Xu, Z., & Bogacz, R. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01514-1 · Cited by 85 · see citing works
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. D. (2021) · Proceedings of the Second ACM International Conference on AI in Finance · doi:10.1145/3490354.3494366 · Cited by 87 · see citing works
Borah, S., Sarma, B., Kewming, M. J., Milburn, G. J., & Twamley, J. (2021) · Physical Review Letters · doi:10.1103/physrevlett.127.190403 · Cited by 77 · see citing works
Multi-Agent DRL-Based Task Offloading in Multiple RIS-Aided IoV Networks
Hazarika, B., Singh, K. K., Biswas, S., Mumtaz, S., & Li, C. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3302010 · Cited by 74 · see citing works
ChatGPT: Systematic Review, Applications, and Agenda for Multidisciplinary Research
Singh, H., & Singh, A. (2023) · Journal of Chinese Economic and Business Studies · doi:10.1080/14765284.2023.2210482 · Cited by 77 · see citing works
Nweye, K., Kaspar, K., Buscemi, G., Fonseca, T., Pinto, G., Ghose, D., Duddukuru, S., Pratapa, P., Li, H., Mohammadi, J., et al. (2024) · Journal of Building Performance Simulation · doi:10.1080/19401493.2024.2418813 · Cited by 69 · see citing works
Counterfactual state explanations for reinforcement learning agents via generative deep learning
Olson, M., Khanna, R., Neal, L., Li, F., & Wong, W. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103455 · Cited by 71 · see citing works
Efficient Continuous Control with Double Actors and Regularized Critics
Lyu, J., Ma, X., Yan, J., & Li, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20732 · Cited by 65 · see citing works
Deep Reinforcement Learning Control of Quantum Cartpoles
Wang, Z. T., Ashida, Y., & Ueda, M. (2020) · Physical Review Letters · doi:10.1103/physrevlett.125.100401 · Cited by 62 · see citing works
Decentralized Policy Gradient Descent Ascent for Safe Multi-Agent Reinforcement Learning
Lu, S., Zhang, K., Chen, T., Başar, T., & Lior Horesh, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17062 · Cited by 60 · see citing works
Spatiotemporally Constrained Action Space Attacks on Deep Reinforcement Learning Agents
Lee, X. Y., Ghadai, S., Tan, K. L., Hegde, C., & Sarkar, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5887 · Cited by 7 · see citing works
Learning Models for Shared Control of Human-Machine Systems with Unknown Dynamics
Broad, A., Murphey, T. D., & Argall, B. (2017) · Robotics: Science and Systems · doi:10.15607/rss.2017.xiii.037 · Cited by 58 · see citing works
Neurosymbolic Reinforcement Learning and Planning: A Survey
Acharya, K., Raza, W., Dourado, C. M. J. D. M., Velasquez, A., & Song, H. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3311428 · Cited by 60 · see citing works
Jarosiński, M., Beekman, F., Bada, G., & Cloetingh, S. A. P. L. (2006) · Geophysical Journal International · doi:10.1111/j.1365-246x.2006.02979.x · Cited by 56 · see citing works
Deep Reinforcement Learning Verification: A Survey
Landers, M., & Doryab, A. (2023) · ACM Computing Surveys · doi:10.1145/3596444 · Cited by 53 · see citing works
Connectome-based reservoir computing with the conn2res toolbox
Suárez, L. E., Mihalik, Á., Milisav, F., Marshall, K., Li, M., Vértes, P. E., Lajoie, G., & Mišić, B. (2024) · Nature Communications · doi:10.1038/s41467-024-44900-4 · Cited by 54 · see citing works
Accelerating Reinforcement Learning for Reaching Using Continuous Curriculum Learning
Luo, S., Kasaei, H., & Schomaker, L. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207427 · Cited by 56 · see citing works
A semantic ontology for representing and quantifying energy flexibility of buildings
Li, H., & Hong, T. (2022) · Advances in Applied Energy · doi:10.1016/j.adapen.2022.100113 · Cited by 52 · see citing works
Lin, Y. S., McPhee, J., & Azad, N. L. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916781 · Cited by 49 · see citing works
Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research
Gulino, C., Fu, J., Luo, W., Tucker, G., Bronstein, E., Lu, Y., Harb, J., Pan, X., Wang, Y., Chen, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.08710 · Cited by 48 · see citing works
Considerations for a more ethical approach to data in AI: On data representation and infrastructure
Baird, A., & Schuller, B. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00025 · Cited by 46 · see citing works
Automated Dynamic Algorithm Configuration
Adriænsen, S., Biedenkapp, A., Shala, G., Awad, N. H., Eimer, T., Lindauer, M., & Hutter, F. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13922 · Cited by 46 · see citing works
Quantum reinforcement learning in continuous action space
Wu, S., Jin, S., Wen, D., Han, D., & Wang, X. (2025) · Quantum · doi:10.22331/q-2025-03-12-1660 · Cited by 56 · see citing works
Flow: Deep Reinforcement Learning for Control in SUMO
Kheterpal, N., Parvate, K., Wu, C., Kreidieh, A., Vinitsky, E., & Bayen, A. M. (2018) · EPiC series in engineering · doi:10.29007/dkzb · Cited by 45 · see citing works
Fast Model Identification via Physics Engines for Data-Efficient Policy Search
Zhu, S., Kimmel, A. S., Bekris, K. E., & Boularias, A. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/451 · Cited by 43 · see citing works
FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. (2021) · doi:10.2139/ssrn.3955949 · Cited by 46 · see citing works
Stackelberg Actor-Critic: Game-Theoretic Reinforcement Learning Algorithms
Zheng, L., Fiez, T., Alumbaugh, Z., Chasnov, B. J., & Ratliff, L. J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20908 · Cited by 42 · see citing works
Henry, R., & Ernst, D. (2021) · Energy and AI · doi:10.1016/j.egyai.2021.100092 · Cited by 43 · see citing works
Optimizing Crop Management with Reinforcement Learning and Imitation Learning
Tao, R., Zhao, P., Wu, J., Martin, N. F., Harrison, M. T., Ferreira, C., Kalantari, Z., & Hovakimyan, N. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/691 · Cited by 40 · see citing works
A novel method based on deep reinforcement learning for machining process route planning
Zhang, H., Wang, W., Zhang, S., Zhang, Y., Zhou, J., Wang, Z., Huang, B., & Huang, R. (2023) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102688 · Cited by 42 · see citing works
Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learning
Hsu, K., Rubies-Royo, V., Tomlin, C. J., & Fisac, J. F. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.077 · Cited by 40 · see citing works
DeepSynth: Automata Synthesis for Automatic Task Segmentation in Deep Reinforcement Learning
Hasanbeig, M., Jeppu, N. Y., Abate, A., Melham, T., & Kroening, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16935 · Cited by 12 · see citing works
Temporal-Logic-Based Reward Shaping for Continuing Reinforcement Learning Tasks
Jiang, Y., Bharadwaj, S., Wu, B., Shah, R., Topcu, U., & Stone, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16975 · Cited by 39 · see citing works
Inclined Quadrotor Landing using Deep Reinforcement Learning
Kooi, J. E., & Babuška, R. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636096 · Cited by 41 · see citing works
AI Thinking for Cloud Education Platform with Personalized Learning
Rad, P., Roopaei, M., Beebe, N. L., Shadaram, M., & Au, Y. A. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.003 · Cited by 37 · see citing works
Automation of membrane capacitive deionization process using reinforcement learning
Yoon, N., Park, S., Son, M., & Cho, K. H. (2022) · Water Research · doi:10.1016/j.watres.2022.119337 · Cited by 36 · see citing works
Towards a common implementation of reinforcement learning for multiple robotic tasks
Martínez-Tenor, Á., Fernández‐Madrigal, J., Cruz‐Martín, A., & González-Jiménez, J. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.011 · Cited by 36 · see citing works
Lai, K.-H., Zha, D., Li, Y., & Hu, X. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/435 · Cited by 40 · see citing works
Using a half cheetah habitat for random augmentation computing
Kishor, K. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19084-0 · Cited by 35 · see citing works
Expected Policy Gradients for Reinforcement LearningPreprint
Ciosek, K., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.1609/aaai.v32i1.11607 · Cited by 62 · see citing works
- Authors
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.01540
- OpenAlex
- W4394666657
- Cited by
- 582
- References
- 0
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 93 · 2023: 149 · 2022: 119 · 2021: 82 · 2020: 37 · 2019: 31 · 2018: 24 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- OpenAI Gym, reinforcement learning, benchmark environments, software design, algorithm comparison, research toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
