PreprintCited by 1,065Artificial Intelligence in GamesReinforcement Learning in RoboticsArtificial Intelligence Applications

The DOI matches its DataCite record; 35 of the 37 references it cites were found in a registry or an index, and 2 are not checked yet.

Dota 2 with Large Scale Deep Reinforcement Learning

Open access

OpenAI, :, Berner, Christopher, Brockman, Greg, Chan, Brooke, Cheung, Vicki, Dębiak, Przemysław, Dennison, Christy, Farhi, David, Fischer, Quirin, Hashme, Shariq, Hesse, Chris, Józefowicz, Rafal, Gray, Scott, Olsson, Catherine, Pachocki, Jakub, Petrov, Michael, Pinto, Henrique P. d. O., Raiman, Jonathan, Salimans, Tim, Schlatter, Jeremy, Schneider, Jonas, Sidor, Szymon, Sutskever, Ilya, Tang, Jie, Wolski, Filip, Zhang, Susan·2019·arXiv

DOI 10.48550/arxiv.1912.06680arXiv 1912.06680

Open this paper in CoChat — free account Open PDF

Abstract

On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1912.06680

Cites

35 of 37 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Self-citation
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citation
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Learning to Forget: Continual Prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 6,122
Learning without Forgetting
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562 · cited 2×
“For comparison Chess requires around one thousand values per observation (mostly 6-possibility categorical values) and Go around six thousand values (all binary)[12].”
BackgroundMethod
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294

Show all 37 references

Research works printed but not linked: 12

[15]15. Konda, V. R. & Tsitsiklis, J. N. Actor-critic algorithms in Advances in neural information processing systems (2000), 1008-1014.
[16]16. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous methods for deep reinforcement learning in International conference on machine learning (2016), 1928-1937.
[17]17. Schulman, J., Moritz, P., Levine, S., Jordan, M. I. & Abbeel, P. High-Dimensional Continuous Control Using Generalized Advantage Estimation. CoRR abs/1506.02438 (2016). · arXiv
[23]23. Chen, T., Goodfellow, I. J. & Shlens, J. Net2Net: Accelerating Learning via Knowledge Transfer in 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings (2016). < http://arxiv.org/abs/ 1511.05641 >.
[27]27. Herbrich, R., Minka, T. & Graepel, T. TrueSkill: a Bayesian skill rating system in Advances in neural information processing systems (2007), 569-576.
[38]38. Anthony, T., Tian, Z. & Barber, D. Thinking fast and slow with deep learning and tree search in Advances in Neural Information Processing Systems (2017), 5360-5370.
[41]41. Kulkarni, T. D., Narasimhan, K., Saeedi, A. & Tenenbaum, J. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation in Advances in neural information processing systems (2016), 3675-3683.
[47]47. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous Methods for Deep Reinforcement Learning in Proceedings of The 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48 (PMLR, New York, New York, USA, June 2016), 1928-1937. < http://proceedings.mlr.press/ v48/mniha16.html >.
[49]49. Fahlman, S. E. & Lebiere, C. in (ed Touretzky, D. S.) 524-532 (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1990). isbn : 1-55860-100-7. < http://dl.acm.org/ citation.cfm?id=109230.107380 >.
[53]53. Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R. & Hadsell, R. Progressive Neural Networks. arXiv preprint arXiv:1606.04671 (2016). · arXiv
[54]54. Hinton, G., Vinyals, O. & Dean, J. Distilling the Knowledge in a Neural Network in NIPS Deep Learning and Representation Learning Workshop (2015). < http://arxiv.org/abs/ 1503.02531 >.
[59]59. Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J. & Zaremba, W. OpenAI Gym. CoRR abs/1606.01540. arXiv: 1606.01540 . < http://arxiv.org/ abs/1606.01540 > (2016). · arXiv

Sorted by citations

Items 101–200 of 1,023

Deep Reinforcement Learning for One-Warehouse Multi-Retailer inventory management
Kaynov, I., van Knippenberg, M., Menkovski, V., van Breemen, A. V., & van Jaarsveld, W. (2024) · International Journal of Production Economics · doi:10.1016/j.ijpe.2023.109088 · Cited by 52
Supervised Learning Achieves Human-Level Performance in MOBA Games: A Case Study of Honor of Kings
Ye, D., Chen, G.-B., Zhao, P., Qiu, F., Yuan, B., Zhang, W., Chen, S., Sun, M., Li, X., Li, S., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3029475 · Cited by 57
OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Control
Xu, B., Gao, F., Yu, C., Zhang, R., Wu, Y., & Wang, Y. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3356168 · Cited by 75
SquirRL: Automating Attack Analysis on Blockchain Incentive Mechanisms with Deep Reinforcement Learning
Hou, C., Zhou, M., Ji, Y., Daian, P., Tramèr, F., Fanti, G. C., & Juels, A. (2021) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24188 · Cited by 82
Enhanced POET: Open-Ended Reinforcement Learning through Unbounded Invention of Learning Challenges and their Solutions
Wang, R., Lehman, J., Rawal, A., Zhi, J., Li, Y., Clune, J., & Stanley, K. O. (2020) · arXiv · doi:10.48550/arxiv.2003.08536 · Cited by 53
Beyond-Visual-Range Air Combat Tactics Auto-Generation by Reinforcement Learning
Piao, H., Sun, Z., Meng, G., Chen, H., Qu, B., Kuijun, L., Sun, Y., Yang, S., & Peng, X. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207088 · Cited by 54
DeepRepair: Style-Guided Repairing for Deep Neural Networks in the Real-World Operational Environment
Yu, B., Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., & Zhao, J. (2021) · IEEE Transactions on Reliability · doi:10.1109/tr.2021.3096332 · Cited by 58
A Distributed Multi-Agent Reinforcement Learning With Graph Decomposition Approach for Large-Scale Adaptive Traffic Signal Control
Jiang, S., Huang, Y., Jafari, M. A., & Jalayer, M. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3131596 · Cited by 58
Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system
Gao, Y., Matsunami, Y., Miyata, S., & Akashi, Y. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.120021 · Cited by 52
A survey on Evolutionary Reinforcement Learning algorithms
Zhu, Q., Wu, X., Lin, Q., Ma, L., Li, J., Ming, Z., & Chen, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126628 · Cited by 52
What is esports? A systematic scoping review and concept analysis of esports
Tang, D., Sum, R. K. W., Li, M., Ma, R., Chung, P., & Ho, W.-K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e23248 · Cited by 51
Learning safe control for multi-robot systems: Methods, verification, and open challenges
Garg, K., Zhang, S., So, O., Dawson, C., & Fan, C. (2024) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2024.100948 · Cited by 56
Self-citation
AutoHMA-LLM: Efficient Task Coordination and Execution in Heterogeneous Multi-Agent Systems Using Hybrid Large Language Models
Yang, T., Feng, P., Guo, Q.-X., Zhang, J.-D., Zhang, X., Ning, J.-H., Wang, X., & Mao, Z. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3528892 · Cited by 49
Agentic AI: The age of reasoning—A review
Nisa, U., Shirazi, M., Saip, M. A., & Pozi, M. S. M. (2025) · Journal of Automation and Intelligence · doi:10.1016/j.jai.2025.08.003 · Cited by 84
Challenges of Reinforcement Learning
Ding, Z., & Dong, H. (2020) · Springer eBooks · doi:10.1007/978-981-15-4095-0_7 · Cited by 52
Adversarial Reinforcement Learning for Procedural Content Generation
Gisslén, L., Eakins, A., Gordillo, C., Bergdahl, J., & Tollmar, K. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619053 · Cited by 64
DOP: Off-Policy Multi-Agent Decomposed Policy Gradients
Wang, Y., Han, B., Wang, T., Dong, H., & Zhang, C. (2021) · International Conference on Learning Representations · Cited by 52
A Survey on Deep Reinforcement Learning for Data Processing and Analytics
Cai, Q., Cui, C., Xiong, Y., Wang, W., Xie, Z., & Zhang, M. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3155196 · Cited by 58
A Deep Reinforcement Learning Framework for Eco-Driving in Connected and Automated Hybrid Electric Vehicles
Zhu, Z., Gupta, S., Gupta, A., & Canova, M. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3318552 · Cited by 52
CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
Ahmed, O., Träuble, F., Goyal, A., Neitz, A., Bengio, Y., Schölkopf, B., Wüthrich, M., & Bauer, S. (2020) · arXiv · doi:10.48550/arxiv.2010.04296 · Cited by 50
A residual convolutional neural network based approach for real-time path planning
Yang, L., Zheng, Z., Qin, F., Zhang, X., & Yao, H. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108400 · Cited by 52
Holo-Dex: Teaching Dexterity with Immersive Mixed Reality
Arunachalam, S. P., Guzey, I., Chintala, S., & Pinto, L. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160547 · Cited by 75
Mastering air combat game with deep reinforcement learning
Zhu, J., Kuang, M., Zhou, W., Shi, H. H., Zhu, J., Zhang, H., Li, X., & Han, X. (2023) · Defence Technology · doi:10.1016/j.dt.2023.08.019 · Cited by 52
Orientation and Decision-Making for Soccer Based on Sports Analytics and AI: A Systematic Review
Pu, Z., Pan, Y., Wang, S., Liu, B., Chen, M., Ma, H., & Cui, Y. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123807 · Cited by 66
Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Survey
Gopaluni, R. B., Tulsyan, A., Chachuat, B., Huang, B., Lee, J. M., Amjad, F., Damarla, S. K., Kim, J. W., & Lawrence, N. P. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.126 · Cited by 53
Complex relationship graph abstraction for autonomous air combat collaboration: A learning and expert knowledge hybrid approach
Piao, H., Han, Y., Chen, H., Peng, X., Fan, S., Sun, Y., Chen, L., Liu, Z., Sun, Z., & Zhou, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119285 · Cited by 48
Counter-Strike Deathmatch with Large-Scale Behavioural Cloning
Pearce, T., & Zhu, J. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893617 · Cited by 61
Multi agent reinforcement learning for online layout planning and scheduling in flexible assembly systems
Kaven, L., Huke, P., Göppert, A., & Schmitt, R. H. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02309-8 · Cited by 52
The MineRL 2019 Competition on Sample Efficient Reinforcement Learning using Human Priors
Guss, W. H., Codel, C., Hofmann, K., Houghton, B., Kuno, N., Milani, S., Mohanty, S., Liebana, D. P., Salakhutdinov, R., Topin, N., et al. (2019) · arXiv · doi:10.48550/arxiv.1904.10079 · Cited by 46
Convergence Proof for Actor-Critic Methods Applied to PPO and RUDDER
Holzleitner, M., Gruber, L., Arjona-Medina, J. A., Brandstetter, J., & Hochreiter, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-662-63519-3_5 · Cited by 48
Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game
Feng, Z., Huang, M., Wu, D., Wu, E. Q., & Yuen, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3296769 · Cited by 46
Optimizing Irrigation Efficiency using Deep Reinforcement Learning in the Field
Ding, X., & Du, W. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3662182 · Cited by 57
Offloading Machine Learning to Programmable Data Planes: A Systematic Survey
Parizotto, R., Coelho, B. L., Nunes, D. C., Haque, I., & Schaeffer-Filho, A. E. (2023) · ACM Computing Surveys · doi:10.1145/3605153 · Cited by 52
Off-Policy Multi-Agent Decomposed Policy GradientsPreprint
Wang, Y., Han, B., Wang, T., Dong, H., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.12322 · Cited by 64
Scaling Up Multi-Agent Reinforcement Learning: An Extensive Survey on Scalability Issues
Liu, D., Ren, F., Yan, J. H., Su, G., Gu, W., & Kato, S. (2024) · IEEE Access · doi:10.1109/access.2024.3410318 · Cited by 51
On Deep Reinforcement Learning for Static Routing and Wavelength Assignment
Cicco, N. D., Mercan, E. F., Karandin, O., Ayoub, O., Troìa, S., Musumeci, F., & Tornatore, M. (2022) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2022.3151323 · Cited by 49
Aligning Artificial Neural Networks and Ontologies towards Explainable AI
Ribeiro, M. D. S., & Leite, J. A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16626 · Cited by 47
Provably Efficient Online Hyperparameter Optimization with Population-Based BanditsPreprint
Parker-Holder, J., Nguyen, V., & Roberts, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02518 · Cited by 47
The Societal Implications of Deep Reinforcement Learning
Whittlestone, J., Arulkumaran, K., & Crosby, M. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12360 · Cited by 47
AlphaHoldem: High-Performance Artificial Intelligence for Heads-Up No-Limit Poker via End-to-End Reinforcement Learning
Zhao, E., Yan, R., Li, J., Li, K., & Xing, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20394 · Cited by 45
Human-in-the-loop reinforcement learning in continuous-action space
Luo, B., Wu, Z., Zhou, F., & Wang, B.-C. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3289315 · Cited by 41
Asymmetric Self-Play-Enabled Intelligent Heterogeneous Multirobot Catching System Using Deep Multiagent Reinforcement Learning
Gao, Y., Chen, J., Chen, X., Wang, C., Hu, J., Deng, F., & Lam, T. L. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3257541 · Cited by 43
Getting AI Right: Introductory Notes on AI & Society
Manyika, J. (2022) · Daedalus · doi:10.1162/daed_e_01897 · Cited by 54
Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning
Zhang, C., Odonkor, P., Zheng, S., Khorasgani, H., Serita, S., Gupta, C., & Wang, H. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378191 · Cited by 40
Multi-resource constrained dynamic workshop scheduling based on proximal policy optimisation
Luo, P. C., Xiong, H. Q., Zhang, B. W., Peng, J. Y., & Xiong, Z. F. (2021) · International Journal of Production Research · doi:10.1080/00207543.2021.1975057 · Cited by 40
Revisiting Design Choices in Proximal Policy OptimizationPreprint
Hsu, C., Mendler-Dünner, C., & Hardt, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10897 · Cited by 52
Turbulence control in plane Couette flow using low-dimensional neural ODE-based models and deep reinforcement learning
Linot, A. J., Zeng, K., & Graham, M. D. (2023) · International Journal of Heat and Fluid Flow · doi:10.1016/j.ijheatfluidflow.2023.109139 · Cited by 42
Distributed Non-Communicating Multi-Robot Collision Avoidance via Map-Based Deep Reinforcement Learning
Chen, G., Yao, S., Ma, J., Pan, L., Chen, Y., Xu, P., Ji, J., & Chen, X. (2020) · Sensors · doi:10.3390/s20174836 · Cited by 39
L4L: Experience-Driven Computational Resource Control in Federated Learning
Zhan, Y., Li, P., Wu, L., & Guo, S. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3068219 · Cited by 39
Meta-Learning through Hebbian Plasticity in Random NetworksPreprint
Najarro, E., & Risi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02686 · Cited by 49
A deep recurrent reinforcement learning approach for enhanced MPPT in PV systems
Wadehra, A., Bhalla, S., Jaiswal, V., Rana, K. P. S., & Kumar, V. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111728 · Cited by 44
Games for Artificial Intelligence Research: A Review and Perspectives
Hu, C., Zhao, Y., Wang, Z., Du, H., & Liu, J. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3410935 · Cited by 56
Deep learning: Historical overview from inception to actualization, models, applications and future trends
Ekundayo, O., & Ezugwu, A. E.-S. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113378 · Cited by 56
Automated scholarly paper review: Concepts, technologies, and challenges
Lin, J., Song, J., Zhou, Z., Chen, Y., & Shi, X. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101830 · Cited by 37
CTDS: Centralized Teacher With Decentralized Student for Multiagent Reinforcement Learning
Zhao, J., Hu, X., Yang, M., Zhou, W., Zhu, J., & Li, H. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3232390 · Cited by 41
Reinforcement Learning-Based School Energy Management System
Chemingui, Y., Gastli, A., & Ellabban, O. (2020) · Energies · doi:10.3390/en13236354 · Cited by 37
LEMMA: A Multi-view Dataset for L Earning Multi-agent Multi-task Activities
Jia, B., Chen, Y., Huang, S., Zhu, Y., & Zhu, S. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58574-7_46 · Cited by 36
Deep reinforcement learning and its applications in medical imaging and radiation therapy: a survey
Xu, L., Zhu, S., & Wen, N. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac9cb3 · Cited by 35
Approximating Nash equilibrium for anti-UAV jamming Markov game using a novel event-triggered multi-agent reinforcement learning
Feng, Z., Huang, M., Wu, Y., Wu, D., Cao, J., Korovin, I., Gorbachev, S. V., & Gorbacheva, N. (2023) · Neural Networks · doi:10.1016/j.neunet.2022.12.022 · Cited by 35
Deep Reinforcement Learning for DER Cyber-Attack Mitigation
Roberts, C., Ngo, S.-T., Milesi, A., Peisert, S., Arnold, D., Saha, S. S., Scaglione, A., Johnson, N. G., Андреевич, К. А., & Fradkin, D. (2020) · IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) · doi:10.1109/smartgridcomm47815.2020.9302997 · Cited by 36
Game Strategies for Physical Robot Soccer Players: A Survey
Antonioni, E., Suriani, V., Riccio, F., & Nardi, D. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3075065 · Cited by 43
Unmanned Aerial Vehicle Swarm Cooperative Decision-Making for SEAD Mission: A Hierarchical Multiagent Reinforcement Learning Approach
Yue, L., Yang, R., Zuo, J., Zhang, Y., Li, Q., & Zhang, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3202938 · Cited by 35
Learning Multipursuit Evasion for Safe Targeted Navigation of Drones
Xiao, J., & Feroskhan, M. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3366871 · Cited by 34
Actor–Critic Reinforcement Learning and Application in Developing Computer-Vision-Based Interface Tracking
Dogru, O., Velswamy, K., & Huang, B. (2021) · Engineering · doi:10.1016/j.eng.2021.04.027 · Cited by 36
Discovering Objects that Can Move
Bao, Z., Tokmakov, P., Jabri, A., Wang, Y.-X., Gaidon, A., & Hebert, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01149 · Cited by 34
DRL-Based Joint Path Planning and Jamming Power Allocation Optimization for Suppressing Netted Radar System
Li, S., Liu, G., Zhang, K., Qian, Z., & Ding, S. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3270762 · Cited by 34
DRLIC: Deep Reinforcement Learning for Irrigation Control
Ding, X., & Du, W. (2022) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn54338.2022.00011 · Cited by 34
A reinforcement learning approach to vehicle coordination for structured advanced air mobility
Deniz, S., Wu, Y., Shi, Y., & Wang, Z. (2024) · Green Energy and Intelligent Transportation · doi:10.1016/j.geits.2024.100157 · Cited by 39
Acquiring musculoskeletal skills with curriculum-based reinforcement learning
Chiappa, A. S., Tano, P., Patel, N., Ingster, A., Pouget, A., & Mathis, A. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.002 · Cited by 39
Optimizing parameters in swarm intelligence using reinforcement learning: An application of Proximal Policy Optimization to the iSOMA algorithm
Klein, L., Zelinka, I., & Seidl, D. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101487 · Cited by 34
Ember
Fraternali, F., Balaji, B., Sengupta, D., Hong, D., & Gupta, R. K. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430734 · Cited by 34
Hybrid-scale contextual fusion network for medical image segmentation
Bao, H., Zhu, Y., & Li, Q. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106439 · Cited by 32
Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces
Williams, K., Schlossman, R., Whitten, D., Ingram, J., Musuvathy, S., Pagan, J. E. G., Williams, K. A., Green, S., Patel, A., Mazumdar, A., et al. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3218496 · Cited by 31
Assessing the value of deep reinforcement learning for irrigation scheduling
Kelly, T. D., Foster, T., & Schultz, D. M. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100403 · Cited by 33
Deep reinforcement learning applied to an assembly sequence planning problem with user preferences
Neves, M., & Neto, P. (2022) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-022-09877-8 · Cited by 35
Multiagent Deep Reinforcement Learning With Demonstration Cloning for Target Localization
Alagha, A., Mizouni, R., Bentahar, J., Otrok, H., & Singh, S. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3262663 · Cited by 31
Finding the ground state of spin Hamiltonians with reinforcement learning
Mills, K., Ronagh, P., & Tamblyn, I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0226-x · Cited by 35
A survey on algorithms for Nash equilibria in finite normal-form games
Li, H., Huang, W., Duan, Z., Mguni, D., Shao, K., Wang, Y.-X., & Deng, X. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100613 · Cited by 35
Proactive and AoI-Aware Failure Recovery for Stateful NFV-Enabled Zero-Touch 6G Networks: Model-Free DRL Approach
Shaghaghi, A., Zakeri, A., Mokari, N., Javan, M. R., Behdadfar, M., & Jorswieck, E. A. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3113054 · Cited by 29
On games and simulators as a platform for development of artificial intelligence for command and control
Goecks, V. G., Waytowich, N. R., Asher, D. E., Park, S. J., Mittrick, M. R., Richardson, J., Vindiola, M. M., Logie, A., Dennison, M., Trout, T., et al. (2022) · The Journal of Defense Modeling and Simulation Applications Methodology Technology · doi:10.1177/15485129221083278 · Cited by 39
CollembolAI , a macrophotography and computer vision workflow to digitize and characterize samples of soil invertebrate communities preserved in fluid
Sys, S., Weißbach, S., Jakob, L., Gerber, S., & Schneider, C. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14001 · Cited by 33
Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment
Sun, Y., Yuan, B., Xiang, Q., Zhou, J., Yu, J., Dai, D., & Zhou, X. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3225867 · Cited by 32
Evaluation of Human-AI Teams for Learned and Rule-Based Agents in HanabiPreprint
Siu, H. C., Peña, J., Chen, E., Zhou, Y., Lopez, V. J., Palko, K., Chang, K. C., & Allen, R. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07630 · Cited by 30
Fair collaborative vehicle routing: A deep multi-agent reinforcement learning approach
Mak, S., Xu, L., Pearce, T., Ostroumov, M., & Brintrup, A. M. (2023) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2023.104376 · Cited by 36
Scalable Microscale Artificial Synapses of Lead Halide Perovskite with Femtojoule Energy Consumption
de Boer, J. J., & Ehrler, B. (2024) · ACS Energy Letters · doi:10.1021/acsenergylett.4c02360 · Cited by 29
A Framework for Multi-Agent UAV Exploration and Target-Finding in GPS-Denied and Partially Observable Environments
Walker, V., Vanegas, F., & Gonzalez, F. (2020) · Sensors · doi:10.3390/s20174739 · Cited by 28
Guided Reinforcement Learning: A Review and Evaluation for Efficient and Effective Real-World Robotics [Survey]
Eßer, J., Bach, N., Jestel, C., Urbann, O., & Kerner, S. (2022) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2022.3207664 · Cited by 34
Learning Near-Optimal Intrusion Responses Against Dynamic Attackers
Hammar, K., & Stadler, R. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3293413 · Cited by 38
RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised LearningPreprint
Killamsetty, K., Zhao, X., Chen, F., & Iyer, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07760 · Cited by 34
E-VAT: An Asymmetric End-to-End Approach to Visual Active Exploration and Tracking
Dionigi, A., Devo, A., Guiducci, L., & Costante, G. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3150866 · Cited by 28
A review on machine learning in flexible surgical and interventional robots: Where we are and where we are going
Wu, D., Zhang, R., Pore, A., Dall’Alba, D., Ha, X. T., Li, Z., Zhang, Y., Gonzalez-Herrera, F., Ourak, M., Kowalczyk, W., et al. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106179 · Cited by 35
Structured learning of rigid‐body dynamics: A survey and unified view from a robotics perspective
Geist, A. R., & Trimpe, S. (2021) · GAMM-Mitteilungen · doi:10.1002/gamm.202100009 · Cited by 33
Reinforcement Learning for Ridesharing: A Survey
Qin, Z. T., Hongtu Zhu, B., & Ye, J. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564924 · Cited by 27
Which Heroes to Pick? Learning to Draft in MOBA Games With Neural Networks and Tree Search
Chen, S., Zhu, M., Ye, D., Zhang, W., Fu, Q., & Yang, W. P. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3095264 · Cited by 31
Reinforcement learning-driven local transactive energy market for distributed energy resources
Zhang, S., May, D. C.-M., Gül, M., & Musı́lek, P. (2022) · Energy and AI · doi:10.1016/j.egyai.2022.100150 · Cited by 29
Self-citation
Learning Visual Robotic Control Efficiently with Contrastive Pre-training and Data Augmentation
Zhan, A., Zhao, R., Pinto, L., Abbeel, P., & Laskin, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981055 · Cited by 58
Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents
Lehna, M., Viebahn, J., Marot, A., Tomforde, S., & Scholz, C. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100276 · Cited by 38
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
Li, H., Yang, X., Wang, Z., Zhu, X., Zhou, J., Qiao, Y., Wang, X., Li, H., Lu, L., & Dai, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01554 · Cited by 42
Review of machine learning technologies and artificial intelligence in modern manufacturing systems
Nassehi, A., Zhong, R. Y., Li, X., & Epureanu, B. I. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-823657-4.00002-6 · Cited by 27
Generative Personas That Behave and Experience Like Humans
Barthet, M., Khalifa, A., Liapis, A., & Yannakakis, G. N. (2022) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3555858.3555879 · Cited by 33

Authors: OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C., Józefowicz, R., Gray, S., Olsson, C., Pachocki, J., Petrov, M., Pinto, H. P. D. O., Raiman, J., Salimans, T., Schlatter, J., Schneider, J., Sidor, S., Sutskever, I., Tang, J., Wolski, F., & Zhang, S.
ORCID: Petrov, Michael
Raiman, Jonathan
Tang, Jie
Zhang, Susan
Venue: arXiv
Publisher: arXiv
Published: 2019
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1912.06680
arXiv: 1912.06680
OpenAlex: W2996037775
Cited by: 1,065
References: 37
Citations by year: 2026: 6 · 2025: 66 · 2024: 178 · 2023: 186 · 2022: 197 · 2021: 273 · 2020: 152 · 2019: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords: Dota 2, self-play, distributed training, continuous training, imperfect information games, long time horizons, continuous state and action spaces, esports

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Dota 2 with Large Scale Deep Reinforcement Learning

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks