The DOI matches its DataCite record; 35 of the 37 references it cites were found in a registry or an index, and 2 are not checked yet.
Dota 2 with Large Scale Deep Reinforcement Learning
Open accessAbstract
On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deep reinforcement learning (DRL) algorithms have been successfully deployed in various types of simulation environments, yet their success beyond simulated worlds has been limited.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a result, successful application of deep RL often requires large teams of experts with significant computational resources (Berner et al., 2019; Schrittwieser et al., 2020; Ouyang et al., 2022).”
From TD-MPC2: Scalable, Robust World Models for Continuous Control (2023) · cites this paper as Berner et al., 2019
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Self-citationProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Learning to Forget: Continual Prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 6,122
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562 · cited 2×
“For comparison Chess requires around one thousand values per observation (mostly 6-possibility categorical values) and Go around six thousand values (all binary)[12].”
BackgroundMethodGrandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294
Research works printed but not linked: 12
- [15]15. Konda, V. R. & Tsitsiklis, J. N. Actor-critic algorithms in Advances in neural information processing systems (2000), 1008-1014.
- [16]16. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous methods for deep reinforcement learning in International conference on machine learning (2016), 1928-1937.
- [17]17. Schulman, J., Moritz, P., Levine, S., Jordan, M. I. & Abbeel, P. High-Dimensional Continuous Control Using Generalized Advantage Estimation. CoRR abs/1506.02438 (2016). · arXiv
- [23]23. Chen, T., Goodfellow, I. J. & Shlens, J. Net2Net: Accelerating Learning via Knowledge Transfer in 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings (2016). < http://arxiv.org/abs/ 1511.05641 >.
- [27]27. Herbrich, R., Minka, T. & Graepel, T. TrueSkill: a Bayesian skill rating system in Advances in neural information processing systems (2007), 569-576.
- [38]38. Anthony, T., Tian, Z. & Barber, D. Thinking fast and slow with deep learning and tree search in Advances in Neural Information Processing Systems (2017), 5360-5370.
- [41]41. Kulkarni, T. D., Narasimhan, K., Saeedi, A. & Tenenbaum, J. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation in Advances in neural information processing systems (2016), 3675-3683.
- [47]47. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous Methods for Deep Reinforcement Learning in Proceedings of The 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48 (PMLR, New York, New York, USA, June 2016), 1928-1937. < http://proceedings.mlr.press/ v48/mniha16.html >.
- [49]49. Fahlman, S. E. & Lebiere, C. in (ed Touretzky, D. S.) 524-532 (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1990). isbn : 1-55860-100-7. < http://dl.acm.org/ citation.cfm?id=109230.107380 >.
- [53]53. Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R. & Hadsell, R. Progressive Neural Networks. arXiv preprint arXiv:1606.04671 (2016). · arXiv
- [54]54. Hinton, G., Vinyals, O. & Dean, J. Distilling the Knowledge in a Neural Network in NIPS Deep Learning and Representation Learning Workshop (2015). < http://arxiv.org/abs/ 1503.02531 >.
- [59]59. Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J. & Zaremba, W. OpenAI Gym. CoRR abs/1606.01540. arXiv: 1606.01540 . < http://arxiv.org/ abs/1606.01540 > (2016). · arXiv
Cited by
Sorted by citations
Items 301–400 of 1,023
AI generations: from AI 1.0 to AI 4.0
Wu, J., You, H., & Du, J. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1585629 · Cited by 27
Reinforcement Learning Toolkits for Gaming: A Comparative Qualitative Analysis
Mekni, M., Jayaramireddy, C. S., & Naraharisetti, S. V. V. S. S. (2022) · Journal of Software Engineering and Applications · doi:10.4236/jsea.2022.1512024 · Cited by 14
LJIR: Learning Joint-Action Intrinsic Reward in cooperative multi-agent reinforcement learning
Chen, Z., Luo, B., Hu, T., & Xu, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.08.016 · Cited by 15
No Prior Mask: Eliminate Redundant Action for Deep Reinforcement Learning
Zhong, D., Yang, Y., & Zhao, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29652 · Cited by 16
A Reinforcement Learning Approach to Military Simulations in Command: Modern Operations
Dimitriu, A., Michaletzky, T. V., Remeli, V., & Tihanyi, V. (2024) · IEEE Access · doi:10.1109/access.2024.3406148 · Cited by 16
A reinforcement learning-based approach for solving multi-agent job shop scheduling problem
Dong, Z., Ren, T., Qi, F., Weng, J., Bai, D., Yang, J., & Wu, C. (2024) · International Journal of Production Research · doi:10.1080/00207543.2024.2423807 · Cited by 14
A Comparison of Self-Play Algorithms Under a Generalized Framework
Hernández, D., Denamganaï, K., Devlin, S., Samothrakis, S., & Walker, J. A. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3058898 · Cited by 14
Lin, C.-W., Ruan, S.-J., Hsu, W.-C., Tu, Y., & Han, S.-L. (2020) · Sensors · doi:10.3390/s20195588 · Cited by 14
VGC AI Competition - A New Model of Meta-Game Balance AI Competition
Reis, S., Reis, L. P., & Lau, N. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9618985 · Cited by 14
DraftRec: Personalized Draft Recommendation for Winning in Multi-Player Online Battle Arena Games
Lee, H., Hwang, D., Kim, H., Lee, B., & Choo, J. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512278 · Cited by 22
How Does AI Play Football? An Analysis of RL and Real-world Football Strategies
Scott, A., Fujii, K., & Onishi, M. (2022) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0010844300003116 · Cited by 21
Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and BenchmarkingPreprint
Pardo, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07537 · Cited by 36
Reverb: A Framework For Experience ReplayPreprint
Cassirer, A., Barth-Maron, G., Brevdo, E., Ramos, S., Boyd, T., Sottiaux, T., & Kroiss, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04736 · Cited by 34
Going Beyond Linear Transformers with Recurrent Fast Weight Programmers
Irie, K., Schlag, I., Csordás, R., & Schmidhuber, J. (2021) · arXiv · doi:10.48550/arxiv.2106.06295 · Cited by 14
AW-Opt: Learning Robotic Skills with Imitation and Reinforcement at ScalePreprint
Lu, Y., Hausman, K., Chebotar, Y., Yan, M., Jang, E., Herzog, A., Xiao, T. G., Irpan, A., Khansari, M., Kalashnikov, D., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05424 · Cited by 20
Scaling multi-agent reinforcement learning to full 11 versus 11 simulated robotic football
Smit, A., Engelbrecht, H. A., Brink, W., & Pretorius, A. (2023) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-023-09603-y · Cited by 16
Liu, L., & Yang, J. H. (2023) · Computers & Industrial Engineering · doi:10.1016/j.cie.2023.109564 · Cited by 14
An Introduction to Adversarially Robust Deep Learning
Peck, J., Goossens, B., & Saeys, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331087 · Cited by 16
Belfadil, A., Modesto, D., Meseguer, J., Joseph‐Duran, B., Saporta, D., & Hernández, J. A. M. (2023) · Journal of Water Resources Planning and Management · doi:10.1061/jwrmd5.wreng-6108 · Cited by 16
Sun, J., & Kim, J. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3343452 · Cited by 13
Gürses, Y., Buyukdemirci, K., & Yıldız, Y. (2024) · IEEE Control Systems Letters · doi:10.1109/lcsys.2024.3349511 · Cited by 13
Autonomous Air Combat Maneuver Decision-Making Based on PPO-BWDA
Wang, H., Zhou, Z., Jiang, J., Deng, W., & Chen, X. (2024) · IEEE Access · doi:10.1109/access.2024.3419889 · Cited by 13
MAIDRL: Semi-centralized Multi-Agent Reinforcement Learning using Agent Influence
Harris, A., & Liu, S. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619002 · Cited by 13
Harada, T., Matsuoka, J., & Hattori, K. (2022) · Artificial Life and Robotics · doi:10.1007/s10015-022-00839-7 · Cited by 13
Deep Reinforcement Learning for Robot Batching Optimization and Flow Control
Hildebrand, M., Andersen, R. S., & Bøgh, S. (2020) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.10.203 · Cited by 15
A design methodology for deep reinforcement learning in autonomous systems
Hillebrand, M., Lakhani, M., & Dumitrescu, R. (2020) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.11.044 · Cited by 14
Sustainable society based on social gamification using Nova Empire ecology mining
Zhang, G., Wu, J., Zhao, K., Zhou, X., Chen, Y., Wang, Y., & Tan, M. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102666 · Cited by 14
Learn Goal-Conditioned Policy with Intrinsic Motivation for Deep Reinforcement Learning
Liu, J., Wang, D., Tian, Q., & Chen, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20721 · Cited by 14
Large Scale Deep Reinforcement Learning in War-games
Wang, H., Tang, H., Hao, J., Hao, X., Fu, Y., & Ma, Y. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313387 · Cited by 13
FormulaZero: Distributionally Robust Online Adaptation via Offline Population SynthesisPreprint
Sinha, A., O’Kelly, M., Zheng, H., Mangharam, R., Duchi, J. C., & Tedrake, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03900 · Cited by 15
Challenges of Applying Deep Reinforcement Learning in Dynamic DispatchingPreprint
Khorasgani, H., Wang, H., & Gupta, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05570 · Cited by 13
Deep Model-Based Reinforcement Learning for High-Dimensional Problems, a SurveyPreprint
Plaat, A., Kosters, W. A., & Preuß, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05598 · Cited by 36
Reinforcement Learning for Adaptive Mesh RefinementPreprint
Yang, J., Dzanic, T., Petersen, B. K., Kudo, J., Mittal, K., Tomov, V., Camier, J., Zhao, T., Hongyuan Zha, B., Kolev, T., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01342 · Cited by 14
Multiagent Deep Reinforcement Learning: Challenges and Directions Towards Human-Like Approaches.Preprint
Wong, A., Bäck, T., Kononova, A. V., & Plaat, A. (2021) · arXiv (Cornell University) · Cited by 13
Online Training of Spiking Recurrent Neural Networks with Phase-Change Memory SynapsesPreprint
Demirağ, Y., Frenkel, C., Payvand, M., & Indiveri, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01804 · Cited by 17
A Meta-Reinforcement Learning Approach to Process Control
McClement, D. G., Lawrence, N. P., Loewen, P. D., Forbes, M. G., Backström, J. U., & Gopaluni, R. B. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.08.321 · Cited by 13
RARSMSDou: Master the Game of DouDiZhu With Deep Reinforcement Learning Algorithms
Luo, Q., & Tan, T.-P. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3303251 · Cited by 14
Nguyen, C. H., Shihua, J. M., & Liem, R. P. (2025) · Communications in Transportation Research · doi:10.1016/j.commtr.2025.100165 · Cited by 12
Hu, Y., Dong, T., & Li, S. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105051 · Cited by 15
Navigating the landscape of multiplayer games
Omidshafiei, S., Tuyls, K., Czarnecki, W. M., Santos, F. C., Rowland, M., Connor, J. T., Hennes, D., Müller, P. F., Pérolat, J., Vylder, B. D., et al. (2020) · RePEc: Research Papers in Economics · Cited by 12
Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systems
Hegde, S., Kanervisto, A., & Petrenko, A. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619096 · Cited by 15
Coucke, N., Heinrich, M. K., Axel Cleeremans, B., & Dorigo, M. (2021) · Swarm Intelligence · doi:10.1007/s11721-021-00199-1 · Cited by 12
Computational Benefits of Intermediate Rewards for Goal-Reaching Policy Learning
Zhai, Y., Baek, C., Zhou, Z., Jiao, J., & Ma, Y. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13326 · Cited by 12
Exact solving scheduling problems accelerated by graph neural networks
Juroš, J., Brčić, M., Končić, M., & Kovač, M. (2022) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro55190.2022.9803345 · Cited by 12
Multi-Agent Deep Reinforcement Learning for Mix-mode Runway Sequencing
Limin, S., Pham, D.-T., & Alam, S. (2022) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc55140.2022.9922221 · Cited by 12
Lee, Y. J., Kim, J., Kwak, M. G., Park, Y. J., & Kim, S. B. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.12.018 · Cited by 12
Planning and Learning in Multi-Agent Path Finding
Yakovlev, K., Андреевич, А. А., Skrynnik, A., & Panov, A. I. (2022) · Doklady Mathematics · doi:10.1134/s1064562422060229 · Cited by 13
Growing Robot Navigation Based on Deep Reinforcement Learning
Ataka, A., & Sandiwan, A. P. (2023) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar57134.2023.10151740 · Cited by 12
Reinforcement Learning Generalization with Surprise MinimizationPreprint
Chen, J. Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12399 · Cited by 13
Mutual Information State Intrinsic ControlPreprint
Zhao, R., Gao, Y., Abbeel, P., Volker Tresp, C., & Xu, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08107 · Cited by 13
Cooperative Multi-Agent Transfer Learning with Level-Adaptive Credit AssignmentPreprint
Zhou, T., Zhang, F., Shao, K., Li, K., Huang, W., Luo, J., Wang, W., Yang, Y., Mao, H., Wang, B., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.00517 · Cited by 22
Learning more skills through optimistic explorationPreprint
Strouse, D., Baumli, K., Warde-Farley, D., Mnih, V., & Hansen, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.14226 · Cited by 12
Continuous Control with Action Quantization from DemonstrationsPreprint
Dadashi, R., Hussenot, L., Vincent, D., Girgin, S., Raichuk, A., Geist, M., & Pietquin, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10149 · Cited by 15
Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learning
Muller-Brockhausen, M., Preuss, M., & Plaat, A. (2021) · 2021 IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619000 · Cited by 11
Neuromorphic Engineering Needs Closed-Loop Benchmarks
Milde, M. B., Afshar, S., Xu, Y., Marcireau, A., Joubert, D., Ramesh, B., Bethi, Y., Ralph, N. O., Arja, S., Dennler, N., et al. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.813555 · Cited by 11
Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanism
Guo, X., Shi, D., & Fan, W. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/15 · Cited by 16
ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning
Yu, X., Shi, R., Feng, P., Tian, Y., Luo, J., & Wu, W. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230609 · Cited by 14
Intrinsic Action Tendency Consistency for Cooperative Multi-Agent Reinforcement Learning
Zhang, J., Zhang, Y., Zhang, X. S., Zang, Y., & Cheng, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29711 · Cited by 11
Co-Generation of Game Levels and Game-Playing Agents
Dharna, A., Togelius, J., & Soros, L. B. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7431 · Cited by 12
Student-Initiated Action Advising via Advice Novelty
Ilhan, E., Gow, J., & Perez, D. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2021.3113644 · Cited by 11
Learning While Playing in Mean-Field Games: Convergence and Optimality
Xie, Q., Yang, Z., Wang, Z., & Minca, A. (2021) · International Conference on Machine Learning · Cited by 11
Control with adaptive Q-learning: A comparison for two classical control problems
Araújo, J. P., Figueiredo, M. A. T., & Botto, M. A. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104797 · Cited by 11
Challenges and Opportunities of Applying Reinforcement Learning to Autonomous Racing
Wurman, P. R., Stone, P., & Spranger, M. (2022) · IEEE Intelligent Systems · doi:10.1109/mis.2022.3184427 · Cited by 11
Sustainable Federated Learning with Long-term Online VCG Auction Mechanism
Wu, L., Guo, S., Liu, Y., Hong, Z., Zhan, Y., & Xu, W. (2022) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs54860.2022.00091 · Cited by 11
Haxss: Hierarchical Reinforcement Learning for XSS Payload Generation
Foley, M., & Maffeis, S. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00031 · Cited by 12
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models
Niu, C., Li, C., Ng, V., & Luo, B. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00055 · Cited by 11
Shang, W., Li, Q., Qin, Z. T., Yu, Y., Meng, Y., & Ye, J. (2021) · Machine Learning · doi:10.1007/s10994-021-05969-w · Cited by 11
Diversity-Based Trajectory and Goal Selection with Hindsight Experience Replay
Dai, T., Liu, H., Arulkumaran, K., Ren, G., & Bharath, A. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89370-5_3 · Cited by 11
Parallel learner: A practical deep reinforcement learning framework for multi-scenario games
Hou, X., Guo, Z., Wang, X., Qian, T., Zhang, J., Qi, S., & Xiao, J. Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107753 · Cited by 11
Aggregation Transfer Learning for Multi-Agent Reinforcement learning
Xu, D., Qiao, P., & Dou, Y. (2021) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase53849.2021.00107 · Cited by 11
Revisiting the Classics: Online RL in the Programmable Dataplane
Simpson, K. A., & Pezaros, D. P. (2022) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms54207.2022.9789930 · Cited by 11
Model-Based Deep Reinforcement Learning for High-Dimensional Problems, a Survey.Preprint
Plaat, A., Kosters, W. A., & Preuß, M. (2020) · arXiv (Cornell University) · Cited by 12
Reinforcement Learning with Latent FlowPreprint
Shang, W., Wang, X., Srinivas, A., Rajeswaran, A., Gao, Y., Abbeel, P., & Laskin, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01857 · Cited by 11
Robust Policy Gradient against Strong Data CorruptionPreprint
Zhang, X., Chen, Y., Zhu, X., & Sun, W. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05800 · Cited by 12
Regularized Behavior Value EstimationPreprint
Gülçehre, Ç., Colmenarejo, S. G., Wang, Z., Sygnowski, J., Paine, T., Żołna, K., Chen, Y., Hoffman, M. W., Pascanu, R., & de Freitas, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09575 · Cited by 34
AI-powered Energy Internet Towards Carbon Neutrality: Challenges and OpportunitiesPreprint
Li, C. (2021) · doi:10.36227/techrxiv.14787573.v1 · Cited by 13
Low-Precision Reinforcement Learning: Running Soft Actor-Critic in Half PrecisionPreprint
Björck, J., Chen, X., De, C., Gomes, C. P., & Weinberger, K. Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13565 · Cited by 13
When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently?Preprint
Song, Z., Song, M., & Bai, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04184 · Cited by 73
Scalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control
Cui, K., Li, M., Fabián, C., & Koeppl, H. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161498 · Cited by 12
Safe Exploration Reinforcement Learning for Load Restoration using Invalid Action Masking
Vu, L., Vu, T., Vu, T.-L., & Srivastava, A. K. (2023) · IEEE Power Engineering Society General Meeting · doi:10.1109/pesgm52003.2023.10253213 · Cited by 10
Spiking Reinforcement Learning with Memory Ability for Mapless Navigation
Yang, B., Yuan, M., Zhang, C., Hong, C., Pan, G., & Tang, H. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341738 · Cited by 10
Tang, Y. F., Guo, S., Liu, J., Wan, B., An, L., & Liu, J. K. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111736 · Cited by 10
SATF: A Scalable Attentive Transfer Framework for Efficient Multiagent Reinforcement Learning
Chen, B., Cao, Z., & Bai, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3387397 · Cited by 11
Stellaris: Staleness-Aware Distributed Reinforcement Learning with Serverless Computing
Yu, H., Wang, H., Tiwari, D., Li, J., & Park, S. (2024) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41406.2024.00045 · Cited by 10
Su, Y., & Yang, H. (2025) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2025.103997 · Cited by 12
Learning a Belief Representation for Delayed Reinforcement Learning
Liotet, P., Venneri, E., & Restelli, M. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534358 · Cited by 11
Pathfinding in stochastic environments: learning vs planning
Skrynnik, A., Andreychuk, A., Yakovlev, K., & Panov, A. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1056 · Cited by 11
Cheaper and Faster: Distributed Deep Reinforcement Learning with Serverless Computing
Yu, H., Li, J., Yang, H., Xu, Y., & Wang, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29592 · Cited by 11
Fast Adaptation to New Environments via Policy-Dynamics Value Functions
Răileanu, R., Goldstein, M. A., & Szlam, A. D. (2020) · International Conference on Machine Learning · Cited by 10
Mysore, S., Mabsout, B. E., Mancuso, R., & Saenko, K. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619008 · Cited by 10
A Machine Learning Multipath Mitigation Approach for Opportunistic Navigation with 5G Signals
Orabi, M., Abdallah, A. A., Khalife, J. J., & Kassas, Z. M. (2021) · Proceedings of the Satellite Division's International Technical Meeting (Online)/Proceedings of the Satellite Division's International Technical Meeting (CD-ROM) · doi:10.33012/2021.17990 · Cited by 10
Interpretable Learned Emergent Communication for Human–Agent Teams
Karten, S., Tucker, M., Li, H., Kailas, S., Lewis, M., & Sycara, K. P. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3236599 · Cited by 15
Continual Learning: Tackling Catastrophic Forgetting in Deep Neural Networks with Replay ProcessesPreprint
Lesort, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00487 · Cited by 31
TLeague: A Framework for Competitive Self-Play based Distributed Multi-Agent Reinforcement LearningPreprint
Sun, P., Xiong, J., Han, L., Sun, X., Li, S., Xu, J., Fang, M., & Zhang, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12895 · Cited by 17
XDO: A Double Oracle Algorithm for Extensive-Form GamesPreprint
McAleer, S., Lanier, J. B., Wang, K., Baldi, P., & Fox, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06426 · Cited by 12
Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid WorldPreprint
Laurent, F., Schneider, M., Scheller, C., Watson, J., Li, J., Chen, Z., Zheng, Y., Chan, S.-H., Makhnev, K., Svidchenko, O., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.16511 · Cited by 12
Imaginary Hindsight Experience Replay: Curious Model-based Learning for Sparse Reward TasksPreprint
McCarthy, R., Wang, Q., & Redmond, S. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02414 · Cited by 19
Scaling Instructable Agents Across Many Simulated Worlds
SIMA Team, Raad, M. A., Ahuja, A., Barros, C., Besse, F., Bolt, A., Bolton, A., Brownfield, B., Buttimore, G., Cant, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.10179 · Cited by 9
“• These environments are asynchronous (e.g., Berner et al., 2019; Vinyals et al., 2019); unlike many research environments, they do not stop and wait while the agent computes its next action.”
InfluentialEnvironment Agnostic Representation for Visual Reinforcement learning
Choi, H., Lee, H., Jeong, S., & Min, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00031 · Cited by 10
Accelerate Multi-Agent Reinforcement Learning in Zero-Sum Games with Subgame Curriculum Learning
Chen, J., Xu, Z., Li, Y., Yu, C., Song, J., Yang, H., Fang, F., Wang, Y., & Wu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29011 · Cited by 10
Metadata
- Authors
- OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C., Józefowicz, R., Gray, S., Olsson, C., Pachocki, J., Petrov, M., Pinto, H. P. D. O., Raiman, J., Salimans, T., Schlatter, J., Schneider, J., Sidor, S., Sutskever, I., Tang, J., Wolski, F., & Zhang, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1912.06680
- OpenAlex
- W2996037775
- Cited by
- 1,065
- References
- 37
- Citations by year
- 2026: 6 · 2025: 66 · 2024: 178 · 2023: 186 · 2022: 197 · 2021: 273 · 2020: 152 · 2019: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- Dota 2, self-play, distributed training, continuous training, imperfect information games, long time horizons, continuous state and action spaces, esports
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
