The DOI matches its DataCite record; 35 of the 37 references it cites were found in a registry or an index, and 2 are not checked yet.
Dota 2 with Large Scale Deep Reinforcement Learning
Open accessAbstract
On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deep reinforcement learning (DRL) algorithms have been successfully deployed in various types of simulation environments, yet their success beyond simulated worlds has been limited.”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a result, successful application of deep RL often requires large teams of experts with significant computational resources (Berner et al., 2019; Schrittwieser et al., 2020; Ouyang et al., 2022).”
From TD-MPC2: Scalable, Robust World Models for Continuous Control (2023) · cites this paper as Berner et al., 2019
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Self-citationProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Learning to Forget: Continual Prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 6,122
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562 · cited 2×
“For comparison Chess requires around one thousand values per observation (mostly 6-possibility categorical values) and Go around six thousand values (all binary)[12].”
BackgroundMethodGrandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294
Research works printed but not linked: 12
- [15]15. Konda, V. R. & Tsitsiklis, J. N. Actor-critic algorithms in Advances in neural information processing systems (2000), 1008-1014.
- [16]16. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous methods for deep reinforcement learning in International conference on machine learning (2016), 1928-1937.
- [17]17. Schulman, J., Moritz, P., Levine, S., Jordan, M. I. & Abbeel, P. High-Dimensional Continuous Control Using Generalized Advantage Estimation. CoRR abs/1506.02438 (2016). · arXiv
- [23]23. Chen, T., Goodfellow, I. J. & Shlens, J. Net2Net: Accelerating Learning via Knowledge Transfer in 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings (2016). < http://arxiv.org/abs/ 1511.05641 >.
- [27]27. Herbrich, R., Minka, T. & Graepel, T. TrueSkill: a Bayesian skill rating system in Advances in neural information processing systems (2007), 569-576.
- [38]38. Anthony, T., Tian, Z. & Barber, D. Thinking fast and slow with deep learning and tree search in Advances in Neural Information Processing Systems (2017), 5360-5370.
- [41]41. Kulkarni, T. D., Narasimhan, K., Saeedi, A. & Tenenbaum, J. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation in Advances in neural information processing systems (2016), 3675-3683.
- [47]47. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous Methods for Deep Reinforcement Learning in Proceedings of The 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48 (PMLR, New York, New York, USA, June 2016), 1928-1937. < http://proceedings.mlr.press/ v48/mniha16.html >.
- [49]49. Fahlman, S. E. & Lebiere, C. in (ed Touretzky, D. S.) 524-532 (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1990). isbn : 1-55860-100-7. < http://dl.acm.org/ citation.cfm?id=109230.107380 >.
- [53]53. Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R. & Hadsell, R. Progressive Neural Networks. arXiv preprint arXiv:1606.04671 (2016). · arXiv
- [54]54. Hinton, G., Vinyals, O. & Dean, J. Distilling the Knowledge in a Neural Network in NIPS Deep Learning and Representation Learning Workshop (2015). < http://arxiv.org/abs/ 1503.02531 >.
- [59]59. Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J. & Zaremba, W. OpenAI Gym. CoRR abs/1606.01540. arXiv: 1606.01540 . < http://arxiv.org/ abs/1606.01540 > (2016). · arXiv
Cited by
Sorted by citations
Items 401–500 of 1,023
PMAC: Personalized Multi-Agent Communication
Meng, X., & Tan, Y. C. R. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29700 · Cited by 11
Learning in games: a systematic review
Qin, R.-J., & Yu, Y. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-3955-x · Cited by 10
A sequential multi-agent reinforcement learning framework for different action spaces
Tian, S., Yang, M., Xiong, R., He, X., & Rajasegarar, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125138 · Cited by 9
May, D. C., Taylor, M. E., & Musı́lek, P. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100446 · Cited by 12
Neural combinatorial optimization: A tutorial
Angioni, D., Archetti, C., & Speranza, M. G. (2025) · Computers & Operations Research · doi:10.1016/j.cor.2025.107102 · Cited by 13
PvP: Profiling Versus Player! Exploiting Gaming Data for Player Recognition
Conti, M., & Tricomi, P. P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62974-8_22 · Cited by 9
Reinforcement learning based edge computing in B5G
Yang, J., Sun, Y., Lei, Y., Zhang, Z., Li, Y., Bao, Y., & Lv, Z. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2022.03.008 · Cited by 9
Supervised and Reinforcement Learning from Observations in Reconnaissance Blind Chess
Bertram, T., Fürnkranz, J., & Müller, M. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893588 · Cited by 10
The Hidden Rules of Hanabi: How Humans Outperform AI Agents
Sidji, M., Smith, W., & Rogerson, M. J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581550 · Cited by 11
SC-MAIRL: Semi-Centralized Multi-Agent Imitation Reinforcement Learning
Brackett, P., Liu, S., & Liu, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3282168 · Cited by 10
Hu, G., Li, H., Liu, S., Zhu, Y., & Zhao, D. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191291 · Cited by 11
Wisniewski, M., Rana, Z. A., Petrunin, I. V., Holt, A., & Harman, S. A. (2024) · Drones · doi:10.3390/drones8060235 · Cited by 9
Your Buddy, the Grandmaster: Repurposing the Game-Playing AI Surplus for Inclusivity
Aytemiz, B., Shu, X., Hu, E. J., & Smith, A. M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7402 · Cited by 9
Action Advising with Advice Imitation in Deep Reinforcement Learning
İlhan, E., Gow, J., & Pérez-Liébana, D. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/wnao2106 · Cited by 9
Evaluating Strategic Structures in Multi-Agent Inverse Reinforcement Learning
Fu, J., Tacchetti, A., Pérolat, J., & Bachrach, Y. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12594 · Cited by 13
Boosting Search Engines with Interactive Agents
Adolphs, L., Börschinger, B., Buck, C., Huebscher, M. C., Ciaramita, M., Espeholt, L., Hofmann, T., Kilcher, Y., Rothe, S., Sessa, P. G., et al. (2021) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000591593 · Cited by 18
A New Open-Source Off-Road Environment for Benchmark Generalization of Autonomous Driving
Han, I., Park, D.-H., & Kim, K.-J. (2021) · IEEE Access · doi:10.1109/access.2021.3116710 · Cited by 9
Deep Learning and Computational Chemistry
James, T., & Hristozov, D. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1787-8_5 · Cited by 9
Automating Reinforcement Learning With Example-Based Resets
Kim, J., Park, J. H., Cho, D., & Kim, H. J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3173039 · Cited by 9
Peer Incentive Reinforcement Learning for Cooperative Multiagent Games
Zhang, T., Liu, Z., Pu, Z., & Yi, J. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3196925 · Cited by 10
Liu, B., Xie, Y., Feng, L., & Fu, P. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105329 · Cited by 10
CryoRL: Reinforcement Learning Enables Efficient Cryo-EM Data Collection
Fan, Q., Li, Y., Yao, Y., Cohn, J., Liu, S., Xu, Z., Vos, S. M., & Cianfrocco, M. A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00771 · Cited by 9
SOAC: The Soft Option Actor-Critic ArchitecturePreprint
Li, C., Ma, X., Zhang, C., Yang, J. J., Xia, L., & Zhao, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14363 · Cited by 9
WordCraft: An Environment for Benchmarking Commonsense AgentsPreprint
Jiang, M., Luketina, J., Nardelli, N., Minervini, P., Torr, P. H. S., Whiteson, S., & Rocktäschel, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.09185 · Cited by 15
SuperSuit: Simple Microwrappers for Reinforcement Learning EnvironmentsPreprint
Terry, J. K., Black, B., & Hari, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.08932 · Cited by 9
Dynamic Games in Empirical Industrial Organization
Aguirregabiria, V., Collard‐Wexler, A., & Ryan, S. (2021) · National Bureau of Economic Research · doi:10.3386/w29291 · Cited by 9
TD-MPC2: Scalable, Robust World Models for Continuous Control
Hansen, N., Su, H., & Wang, X. (2023) · arXiv · doi:10.48550/arxiv.2310.16828 · Cited by 8
“As a result, successful application of deep RL often requires large teams of experts with significant computational resources (Berner et al., 2019; Schrittwieser et al., 2020; Ouyang et al., 2022).”
BackgroundWang, L., Yang, H., Lin, Y., Yin, S., & Wu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125389 · Cited by 19
HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
Ding, Y., Botzer, N., & Weninger, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17813 · Cited by 10
Supervised pre-training for improved stability in deep reinforcement learning
Jang, S., & Kim, H.-I. (2022) · ICT Express · doi:10.1016/j.icte.2021.12.015 · Cited by 8
Self-adapting WIP parameter setting using deep reinforcement learning
Silva, M. T. D. A. E., & Azevedo, A. L. (2022) · Computers & Operations Research · doi:10.1016/j.cor.2022.105854 · Cited by 8
Rigoli, L. M., Patil, G., Nalepka, P., Kallen, R. W., Hosking, S. G., Best, C. J., & Richardson, M. J. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221092930 · Cited by 10
Multi-Agent Deep Reinforcement Learning in Flying Ad-Hoc Networks for Delay-Constrained Applications
Grasso, C., Raftopoulos, R., & Schembra, G. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.07.011 · Cited by 8
Multiexperience-Assisted Efficient Multiagent Reinforcement Learning
Zhang, T., Liu, Z., Yi, J., Wu, S., Pu, Z., & Zhao, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264275 · Cited by 8
DanZero: Mastering GuanDan Game with Reinforcement Learning
Lu, Y., Zhao, J. Q., Zhao, Y., Zhou, W., & Li, H. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333179 · Cited by 9
Management of investment portfolios employing reinforcement learning
Santos, G. C., Garruti, D. V. T., Barboza, F., de Souza, K. G., Domingos, J. C., & Veiga, A. C. P. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1695 · Cited by 9
Enabling Rural IoV Communication through Decentralized Clustering and Federated Learning
Scott, C., Khan, M. S., Paranjothi, A., & Li, Q. (2024) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc60891.2024.10427882 · Cited by 8
FM3Q: Factorized Multi-Agent MiniMax Q-Learning for Two-Team Zero-Sum Markov Game
Hu, G., Zhu, Y., Li, H., & Zhao, D. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3383454 · Cited by 8
Strand, A., Gorton, P. R., & Bråthen, K. (2025) · IEEE Access · doi:10.1109/access.2025.3580279 · Cited by 18
SAFE-RL: Saliency-Aware Counterfactual Explainer for Deep Reinforcement Learning Policies
Samadi, A., Koufos, K., Debattista, K., & Dianati, M. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3414270 · Cited by 8
TVDO: Tchebycheff Value-Decomposition Optimization for Multiagent Reinforcement Learning
Hu, X., Guo, P., Li, Y., Li, G., Cui, Z., & Yang, J. J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3455422 · Cited by 8
A State Representation Dueling Network for Deep Reinforcement Learning
Qiu, H.-M., & Liu, F. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00107 · Cited by 8
Policy Fusion for Adaptive and Customizable Reinforcement Learning Agents
Sestini, A., Kuhnle, A., & Bagdanov, A. D. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9618983 · Cited by 10
Reinforcement Learning Environment for Tactical Networks
Mohlenhof, T., Jansen, N., & Rachid, W. (2021) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis52405.2021.9486411 · Cited by 8
A Generalized Stacked Reinforcement Learning Method for Sampled Systems
Osinenko, P., Dobriborsci, D., Yaremenko, G., & Malaniya, G. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3250032 · Cited by 8
Tang, B., Li, Z., & Han, K. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564834 · Cited by 8
Avoiding collaborative paradox in multi‐agent reinforcement learning
Kim, H., Kim, S., Lee, D., & Jang, I. (2021) · ETRI Journal · doi:10.4218/etrij.2021-0010 · Cited by 8
Speedup Training Artificial Intelligence for Mahjong via Reward Variance Reduction
Li, J., Wu, S., Fu, H., Fu, Q., Zhao, E., & Xing, J. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893584 · Cited by 8
Alexander, F., Abdiwijaya, E. A., Pherry, F., Gunawan, A. A. S., & Anderies (2022) · International Conference on Software Engineering and Information Technology (ICoSEIT) · doi:10.1109/icoseit55604.2022.10029949 · Cited by 7
PROBLEMS OF THE DEVELOPMENT OF SCIENCE AND THE VIEW OF SOCIETY
International Science Group, & Vladlenov, D. (2023) · doi:10.46299/isg.p.2023.1.11 · Cited by 8
Yang, S., Barlow, M., Townsend, T., Liu, X., Samarasinghe, D., Lakshika, E., Moy, G., Lynar, T., & Turnbull, B. (2023) · IEEE Access · doi:10.1109/access.2023.3287100 · Cited by 10
Deep Incubation: Training Large Models by Divide-and-Conquering
Ni, Z., Wang, Y., Yu, J., Jiang, H., Cao, Y., & Huang, G. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01590 · Cited by 11
Niroomand, M. P., Dicks, L., Pyzer‐Knapp, E. O., & Wales, D. J. (2024) · Digital Discovery · doi:10.1039/d3dd00204g · Cited by 8
Policy Entropy for Out-of-Distribution Classification
Sedlmeier, A., Müller, R., Illium, S., & Linnhoff–Popien, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61616-8_34 · Cited by 8
Fast Adaptation via Policy-Dynamics Value FunctionsPreprint
Răileanu, R., Goldstein, M., Szlam, A. D., & Fergus, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02879 · Cited by 13
Planning from Pixels using Inverse Dynamics ModelsPreprint
Paster, K., McIlraith, S. A., & Ba, J. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02419 · Cited by 28
Solving Compositional Reinforcement Learning Problems via Task ReductionPreprint
Li, Y., Wu, Y., Xu, H., Wang, X., & Wu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07607 · Cited by 10
Why is AI hard and Physics simple?Preprint
Roberts, D. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00008 · Cited by 14
Adapting ImageNet-scale models to complex distribution shifts with self-learningPreprint
Rusak, E., Schneider, S., Gehler, P., Bringmann, O., Brendel, W., & Bethge, M. (2021) · arXiv (Cornell University) · Cited by 8
Huang, S., Ontañón, S., Bamford, C., & Grela, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13807 · Cited by 8
No-Press Diplomacy from ScratchPreprint
Bakhtin, A., Wu, D., Lerer, A. K., & Brown, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02924 · Cited by 10
TiKick: Towards Playing Multi-agent Football Full Games from Single-agent DemonstrationsPreprint
Huang, S., Chen, W., Zhang, L., Xu, S., Li, Z., Zhu, F., Ye, D., Chen, T., & Zhu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04507 · Cited by 32
Identifying Resource-Rational Heuristics for Risky ChoicePreprint
Krueger, P. M., Callaway, F., Gul, S., Griffiths, T. L., & Lieder, F. (2022) · doi:10.31234/osf.io/mg7dn · Cited by 9
Scaling Scaling Laws with Board Games
Jones, A. L. (2021) · arXiv · doi:10.48550/arxiv.2104.03113 · Cited by 7
Lehna, M., Holzhüter, C., Tomforde, S., & Scholz, C. (2024) · Sustainable Energy, Grids and Networks · doi:10.1016/j.segan.2024.101510 · Cited by 12
Zhou, W., Fotouhi, H., & Miller-Hooks, E. D. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114388 · Cited by 7
A general framework for reinforcement learning in cognitive architectures
Morais, G., Sakabe, E. Y., Costa, P. D. P., Simões, A. D. S., Gudwin, R., & Colombini, E. L. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101354 · Cited by 7
Moradzadeh, S., Zhang, Z., Gui, X., & Kou, Y. (2025) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-025-09519-z · Cited by 9
Cooperative Multi-Agent Deep Reinforcement Learning with Counterfactual Reward
Shao, K., Zhu, Y., Tang, Z., & Zhao, D. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207169 · Cited by 7
The Implementation of Reinforcement Learning Algorithm for AI Bot in Fighting Video Game
Ramlan, A. A. B., Ali, A. M., Hamid, N. H. A., & Osman, R. (2021) · International Symposium on Agents, Multi-Agent Systems and Robotics (ISAMSR) · doi:10.1109/isamsr53229.2021.9567749 · Cited by 7
Safe Robot Navigation Using Constrained Hierarchical Reinforcement Learning
Roza, F. S., Rasheed, H., Roscher, K., Ning, X., & Günnemann, S. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00123 · Cited by 7
Philosophers ought to develop, theorize about, and use philosophically relevant AI
Clay, G., & Ontiveros, C. (2023) · Metaphilosophy · doi:10.1111/meta.12647 · Cited by 9
Deep Reinforcement Learning for Downlink Scheduling in 5G and Beyond Networks: A Review
Seguin, M., Omer, A., Koosha, M., Malandra, F., & Mastronarde, N. (2023) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc56721.2023.10293754 · Cited by 8
Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination
Seraj, E., Paleja, R., Pimentel, L., Lee, K. M., Wang, Z., Martin, D., Sklar, M., Zhang, J. Z., Kakish, Z., & Gombolay, M. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3431829 · Cited by 8
Learning to Move Like Professional Counter‐Strike Players
Durst, D., Xie, F., Sarukkai, V., Shacklett, B., Frosio, I., Tessler, C., Kim, J., Taylor, C., Bernstein, G., Choudhury, S., et al. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15173 · Cited by 7
Human strategy learning-based multi-agent deep reinforcement learning for online team sports game
Lee, S., Lee, G., Kim, W., Kim, J., Park, J., & Cho, K. (2025) · IEEE Access · doi:10.1109/access.2025.3531435 · Cited by 7
Generalising Discrete Action Spaces with Conditional Action Trees
Bamford, C., & Ovalle, A. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619093 · Cited by 9
Learning the Fastest RNA Folding Path Based on Reinforcement Learning and Monte Carlo Tree Search
Mao, K., & Xiao, Y. (2021) · Molecules · doi:10.3390/molecules26154420 · Cited by 7
A Data-Driven Simulator for Assessing Decision-Making in Soccer
Mendes-Neves, T., Mendes‐Moreira, J., & Rossetti, R. J. F. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86230-5_54 · Cited by 7
Two-stage training algorithm for AI robot soccer
Kim, T., Vecchietti, L. F., Choi, K., Sarıel, S., & Har, D. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.718 · Cited by 9
Navigational Behavior of Humans and Deep Reinforcement Learning Agents
Rigoli, L. M., Patil, G., Stening, H., Kallen, R. W., & Richardson, M. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.725932 · Cited by 7
Learning Cooperative Multi-Agent Policies With Partial Reward Decoupling
Freed, B., Kapoor, A., Abraham, I., Schneider, J., & Choset, H. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3135930 · Cited by 10
Self-citationGong, Y., Guo, J., Lin, D.-L., Zuo, Y.-L., Liang, J.-C., Luo, L.-J., Shao, X.-X., Zhou, C., & Li, M. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3145886 · Cited by 7
Skills to Drive: Successor Features for Autonomous Highway Pilot
Szőke, L., Aradi, S., Bécsi, T., & Gáspár, P. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3150493 · Cited by 7
Off-Policy Meta-Reinforcement Learning With Belief-Based Task Inference
Imagawa, T., Hiraoka, T., & Tsuruoka, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3170582 · Cited by 7
A Novel and Efficient Influence-Seeking Exploration in Deep Multiagent Reinforcement Learning
Yoo, B., Ningombam, D. D., Yi, S., Kim, H. W., Chung, E., Han, R., & Song, H. J. (2022) · IEEE Access · doi:10.1109/access.2022.3171053 · Cited by 7
Janusz, A., Kałuża, D., Matraszek, M., Grad, Ł., Świechowski, M., & Ślȩzak, D. (2022) · Information Sciences · doi:10.1016/j.ins.2022.10.097 · Cited by 7
Generalized Maximum Entropy Reinforcement Learning via Reward Shaping
Tao, F., Wu, M., & Cao, Y. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3297988 · Cited by 8
Fuzzing with Sequence Diversity Inference for Sequential Decision-making Model Testing
Wang, K., Wang, Y., Wang, J., & Wang, Q. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00041 · Cited by 9
Hicks, C., Mavroudis, V., Foley, M., Davies, T., Highnam, K., & Watson, T. (2023) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3605764.3623986 · Cited by 10
Deep Reinforcement Learning Approach for Augmented Reality Games
Magdy, R., Rashad, S., Hany, M. A. S., Tarek, M., Hassan, M. A., & Mohammed, A. (2021) · International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) · doi:10.1109/miucc52538.2021.9447671 · Cited by 7
InferNet for Delayed Reinforcement Tasks: Addressing the Temporal Credit Assignment Problem
Ausin, M. S., Azizsoltani, H., Ju, S., Kim, Y. J., & Chi, M. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671827 · Cited by 8
Weakly-Supervised Reinforcement Learning for Controllable BehaviorPreprint
Lee, L., Eysenbach, B., Salakhutdinov, R., Gu, S., & Finn, C. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2004.02860 · Cited by 28
A Policy Gradient Method for Task-Agnostic ExplorationPreprint
Mutti, M., Pratissoli, L., & Restelli, M. (2020) · arXiv (Cornell University) · Cited by 7
Provable Fictitious Play for General Mean-Field GamesPreprint
Xie, Q., Yang, Z., Wang, Z., & Minca, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04211 · Cited by 14
Key Concepts in AI Safety: Interpretability in Machine Learning
Rudner, T. G. J., & Toner, H. (2021) · doi:10.51593/20190042 · Cited by 7
Esports Agents with a Theory of Mind: Towards Better Engagement, Education, and EngineeringPreprint
Shergadwala, M., & El‐Nasr, M. S. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/qjcg9 · Cited by 12
A Generalizable Approach to Learning OptimizersPreprint
Almeida, D., Winter, C., Tang, J., & Zaremba, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.00958 · Cited by 32
Self-citationMava: a research framework for distributed multi-agent reinforcement learning.Preprint
Pretorius, A., Tessera, K.-A., Smit, A. P., Formanek, C., Grimbly, S. J., Eloff, K., Danisa, S., Francis, L., Shock, J. P., Kamper, H., et al. (2021) · arXiv (Cornell University) · Cited by 8
Heterogeneous Graph Attention Networks for Learning Diverse CommunicationPreprint
Seraj, E., Wang, Z., Paleja, R., Sklar, M., Patel, A., & Gombolay, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.09568 · Cited by 18
Metadata
- Authors
- OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C., Józefowicz, R., Gray, S., Olsson, C., Pachocki, J., Petrov, M., Pinto, H. P. D. O., Raiman, J., Salimans, T., Schlatter, J., Schneider, J., Sidor, S., Sutskever, I., Tang, J., Wolski, F., & Zhang, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1912.06680
- OpenAlex
- W2996037775
- Cited by
- 1,065
- References
- 37
- Citations by year
- 2026: 6 · 2025: 66 · 2024: 178 · 2023: 186 · 2022: 197 · 2021: 273 · 2020: 152 · 2019: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- Dota 2, self-play, distributed training, continuous training, imperfect information games, long time horizons, continuous state and action spaces, esports
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
