PreprintCited by 1,065Artificial Intelligence in GamesReinforcement Learning in RoboticsArtificial Intelligence Applications

The DOI matches its DataCite record; 35 of the 37 references it cites were found in a registry or an index, and 2 are not checked yet.

Dota 2 with Large Scale Deep Reinforcement Learning

Open access

OpenAI, :, Berner, Christopher, Brockman, Greg, Chan, Brooke, Cheung, Vicki, Dębiak, Przemysław, Dennison, Christy, Farhi, David, Fischer, Quirin, Hashme, Shariq, Hesse, Chris, Józefowicz, Rafal, Gray, Scott, Olsson, Catherine, Pachocki, Jakub, Petrov, Michael, Pinto, Henrique P. d. O., Raiman, Jonathan, Salimans, Tim, Schlatter, Jeremy, Schneider, Jonas, Sidor, Szymon, Sutskever, Ilya, Tang, Jie, Wolski, Filip, Zhang, Susan·2019·arXiv

DOI 10.48550/arxiv.1912.06680arXiv 1912.06680

Open this paper in CoChat — free account Open PDF

Abstract

On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1912.06680

Cites

35 of 37 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Self-citation
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citation
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Learning to Forget: Continual Prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 6,122
Learning without Forgetting
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562 · cited 2×
“For comparison Chess requires around one thousand values per observation (mostly 6-possibility categorical values) and Go around six thousand values (all binary)[12].”
BackgroundMethod
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294

Show all 37 references

Research works printed but not linked: 12

[15]15. Konda, V. R. & Tsitsiklis, J. N. Actor-critic algorithms in Advances in neural information processing systems (2000), 1008-1014.
[16]16. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous methods for deep reinforcement learning in International conference on machine learning (2016), 1928-1937.
[17]17. Schulman, J., Moritz, P., Levine, S., Jordan, M. I. & Abbeel, P. High-Dimensional Continuous Control Using Generalized Advantage Estimation. CoRR abs/1506.02438 (2016). · arXiv
[23]23. Chen, T., Goodfellow, I. J. & Shlens, J. Net2Net: Accelerating Learning via Knowledge Transfer in 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings (2016). < http://arxiv.org/abs/ 1511.05641 >.
[27]27. Herbrich, R., Minka, T. & Graepel, T. TrueSkill: a Bayesian skill rating system in Advances in neural information processing systems (2007), 569-576.
[38]38. Anthony, T., Tian, Z. & Barber, D. Thinking fast and slow with deep learning and tree search in Advances in Neural Information Processing Systems (2017), 5360-5370.
[41]41. Kulkarni, T. D., Narasimhan, K., Saeedi, A. & Tenenbaum, J. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation in Advances in neural information processing systems (2016), 3675-3683.
[47]47. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D. & Kavukcuoglu, K. Asynchronous Methods for Deep Reinforcement Learning in Proceedings of The 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48 (PMLR, New York, New York, USA, June 2016), 1928-1937. < http://proceedings.mlr.press/ v48/mniha16.html >.
[49]49. Fahlman, S. E. & Lebiere, C. in (ed Touretzky, D. S.) 524-532 (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1990). isbn : 1-55860-100-7. < http://dl.acm.org/ citation.cfm?id=109230.107380 >.
[53]53. Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R. & Hadsell, R. Progressive Neural Networks. arXiv preprint arXiv:1606.04671 (2016). · arXiv
[54]54. Hinton, G., Vinyals, O. & Dean, J. Distilling the Knowledge in a Neural Network in NIPS Deep Learning and Representation Learning Workshop (2015). < http://arxiv.org/abs/ 1503.02531 >.
[59]59. Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J. & Zaremba, W. OpenAI Gym. CoRR abs/1606.01540. arXiv: 1606.01540 . < http://arxiv.org/ abs/1606.01540 > (2016). · arXiv

Sorted by citations

Items 701–800 of 1,023

Deep Reinforcement Learning Using a Low-Dimensional Observation Filter for Visual Complex Video Game Playing
Kich, V. A., de Jesus, J. C., Grando, R. B., Kolling, A. H., Heisler, G. V., & Guerra, R. D. S. (2021) · Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames) · doi:10.5753/sbgames_estendido.2021.19659 · Cited by 3
Fast and Data Efficient Reinforcement Learning from Pixels via Non-parametric Value Approximation
Long, A., Blair, A., & van Hoof, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20728 · Cited by 3
Programmatic Modeling and Generation of Real-Time Strategic Soccer Environments for Reinforcement Learning
Azad, A. S., Kim, E., Wu, Q., Lee, K., Stoica, I. G., Abbeel, P., Sangiovanni-Vincentelli, A. L., & Seshia, S. A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20549 · Cited by 3
CST-Godot: Bridging the Gap Between Game Engines and Cognitive Agents
Morais, G., Loron, I., Coletta, L. F. S., da Silva, A. A., Simões, A. D. S., Gudwin, R., Costa, P. D. P., & Colombini, E. L. (2022) · Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) · doi:10.1109/sbgames56371.2022.9961082 · Cited by 3
Small Nash Equilibrium Certificates in Very Large GamesPreprint
Zhang, B. H., & Sandholm, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16387 · Cited by 4
Single-partition adaptive Q-learningPreprint
Araújo, J. P., Figueiredo, M. A. T., & Botto, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06741 · Cited by 3
Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement LearningPreprint
Zhang, C., Odonkor, P., Zheng, S., Khorasgani, H., Serita, S., & Gupta, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10713 · Cited by 3
Self-Imitation Learning in Sparse Reward Settings.Preprint
Chen, Z., & Lin, M. (2020) · arXiv (Cornell University) · Cited by 3
Control with adaptive Q-learningPreprint
Araújo, J. P., Figueiredo, M. A. T., & Botto, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02141 · Cited by 3
Provably Breaking the Quadratic Error Compounding Barrier in Imitation Learning, OptimallyPreprint
Rajaraman, N., Han, Y., Yang, L. F., Ramchandran, K., & Jiao, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12948 · Cited by 3
Sparse Curriculum Reinforcement Learning for End-to-End Driving.Preprint
Agarwal, P., de Beaucorps, P., & de Charette, R. (2021) · arXiv (Cornell University) · Cited by 3
Optimize Neural Fictitious Self-Play in Regret Minimization ThinkingPreprint
Chen, Y., Zhang, L., Li, S., & Pan, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10845 · Cited by 3
Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-SolversPreprint
Marris, L., Müller, P. F., Lanctot, M., Tuyls, K., & Graepel, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09435 · Cited by 11
Baconian : a unified model-based reinforcement learning library
Dong, L. (2021) · doi:10.32657/10356/146557 · Cited by 3
Level generation and style enhancement -- deep learning for game development overviewPreprint
Migdał, P., Olechno, B., & Podgórski, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07397 · Cited by 2
Robust Risk-Sensitive Reinforcement Learning Agents for Trading MarketsPreprint
Gao, Y., Lui, K. Y.-C., & Hernandez-Leal, P. (2021) · arXiv.org · doi:10.48550/arxiv.2107.08083 · Cited by 10
Hierarchically Integrated Models: Learning to Navigate from Heterogeneous RobotsPreprint
Kang, K., Kahn, G., & Levine, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13280 · Cited by 5
Search in Imperfect Information GamesPreprint
Schmid, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05884 · Cited by 8
Fixed Points in Cyber Space: Rethinking Optimal Evasion Attacks in the Age of AI-NIDSPreprint
de Witt, C. S., Huang, Y., Torr, P. H. S., & Strohmeier, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.12197 · Cited by 5
Continuous Control With Ensemble Deep Deterministic Policy GradientsPreprint
Januszewski, P., Olko, M., Królikowski, M., Świątkowski, J., Andrychowicz, M., Kuciński, Ł., & Miłoś, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.15382 · Cited by 5
Explainable Biomedical Recommendations via Reinforcement Learning Reasoning on Knowledge GraphsPreprint
Edwards, G., Nilsson, S., Rózemberczki, B., & Papa, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10625 · Cited by 12
Autonomous Network Defence Using Multi-Agent Reinforcement Learning and Self-Play
Campbell, R. (2022) · doi:10.31979/etd.8pey-takb · Cited by 7
Proceedings of the XI International Scientific and Practical Conference
(2023) · doi:10.46299/isg.2023.1.11 · Cited by 3
Offline Policy Comparison Under Limited Historical Agent-Environment Interactions
Dereventsov, A., Daws, J., & Webster, C. (2024) · Lecture notes in computational science and engineering · doi:10.1007/978-3-031-55060-7_5 · Cited by 4
Multi-Agent Cooperative Games Using Belief Map Assisted Training
Luo, C., Huang, Q., Wu, A. B., Khan, S., Li, H. H., & Qiu, Q. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230444 · Cited by 2
Observation-Time-Action Deep Stacking Strategy: Solving Partial Observability Problems with Visual Input
Jiang, K., Wang, Q., Xu, Y., & Deng, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650736 · Cited by 3
Safe Reinforcement Learning via Episodic Control
Li, Z., Zhu, D., & Großklags, J. (2025) · IEEE Access · doi:10.1109/access.2025.3535679 · Cited by 2
Learning general multi-agent decision model through multi-task pre-training
Wang, J., Xu, L., & Sun, C. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129524 · Cited by 3
Multi-agent Reinforcement Learning for Sparse Reward Tasks Using Incremental Goal Enhanced Method
Han, M., Guo, Z., Sun, L., Ding, A., Wang, T., Zhao, G., & Ma, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4756-9_7 · Cited by 2
Intelligent Counterforce Allocation Method Using Multi-Agent Reinforcement Learning for Ground Operations
Park, K., & Shim, S. (2025) · IEEE Access · doi:10.1109/access.2025.3590019 · Cited by 2
Reinforcement Learning for decision support in defense and security: A systematic review
Schadd, M. P. D., Berman, D. S., Chen, C. M., Cohen, M., Dorsch, J., GEGOV, A. E., Moll, M., Rose, O., Rösner, A., Saastamoinen, K., et al. (2026) · Annals of Operations Research · doi:10.1007/s10479-026-07205-x · Cited by 4
Satellite Attitude Tracking Decision Method based on Deep Deterministic Policy Gradient for Moving Target Observation
Zhong, S. S., Jin, Z., & Wang, H. (2021) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac50856.2021.9390829 · Cited by 2
Delay Aware Universal Notice Network: Real world multi-robot transfer learning
Beaussant, S., Lengagne, S., Thuilot, B., & Stasse, O. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635917 · Cited by 2
Data-efficient Deep Reinforcement Learning Method Toward Scaling Continuous Robotic Task with Sparse Rewards
Ren, J., Zhang, Y., Zeng, Y., & Lan, Y. (2021) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar52367.2021.9517647 · Cited by 2
Deep Reinforcement Learning Approach for Flocking Control of Multi-agents
Zhang, H., & Cheng, J. (2021) · Chinese Control Conference (CCC) · doi:10.23919/ccc52363.2021.9549647 · Cited by 2
Precision Batching: Bitserial Decomposition for Efficient Neural Network Inference on GPUs
Lam, M., Yedidia, Z., Banbury, C., & Reddi, V. J. (2021) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1109/pact52795.2021.00017 · Cited by 3
Cognitive Shadowing for Learning Opponents in a Strategy Game Experiment
Lavoie-Hudon, L., Lafond, D., Labonté, K., & Tremblay, S. (2021) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3450337.3483453 · Cited by 2
Mitigating Cowardice for Reinforcement Learning Agents in Combat Scenarios
Bakos, S., & Davoudi, H. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893546 · Cited by 2
Genetic Programming + Multi-Agent Reinforcement Learning: Hybrid Approaches for Decision Processes
Fitch, N., & Clancy, D. J. (2022) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero53065.2022.9843637 · Cited by 2
Cognition-Enabled Robots Assist in Care and Everyday Life: Perspectives, Challenges, and Current Views and Insights
Beetz, M., Engel, U., & Langer, H. (2022) · SpringerBriefs in sociology · doi:10.1007/978-3-031-11447-2_6 · Cited by 2
Cooperative and competitive multi-agent deep reinforcement learning
Chen, R. (2022) · International Conference on Artificial Intelligence, Automation and High Performance Computing (AIAHPC) · doi:10.1117/12.2641830 · Cited by 3
DRLeague: a Novel 3D Environment for Training Reinforcement Learning Agents
Farrapo, H., Filho, R. F. F., Maia, J. G. R., & Serafim, P. B. S. (2022) · Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) · doi:10.1109/sbgames56371.2022.9961113 · Cited by 2
Mix-up Consistent Cross Representations for Data-Efficient Reinforcement Learning
Liu, S., Cao, G., Liu, Y., Li, Y., Wu, C., & Xi, X. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892416 · Cited by 2
Artificial Intelligence With Graph Neural Networks Applied to a Risk -Like Board Game
Bauer, A. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2023.3270162 · Cited by 2
DOTA2 Winner Team Prediction based on Stacked Bidirectional LSTM Network
Uddin, J., Fahmida, I., Moyeen, S. I., & Hasan, M. M. (2022) · International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE) · doi:10.1109/icecte57896.2022.10114527 · Cited by 2
Noise- and Fuel-Minimal Departure Trajectory Optimization with Reinforcement Learning
Nguyen, C. H., Shihua, J. M., Hui, K. Y., & Liem, R. P. (2023) · AIAA AVIATION Forum · doi:10.2514/6.2023-4215 · Cited by 2
Reinforcement learning methods in board and MOBA games
Chai, H. (2023) · Applied and Computational Engineering · doi:10.54254/2755-2721/2/20220556 · Cited by 3
Transferable Curricula through Difficulty Conditioned Generators
Tio, S., & Varakantham, P. R. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/543 · Cited by 5
Efficient Training of Foosball Agents Using Multi-agent Competition
Gashi, A., Hergenröther, E., & Grieser, G. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-37717-4_30 · Cited by 2
Gamer in the scanner: Event-related analysis of fMRI activity during retro videogame play guided by automated annotations of game content
Harel, Y., Pinsard, B., Boyle, J. A., Borghesani, V., Clei, M. L., Mignot, P.-H., St‐Laurent, M., Jerbi, K., & Bellec, P. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1256 · Cited by 2
Mixture of Public and Private Distributions in Imperfect Information Games
Arjonilla, J., Saffidine, A., & Cazenave, T. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333169 · Cited by 2
Personalized Decision Supports based on Theory of Mind Modeling and Explainable Reinforcement Learning
Li, H., Fan, Y., Zheng, K., Lewis, M., & Sycara, K. P. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394414 · Cited by 2
Learning Environment For The Air Domain (Lead)
Strand, A., Gorton, P., Asprusten, M., & Bråthen, K. (2023) · Winter Simulation Conference · doi:10.1109/wsc60868.2023.10408232 · Cited by 2
A review of artificial intelligence in video games: From preset scripts to self-learning
Zhu, J. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/49/20241083 · Cited by 1
Data Poisoning to Fake a Nash Equilibria for Markov Games
Wu, Y., McMahan, J., Zhu, X., & Xie, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29529 · Cited by 5
Integrating human learning and reinforcement learning: A novel approach to agent training
Li, Y.-H., Zhang, F., Hua, Q., & Zhou, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111782 · Cited by 2
Exploring the relationship between personality and gaming disorder symptoms in a sample of Dota 2 players
Bäcklund, C., Sörman, D. E., Röhlcke, S., & Nyström, M. B. T. (2024) · Current Psychology · doi:10.1007/s12144-024-06180-5 · Cited by 3
Neural Network-Based Information Set Weighting for Playing Reconnaissance Blind Chess
Bertram, T., Fürnkranz, J., & Müller, M. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3425803 · Cited by 2
Design of Military Chess System Based on Alpha-Beta Pruning Algorithm
Wang, J., Liu, M., & Zhao, G. (2024) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc62350.2024.10588263 · Cited by 2
A Simple, Solid, and Reproducible Baseline for Bridge Bidding AI
Kita, H., Koyamada, S., Yamaguchi, Y., & Shin, I. (2024) · IEEE Conference on Games (CoG) · doi:10.1109/cog60054.2024.10645547 · Cited by 2
Ultra-fast and accurate force spectrum prediction and inverse design of light-driven microstructure by deep learning
Dongyong, W., Li, X., & Ng, J. T. F. (2024) · Optics Express · doi:10.1364/oe.537005 · Cited by 2
Diversifying Policies With Non-Markov Dispersion to Expand the Solution Space
Qu, B., Cao, X., Chang, Y., Tsang, I. W.-H., & Ong, Y.-S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3455257 · Cited by 2
APC: Predict Global Representation From Local Observation In Multi-Agent Reinforcement Learning
Li, X., Yang, G., Zhang, D., & Tao, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651100 · Cited by 2
TaCoD: Tasks-Commonality-Aware World in Meta Reinforcement Learning
Xiong, X., Xu, S., & Xu, B. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10649914 · Cited by 2
Deep reinforcement learning based magnet design for arm MRI system
Pang, Y., Guo, Y., Liu, Y., Song, Z., & Wang, Z. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02382-2 · Cited by 2
GP-PAIL: Generative Adversarial Imitation Learning in Massive-Agent Environments
Li, Y., Wang, B., & Su, J. (2024) · IEEE International Conference on Big Data and Artificial Intelligence (BDAI) · doi:10.1109/bdai62182.2024.10692671 · Cited by 2
FPGA-based Acceleration of Deep Q-Networks with STANN-RL
Rothmann, M., & Porrmann, M. (2024) · International Conference on Fog and Mobile Edge Computing (FMEC) · doi:10.1109/fmec62297.2024.10710277 · Cited by 2
Reducing Redundant Computation in Multi-Agent Coordination through Locally Centralized Execution
Bai, Y., & Sugawara, T. (2024) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai63651.2024.00073 · Cited by 2
To Cooperate or Not: Multi-Agent Reinforcement Learning-Based On-Ramp Merging Strategies for Autonomous Vehicles
Wang, D., Xu, G., & Wu, Z. (2024) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case59546.2024.10711529 · Cited by 2
Purified Policy Space Response Oracles for Symmetric Zero-Sum Games
Shao, Z., Zhuang, L., Huang, Y., Li, H., & Wang, S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3457509 · Cited by 2
Development and Deployment of Reinforcement Learning based Control for Large Scale Decision-Making in Manufacturing: A Case Study
Maske, H., Upadhyay, D., & Long, S. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10886812 · Cited by 2
Diverse Collaboration in Multi-Agent Reinforcement Learning via Self-Adaptive Method
Xue, X., Liu, Q., Shi, M., & Jin, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887769 · Cited by 2
Reward Function Analysis for Deep Reinforcement Learning Agent in Goal-Oriented Navigation
Drid, A. H., Debilou, A., Chouchane, A., Lahmar, O., & Ghiloubi, I. B. (2025) · International Symposium on iNnovative Informatics of Biskra (ISNIB) · doi:10.1109/isnib64820.2025.10983527 · Cited by 2
A Survey of Non-Learning-Based Abstractions for Sequential Decision-Making
Schmöcker, R., & Dockhorn, A. (2025) · IEEE Access · doi:10.1109/access.2025.3572830 · Cited by 2
Dynamic Visual Attention-based Neuron Awakening and Shifting in deep reinforcement learning
Ma, J., Li, C., Feng, Z., & Xiao, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111486 · Cited by 3
Using Counterfactual Reasoning and Reinforcement Learning for Decision-Making in Autonomous Driving.
Hart, P., & Knoll, A. (2020) · Cited by 2
Training a Reinforcement Learning Agent based on XCS in a Competitive Snake Environment
Büttner, J., & von Mammen, S. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619161 · Cited by 2
How feasible is end-to-end deep learning for clinical neuroimaging?
Farrugia, N. (2022) · Journal of Neuroradiology · doi:10.1016/j.neurad.2022.10.002 · Cited by 2
9. From Turing’s Speculations to an Academic Discipline: A History of AI Existential Safety
Burden, J., Clarke, S., & Whittlestone, J. (2023) · Open Book Publishers · doi:10.11647/obp.0336.09 · Cited by 2
Coevolutionary Deep Reinforcement Learning
Cotton, D., Traish, J. M., & Chaczko, Z. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308290 · Cited by 2
Self-Play or Group Practice: Learning to Play Alternating Markov Game in Multi-Agent System
Leung, C.-W., Hu, S., & Leung, H.-F. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412176 · Cited by 2
Deep hierarchical reinforcement learning to manage the trade-off between sustainability and profitability in common pool resources systems
POIRON-GUIDONI, N., & Bisgambiglia, P.-A. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534024 · Cited by 2
Balancing detectability and performance of attacks on the control channel of Markov Decision Processes
Russo, A., & Proutière, A. (2022) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc53348.2022.9867848 · Cited by 2
VMAPD: Generate Diverse Solutions for Multi-Agent Games with Recurrent Trajectory Discriminators
Huang, S., Yu, C., Wang, B., Li, D., Wang, Y., Chen, T., & Zhu, J. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893722 · Cited by 2
LevDoom: A Benchmark for Generalization on Level Difficulty in Reinforcement Learning
Tomilin, T., Dai, T., Fang, M., & Pechenizkiy, M. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893707 · Cited by 2
OpenHoldem: A Benchmark for Large-Scale Imperfect-Information Game Research
Li, K., Xu, H., Zhao, E., Wu, Z., & Xing, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3280186 · Cited by 6
Underexplored Subspace Mining for Sparse-Reward Cooperative Multi-Agent Reinforcement Learning
Yu, Y., Yin, Q., Zhang, J., Chen, H., & Huang, K. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191833 · Cited by 2
Q-SAT: Value Factorization with Self-Attention for Deep Multi-Agent Reinforcement Learning
Hu, X., Zhao, J., Zhao, Y., Zhou, W., & Li, H. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191777 · Cited by 3
Creating Diverse Play-Style-Centric Agents through Behavioural Cloning
Ingram, B., van Alten, C. J., Klein, R., & Rosman, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v19i1.27521 · Cited by 2
DGPO: Discovering Multiple Strategies with Diversity-Guided Policy Optimization
Chen, W., Huang, S., Chiang, Y., Pearce, T., Tu, W.-W., Chen, T., & Zhu, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29019 · Cited by 6
COPSRO: An Offline Empirical Game Theoretic Method With Conservative Critic
Shao, Z., Zhuang, L., Li, H., & Wang, S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3454477 · Cited by 2
Scalable Multi-agent Reinforcement Learning Architecture for Semi-MDP Real-Time Strategy Games
Wang, Z., Wu, W., & Huang, Z. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-7670-6_36 · Cited by 2
X-BaD: A Flexible Tool for Explanation-Based Bias Detection
Pacini, M., Nesti, F., Biondi, A., & Buttazzo, G. (2021) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr51186.2021.9527956 · Cited by 2
Multi-agent Task Coordination Method Based on RCRS
Xueke, Y., Zhang, Y., Luo, J., & Wang, K. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-9492-9_254 · Cited by 2
Learning Task-Independent Game State Representations from Unlabeled Images
Trivedi, C., Makantasis, K., Liapis, A., & Yannakakis, G. N. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893648 · Cited by 3
Interpolated Experience Replay for Continuous Environments
von Pilchau, W. P., Stein, A., & Hähner, J. (2022) · International Joint Conference on Computational Intelligence · doi:10.5220/0011326900003332 · Cited by 2
Mimicking Evolution with Reinforcement LearningPreprint
Abrantes, J. P., Abrantes, A. J., & Oliehoek, F. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00048 · Cited by 5
Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement LearningPreprint
Singh, J., & Zheng, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.12254 · Cited by 2
Psychological and Neural Evidence for Reinforcement Learning: A Survey.Preprint
Subramanian, A., Chitlangia, S., & Baths, V. (2020) · arXiv (Cornell University) · Cited by 2
Agent Environment Cycle GamesPreprint
Terry, J. K., Grammel, N., Black, B., Hari, A., Horsch, C., & Santos, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13051 · Cited by 6

Authors: OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C., Józefowicz, R., Gray, S., Olsson, C., Pachocki, J., Petrov, M., Pinto, H. P. D. O., Raiman, J., Salimans, T., Schlatter, J., Schneider, J., Sidor, S., Sutskever, I., Tang, J., Wolski, F., & Zhang, S.
ORCID: Petrov, Michael
Raiman, Jonathan
Tang, Jie
Zhang, Susan
Venue: arXiv
Publisher: arXiv
Published: 2019
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1912.06680
arXiv: 1912.06680
OpenAlex: W2996037775
Cited by: 1,065
References: 37
Citations by year: 2026: 6 · 2025: 66 · 2024: 178 · 2023: 186 · 2022: 197 · 2021: 273 · 2020: 152 · 2019: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords: Dota 2, self-play, distributed training, continuous training, imperfect information games, long time horizons, continuous state and action spaces, esports

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Dota 2 with Large Scale Deep Reinforcement Learning

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks