Superhuman AI for multiplayer poker
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
AI now masters six-player poker: Computer programs have shown superiority over humans in two-player games such as chess, Go, and heads-up, no-limit Texas hold'em poker. However, poker games usually include six players—a much trickier challenge for artificial intelligence than the two-player variant. Brown and Sandholm developed a program, dubbed Pluribus, that learned how to play six-player no-limit Texas hold'em by playing against five copies of itself (see the Perspective by Blair and Saffidine). When pitted against five elite professional poker players, or with five copies of Pluribus playing against one professional, the computer performed significantly better than humans over the course of 10,000 hands of poker. Science , this issue p. 885 ; see also p. 864
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Yet, although AI outperforms humans in an ever-broadening range of tasks, from playing poker (20) and Go (21) to translating languages (22) and diagnosing skin cancer (23), it trails far behind when it comes to ToM.”
From Evaluating large language models in theory of mind tasks (2024) · cites this paper as [20]
In the citing paper
“This ability to strategically misrepresent information helped Pluribus become the first AI system to achieve superhuman performance in heads-up, no-limit Texas hold ’em poker.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [7]
In the citing paper
“Pluribus demonstrated a clear ability to bluff in a video of its game against five professional human poker players.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [7]
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084 · cited 2×
“Real-time search has been necessary for achieving super-human performance in many perfect-information games, including backgammon ( 18 ), chess ( 8 ), and Go ( 9 , 19 ).”
BackgroundMethodNash, J. (1951) · The Annals of Mathematics · doi:10.2307/1969529 · Cited by 7,002
Nash, J. (1989) · Cournot Oligopoly · doi:10.1017/cbo9780511528231.007 · Cited by 5,595
Zur Theorie der Gesellschaftsspiele
v. Neumann, J. (1928) · Mathematische Annalen · doi:10.1007/bf01448847 · Cited by 2,572
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618 · cited 2×
“Real-time search has been necessary for achieving super-human performance in many perfect-information games, including backgammon ( 18 ), chess ( 8 ), and Go ( 9 , 19 ).”
BackgroundMethodCampbell, M., Hoane, A. J., & Hsu, F.-H. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(01)00129-1 · Cited by 1,226
The Complexity of Computing a Nash Equilibrium
Daskalakis, C., Goldberg, P. W., & Papadimitriou, C. H. (2009) · SIAM Journal on Computing · doi:10.1137/070699652 · Cited by 921
DeepStack: Expert-level artificial intelligence in heads-up no-limit poker
Moravčík, M., Schmid, M., Burch, N., Lisý, V., Morrill, D., Bard, N., Davis, T., Waugh, K., Johanson, M., & Bowling, M. (2017) · Science · doi:10.1126/science.aam6960 · Cited by 786
Temporal Difference Learning and TD-Gammon
Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 764
Research works printed but not linked: 26
- S. Ganzfried T. Sandholm in International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) (2011) pp. 533–540.
- K. Berg T. Sandholm AAAI Conference on Artificial Intelligence (AAAI) (2017).
- L. S. Shapley Advances in Game Theory M. Drescher L. S. Shapley A. W. Tucker Eds. (Princeton Univ. Press 1964).
- T. Sandholm in AAAI Conference on Artificial Intelligence (AAAI) (2015) pp. 4127–4131. Senior Member Track.
- M. Johanson N. Burch R. Valenzano M. Bowling in International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2013) pp. 271–278.
- S. Ganzfried T. Sandholm in AAAI Conference on Artificial Intelligence (AAAI) (2014) pp. 682–690.
- N. Brown S. Ganzfried T. Sandholm in International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2015) pp. 7–15.
- M. Zinkevich M. Johanson M. H. Bowling C. Piccione in Neural Information Processing Systems (NeurIPS) (2007) pp. 1729–1736.
- E. G. Jackson AAAI Workshop on Computer Poker and Imperfect Information (2013).
- E. G. Jackson AAAI Workshop on Computer Poker and Imperfect Information (2016).
- N. Brown T. Sandholm in International Joint Conference on Artificial Intelligence (IJCAI) (2016) pp. 4238–4239.
- E. G. Jackson AAAI Workshop on Computer Poker and Imperfect Information Games (2017).
- M. Lanctot K. Waugh M. Zinkevich in M. Bowling Neural Information Processing Systems (NeurIPS) (2009) pp. 1078–1086.
- M. Johanson N. Bard M. Lanctot R. Gibson M. Bowling in International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2012) pp. 837–846.
- R. Gibson M. Lanctot N. Burch D. Szafron M. Bowling in AAAI Conference on Artificial Intelligence (AAAI) (2012) pp. 1355–1361.
- N. Brown T. Sandholm AAAI Conference on Artificial Intelligence (AAAI) (2019).
- S. Ganzfried T. Sandholm in International Joint Conference on Artificial Intelligence (IJCAI) (2013) pp. 120–128.
- N. Brown T. Sandholm B. Amos in Neural Information Processing Systems (NeurIPS) (2018) pp. 7663–7674.
- M. Johanson K. Waugh M. Bowling M. Zinkevich in International Joint Conference on Artificial Intelligence (IJCAI) (2011) pp. 258–265.
- N. Burch M. Schmid M. Moravcik D. Morill M. Bowling in AAAI Conference on Artificial Intelligence (AAAI) (2018) pp. 949–956.
- K. Waugh AAAI Workshop on Computer Poker and Imperfect Information (2013).
- A. Gilpin T. Sandholm T. B. Sørensen in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (2007) pp. 50–57.
- S. Ganzfried T. Sandholm in International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) (2015) pp. 37–45.
- N. Burch M. Johanson M. Bowling in AAAI Conference on Artificial Intelligence (AAAI) (2014) pp. 602–608.
- M. Moravcik M. Schmid K. Ha M. Hladik S. Gaukrodger in AAAI Conference on Artificial Intelligence (AAAI) (2016) pp. 572–578.
- N. Brown T. Sandholm in Neural Information Processing Systems (NeurIPS) (2017) pp. 689-699.
Cited by
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
“Since then, deep reinforcement learning (RL)- based programs and applications have been developed to determine the degree to which they can compete with human champion players in various games like Texas hold’em poker [11] and Dota 2 [12].”
BackgroundMulti-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
Zhang, K., Yang, Z., & Başar, T. (2021) · Studies in Systems, Decision and Control · doi:10.1007/978-3-030-60990-0_12 · Cited by 1,264
Accelerating scientific discovery with Co-Scientist
Gottweis, J., Weng, W., Daryin, A., Tu, T., Sirkovic, P., Myaskovsky, A., Glowaty, G., Weissenberger, F., Orlandi, A., Popovici, D., et al. (2026) · Nature · doi:10.1038/s41586-026-10644-y · Cited by 110
Improving the accuracy of medical diagnosis with causal machine learning
Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598
Alpaydın, E. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/13811.001.0001 · Cited by 374
Managing extreme AI risks amid rapid progress
Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., Harari, Y. N., Zhang, Y.-Q., Xue, L., Shalev-Shwartz, S., et al. (2024) · Science · doi:10.1126/science.adn0117 · Cited by 349
Evaluating large language models in theory of mind tasks
Kosinski, M. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2405460121 · Cited by 339
“Yet, although AI outperforms humans in an ever - broadening range of tasks, from playing poker ( 20 ) and Go ( 21 ) to translating languages ( 22 ) and diagnosing skin cancer ( 23 ), it trails far behind when it comes to ToM.”
BackgroundGame-Theoretic Multiagent Reinforcement Learning
Yang, Y., Ma, C., Ding, Z., McAleer, S., Jin, C., Wang, J., & Sandholm, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00583 · Cited by 136
Self-citationAgent-Based Modeling in Economics and Finance: Past, Present, and Future
Axtell, R. L., & Farmer, J. D. (2025) · Journal of Economic Literature · doi:10.1257/jel.20221319 · Cited by 240
A review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 270
A survey of multi-agent deep reinforcement learning with communication
Zhu, C., Dastani, M. M., & Wang, S. (2024) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-023-09633-6 · Cited by 391
“Many real-world scenarios, such as autonomous driving [1], sensor networks [2], robotics [3] and game-playing [4, 5], can be modeled as multi-agent systems.”
Deep reinforcement learning in computer vision: a comprehensive survey
Le, N., Rathour, V. S., Yamazaki, K., Luu, K., & Savvides, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10061-9 · Cited by 261
Direct shape optimization through deep reinforcement learning
Viquerat, J., Rabault, J., Kuhnle, A., Ghraieb, H., Larcher, A., & Hachem, E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110080 · Cited by 245
Di, X., & Shi, R. (2021) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2021.103008 · Cited by 235
Deep multiagent reinforcement learning: challenges and directions
Wong, A., Bäck, T., Kononova, A. V., & Plaat, A. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10299-x · Cited by 197
“2016) and the card game Poker (Brown and Sandholm 2018, 2019; Bowling et al.”
BackgroundCooperative and Competitive Multi-Agent Systems: From Optimization to Games
Wang, J., Hong, Y., Wang, J., Xu, J., Tang, Y., Han, Q.-L., & Kurths, J. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105506 · Cited by 231
AI deception: A survey of examples, risks, and potential solutions
Park, P. S., Goldstein, S., O’Gara, A., Chen, M., & Hendrycks, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100988 · Cited by 243
“• Bluffs: Pluribus, a poker-playing model created by Meta, successfully bluffed human players into folding (Brown et al. 2019).”
AI Deception: A Survey of Examples, Risks, and Potential Solutions
Park, P. S., Goldstein, S., O'Gara, A., Chen, M., & Hendrycks, D. (2023) · arXiv · doi:10.48550/arxiv.2308.14752 · Cited by 243
“• Bluffs: Pluribus, a poker-playing model created by Meta, successfully bluffed human players into folding (Brown et al. 2019).”
Human-level play in the game of Diplomacy by combining language models with strategic reasoning
Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., et al. (2022) · Science · doi:10.1126/science.ade9097 · Cited by 241
Self-citationRabault, J., & Kuhnle, A. (2019) · Physics of Fluids · doi:10.1063/1.5116415 · Cited by 217
AI and the Future of Skills, Volume 1: Capabilities and Assessments
OECD (2021) · Educational research and innovation · doi:10.1787/5ee71f34-en · Cited by 307
Deep reinforcement learning in medical imaging: A literature review
Zhou, S. K., Le, H. N., Luu, K., V Nguyen, H., & Ayache, N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102193 · Cited by 215
A Survey of Data-driven and Knowledge-aware eXplainable AI
Li, X.-H., Cao, C. C., Shi, Y., Bai, W., Gao, H., Qiu, L., Wang, C., Gao, Y., Zhang, S., Xue, X., et al. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2983930 · Cited by 224
Human-AI agency in the age of generative AI
Krakowski, S. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100560 · Cited by 162
Artificial intelligence and systemic risk
Daníelsson, J., Macrae, R., & Uthemann, A. (2022) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2021.106290 · Cited by 165
Mastering the game of Stratego with model-free multiagent reinforcement learning
Perolat, J., De Vylder, B., Hennes, D., Tarassov, E., Strub, F., de Boer, V., Muller, P., Connor, J. T., Burch, N., Anthony, T., et al. (2022) · Science · doi:10.1126/science.add4679 · Cited by 159
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
Tolan, S., Pesole, A., Martínez-Plumed, F., Fernández-Macías, E., Hernández-Orallo, J., & Gómez, E. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12647 · Cited by 165
“For instance, performing well in games such as checkers, chess, Go and poker (Silver et al., 2016, 2017; Brown and Sandholm, 2019), which is recorded in corresponding benchmarks, is not a required ability in any work-related task.”
BackgroundMachine learning in polymer informatics
Sha, W., Li, Y., Tang, S., Tian, J., Zhao, Y., Guo, Y., Zhang, W., Zhang, X., Lu, S., Cao, Y., et al. (2021) · InfoMat · doi:10.1002/inf2.12167 · Cited by 200
Optical synaptic devices with ultra-low power consumption for neuromorphic computing
Zhu, C., Liu, H., Wang, W., Xiang, L., Jiang, J., Shuai, Q., Yang, X., Zhang, T., Zheng, B., Wang, H., et al. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-01031-z · Cited by 182
Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focussed Mini-Review
Liu, R., Nageotte, F., Zanne, P., de Mathelin, M., & Dresp-Langley, B. (2021) · Robotics · doi:10.3390/robotics10010022 · Cited by 188
“In 2019, 159 Pluribus [28] showed its success over top human professionals in multiplayer poker, and OpenAI Five 160 [29] beat the previous world champions in a Dota 2 demonstration match.”
BackgroundSurvey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods
Cao, Y., Zhao, H., Cheng, Y., Shu, T., Chen, Y., Liu, G., Liang, G., Zhao, J., Yan, J., & Li, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3497992 · Cited by 174
“In different realms, deep RL algorithms have achieved promising performance, such as real-time strategy games [5], [6], board games [7], [8], energy management [9], and imperfect information games [10], [11].”
Vignon, C., Rabault, J., & Vinuesa, R. (2023) · Physics of Fluids · doi:10.1063/5.0143913 · Cited by 161
Chmait, N., & Westerbeek, H. M. (2021) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2021.682287 · Cited by 171
“…defeating Kasparov in Chess (Campbell et al., 2002), AlphaGo Zero defeating Lee Sedol in Go (Silver et al., 2017) (noting that AlphaZero is also unbeatable in chess) and Vinyals et al. (2019) AlphaStar in StarcraftII as well as superhuman AI for multiplayer poker (Brown and Sandholm, 2019).”
Artificial Intelligence to Power the Future of Materials Science and Engineering
Sha, W., Guo, Y., Yuan, Q. M., Tang, S., Zhang, X., Lu, S., Guo, X., Cao, Y., & Cheng, S. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.201900143 · Cited by 171
Accelerating scientific discovery with Co-Scientist
Gottweis, J., Weng, W.-H., Daryin, A., Tu, T., Sirkovic, P., Myaskovsky, A., Glowaty, G., Weissenberger, F., Orlandi, A., Popovici, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.18864 · Cited by 158
Harms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149
“…performance on a wider variety of narrow tasks with limited to no human supervision, including but not limited to increasingly complex board games [Brown and Sandholm 2019; Perolat et al. 2022; Silver et al. 2016, 2017] and video games [Mnih et al. 2013; Schrittwieser et al. 2020; Ye et al. 2021].”
BackgroundHumans rely more on algorithms than social influence as a task becomes more difficult
Bogert, E., Schecter, A., & Watson, R. T. (2021) · Scientific Reports · doi:10.1038/s41598-021-87480-9 · Cited by 144
Artificial intelligence in OCT angiography
Hormel, T. T., Hwang, T. S., Bailey, S. T., Wilson, D. J., Huang, D., & Jia, Y. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2021.100965 · Cited by 151
V-Learning—A Simple, Efficient, Decentralized Algorithm for Multiagent Reinforcement Learning
Jin, C., Liu, Q., Wang, Y., & Yu, T. (2023) · Mathematics of Operations Research · doi:10.1287/moor.2021.0317 · Cited by 157
Hemmer, P., Westphal, M., Schemmer, M., Vetter, S., Vössing, M., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584052 · Cited by 93
“Nowadays, the performance of AI models is similar to, and in certain application areas even exceeds the performance of human experts [12, 29, 64].”
BackgroundFutures of artificial intelligence through technology readiness levels
Martínez-Plumed, F., Gómez, E., & Hernández-Orallo, J. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2020.101525 · Cited by 130
Using games to understand the mind
Allen, K. R., Brändle, F., Botvinick, M., Fan, J. E., Gershman, S. J., Gopnik, A., Griffiths, T. L., Hartshorne, J. K., Hauser, T. U., Ho, M. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01878-9 · Cited by 174
Evaluating Large Language Models in Theory of Mind Tasks
Kosinski, M. (2023) · arXiv · doi:10.48550/arxiv.2302.02083 · Cited by 339
“Yet, although AI outperforms humans in an ever - broadening range of tasks, from playing poker ( 20 ) and Go ( 21 ) to translating languages ( 22 ) and diagnosing skin cancer ( 23 ), it trails far behind when it comes to ToM.”
BackgroundThe fundamental principles of reproducibility
Gundersen, O. E. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0210 · Cited by 90
“players of Atari [44], go, chess, shogi [45], poker [46] and Starcraft [47].”
BackgroundBuilding machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi-Xuan, T., Ho, M., Mansinghka, V., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 73
Humans perceive warmth and competence in artificial intelligence
McKee, K. R., Bai, X., & Fiske, S. T. (2023) · iScience · doi:10.1016/j.isci.2023.107256 · Cited by 93
Liu, H., Lai, V., & Tan, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479552 · Cited by 111
“1 INTRODUCTION As AI performance grows rapidly and often surpasses humans in constrained tasks [4, 23, 27, 48, 57], a critical challenge to enable social good is to understand how AI assistance can be used to enhance human performance.”
BackgroundUsing Human Feedback to Fine-tune Diffusion Models without Any Reward Model
Yang, K., Tao, J., Lyu, J., Ge, C., Chen, J., Shen, W., Zhu, X., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00854 · Cited by 306
“Like many RL methods [7, 51, 52] which give rewards by ∀ s t , a t ∈ σ, r ( s t , a t ) = 1 for winning the game and ∀ t ∈ σ, r ( s t , a t ) = − 1 for losing the game, we also assume that if the segment is preferred, then any state-action pair of the segment is better than the other segment.”
OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement LearningPreprint
Ajay, A., Kumar, A., Agrawal, P., Levine, S., & Nachum, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13611 · Cited by 135
“…Learning (RL) systems have achieved impressive performance in a variety of on-line settings such as games (Silver et al., 2016; Tesauro, 1995; Brown & Sandholm, 2019) and robotics (Levine et al., 2016; Dasari et al., 2019; Peters et al., 2010; Parmas et al., 2019; Pinto & Gupta, 2016; Nachum…”
BackgroundOpen Problems in Cooperative AI
Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., Larson, K., & Graepel, T. (2020) · arXiv · doi:10.48550/arxiv.2012.08630 · Cited by 93
A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making
Schemmer, M., Hemmer, P., Nitsche, M., Kühl, N., & Vössing, M. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534128 · Cited by 91
“In this context, AI’s continuously rising capabilities have surpassed human performance in an increasing number of tasks, such as playing poker [7], go [56], or correctly recognizing various categories of interest in images [24].”
BackgroundCreating Pro-Level AI for a Real-Time Fighting Game Using Deep Reinforcement Learning
Oh, I.-S., Rho, S., Moon, S., Son, S., Lee, H., & Chung, J. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3049539 · Cited by 99
“The Poker AI, Pluribus (Brown and Sandholm 2019), hand-tuned three different strategies on top of basic”
MethodRobust Reinforcement Learning using Adversarial PopulationsPreprint
Vinitsky, E., Du, Y., Parvate, K., Jang, K., Abbeel, P., & Bayen, A. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01825 · Cited by 107
“adversary in the robustness literature is in contrast to the multi-player game literature. In multi-player games, large sets of adversaries are used to ensure that an agent cannot easily be exploited [29, 5, 3]. Drawing inspiration from this literature, we introduce RAP (Robustness via Adversary Populations): a random…”
Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesPreprint
Brown, N., Bakhtin, A., Lerer, A. K., & Gong, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13544 · Cited by 221
“An alternative approach for depth-limited search in imperfect-information games that does not use a value function for PBSs was used in the Pluribus poker AI to defeat elite human professionals in multiplayer poker for the first time [16, 15].”
BackgroundMethodInfluentialSelf-citationShou, Z., Xu, C., Fu, Y., & Di, X. S. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103560 · Cited by 84
From Chess and Atari to StarCraft and Beyond: How Game AI is Driving the World of AI
Risi, S., & Preuss, M. (2020) · Künstliche Intell. · doi:10.1007/s13218-020-00647-w · Cited by 93
“However, also multi-player partial information games such as Poker [9] and even cooperative multi-player games such as Hanabi [39] have recently been tackled and AI players now exist that can play these games at the level of the best human players.”
BackgroundAgentic profiles for effective AI governance
Kasirzadeh, A., & Gabriel, I. (2026) · Nature · doi:10.1038/s41586-026-10805-z · Cited by 90
A Steering Algorithm for Redirected Walking Using Reinforcement Learning
Strauss, R. R., Ramanujan, R., Becker, A., & Peck, T. C. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.2973060 · Cited by 88
“…successes recently, enabling machines to surpass human performance in classic video games [31], defeat the world champion in the combinatorially daunting game of Go [44], achieve superhuman performance in multiplayer poker [7], and approach human-level dexterity for object manipulation [3].”
BackgroundXiang, X., & Foo, S. Y. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3030029 · Cited by 87
“Brown and Sandholm [49] proposed Pluribus, a superhuman AI capable of defeating elite human professionals in six-player no-limit Texas hold’em poker, with self-play through improved Monte Carlo CFR. Hearts and Wizard Hearts is a multi-player non-cooperative finite-state zero-sum imperfect-information game that can for…”
BackgroundA Survey on Explainable Artificial Intelligence Techniques and Challenges
Hanif, A., Zhang, X., & Wood, S. (2021) · 2021 IEEE 25th International Enterprise Distributed Object Computing Workshop (EDOCW) · doi:10.1109/edocw52865.2021.00036 · Cited by 62
Agentic Large Language Models, a Survey
Plaat, A., Van Duijn, M., Van Stein, N., Preuss, M., Van der Putten, P., & Batenburg, K. J. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.18675 · Cited by 75
Reward design for driver repositioning using multi-agent reinforcement learning
Shou, Z., & Di, X. S. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102738 · Cited by 90
Creating a large language model of a philosopher
Schwitzgebel, E., Schwitzgebel, D., & Strasser, A. (2024) · Mind & Language · doi:10.1111/mila.12466 · Cited by 73
Perspectives on adaptive dynamical systems
Sawicki, J., Berner, R., Loos, S. A. M., Anvari, M., Bader, R., Barfuß, W., Botta, N., Brede, N., Franović, I., Gauthier, D. J., et al. (2023) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0147231 · Cited by 84
Expertise increases planning depth in human gameplay
van Opheusden, B., Kuperwajs, I., Galbiati, G., Bnaya, Z., Li, Y., & Ma, W. J. (2023) · Nature · doi:10.1038/s41586-023-06124-2 · Cited by 115
Simplified Action Decoder for Deep Multi-Agent Reinforcement LearningPreprint
Hu, H., & Foerster, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02288 · Cited by 87
“This includes examples such as Go (Silver et al., 2016; 2017; 2018), poker (Brown & Sandholm, 2017; Moravˇcík et al., 2017; Brown & Sandholm, 2019) and chess (Campbell et al., 2002).”
MethodAlhazmi, K., Albalawi, F., & Sarathy, S. M. (2021) · Chemical Engineering Journal · doi:10.1016/j.cej.2021.130993 · Cited by 68
“Reinforcement learning has recently attracted attention due to its success in learning how to play complex games, such as the board game Go and multiplayer poker, without human knowledge or supervision [10, 11, 12].”
Integrated Traffic Control for Freeway Recurrent Bottleneck Based on Deep Reinforcement Learning
Wang, C., Xu, Y., Zhang, J., & Ran, B. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3141730 · Cited by 76
“Recently, reinforcement learning (RL) based artificial intelligence (A.I.) defeated top human professionals in complicated multiplayer games [8], [9].”
BackgroundReinforcement Learning: An OverviewPreprint
Murphy, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.05265 · Cited by 91
High-accuracy model-based reinforcement learning, a survey
Plaat, A., Kosters, W. A., & Preuß, M. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10335-w · Cited by 80
“More complex games, such as partial information (card games such as poker (Brown and Sandholm 2019)) or games with multiple actors (real-time strategy video games such as StarCraft (Vinyals et al. 2019; Ontanón et al. 2013; Wong et al. 2022)) are not used in the approaches that we survey here.”
Rethinking formal models of partially observable multiagent decision making
Kovařík, V., Schmid, M., BURCH, N. R., Bowling, M., & Lisý, V. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103645 · Cited by 62
Artificial Intelligence in Orthopedic Radiography Analysis: A Narrative Review
Chen, K. S.-M., Stotter, C., Klestil, T., & Nehrer, S. (2022) · Diagnostics · doi:10.3390/diagnostics12092235 · Cited by 66
“For example, in a game of chess or poker [22], the individual steps and sequences would be difficult to compute but the outcome of winning or losing can be predefined as a reward, and the algorithm learns the most optimal way of reaching it [20].”
BackgroundStudent of Games: A unified learning algorithm for both perfect and imperfect information games
Schmid, M., Moravčík, M., BURCH, N. R., Kadlec, R., Davidson, J., Waugh, K., Bard, N., Timbers, F., Lanctot, M., Holland, G. Z., et al. (2023) · Science Advances · doi:10.1126/sciadv.adg3256 · Cited by 94
“Search was then added and proved to be a crucial ingredient to achieve super-human success in no-limit variants ( 8 – 10 )].”
To Regulate or Not: A Social Dynamics Analysis of an Idealised AI Race
Han, T. A., Pereira, L. M., Santos, F. C., & Lenaerts, T. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12225 · Cited by 78
“This excitement is, on the one hand, due to a series of superhuman performances generated by particular breakthrough technologies (Silver et al., 2017; Brown & Sandholm, 2018; Silver et al., 2018; Brown & Sandholm, 2019).”
BackgroundThe Gamblification of Investing: How a New Generation of Investors Is Being Born to Lose
Newall, P. W. S., & Weiss‐Cohen, L. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19095391 · Cited by 67
“However, this profitability is not readily available to the average gambler, as nowadays professional gamblers resemble hedge funds in their use of large datasets and artificial intelligence [22,23].”
BackgroundEkundayo, O., & Ezugwu, A. E.-S. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113378 · Cited by 62
Loken, E. D., Clark, A. J., & Karstens, C. D. (2020) · Weather and Forecasting · doi:10.1175/waf-d-19-0258.1 · Cited by 59
Exploring optimal control of epidemic spread using reinforcement learning
Ohi, A. Q., Mridha, M. F., Monowar, M. M., & Hamid, M. A. (2020) · Scientific Reports · doi:10.1038/s41598-020-79147-8 · Cited by 89
DREAM: Deep Regret minimization with Advantage baselines and Model-free learningPreprint
Steinberger, E., Lerer, A. K., & Brown, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10410 · Cited by 66
“This mirrors the success of tabular CFR, variants of which are state-of-the-art among tabular equilibrium-finding algorithms [6] and which have been used in every major AI milestone in the domain of poker [2, 23, 5, 7].”
Self-citationA Review: Machine Learning for Combinatorial Optimization Problems in Energy Areas
Yang, X., Wang, Z., Zhang, H., Ma, N., Yang, N., Liu, H., Zhang, H., & Yang, L. (2022) · Algorithms · doi:10.3390/a15060205 · Cited by 60
“Multi-player poker game [227] and multi-player online battle arenas, such as DOTA 2 [228] and StarCraft 2 [229], are several classical applications using mixed settings, in which human-level or superhuman-level is achieved.”
BackgroundReal World Games Look Like Spinning TopsPreprint
Czarnecki, W. M., Gidel, G., Tracey, B., Tuyls, K., Omidshafiei, S., Balduzzi, D., & Jaderberg, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.09468 · Cited by 133
“, 2019] for DOTA 2, and Pluribus [Brown and Sandholm, 2019] for no-limit Texas Hold ’Em Poker.”
BackgroundNear-Optimal Reinforcement Learning with Self-PlayPreprint
Bai, Y., Jin, C., & Yu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12007 · Cited by 74
“Multi-agent RL has achieved significant recent success on traditionally challenging tasks, for example in the game of GO [30, 31], Poker [6], real-time strategy games [33, 22], decentralized controls or multiagent robotics systems [5], autonomous driving [27], as well as complex social scenarios such as hide-and-seek […”
BackgroundBossert, L. N., & Hagendorff, T. (2021) · Technology in Society · doi:10.1016/j.techsoc.2021.101678 · Cited by 57
Piao, H., Han, Y., Chen, H., Peng, X., Fan, S., Sun, Y., Chen, L., Liu, Z., Sun, Z., & Zhou, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119285 · Cited by 50
The WISED knowledge-creating company: rethinking SECI model in light of the digital transition
Cerchione, R., Centobelli, P., Borin, E., Usai, A., & Oropallo, E. (2024) · Journal of Knowledge Management · doi:10.1108/jkm-02-2024-0133 · Cited by 53
AI in Human-computer Gaming: Techniques, Challenges and Opportunities
Yin, Q., Yang, J. J., Huang, K., Zhao, M., Ni, W., Liang, B., Huang, Y., Wu, S., & Wang, L. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1384-6 · Cited by 55
“Those AIs defeat professional human players in certain games by a combination of modern techniques, indicating a big step of the decision making intelligence [9], [10], [11].”
BackgroundImproving Policies via Search in Cooperative Partially Observable Games
Lerer, A. K., Hu, H., Foerster, J., & Brown, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6208 · Cited by 50
Self-citationZhao, E., Yan, R., Li, J., Li, K., & Xing, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20394 · Cited by 78
“This restriction makes the training of a high-performance CFR-based HUNL AI computationally infeasible for most research institutions and prevents the application of the CFR model into larger IIGs.”
MethodInfluentialGrand challenges in industrial and systems engineering
Karwowski, W., Salvendy, G., Albert, L. A., Kim, W. C., Denton, B. T., Dessouky, M. M., Dolgui, A. B., Duffy, V. G., Kumara, S. R. T., Li, J., et al. (2025) · International Journal of Production Research · doi:10.1080/00207543.2024.2432463 · Cited by 52
“…that demonstrate ‘super-human’ performance in settings ranging from drone racing (Ack-erman 2023; Song et al.2023) to highly complex strategy games such as poker (Brown and Sandholm 2019), Star-Craft II (Simonite 2019), and Diplomacy (Meta Fundamental AI Research Diplomacy Team (FAIR) 2022).”
Quizbowl: The Case for Incremental Question AnsweringPreprint
Rodríguez, P., Feng, S., Iyyer, M., He, H., & Boyd-Graber, J. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04792 · Cited by 63
Scaling up Mean Field Games with Online Mirror DescentPreprint
Pérolat, J., Perrin, S., Élie, R., Laurière, M., Piliouras, G., Geist, M., Tuyls, K., & Pietquin, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00623 · Cited by 47
Decision Making in Monopoly Using a Hybrid Deep Reinforcement Learning Approach
Bonjour, T., Haliem, M., Alsalem, A. O., Thomas, S., Li, H., Aggarwal, V., Kejriwal, M., & Bhargava, B. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3166555 · Cited by 47
“3166555 diplomacy [4], Poker1 [6], and StarCraft [7], [8].”
Xie, Q., Chen, Y., Wang, Z., & Yang, Z. (2022) · Mathematics of Operations Research · doi:10.1287/moor.2022.1268 · Cited by 45
Learning equilibria in symmetric auction games using artificial neural networks
Bichler, M., Fichtl, M., Heidekrüger, S., Kohring, N., & Sutterer, P. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00365-4 · Cited by 77
“Although there has been significant recent work on imperfect-information finite-dimensional extensive-form games such as Poker or other card games [15, 16, 17, 18], relatively few papers focus on continuous-type and -action Bayesian games such as auctions.”
BackgroundThe role of information structures in game-theoretic multi-agent learning
Li, T., Zhao, Y., & Zhu, Q. (2022) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2022.03.003 · Cited by 69
Human-AI Collaboration in Cooperative Games: A Study of Playing Codenames with an LLM Assistant
Sidji, M., Smith, W., & Rogerson, M. J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677081 · Cited by 48
“AI agents can take on many roles such as non-player characters (NPCs) or adversaries, and advancements in their capabilities have seen them defeat professional players in boards games like Chess, Go and Poker and digital games like Starcraft 2 and DOTA 2 [11, 12, 16, 22, 53].”
Reinforcement learning based framework for COVID-19 resource allocation
Zong, K., & Luo, C. (2022) · Computers & Industrial Engineering · doi:10.1016/j.cie.2022.107960 · Cited by 51
“In recent years, reinforcement learning has been applied to many fields and achieved remarkable results (Eilers, Dunis, von Mettenheim, & Breitner, 2014; Silver et al., 2017; Brown et al., 2019).”
Multi-Agent Collaboration via Reward Attribution DecompositionPreprint
Zhang, T., Xu, H., Wang, X., Wu, Y., Keutzer, K., Gonzalez, J. E., & Tian, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08531 · Cited by 50
“…Bayesian inference (He et al., 2016; Shen and How, 2019; Serrino et al., 2019), symmetry breaking (Hu et al., 2020), learning Nash equilibrium strategies (Lanctot et al., 2017; Brown and Sandholm, 2019) and population-based training (Vinyals et al., 2019; Long et al., 2020; Canaan et al., 2020).”
BackgroundAutomated scholarly paper review: Concepts, technologies, and challenges
Lin, J., Song, J., Zhou, Z., Chen, Y., & Shi, X. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101830 · Cited by 37
How learning unfolds in the brain: toward an optimization view
Hennig, J. A., Oby, E. R., Losey, D. M., Batista, A. P., Yu, B. M., & Chase, S. M. (2021) · Neuron · doi:10.1016/j.neuron.2021.09.005 · Cited by 47
Metadata
- Authors
- Brown, N., & Sandholm, T.
- Affiliations
- Meta (United States) (US)
- Computer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
- Corresponding author
- Brown, Noam
- Venue
- Science
- Published
- 2019-08-30
- Volume
- 365
- Issue
- 6456
- Pages
- 885-890
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2960876848
- Cited by
- 592
- References
- 24
- Citations by year
- 2026: 34 · 2025: 77 · 2024: 81 · 2023: 83 · 2022: 88 · 2021: 125 · 2020: 77 · 2019: 27
- FWCI
- 36.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (1718457, 1617590, 1733556)
- Army Research Office (W911NF-17-1-0082)
- NSF XSEDE (CCR090023)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- no-limit Texas Hold'Em, game AI, human-machine comparison
- MeSH terms
- Games, Recreational, Artificial Intelligence, Game Theory, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.