The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft
Open accessAbstract
This paper presents an overview of the existing work on AI for real-time strategy (RTS) games. Specifically, we focus on the work around the game StarCraft, which has emerged in the past few years as the unified test bed for this research. We describe the specific AI challenges posed by RTS games, and overview the solutions that have been explored to address them. Additionally, we also present a summary of the results of the recent StarCraft AI competitions, describing the architectures used by the participants. Finally, we conclude with a discussion emphasizing which problems in the context of RTS game AI have been solved, and which remain open.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches
Aamodt, A., & Plaza, E. (1994) · AI Communications · doi:10.3233/aic-1994-7104 · Cited by 5,624
Treuille, A., Cooper, S., & Popović, Z. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142008 · Cited by 874
TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play
Tesauro, G. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.215 · Cited by 787
Benchmarks for Grid-Based Pathfinding
Sturtevant, N. R. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2197681 · Cited by 549
A data mining approach to strategy prediction
Weber, B. G., & Mateas, M. (2009) · 2009 IEEE Symposium on Computational Intelligence and Games · doi:10.1109/cig.2009.5286483 · Cited by 223
A probabilistic plan recognition algorithm based on plan tree grammars
Geib, C. W., & Goldman, R. P. (2009) · Artificial Intelligence · doi:10.1016/j.artint.2009.01.003 · Cited by 206
Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game
Aha, D. W., Molineaux, M., & Ponsen, M. (2005) · Lecture Notes in Computer Science · doi:10.1007/11536406_4 · Cited by 175
The Combinatorial Multi-Armed Bandit Problem and Its Application to Real-Time Strategy Games
Ontañón, S. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v9i1.12681 · Cited by 129
A Bayesian model for opening prediction in RTS games with application to StarCraft
Synnaeve, G., & Bessìère, P. (2011) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2011.6032018 · Cited by 107
Self-citation
Research works printed but not linked: 40
- branavan, 2011, Learning to win by reading manuals in a Monte-Carlo framework, Proc Annu Meeting Assoc Comput Linguist, 268
- refanidis, 2000, Heuristic planning with resources, Proc Eur Conf Artif Intell, 521
- chung, 2005, Monte Carlo planning in RTS games, Proc IEEE Symp Comput Intell Games, 117
- churchill, 2012, Fast heuristic search for RTS game combat scenarios, Proc 6th AAAI Conf Artif Intell Interact Digital Entertain, 112
- kabanza, 2010, Opponent behaviour recognition for real-time strategy games, Proc 21st AAAI Conf Artificial Intell, 29
- ?ertick�, 2013, ?Implementing a wall-in building placement in StarCraft with declarative programming ?
- miles, 2006, Co-evolving real-time strategy game playing influence map trees with genetic algorithms, Proc Int Congr Evol Comput, 88
- sharma, 2007, Transfer learning in real-time strategy games using hybrid CBR/RL, Proc Int Joint Conf Artif Intell, 1041
- demyen, 2006, Efficient triangulation-based pathfinding, Proc Nat Conf Artif Intell, 1, 942
- reynolds, 1999, Steering behaviors for autonomous characters, Proc Game Developer Conf, 763
- hale, 2008, Automatically-generated convex region decomposition for real-time spatial agent navigation in virtual worlds, Proc 4th Artif Intell Interactive Digit Entertain Conf, 173
- molineaux, 2008, Learning continuous action models in a real-time strategy environment, Proc FLAIRS Conf, 257
- perkins, 2010, Terrain analysis in real-time strategy games: An integrated approach to choke point detection and region decomposition, Proc 6th Artif Intell Interactive Digit Entertain Conf, 168
- tesauro, 2001, Machines that Learn to Play Games, 117
- buro, 2003, Real-time strategy games: A new AI research challenge, Proc Int Joint Conf Artif Intell, 1534
- schadd, 2007, Opponent modeling in real-time strategy games, Proceedings of the GAME-ON, 61
- ?ertick�, 2013, Case-based reasoning for army compositions in real-time strategy games, Proc Sci Conf Young Res, 70
- jaidee, 2011, Case-based learning in goal-driven autonomy agents for real-time strategy combat tasks, Proc Comput Games Workshop, 43
- weber, 2011, A particle model for state estimation in real-time strategy games, Proc 6th AAAI Conf Artif Intell Interact Digital Entertain, 103
- pottinger, 2000, Terrain analysis for real-time strategy games, Proc Game Developer Conf
- weber, 2010, Applying goal-driven autonomy to StarCraft, Proc Artif Intell Interactive Digit Entertain, 101
- sutton, 1998, Reinforcement Learning An Introduction (Adaptive Computation and Machine Learning)
- koenig, 2002, D*lite, Proc AAAI/IAAI, 476
- wintermute, 2007, Sorts: A human-level approach to real-time strategy AI, Proc AI Interactive Digit Entertain Conf, 55
- ponsen, 2004, ?Improving adaptive game AI with evolutionary learning ?, 389
- jaidee, 2012, CLASSQ-L: A q-learning algorithm for adversarial real-time strategy games, Proc AI Adversarial Real-Time Games Workshop at AIIDE 2012, 8
- madeira, 2006, Designing a reinforcement learning-based adaptive AI for large-scale strategy games, Proc AI Interactive Digit Entertain Conf, 121
- marthi, 2005, Concurrent hierarchical reinforcement learning, Proc Int Joint Conf Artif Intell, 779
- hoang, 2005, Hierarchical plan representations for encoding strategic game AI, Proc Artif Intell Interactive Digit Entertain Conf, 63
- balla, 2009, UCT for tactical assault planning in real-time strategy games, Proc Int Joint Conf Artif Intell, 40
- churchill, 2011, Build order optimization in StarCraft, Proc Artif Intell Interactive Digit Entertain Conf, 14
- dereszynski, 2011, Learning probabilistic behavior models in real-time strategy games, Proc Artif Intell Digit Entertain Conf, 20
- synnaeve, 2011, A Bayesian model for plan recognition in RTS games applied to StarCraft, Proc 4th Artif Intell Interactive Digit Entertain Conf, 79
- young, 2012, Evolutionary learning of goal priorities in a real-time strategy game, Proc 1st Artif Intell Interactive Digit Entertainment Conf, 87
- synnaeve, 2012, Bayesian programming and learning for multi-player video games
- weber, 2011, Building human-level AI for real-time strategy games, Proc AIIDE Fall Symp Adv Cogn Syst, 329
- synnaeve, 2012, A dataset for StarCraft AI & an example of armies clustering, Proc AIIDE Workshop AI Adversarial Real-Time Games, 25
- houlette, 2003, The ultimate guide to FSMs in games, AI Game Programming Wisdom, 2, 283
- miles, 2007, Co-evolving Real Time Strategy Game Players
- uriarte, 2012, Kiting in RTS games using influence maps, Proc AI Adversarial Real-Time Games Workshop at AIIDE 2012, 31
Cited by
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Proximal Policy Optimization in StarCraft
Liu, Y. (2025) · doi:10.12794/metadc1505267 · Cited by 615
Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning
Makoviychuk, V., Wawrzyniak, L., Guo, Y., Lu, M., Storey, K., Macklin, M., Hoeller, D., Rudin, N., Allshire, A., Handa, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.10470 · Cited by 509
Monte Carlo Tree Search: a review of recent modifications and applications
Świechowski, M., Godlewski, K., Sawicki, B., & Mańdziuk, J. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10228-y · Cited by 365
Machado, M. C., Bellemare, M. G., Talvitie, E., Veness, J., Hausknecht, M., & Bowling, M. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5699 · Cited by 359
Metadata
- Authors
- Ontanon, S., Synnaeve, G., Uriarte, A., Richoux, F., Churchill, D., & Preuss, M.
- Affiliations
- École Normale Supérieure - PSL (FR)
- Drexel University (US)
- Laboratoire d'informatique de Nantes Atlantique (FR)
- University of Alberta (CA)
- TU Dortmund University (DE)
- Venue
- IEEE Transactions on Computational Intelligence and AI in Games
- Published
- 2013-12
- Volume
- 5
- Issue
- 4
- Pages
- 293-311
- ISSN
- 1943-068X (ISSN-L)
- 1943-0698
- OpenAlex
- W2031748952
- Cited by
- 423
- References
- 33
- Citations by year
- 2026: 9 · 2025: 23 · 2024: 15 · 2023: 25 · 2022: 23 · 2021: 35 · 2020: 49 · 2019: 48 · 2018: 58 · 2017: 51 · 2016: 37 · 2015: 27 · 2014: 23
- FWCI
- 31.80
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Locations
- IEEE Transactions on Computational Intelligence and AI in Games (publishedVersion)
- HAL (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- real-time strategy games, game AI, StarCraft, AI competition, game-playing agents, agent architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft. https://app.cochat.ai/papers/10.1109/tciaig.2013.2286295
- The paper
- Ontanon, S., Synnaeve, G., Uriarte, A., Richoux, F., Churchill, D., & Preuss, M. (2013). A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft. IEEE Transactions on Computational Intelligence and AI in Games. https://doi.org/10.1109/tciaig.2013.2286295
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.