The DOI matches its Crossref record; 157 of the 157 references it cites were found in a registry or an index.
Deep Learning for Video Game Playing
Open accessAbstract
In this paper, we review recent deep learning advances in the context of how they have been applied to play different types of video games such as first-person shooters, arcade games, and real-time strategy games. We analyze the unique requirements that different game genres pose to a deep learning system and highlight important open challenges in the context of applying these machine learning methods to video games, such as general game playing, dealing with extremely large decision spaces and sparse rewards.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · cited 1×
“Methods that aim to make the networks computationally more efficient by either compressing networks [62] or pruning networks after training [43], [47] could be useful.”
BackgroundBengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1×
“Curriculum learning attempts to speed up learning by training on a set of progressively harder environments [7].”
Background(1999) · Cited by 5,147
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · cited 1×
“[2].”
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369 · cited 1×
“RNNs are typically applied to time series data, where the next output of the ANN is likely dependent on the previous ones [119], [58].”
Background(2011) · Cited by 3,939
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970 · cited 1×
“Deep learning is also far from the only AI method that has applications in games, other prominent methods include Monte Carlo Tree Search [12] and evolutionary computation [85], [66].”
MethodThe Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876
Bergstra, J., Yamins, D. L. K., & Cox, D. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1,852
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · cited 1×
“It was shown to learn to navigate in complex Doom and Super Mario levels only relying on intrinsic rewards [81].”
BackgroundMulti-Agent Reinforcement Learning: Independent vs. Cooperative Agents
Tan, M. (1993) · Machine Learning Proceedings 1993 · doi:10.1016/b978-1-55860-307-3.50049-6 · Cited by 1,810
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Benchmarking Deep Reinforcement Learning for Continuous Control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058 · cited 1×
“Neural Turing Machines (NTMs) are fully differentiable neural networks coupled with an external memory resource, which can learn to solve simple algorithmic problems such as copying and sorting [27].”
BackgroundReinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 1,042
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,024
Deep Q-learning From Demonstrations
Hester, T., Vecerik, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Osband, I., et al. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11757 · Cited by 889
Multiagent cooperation and competition with deep reinforcement learning
Tampuu, A., Matiisen, T., Kodelja, D., Kuzovkin, I., Korjus, K., Aru, J., Aru, J., & Vicente, R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172395 · Cited by 877
van Hasselt, H. P. (2010) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 839
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Williams, R. J. (1992) · Machine Learning · doi:10.1023/a:1022672621406 · Cited by 817
Universal intelligence: a definition of machine intelligence
Legg, S., & Hutter, M. (2007) · Minds and Machines · doi:10.1007/s11023-007-9079-x · Cited by 803
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
Kulkarni, T. D., Narasimhan, K., Saeedi, A., & Tenenbaum, J. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.06057 · Cited by 770
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747
(2016) · neural information processing systems · Cited by 735
Intrinsically Motivated Reinforcement Learning
Singh, S., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 610
PathNet: Evolution Channels Gradient Descent in Super Neural Networks
Fernando, C., Banarse, D., Blundell, C., Zwólš, Y., Ha, D., Rusu, A. A., Pritzel, A., & Wierstra, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08734 · Cited by 591
Noisy Networks for Exploration
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 543
ViZDoom: A Doom-based AI research platform for visual reinforcement learning
Kempka, M., Wydmuch, M., Runc, G., Toczek, J., & Jaskowski, W. (2016) · 2016 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860433 · Cited by 541
Such, F. P., Madhavan, V., Conti, E., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06567 · Cited by 525
Procedural Content Generation in Games
Shaker, N., Togelius, J., & Nelson, M. J. (2016) · Computational Synthesis and Creative Systems · doi:10.1007/978-3-319-42716-4 · Cited by 519
Self-citationArtificial Intelligence and Games
Yannakakis, G. N., & Togelius, J. (2018) · doi:10.1007/978-3-319-63519-4 · Cited by 511
Self-citationScalable trust-region method for deep reinforcement learning using Kronecker-factored approximation
Wu, Y., Mansimov, E., Liao, S., Grosse, R., & Ba, J. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05144 · Cited by 432
Procedural Content Generation via Machine Learning (PCGML)
Summerville, A., Snodgrass, S., Guzdial, M., Holmgard, C., Hoover, A. K., Isaksen, A., Nealen, A., & Togelius, J. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2846639 · Cited by 425
Self-citationExploiting Open-Endedness to Solve Problems Through the Search for Novelty
Lehman, J., & Stanley, K. O. (2008) · Cited by 408
Counterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08926 · Cited by 401
Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
Foerster, J., Nardelli, N., Farquhar, G., Afouras, T., Torr, P. H. S., Kohli, P., & Whiteson, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08887 · Cited by 397
Real-Time Neuroevolution in the NERO Video Game
Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.856210 · Cited by 390
Massively Parallel Methods for Deep Reinforcement Learning
Nair, A., Srinivasan, P., Blackwell, S., Alcicek, C., Fearon, R., De Maria, A., Panneershelvam, V., Suleyman, M., Beattie, C., Petersen, S., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.04296 · Cited by 379
Count-Based Exploration with Neural Density Models
Ostrovski, G., Bellemare, M. G., Oord, A. V. D., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1703.01310 · Cited by 377
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Guo, X., Singh, S. P., Lee, H., Lewis, R. L., & Wang, X. (2014) · neural information processing systems · Cited by 367
Machado, M. C., Bellemare, M. G., Talvitie, E., Veness, J., Hausknecht, M., & Bowling, M. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5699 · Cited by 359
Learning to Navigate in Complex Environments
Mirowski, P., Pascanu, R., Viola, F., Soyer, H., Ballard, A. J., Banino, A., Denil, M., Goroshin, R., Sifre, L., Kavukcuoglu, K., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03673 · Cited by 323
Control of Memory, Active Perception, and Action in MinecraftPreprint
Oh, J., Chockalingam, V., Singh, S. P., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09128 · Cited by 322
Teacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 320
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1025696116075 · Cited by 317
Learning Physical Intuition of Block Towers by ExamplePreprint
Lerer, A. K., Gross, S., & Fergus, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01312 · Cited by 307
Conti, E., Madhavan, V., Such, F. P., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06560 · Cited by 302
A Deep Hierarchical Approach to Lifelong Learning in Minecraft
Tessler, C., Givony, S., Zahavy, T., Mankowitz, D., & Mannor, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10744 · Cited by 299
Language Understanding for Text-based Games using Deep Reinforcement Learning
Narasimhan, K., Kulkarni, T., & Barzilay, R. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1001 · Cited by 285
Rusu, A. A., Colmenarejo, S. G., Gulcehre, C., Desjardins, G., Kirkpatrick, J., Pascanu, R., Mnih, V., Kavukcuoglu, K., & Hadsell, R. (2015) · arXiv · doi:10.48550/arxiv.1511.06295 · Cited by 270
Deep Q-learning from Demonstrations
Hester, T., Vecerík, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Dulac-Arnold, G., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03732 · Cited by 270
Learning to Act by Predicting the FuturePreprint
Dosovitskiy, A., & Koltun, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01779 · Cited by 252
Reinforcement Learning with Unsupervised Auxiliary Tasks
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 247
Peng, P., Wen, Y., Yang, Y., Yuan, Q., Tang, Z., Long, H., & Wang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10069 · Cited by 241
Model-Free reinforcement learning with continuous action in practice
Degris, T., Pilarski, P. M., & Sutton, R. S. (2012) · 2012 American Control Conference (ACC) · doi:10.1109/acc.2012.6315022 · Cited by 239
Evolving mario levels in the latent space of a deep convolutional generative adversarial network
Volz, V., Schrum, J., Liu, J., Lucas, S. M., Smith, A., & Risi, S. (2018) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3205455.3205517 · Cited by 239
Self-citationLearn What Not to Learn: Action Elimination with Deep Reinforcement LearningPreprint
Zahavy, T., Haroush, M., Merlis, N., Mankowitz, D. J., & Mannor, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02121 · Cited by 235
A video game description language for model-based or interactive learning
Schaul, T. (2013) · 2013 IEEE Conference on Computational Inteligence in Games (CIG) · doi:10.1109/cig.2013.6633610 · Cited by 214 · cited 1×
“The General Video Game AI (GVG-AI) framework [116] allows for easy creation and modification of games and levels using the video game description language [122].”
MethodThe Malmo platform for artificial intelligence experimentation
Johnson, M., Hofmann, K., Hutton, T. J., & Bignell, D. E. (2016) · International Joint Conference on Artificial Intelligence · Cited by 210
Playing FPS Games with Deep Reinforcement LearningPreprint
Lample, G., & Chaplot, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.05521 · Cited by 210
TextWorld: A Learning Environment for Text-Based Games
Côté, M.-A., Kádár, Á., Yuan, X., Kybartas, B., Barnes, T., Fine, E., Moore, J., Hausknecht, M., El Asri, L., Adada, M., et al. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-24337-1_3 · Cited by 209
Loss is its own Reward: Self-Supervision for Reinforcement LearningPreprint
Shelhamer, E., Mahmoudieh, P., Argus, M. J., & Darrell, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07307 · Cited by 205
Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation
Justesen, N., Torrado, R. R., Bontrager, P., Khalifa, A., Togelius, J., & Risi, S. (2018) · OAR@UM (University of Malta) · doi:10.48550/arxiv.1806.10729 · Cited by 204
Self-citationAction-conditional video prediction using deep networks in Atari games
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · Cited by 196
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2012) · arXiv · doi:10.48550/arxiv.1207.4708 · Cited by 187
Modèles connexionnistes de l'apprentissage
Le Cun, Y., & Fogelman-Soulié, F. (1987) · Intellectica. Revue de l'Association pour la Recherche Cognitive · doi:10.3406/intel.1987.1804 · Cited by 185
Hybrid Reward Architecture for Reinforcement Learning
van Seijen, H., Fatemi, M., Romoff, J., Laroche, R., Barnes, T., & Tsang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04208 · Cited by 176
Learning to Communicate to Solve Riddles with Deep Distributed Recurrent Q-NetworksPreprint
Foerster, J., Assael, Y., de Freitas, N., & Whiteson, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02672 · Cited by 175
Automatic Content Generation in the Galactic Arms Race Video Game
Hastings, E. J., Guha, R. K., & Stanley, K. O. (2009) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2009.2038365 · Cited by 173
Deep Reinforcement Learning for General Video Game AI
Torrado, R. R., Bontrager, P., Togelius, J., Liu, J., & Pérez-Liébana, D. (2018) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490422 · Cited by 172
Self-citationA Neuroevolution Approach to General Atari Game Playing
Hausknecht, M., Lehman, J., Miikkulainen, R., & Stone, P. (2014) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2013.2294713 · Cited by 168
A Panorama of Artificial and Computational Intelligence in Games
Yannakakis, G. N., & Togelius, J. (2015) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2014.2339221 · Cited by 166
Self-citationDeep Reinforcement Learning with a Natural Language Action Space
He, J., Chen, J., He, X., Gao, J., Li, L., Deng, L., & Ostendorf, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1153 · Cited by 164
Wiering, M., & Schmidhuber, J. (1997) · Adaptive Behavior · doi:10.1177/105971239700600202 · Cited by 163
Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games.Preprint
Peng, P., Yuan, Q., Wen, Y., Yang, Y., Tang, Z., Long, H., & Wang, Y.-X. (2017) · arXiv (Cornell University) · Cited by 162
Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics
Kansky, K., Silver, T., Mély, D. A., Eldawy, M., Lázaro-Gredilla, M., Lou, X., Dorfman, N., Sidor, S., Phoenix, S., & George, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04317 · Cited by 161
Neuroevolution in Games: State of the Art and Open Challenges
Risi, S., & Togelius, J. (2015) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2015.2494596 · Cited by 156
Self-citationObserve and Look Further: Achieving Consistent Performance on AtariPreprint
Pohlen, T., Piot, B., Hester, T., Azar, M. G., Horgan, D., Budden, D., Barth-Maron, G., van Hasselt, H. P., Quan, J., Vecerík, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11593 · Cited by 154
Distral: Robust Multitask Reinforcement Learning
Teh, Y. W. (2025) · TIB Data Manager · doi:10.57702/nufubi9l · Cited by 144
Usunier, N., Synnaeve, G., Lin, Z., & Chintala, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02993 · Cited by 143
Training Agent for First-Person Shooter Game with Actor-Critic Curriculum Learning
Wu, Y., & Tian, Y. (2017) · International Conference on Learning Representations · Cited by 136
Evolutionary computation and games
Lucas, S. M., & Kendall, G. (2006) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2006.1597057 · Cited by 133
Evolving large-scale neural networks for vision-based reinforcement learning
Koutník, J., Cuccu, G., Schmidhuber, J., & Gomez, F. (2013) · Proceedings of the 15th annual conference on Genetic and evolutionary computation · doi:10.1145/2463372.2463509 · Cited by 130
The Combinatorial Multi-Armed Bandit Problem and Its Application to Real-Time Strategy Games
Ontañón, S. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v9i1.12681 · Cited by 129
Reflections on Cognition and Parallel Distributed Processing
(1986) · The MIT Press eBooks · doi:10.7551/mitpress/5236.003.0018 · Cited by 112
ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy GamesPreprint
Tian, Y., Gong, Q., Shang, W., Wu, Y., & Zitnick, C. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01067 · Cited by 109
Imitating human playing styles in Super Mario Bros
Ortega, J. G., Shaker, N., Togelius, J., & Yannakakis, G. N. (2012) · Entertainment Computing · doi:10.1016/j.entcom.2012.10.001 · Cited by 104
Self-citationMachine learning in digital games: a survey
Galway, L., Charles, D. K., & Black, M. M. (2008) · Artificial Intelligence Review · doi:10.1007/s10462-009-9112-y · Cited by 95
A new design for a Turing Test for Bots
Hingston, P. (2010) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/itw.2010.5593336 · Cited by 95
Human-Like Playtesting with Deep Learning
Gudmundsson, S. F., Eisen, P., Poromaa, E., Nodet, A., Purmonen, S., Kozakowski, B., Meurling, R., & Cao, L. (2018) · 2018 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490442 · Cited by 90
Learning Visual Predictive Models of Physics for Playing Billiards
Fragkiadaki, K., Agrawal, P., Levine, S., & Malik, J. (2016) · International Conference on Learning Representations · Cited by 89
TorchCraft: a Library for Machine Learning Research on Real-Time Strategy GamesPreprint
Synnaeve, G., Nardelli, N., Auvolat, A., Chintala, S., Lacroix, T., Lin, Z., Richoux, F., & Usunier, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00625 · Cited by 80
Computational Intelligence in Games
(2001) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1833-8 · Cited by 78
Playing Doom with SLAM-Augmented Deep Reinforcement LearningPreprint
Bhatti, S., Desmaison, A., Mikšík, O., Nardelli, N., Siddharth, N., & Torr, P. H. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00380 · Cited by 74
MazeBase: A Sandbox for Learning from GamesPreprint
Sukhbaatar, S., Szlam, A. D., Synnaeve, G., Chintala, S., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07401 · Cited by 72
Learning macromanagement in starcraft from replays using deep learning
Justesen, N., & Risi, S. (2017) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2017.8080430 · Cited by 72
Self-citationTStarBots: Defeating the Cheating Level Builtin AI in StarCraft II in the Full GamePreprint
Sun, P., Sun, X., Han, L., Xiong, J., Wang, Q., Li, B., Zheng, Y., Liu, J., Liu, Y., Liu, H., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.07193 · Cited by 72
Beattie, C., Leibo, J. Z., Teplyashin, D., Ward, T., Wainwright, M., Küttler, H., Lefrancq, A., Green, S., Valdés, V., Sadik, A., et al. (2016) · arXiv · doi:10.48550/arxiv.1612.03801 · Cited by 68 · cited 1×
“DeepMind Lab is a platform for 3-D navigation and puzzle-solving tasks based on the Quake III Arena (id Software, 1999) engine [6].”
MethodMeasuring Intelligence through GamesPreprint
Schaul, T., Togelius, J., & Schmidhuber, J. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1109.1314 · Cited by 65
Self-citationHalf Field Offense: An Environment for Multiagent Learning and Ad Hoc Teamwork
Stone, M. H. A. P. (2016) · Cited by 63
Autoencoder-augmented neuroevolution for visual doom playing
Alvernaz, S., & Togelius, J. (2017) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2017.8080408 · Cited by 62
Self-citationEvaluating real-time strategy game states using convolutional neural networks
Stănescu, M., Barriga, N. A., Hess, A., & Buro, M. (2016) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860439 · Cited by 61
Believable Bots: Can Computers Play Like People?
Hingston, P. (2012) · Springer eBooks · doi:10.1007/978-3-642-32323-2 · Cited by 57
Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game
Risi, S., Lehman, J., D’Ambrosio, D. B., Hall, R. C. W., & Stanley, K. O. (2012) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v8i1.12502 · Cited by 56
Self-citationWhat Can You Do with a Rock? Affordance Extraction via Word Embeddings
Fulda, N., Ricks, D. J., Murdoch, B., & Wingate, D. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/144 · Cited by 56
On-Policy vs. Off-Policy Updates for Deep Reinforcement Learning
Stone, M. H. A. P. (2016) · Cited by 44
Game Engine Learning from Video
Guzdial, M., Li, B., & Riedl, M. O. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/518 · Cited by 43
Keepaway Soccer: A Machine Learning Test bed
Stone, P., & Sutton, R. S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45603-1_22 · Cited by 41
Multi-task learning in Atari video games with emergent tangled program graphs
Kelly, S., & Heywood, M. I. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071303 · Cited by 39
Combining Strategic Learning with Tactical Search in Real-Time Strategy Games
Barriga, N. A., Stănescu, M., & Buro, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v13i1.12922 · Cited by 39
UT⁁2: Human-like behavior via neuroevolution of combat behavior and replay of human traces
Schrum, J., Karpov, I. V., & Miikkulainen, R. P. (2011) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2011.6032024 · Cited by 38
Ontogenetic and Phylogenetic Reinforcement Learning
Togelius, J., Schaul, T., Wierstra, D., Igel, C., Gomez, F. J., & Schmidhuber, J. (2009) · mediaTUM (Technical University of Munich) · Cited by 38
Self-citationGenerative agents for player decision modeling in games
Holmgård, C., Liapis, A., Togelius, J., & Yannakakis, G. N. (2014) · OAR@UM (University of Malta) · Cited by 36
Self-citationOnline Evolution for Multi-action Adversarial Games
Justesen, N., Mahlmann, T., & Togelius, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31204-0_38 · Cited by 29
Self-citationText-based adventures of the golovin AI agent
Kostka, B., Kwiecieli, J., Kowalski, J., & Rychlikowski, P. (2017) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2017.8080433 · Cited by 28
Portfolio Online Evolution in StarCraft
Wang, C., Chen, P., Li, Y., Holmgård, C., & Togelius, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12862 · Cited by 27
Self-citationPlaying Atari with Six Neurons
Cuccu, G., Togelius, J., & Cudré-Mauroux, P. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ipby2290 · Cited by 25
Self-citationReinforcement Learning for Build-Order Production in StarCraft II
Tang, Z., Zhao, D., Zhu, Y., & Guo, P. (2018) · International Conference on Information Science and Technology · doi:10.1109/icist.2018.8426160 · Cited by 24
DLNE: A hybridization of deep learning and neuroevolution for visual control
Poulsen, A. P., Thorhauge, M., Funch, M. H., & Risi, S. (2017) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2017.8080444 · Cited by 23
Self-citationCombining Strategic Learning and Tactical Search in Real-Time Strategy GamesPreprint
Barriga, N. A., Stănescu, M., & Buro, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.03480 · Cited by 20
Muñoz‐Avila, H., Bauckhage, C., Bída, M., Congdon, C. B., & Kendall, G. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dfu.vol6.12191.33 · Cited by 19
General Video Game AI: Learning from screen capture
Kunanusont, K., Lucas, S. M., & Pérez-Liébana, D. (2017) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969556 · Cited by 18
EvoCommander: A Novel Game Based on Evolving and Switching Between Artificial Brains
Jallov, D., Risi, S., & Togelius, J. (2016) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2016.2535416 · Cited by 15
Self-citationDeep Apprenticeship Learning for Playing Video Games
Bogdanović, M., Markovikj, D., Denil, M., & de Freitas, N. (2015) · Cited by 14
Breeding a diversity of Super Mario behaviors through interactive evolution
Sørensen, P. D., Olsen, J. M., & Risi, S. (2016) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860436 · Cited by 13
Self-citationNeurovisual Control in the Quake II Environment
Parker, M., & Bryant, B. D. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2184109 · Cited by 9
StarCraft II: A New Challenge for Reinforcement Learning
Vinyals, O., Ewalds, T., Bartunov, S., Georgiev, P., Vezhnevets, A. S., Yeo, M., Makhzani, A., Küttler, H., Agapiou, J., Schrittwieser, J., et al. (2017) · arXiv · doi:10.48550/arxiv.1708.04782
Distributed Prioritized Experience Replay
Horgan, D., Quan, J., Budden, D., Barth-Maron, G., Hessel, M., van Hasselt, H., & Silver, D. (2018) · arXiv · doi:10.48550/arxiv.1803.00933
Cited by
Transfer Learning in Deep Reinforcement Learning: A Survey
Zhu, Z., Lin, K., Jain, A. K., & Zhou, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292075 · Cited by 861
“[147] provided a comprehensive survey on DL applications in video game playing, which also covers TL and RL strategies from certain perspectives.”
BackgroundArtificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 342
ŞAHiN, E., Arslan, N. N., & Özdemir, D. (2025) · Neural Computing and Applications · doi:10.1007/s00521-024-10437-2 · Cited by 278
Metadata
- Authors
- Justesen, N., Bontrager, P., Togelius, J., & Risi, S.
- Venue
- IEEE Transactions on Games
- Published
- 2020-03
- Volume
- 12
- Issue
- 1
- Pages
- 1-20
- ISSN
- 2475-1502 (ISSN-L)
- 2475-1510
- OpenAlex
- W2753316839
- Cited by
- 257
- References
- 157
- FWCI
- 16.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.