Search-Based Procedural Content Generation: A Taxonomy and Survey
Open accessThe DOI matches its Crossref record; 79 of the 80 references it cites were found in a registry or an index.
Abstract
The focus of this survey is on research in applying evolutionary and other metaheuristic search algorithms to automatically generating content for games, both digital and nondigital (such as board games). The term search-based procedural content generation is proposed as the name for this emerging field, which at present is growing quickly. A taxonomy for procedural content generation is devised, centering on what kind of content is generated, how the content is represented and how the quality/fitness of the content is evaluated; search-based procedural content generation in particular is situated within this taxonomy. This article also contains a survey of all published papers known to the authors in which game content is generated through search or optimisation, and ends with an overview of important open research problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Kennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2019) · Handbook of Machine Learning · doi:10.1142/9789811205675_0004 · Cited by 6,270
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
Self-citationSMS-EMOA: Multiobjective selection based on dominated hypervolume
Beume, N., Naujoks, B., & Emmerich, M. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.08.008 · Cited by 2,048
Mathematical models for cellular interactions in development I. Filaments with one-sided inputs
Lindenmayer, A. (1968) · Journal of Theoretical Biology · doi:10.1016/0022-5193(68)90079-9 · Cited by 1,620
Search‐based software test data generation: a survey
McMinn, P. (2004) · Software Testing, Verification and Reliability · doi:10.1002/stvr.294 · Cited by 1,368
Takagi, H. (2001) · Proceedings of the IEEE · doi:10.1109/5.949485 · Cited by 1,327
Procedural modeling of buildings
Müller, P., Wonka, P., Haegler, S., Ulmer, A., & Van Gool, L. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141931 · Cited by 950
Research works printed but not linked: 9
- golding, 2010, Building blocks: Artist driven procedural buildings, Proc Present Game Develop Conf
- compton, 2010, Remarks during a panel session at the FDG workshop on PCG
- mallett, 1998, Zillions of Games
- wardrip-fruin, 2009, Expressive Process
- togelius, 2010, Proc EvoAppl, 6024
- olsen, 2004, Realtime procedural terrain generation
- kernighan, 1999, The Practice of Programming
- smelik, 2010, Proc Found Digit Games
- miikkulainen, 2006, Computational Intelligence Principles and Practice
Cited by
Gatt, A., & Krahmer, E. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5477 · Cited by 776
“…a few endeavours to enhance the variety of linguistic expressions used in virtual environments (e.g., Orkin & Roy, 2007), nlg technology is relatively unrepresented in research on games, despite significant progress on dynamic content generation in game environments (e.g., Togelius et al., 2011).”
BackgroundDesigning neural networks through neuroevolution
Stanley, K. O., Clune, J., Lehman, J., & Miikkulainen, R. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0006-z · Cited by 689
Self-citationExperience-Driven Procedural Content Generation
Yannakakis, G. N., & Togelius, J. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.6 · Cited by 470
Self-citationProcedural Content Generation via Machine Learning (PCGML)
Summerville, A., Snodgrass, S., Guzdial, M., Holmgard, C., Hoover, A. K., Isaksen, A., Nealen, A., & Togelius, J. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2846639 · Cited by 425
Self-citationEvolving mario levels in the latent space of a deep convolutional generative adversarial network
Volz, V., Schrum, J., Liu, J., Lucas, S. M., Smith, A., & Risi, S. (2018) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3205455.3205517 · Cited by 239
Sentient sketchbook : computer-assisted game level authoring
Liapis, A., Yannakakis, G. N., & Togelius, J. (2013) · OAR@UM (University of Malta) · Cited by 233
Self-citationIncreasing generality in machine learning through procedural content generation
Risi, S., & Togelius, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0208-z · Cited by 122
Self-citationYannakakis, G. N. (2012) · Proceedings of the 9th conference on Computing Frontiers · doi:10.1145/2212908.2212954 · Cited by 179
Self-citationProcedural Content Generation through Quality Diversity
Gravina, D., Khalifa, A., Liapis, A., Togelius, J., & Yannakakis, G. N. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848053 · Cited by 179
Self-citationGuzdial, M., Liao, N., Chen, J., Chen, S.-Y., Shah, S., Shah, V., Reno, J., Smith, G., & Riedl, M. O. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300854 · Cited by 128
Neuroevolution in Games: State of the Art and Open Challenges
Risi, S., & Togelius, J. (2015) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2015.2494596 · Cited by 173
Self-citationA Panorama of Artificial and Computational Intelligence in Games
Yannakakis, G. N., & Togelius, J. (2015) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2014.2339221 · Cited by 166
Self-citationPCGRL: Procedural Content Generation via Reinforcement Learning
Khalifa, A., Bontrager, P., Earle, S., & Togelius, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7416 · Cited by 156
Self-citationDeep learning for procedural content generation
Liu, J., Snodgrass, S., Khalifa, A., Risi, S., Yannakakis, G. N., & Togelius, J. (2021) · Neural Computing and Applications · doi:10.1007/s00521-020-05383-8 · Cited by 143
Self-citationThe 2010 Mario AI Championship: Level Generation Track
Shaker, N., Togelius, J., Yannakakis, G. N., Weber, B. G., Shimizu, T., Hashiyama, T., Sorenson, N., Pasquier, P., Mawhorter, P. A., Takahashi, G., et al. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2166267 · Cited by 143
Self-citationPlayer behavioural modelling for video games
Bakkes, S. C. J., Spronck, P. H. M., & van Lankveld, G. (2012) · Entertainment Computing · doi:10.1016/j.entcom.2011.12.001 · Cited by 140
Bootstrapping Conditional GANs for Video Game Level Generation
Torrado, R. R., Khalifa, A., Green, M. C., Justesen, N., Risi, S., & Togelius, J. (2020) · IEEE Conference on Games (CoG) · doi:10.1109/cog47356.2020.9231576 · Cited by 134
Self-citationWaveFunctionCollapse is constraint solving in the wild
Karth, I., & Smith, A. M. (2017) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3102071.3110566 · Cited by 124
Procedural Content Generation: Goals, Challenges and Actionable Steps
Togelius, J., Champandard, A. J., Lanzi, P. L., Mateas, M., Paiva, A., Preuß, M., & Stanley, K. O. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dfu.vol6.12191.61 · Cited by 124
Self-citationLiapis, A., Yannakakis, G. N., & Togelius, J. (2014) · OAR@UM (University of Malta) · Cited by 121
Self-citationA case study of expressively constrainable level design automation tools for a puzzle game
Smith, A. M., Andersen, E., Mateas, M., & Popović, Z. (2012) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/2282338.2282370 · Cited by 116
Evolving personas for player decision modeling
Holmgard, C., Liapis, A., Togelius, J., & Yannakakis, G. N. (2014) · 2014 IEEE Conference on Computational Intelligence and Games · doi:10.1109/cig.2014.6932911 · Cited by 106
Self-citationProcedural Content Generation in Games: A Survey with Insights on Emerging LLM Integration
Maleki, M. F., & Zhao, R. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v20i1.31877 · Cited by 107
Towards Personalised Gaming via Facial Expression Recognition
Blom, P. M., Bakkes, S. C. J., Tan, C. T., Whiteson, S., Roijers, D. M., Valenti, R., & Gevers, T. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12707 · Cited by 102
Towards a Video Game Description Language
Ebner, M., Levine, J., Lucas, S. M., Schaul, T., Thompson, T., & Togelius, J. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dfu.vol6.12191.85 · Cited by 98
Self-citationGame Level Generation from Gameplay Videos
Guzdial, M., & Riedl, M. O. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12861 · Cited by 95
Empowering Quality Diversity in Dungeon Design with Interactive Constrained MAP-Elites
Alvarez, A., Dahlskog, S., Font, J., & Togelius, J. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848022 · Cited by 94
Self-citationLearning to Generate Video Game Maps Using Markov Models
Snodgrass, S., & Ontañón, S. (2016) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2016.2623560 · Cited by 91
A Temporal Data-Driven Player Model for Dynamic Difficulty Adjustment
Zook, A., & Riedl, M. O. (2012) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v8i1.12504 · Cited by 86
Towards a Generic Method of Evaluating Game Levels
Liapis, A., Yannakakis, G., & Togelius, J. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v9i1.12680 · Cited by 64
Self-citationMixed-initiative procedural generation of dungeons using game design patterns
Baldwin, A., Dahlskog, S., Font, J., & Holmberg, J. (2017) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2017.8080411 · Cited by 85
Liapis, A., Yannakakis, G. N., Nelson, M. J., Preuss, M., & Bidarra, R. (2019) · IEEE Transactions on Games · doi:10.1109/tg.2018.2870876 · Cited by 70
Self-citationProcedural Puzzle Generation: A Survey
Kegel, B. D., & Haahr, M. (2019) · IEEE Transactions on Games · doi:10.1109/tg.2019.2917792 · Cited by 85
Winning Is Not Everything: Enhancing Game Development With Intelligent Agents
Zhao, Y., Borovikov, I., Silva, F. D. M., Beirami, A., Rupert, J., Somers, C., Harder, J., Kolen, J. F., Pinto, J., Pourabolghasem, R., et al. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2020.2990865 · Cited by 83
Constrained Novelty Search: A Study on Game Content Generation
Liapis, A., Yannakakis, G. N., & Togelius, J. (2014) · Evolutionary Computation · doi:10.1162/evco_a_00123 · Cited by 82
Self-citationA search-based approach for generating Angry Birds levels
Ferreira, L. N., & Toledo, C. F. M. (2014) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2014.6932912 · Cited by 77
A Comparative Evaluation of Procedural Level Generators in the Mario AI Framework
Horn, B., Dahlskog, S., Shaker, N., Smith, G., & Togelius, J. (2014) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 76
Self-citationGames for Artificial Intelligence Research: A Review and Perspectives
Hu, C., Zhao, Y., Wang, Z., Du, H., & Liu, J. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3410935 · Cited by 75
The ANGELINA Videogame Design System—Part I
Cook, M., Colton, S., & Gow, J. (2017) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2016.2520256 · Cited by 52
Experiments in map generation using Markov chains.
Snodgrass, S., & Ontañón, S. (2014) · Foundations of Digital Games · Cited by 74
Exploring Game Space Using Survival Analysis.
Isaksen, A., Gopstein, D., & Nealen, A. (2015) · Foundations of Digital Games · Cited by 72
Can Robot Navigation Bugs Be Found in Simulation? An Exploratory Study
Sotiropoulos, T., Waeselynck, H., Guiochet, J., & Ingrand, F. (2017) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2017.25 · Cited by 71
Riedl, M. O., & Zook, A. (2013) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2013.6633663 · Cited by 68
Illuminating Mario Scenes in the Latent Space of a Generative Adversarial Network
Fontaine, M. C., Liu, R., Khalifa, A., Modi, J., Togelius, J., Hoover, A. K., & Nikolaidis, S. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i7.16740 · Cited by 67
Self-citationExperience-Driven PCG via Reinforcement Learning: A Super Mario Bros Study
Shu, T., Liu, J., & Yannakakis, G. N. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619124 · Cited by 67
Self-citationA review of computational intelligence in RTS games
Lara-Cabrera, R., Cotta, C., & Fernández, A. J. (2013) · IEEE Symposium on Foundations of Computational Intelligence (FOCI) · doi:10.1109/foci.2013.6602463 · Cited by 66
Deploying learning materials to game content for serious education game development: A case study
Rosyid, H. A., Palmerlee, M., & Chen, K. (2018) · Entertainment Computing · doi:10.1016/j.entcom.2018.01.001 · Cited by 66
Automatic generation and recommendation of personalized challenges for gamification
Khoshkangini, R., Valetto, G., Marconi, A., & Pistore, M. (2020) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09255-2 · Cited by 65
Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game
Risi, S., Lehman, J., D’Ambrosio, D. B., Hall, R. C. W., & Stanley, K. O. (2012) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v8i1.12502 · Cited by 65
Self-citationProcedural Content Generation in the Game Industry
Amato, A. (2017) · Springer eBooks · doi:10.1007/978-3-319-53088-8_2 · Cited by 65
Baba is Y’all: Collaborative Mixed-Initiative Level Design
Charity, M., Khalifa, A., & Togelius, J. (2020) · IEEE Conference on Games (CoG) · doi:10.1109/cog47356.2020.9231807 · Cited by 65
Self-citationPensamento Computacional nos Ensinos Fundamental e Médio: uma revisão sistemática
Bordini, A., Avila, C., Marques, M. B. S., Foss, L., & Cavalheiro, S. A. D. C. (2017) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/cbie.sbie.2017.123 · Cited by 63
Patterns and procedural content generation: revisiting Mario in world 1 level 1
Dahlskog, S., & Togelius, J. (2012) · doi:10.1145/2427116.2427117 · Cited by 63
Self-citationA Short Introduction to Procedural Content Generation Algorithms for Videogames
Barriga, N. A. (2019) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213019300011 · Cited by 63
Tile pattern KL-divergence for analysing and evolving game levels
Lucas, S. M., & Volz, V. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321781 · Cited by 63
Automatic Generation of Game Content using a Graph-based Wave Function Collapse Algorithm
Kim, H., Lee, S.-T., Lee, H., Hahn, T., & Kang, S.-J. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848019 · Cited by 63
SceGene: Bio-Inspired Traffic Scenario Generation for Autonomous Driving Testing
Li, A., Chen, S., Sun, L., Zheng, N., Tomizuka, M., & Zhan, W. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3134661 · Cited by 62
Intentional computational level design
Khalifa, A., Green, M. C., Barros, G. A. B., & Togelius, J. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321849 · Cited by 62
Self-citationTransforming Exploratory Creativity with DeLeNoX
Liapis, A., Martínez, H. P., Togelius, J., & Yannakakis, G. N. (2021) · IT University Of Copenhagen (IT University of Copenhagen) · doi:10.48550/arxiv.2103.11715 · Cited by 62
Self-citationPOET: open-ended coevolution of environments and their optimized solutions
Wang, R., Lehman, J., Clune, J., & Stanley, K. O. (2019) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3321707.3321799 · Cited by 61
“The field of procedural content generation (PCG) [52, 61] also offers inspiration for generating new challenges (usually focused on gaming).”
BackgroundSelf-citationDeep neuroevolution of recurrent and discrete world models
Risi, S., & Stanley, K. O. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321817 · Cited by 62
Self-citationAffective Game Computing: A Survey
Yannakakis, G. N., & Melhárt, D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3315689 · Cited by 60
Self-citationGenerating Educational Game Levels with Multistep Deep Convolutional Generative Adversarial Networks
Park, K., Mott, B., Min, W., Boyer, K. E., Wiebe, E., & Lester, J. C. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848085 · Cited by 60
A mixed-initiative tool for designing level progressions in games
Butler, E., Smith, A. M., Liu, Y.-E., & Popović, Z. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502011 · Cited by 59
Understanding procedural content generation: a design-centric analysis of the role of PCG in games
Smith, G. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557341 · Cited by 56
“, focuses on the technical approaches to creating optimization-based generators, written from the perspective of PCG researchers for readers with a background in AI [56].”
BackgroundInfluentialDeep Surrogate Assisted Generation of Environments
Bhatt, V., Tjanaka, B., Fontaine, M. C., & Nikolaidis, S. (2022) · neural information processing systems · doi:10.52202/068431-2737 · Cited by 55
Yannakakis, G. N., Karpouzis, K. C., Paiva, A., & Hudlická, E. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8_62 · Cited by 54
Self-citationA procedural procedural level generator generator
Kerssemakers, M., Tuxen, J., Togelius, J., & Yannakakis, G. N. (2012) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2012.6374174 · Cited by 54
Self-citationWang, R., Lehman, J., Rawal, A., Zhi, J., Li, Y., Clune, J., & Stanley, K. O. (2020) · arXiv · doi:10.48550/arxiv.2003.08536 · Cited by 53
Self-citationTwo-step constructive approaches for dungeon generation
Green, M. C., Khalifa, A., Alsoughayer, A., Surana, D., Liapis, A., & Togelius, J. (2019) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3337722.3341847 · Cited by 52
Self-citationPetalz: Search-Based Procedural Content Generation for the Casual Gamer
Risi, S., Lehman, J., D’Ambrosio, D. B., Hall, R. C. W., & Stanley, K. O. (2015) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2015.2416206 · Cited by 52
Self-citationTOAD-GAN: Coherent Style Level Generation from a Single Example
Awiszus, M., Schubert, F., & Rosenhahn, B. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7401 · Cited by 52
Navigating the landscape of multiplayer games
Omidshafiei, S., Tuyls, K., Czarnecki, W. M., Santos, F. C., Rowland, M., Connor, J., Hennes, D., Muller, P., Pérolat, J., Vylder, B. D., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19244-4 · Cited by 51
Procedural Personas as Critics for Dungeon Generation
Liapis, A., Holmgård, C., Yannakakis, G. N., & Togelius, J. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16549-3_27 · Cited by 50
Self-citationPractical PCG Through Large Language Models
Nasir, M. U., & Togelius, J. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333197 · Cited by 50
Self-citationControllable procedural map generation via multiobjective evolution
Togelius, J., Preuss, M., Beume, N., Wessing, S., Hagelbäck, J., Yannakakis, G. N., & Grappiolo, C. (2013) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-012-9174-5 · Cited by 48
“On the continuum of direct-indirect representations presented in [8], our representation would be at level one or two from the top (the ‘‘direct’’ end of the scale).”
BackgroundInfluentialSelf-citationSearching for good and diverse game levels
Preuß, M., Liapis, A., & Togelius, J. (2014) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2014.6932908 · Cited by 48
Self-citationModifying MCTS for human-like general video game playing
Khalifa, A., Isaksen, A., Togelius, J., & Nealen, A. (2016) · OAR@UM (University of Malta) · Cited by 48
Self-citationAn Analog History of Procedural Content Generation.
Smith, G. (2015) · Foundations of Digital Games · Cited by 48
Word2World: Generating Stories and Worlds through Large Language ModelsPreprint
Nasir, M. U., James, S. D., & Togelius, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.06686 · Cited by 48
Self-citationGarcía, F. B. (2024) · RIUR (Universidad de La Rioja) · Cited by 48
The ANGELINA Videogame Design System—Part II
Cook, M., Colton, S., & Gow, J. (2017) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2016.2520305 · Cited by 47
The N-Tuple bandit evolutionary algorithm for automatic game improvement
Kunanusont, K., Gaina, R. D., Liu, J., Pérez-Liébana, D., & Lucas, S. M. (2017) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969571 · Cited by 47
Alvarez, A., Dahlskog, S., Font, J., & Togelius, J. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2020.3046133 · Cited by 47
Self-citationSarkar, A., & Cooper, S. (2021) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3472538.3472545 · Cited by 46
Automatic Game Design via Mechanic Generation
Zook, A., & Riedl, M. O. (2014) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v28i1.8788 · Cited by 26
Learning to Generate Levels From Nothing
Bontrager, P., & Togelius, J. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619131 · Cited by 45
Self-citationTesting Autonomous Robot Control Software Using Procedural Content Generation
Arnold, J., & Alexander, R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40793-2_4 · Cited by 45
Piispanen, L. J., Pfaffhauser, M., Wootton, J. R., Togelius, J., & Kultima, A. (2025) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-025-00308-7 · Cited by 44
Self-citationGame level layout from design specification
Ma, C., Vining, N., Lefèbvre, S., & Sheffer, A. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12314 · Cited by 44
Towards pattern-based mixed-initiative dungeon generation
Baldwin, A., Dahlskog, S., Font, J., & Holmberg, J. (2017) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3102071.3110572 · Cited by 44
Skill-based Mission Generation: A Data-driven Temporal Player Modeling Approach
Zook, A., Lee-Urban, S., Drinkwater, M. R., & Riedl, M. O. (2012) · doi:10.1145/2538528.2538534 · Cited by 44
Dahlskog, S., & Togelius, J. (2014) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2014.6932909 · Cited by 44
Self-citationMixed-Initiative Design of Game Levels: Integrating Mission and Space into Level Generation
Karavolos, D., Bouwer, A. J., & Bidarra, R. (2015) · Data Archiving and Networked Services (DANS) · Cited by 43
Ludus Ex Machina: Building A 3D Game Designer That Competes Alongside Humans.
Cook, M., & Colton, S. (2014) · ICCC · Cited by 43
Valls-Vargas, J., Zhu, J., & Ontañón, S. (2017) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3102071.3102079 · Cited by 42
Artificial Intelligence and Video Game Creation: A Framework for the New Logic of Autonomous Design
Seidel, S., Berente, N., Lindberg, A., Lyytinen, K., Martinez, B., & Nickerson, J. V. (2020) · Journal of Digital Social Research · doi:10.33621/jdsr.v2i3.46 · Cited by 42
Complexity and Difficulty of Items in Learning Systems
Pelánek, R., Effenberger, T., & Čechák, J. (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00252-4 · Cited by 42
Learning Controllable Content Generators
Earle, S., Edwards, M., Khalifa, A., Bontrager, P., & Togelius, J. (2021) · 2021 IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619159 · Cited by 41
Self-citationProcedural Content Generation via Generative Artificial Intelligence
Xinyu, M. A. O., Yu, W., Okawara, Y., Xueying, Z. H. A. N., Yamada, K. D., & Zielewski, M. R. (2026) · Interdisciplinary Information Sciences · doi:10.4036/iis.2026.r.01 · Cited by 41
Metadata
- Authors
- Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C.
- Affiliations
- IT University of Copenhagen (DK)
- University of Central Florida (US)
- Imperial College London (GB)
- Venue
- IEEE Transactions on Computational Intelligence and AI in Games
- Published
- 2011-09
- Volume
- 3
- Issue
- 3
- Pages
- 172-186
- ISSN
- 1943-068X (ISSN-L)
- 1943-0698
- OpenAlex
- W2168115594
- Cited by
- 706
- References
- 80
- Citations by year
- 2026: 38 · 2025: 44 · 2024: 49 · 2023: 28 · 2022: 37 · 2021: 40 · 2020: 66 · 2019: 64 · 2018: 45 · 2017: 48 · 2016: 61 · 2015: 47 · 2014: 63 · 2013: 39 · 2012: 32
- FWCI
- 40.87
- Type
- journal article
- Language
- en
- Open access
- Locations
- IEEE Transactions on Computational Intelligence and AI in Games (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I001964/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Keywords
- procedural content generation, evolutionary algorithms, metaheuristic search, game content generation, game design, board games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.