The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Procedural Content Generation via Machine Learning (PCGML)
Open accessAbstract
This survey explores procedural content generation via machine learning (PCGML), defined as the generation of game content using machine learning models trained on existing content. As the importance of PCG for game development increases, researchers explore new avenues for generating high-quality content with or without human involvement; this paper addresses the relatively new paradigm of using machine learning (in contrast with search-based, solver-based, and constructive methods). We focus on what is most often considered functional game content, such as platformer levels, game maps, interactive fiction stories, and cards in collectible card games, as opposed to cosmetic content, such as sprites and sound effects. In addition to using PCG for autonomous generation, cocreativity, mixed-initiative design, and compression, PCGML is suited for repair, critique, and content analysis because of its focus on modeling existing content. We discuss various data sources and representations that affect the generated content. Multiple PCGML methods are covered, including neural networks: long short-term memory networks, autoencoders, and deep convolutional networks; Markov models: $n$-grams and multi-dimensional Markov chains; clustering; and matrix factorization. Finally, we discuss open problems in PCGML, including learning from small data sets, lack of training data, multilayered learning, style-transfer, parameter tuning, and PCG as a game mechanic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Ankerst, M. (1999) · doi:10.1145/304181.304187 · Cited by 3,982
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Martuza, V. R., & Kenny, D. A. (1981) · Educational Researcher · doi:10.2307/1175080 · Cited by 2,028
The Unreasonable Effectiveness of Data
Halevy, A., Norvig, P., & Pereira, F. (2009) · IEEE Intelligent Systems · doi:10.1109/mis.2009.36 · Cited by 1,767
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Cybertext: Perspectives on Ergodic Literature
Aarseth, E. (1997) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 1,212
The hierarchical hidden Markov model: Analysis and applications
Fine, S., Singer, Y., & Tishby, N. (1998) · Machine Learning · doi:10.1023/a:1007469218079 · Cited by 906
DRAW: A Recurrent Neural Network For Image Generation
Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., & Wierstra, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04623 · Cited by 841
Search-Based Procedural Content Generation: A Taxonomy and Survey
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2148116 · Cited by 706
Self-citationLearning to generate chairs with convolutional neural networks
Dosovitskiy, A., Springenberg, J. T., & Brox, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298761 · Cited by 640
Image Inpainting : Overview and Recent Advances
Guillemot, C., & Le Meur, O. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2273004 · Cited by 608
Procedural Content Generation in Games
Shaker, N., Togelius, J., & Nelson, M. J. (2016) · Computational Synthesis and Creative Systems · doi:10.1007/978-3-319-42716-4 · Cited by 519
Self-citationExperience-Driven Procedural Content Generation
Yannakakis, G. N., & Togelius, J. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.6 · Cited by 470
Self-citationBoulanger-Lewandowski, N., Bengio, Y., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6392 · Cited by 459
Example-guided physically based modal sound synthesis
Ren, Z., Yeh, H., & Lin, M. C. (2013) · ACM Transactions on Graphics · doi:10.1145/2421636.2421637 · Cited by 453
Real-time computer vision with OpenCV
Pulli, K., Baksheev, A., Kornyakov, K., & Eruhimov, V. (2012) · Communications of the ACM · doi:10.1145/2184319.2184337 · Cited by 440
A probabilistic model for component-based shape synthesis
Kalogerakis, E., Chaudhuri, S., Koller, D., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185551 · Cited by 350
emoji2vec: Learning Emoji Representations from their Description
Eisner, B., Rocktäschel, T., Augenstein, I., Bosnjak, M., & Riedel, S. (2016) · Proceedings of The Fourth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w16-6208 · Cited by 291
Answer Set Programming for Procedural Content Generation: A Design Space Approach
Smith, A. M., & Mateas, M. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2158545 · Cited by 201
Super Mario as a String: Platformer Level Generation Via LSTMs
Summerville, A., & Mateas, M. (2016) · doi:10.26503/dl.v2016i1.752 · Cited by 162
Self-citationSentient sketchbook : computer-assisted game level authoring
Liapis, A., Yannakakis, G. N., & Togelius, J. (2013) · OAR@UM (University of Malta) · Cited by 160
Self-citationTanagra: Reactive Planning and Constraint Solving for Mixed-Initiative Level Design
Smith, G., Whitehead, J., & Mateas, M. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2159716 · Cited by 156
General Video Game Level Generation
Khalifa, A., Pérez-Liébana, D., Lucas, S. M., & Togelius, J. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908920 · Cited by 99
Self-citationWhite, T. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.12585362.v1 · Cited by 94
Game Level Generation from Gameplay Videos
Guzdial, M., & Riedl, M. O. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12861 · Cited by 82
Self-citationLearning to Generate Video Game Maps Using Markov Models
Snodgrass, S., & Ontañón, S. (2016) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2016.2623560 · Cited by 76
Self-citationDahlskog, S., Togelius, J., & Nelson, M. J. (2014) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/2676467.2676506 · Cited by 73
Self-citationRopossum: An Authoring Tool for Designing, Optimizing and Solving Cut the Rope Levels
Shaker, N., Shaker, M., & Togelius, J. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v9i1.12611 · Cited by 72
Self-citationExperiments in map generation using Markov chains.
Snodgrass, S., & Ontañón, S. (2014) · Foundations of Digital Games · Cited by 60
Self-citationA Comparative Evaluation of Procedural Level Generators in the Mario AI Framework
Horn, B., Dahlskog, S., Shaker, N., Smith, G., & Togelius, J. (2014) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 59
Self-citationTransforming Exploratory Creativity with DeLeNoXPreprint
Liapis, A., Martínez, H. P., Togelius, J., & Yannakakis, G. N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11715 · Cited by 57
Self-citationUnderstanding mario: an evaluation of design metrics for platformers
Summerville, A., Mariño, J. R. H., Snodgrass, S., Ontañón, S., & Lelis, L. H. S. (2017) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3102071.3102080 · Cited by 57
Self-citationSchartmann, A. (2015) · Bloomsbury Academic eBooks · Cited by 52
Treanor, M., Zook, A., Eladhari, M. P., Togelius, J., Smith, G., Cook, M. L., Thompson, T., Magerko, B. S., Levine, J., & Smith, A. M. (2015) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 47
Self-citationControllable procedural content generation via constrained multi-dimensional Markov chain sampling
Snodgrass, S., & Ontañón, S. (2016) · International Joint Conference on Artificial Intelligence · Cited by 40
Self-citationA Hierarchical MdMC Approach to 2D Video Game Map Generation
Snodgrass, S., & Ontañón, S. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v11i1.12794 · Cited by 30
Self-citationCrowdsourcing Open Interactive Narrative.
Guzdial, M., Harrison, B. E., Li, B., & Riedl, M. O. (2015) · Foundations of Digital Games · Cited by 28
Self-citationAn Approach to Domain Transfer in Procedural Content Generation of Two-Dimensional Videogame Levels
Snodgrass, S., & Ontañón, S. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12853 · Cited by 20
Self-citationMystical Tutor: A Magic: The Gathering Design Assistant via Denoising Sequence-to-Sequence Learning
Summerville, A., & Mateas, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12851 · Cited by 20
Self-citationShaker, N., & Abou-Zleikha, M. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12729 · Cited by 18
Towards a Procedural Evaluation Technique: Metrics for Level Design.
Canossa, A., & Smith, G. (2015) · Foundations of Digital Games · Cited by 15
Neuroevolution for General Video Game Playing
Samothrakis, S., Pérez-Liébana, D., Lucas, S. M., & Fasli, M. (2015) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2015.7317943 · Cited by 14
A Conceptual Blending Approach to the Generation of Cognitive Scripts for Interactive Narrative
Permar, J., & Magerko, B. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v9i4.12621 · Cited by 14
Functional Scaffolding for Composing Additional Musical Voices
Hoover, A. K., Szerlip, P., & Stanley, K. O. (2014) · Computer Music Journal · doi:10.1162/comj_a_00269 · Cited by 13
Self-citationLearning knowledge to support domain-independent narrative intelligence
Li, B. (2015) · SMARTech Repository (Georgia Institute of Technology) · Cited by 13
CNN based texture synthesize with Semantic segmentPreprint
Liang, X., Zhuo, B., Li, P., & He, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.04731 · Cited by 4
Cited by
Deep Learning for Video Game Playing
Justesen, N., Bontrager, P., Togelius, J., & Risi, S. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2019.2896986 · Cited by 257
Self-citationPCGRL: Procedural Content Generation via Reinforcement Learning
Khalifa, A., Bontrager, P., Earle, S., & Togelius, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7416 · Cited by 156
Self-citationSchrum, J., Gutierrez, J., Volz, V., Liu, J., Lucas, S., & Risi, S. (2020) · Proceedings of the 2020 Genetic and Evolutionary Computation Conference · doi:10.1145/3377930.3389821 · Cited by 63
Du, Z., & Lu, R. (2025) · Batteries · doi:10.3390/batteries11060204 · Cited by 58
Game Generation via Large Language Models
Hu, C., Zhao, Y., & Liu, J. (2024) · 2024 IEEE Conference on Games (CoG) · doi:10.1109/cog60054.2024.10645597 · Cited by 23
Metadata
- Authors
- Summerville, A., Snodgrass, S., Guzdial, M., Holmgard, C., Hoover, A. K., Isaksen, A., Nealen, A., & Togelius, J.
- Venue
- IEEE Transactions on Games
- Published
- 2018-09
- Volume
- 10
- Issue
- 3
- Pages
- 257-270
- ISSN
- 2475-1502 (ISSN-L)
- 2475-1510
- OpenAlex
- W2586544230
- Cited by
- 425
- References
- 60
- FWCI
- 26.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.