Augmenting Automated Game Testing with Deep Reinforcement Learning
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
General game testing relies on the use of human play testers, play test scripting, and prior knowledge of areas of interest to produce relevant test data. Using deep reinforcement learning (DRL), we introduce a self-learning mechanism to the game testing framework. With DRL, the framework is capable of exploring and/or exploiting the game mechanics based on a user-defined, reinforcing reward signal. As a result, test coverage is increased and unintended game play mechanics, exploits and bugs are discovered in a multitude of game types. In this paper, we show that DRL can be used to increase test coverage, find exploits, test map difficulty, and to detect common problems that arise in the testing of first-person shooter (FPS) games.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Although these studies aim to enhance behavioral diversity to improve test coverage, they lack mechanisms to control or direct the learned policy toward specific play styles.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [30]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, such agents often converge to repetitive and non-human optimal behaviors.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 1×
“tends to reach higher scores without a significant increase in training time [12].”
BackgroundCuriosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · cited 1×
“The reward signal can also be used to imitate human players and to encourage exploration by means of curiosity [11].”
BackgroundPlaying FPS Games with Deep Reinforcement Learning
Lample, G., & Chaplot, D. S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10827 · Cited by 452
Emergent Tool Use From Multi-Agent Autocurricula
Baker, B., Kanitscheider, I., Markov, T., Wu, Y., Powell, G., McGrew, B., & Mordatch, I. (2019) · arXiv · doi:10.48550/arxiv.1909.07528 · Cited by 424 · cited 2×
“Moreover, there are plenty of examples where RL algorithms have found unintended mechanics in complex scenarios [2].”
BackgroundLearning to Navigate in Complex Environments
Mirowski, P., Pascanu, R., Viola, F., Soyer, H., Ballard, A. J., Banino, A., Denil, M., Goroshin, R., Sifre, L., Kavukcuoglu, K., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03673 · Cited by 323
Wuji: Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement Learning
Zheng, Y., Xie, X., Su, T., Ma, L., Hao, J., Meng, Z., Liu, Y., Shen, R., Chen, Y., & Fan, C. (2019) · 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00077 · Cited by 174
QBE: QLearning-Based Exploration of Android Applications
Köroglu, Y., Şen, A., Muslu, Ö., et al. (2018) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2018.00020 · Cited by 100
Playing FPS Games with Deep Reinforcement Learning
Lample, G., & Chaplot, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.05521 · Cited by 96
Human-Like Playtesting with Deep Learning
Gudmundsson, S. F., Eisen, P., Poromaa, E., Nodet, A., Purmonen, S., Kozakowski, B., Meurling, R., & Cao, L. (2018) · 2018 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490442 · Cited by 90 · cited 1×
“vised learning using human game play data has successfully been applied to testing in 2D mobile puzzle games by predicting human-like actions to evaluate the playability of game levels [6].”
MethodExploring Game Space Using Survival Analysis.
Isaksen, A., Gopstein, D., & Nealen, A. (2015) · Foundations of Digital Games · Cited by 72
Research works printed but not linked: 1
- borovikov, 2019, Winning isn’t everything: Training agents to playtest modern games, Proc AAAI Workshop Reinforcement Learn Games
Cited by
Improving Playtesting Coverage via Curiosity Driven Reinforcement Learning Agents
Gordillo, C., Bergdahl, J., Tollmar, K., & Gisslen, L. (2021) · 2021 IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619048 · Cited by 50
Self-citationAutomated Play-Testing through RL Based Human-Like Play-Styles Generation
Le Pelletier de Woillemont, P., Labory, R., & Corruble, V. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v18i1.21958 · Cited by 7
“RL can be use to improve game testing (Bergdahl et al. 2021) in order to find unintended exploits in the video game.”
BackgroundGenerating Personas for Games with Multimodal Adversarial Imitation Learning
Ahlberg, W., Sestini, A., Tollmar, K., & Gisslén, L. (2023) · 2023 IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333167 · Cited by 5
Self-citationUBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors
Cilan, A., & Ozgovde, A. (2026) · IEEE Transactions on Games · doi:10.1109/tg.2026.3703355
“Methods like [28], [29], [30], [31], [32] successfully generate various play styles by applying reward shaping to diversify the trained model’s behavior.”
Metadata
- Authors
- Bergdahl, J., Gordillo, C., Tollmar, K., & Gisslen, L.
- Venue
- 2020 IEEE Conference on Games (CoG)
- Publisher
- IEEE
- Published
- 2020-08
- Pages
- 600-603
- OpenAlex
- W3094597259
- Cited by
- 91
- References
- 12
- Citations by year
- 2026: 8 · 2025: 22 · 2024: 15 · 2023: 17 · 2022: 18 · 2021: 9 · 2020: 2
- FWCI
- 7.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Conference on Games (CoG) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- automated game testing, deep reinforcement learning, test coverage, bug detection, first-person shooter games, reward signals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Augmenting Automated Game Testing with Deep Reinforcement Learning. https://app.cochat.ai/papers/10.1109/cog47356.2020.9231552
- The paper
- Bergdahl, J., Gordillo, C., Tollmar, K., & Gisslen, L. (2020). Augmenting Automated Game Testing with Deep Reinforcement Learning. 2020 IEEE Conference on Games (CoG). https://doi.org/10.1109/cog47356.2020.9231552
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.