The DOI matches its Crossref record; 19 of the 21 references it cites were found in a registry or an index.
Configurable Agent With Reward As Input: A Play-Style Continuum Generation
Open accessAbstract
Modern video games are becoming richer and more complex in terms of game mechanics. This complexity allows for the emergence of a wide variety of ways to play the game across the players. From the point of view of the game designer, this means that one needs to anticipate a lot of different ways the game could be played. Machine Learning (ML) could help address this issue. More precisely, Reinforcement Learning is a promising answer to the need of automating video game testing. In this paper we present a video game environment which lets us define multiple play-styles. We then introduce CARI: a Configurable Agent with Reward as Input. An agent able to simulate a wide continuum range of play-styles. It is not constrained to extreme archetypal behaviors like current methods using reward shaping. In addition it achieves this through a single training loop, instead of the usual one loop per play-style. We compare this novel training approach with the more classic reward shaping approach and conclude that CARI can also outperform the baseline on archetypes generation. This novel agent could be used to investigate behaviors and balancing during the production of a video game with a realistic amount of training time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As suggested in the study [28], a model that predicts reward coefficients from the game metadata of human players is needed for this task.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“CARI provides directional control via reward weights but converges to edge behaviors in the PCA projection (Figure 7), consistent with its weight-based formulation favoring extreme trade-offs.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, since there is no explicit mapping between these reward coefficients and human behavioral data, reproducing a specific human play style remains challenging.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“To provide a fair baseline, we implemented CARI (Configurable Agent with Reward as Input) [28] under identical training conditions: same environment, observation space, action space, network architecture, and training horizon.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“In contrast to prior studies that rely on reward coefficient diversification or utility function adjustments [16], [28], [31], [32], the UBCL framework leverages actual game metrics in the reward function, enabling approximate reproduction of desired human-like behaviors by using game-play data, with accuracy varying across behavioral dimensions.”
From UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors (2026) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · cited 1×
“The most famous one is the Atari suite [18] which, while being”
BackgroundCooper, A. (1999) · Cited by 1,157
Quality Diversity: A New Frontier for Evolutionary Computation
Pugh, J. K., Soros, L. B., & Stanley, K. O. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00040 · Cited by 514
Visualizing and Understanding Atari AgentsPreprint
Greydanus, S., Koul, A., Dodge, J. E., & Fern, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00138 · Cited by 336
Sample Efficient Actor-Critic with Experience Replay
Wang, Z., Bapst, V., Heess, N., Mnih, V., Munos, R., Kavukcuoglu, K., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01224 · Cited by 192
Defining personas in games using metrics
Tychsen, A., & Canossa, A. (2008) · Proceedings of the 2008 Conference on Future Play: Research, Play, Share · doi:10.1145/1496984.1496997 · Cited by 169
Automated Playtesting With Procedural Personas Through MCTS With Evolved Heuristics
Holmgard, C., Green, M. C., Liapis, A., & Togelius, J. (2019) · IEEE Transactions on Games · doi:10.1109/tg.2018.2808198 · Cited by 125 · cited 4×
“To that effect Holmgård et al. use RL [7], evolutionary [8] and MCTS [9] agents.”
BackgroundMethodInfluential
Research works printed but not linked: 4
- norouzzadeh ravari, 0, Playing styles in starcraft, 2018 european GAME-ON Conference on Simulation and AI in Computer Games
- ng, 2000, Algorithms for inverse reinforcement learning, ICML, 1, 2
- vinyals, 2019, Alphastar Mastering the real-time strategy game StarCraft II
- andrade, 2005, Automatic computer game balancing a reinforcement learning approach, 1111
Cited by
Automated Gameplay Testing and Validation With Curiosity-Conditioned Proximal Trajectories
Sestini, A., Gisslén, L., Bergdahl, J., Tollmar, K., & Bagdanov, A. D. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3226910 · Cited by 47
CCP: Configurable Crowd Profiles
Panayiotou, A., Kyriakou, T., Lemonari, M., Chrysanthou, Y., & Charalambous, P. (2022) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3528233.3530712 · Cited by 32
Towards Informed Design and Validation Assistance in Computer Games Using Imitation Learning
Sestini, A., Bergdahl, J., Tollmar, K., Bagdanov, A. D., & Gisslén, L. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333234 · Cited by 21
Automated Play-Testing through RL Based Human-Like Play-Styles Generation
Le Pelletier de Woillemont, P., Labory, R., & Corruble, V. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v18i1.21958 · Cited by 7
Self-citationGenerating Personas for Games with Multimodal Adversarial Imitation Learning
Ahlberg, W., Sestini, A., Tollmar, K., & Gisslén, L. (2023) · 2023 IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333167 · Cited by 5
Metadata
- Authors
- Le Pelletier de Woillemont, P., Labory, R., & Corruble, V.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Venue
- 2021 IEEE Conference on Games (CoG)
- Publisher
- IEEE
- Published
- 2021-08-17
- Pages
- 1-8
- OpenAlex
- W4205137590
- Cited by
- 12
- References
- 21
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 5 · 2022: 3
- FWCI
- 1.04
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Conference on Games (CoG) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Keywords
- reinforcement learning agents, reward shaping, game balance, game mechanics, CARI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Configurable Agent With Reward As Input: A Play-Style Continuum Generation. https://app.cochat.ai/papers/10.1109/cog52621.2021.9619127
- The paper
- Le Pelletier de Woillemont, P., Labory, R., & Corruble, V. (2021). Configurable Agent With Reward As Input: A Play-Style Continuum Generation. 2021 IEEE Conference on Games (CoG). https://doi.org/10.1109/cog52621.2021.9619127
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.