Fusing Visual and Behavioral Cues for Modeling User Experience in Games
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Estimating affective and cognitive states in conditions of rich human-computer interaction, such as in games, is a field of growing academic and commercial interest. Entertainment and serious games can benefit from recent advances in the field as, having access to predictors of the current state of the player (or learner) can provide useful information for feeding adaptation mechanisms that aim to maximize engagement or learning effects. In this paper, we introduce a large data corpus derived from 58 participants that play the popular Super Mario Bros platform game and attempt to create accurate models of player experience for this game genre. Within the view of the current research, features extracted both from player gameplay behavior and game levels, and player visual characteristics have been used as potential indicators of reported affect expressed as pairwise preferences between different game sessions. Using neuroevolutionary preference learning and automatic feature selection, highly accurate models of reported engagement, frustration, and challenge are constructed (model accuracies reach 91%, 92%, and 88% for engagement, frustration, and challenge, respectively). As a step further, the derived player experience models can be used to personalize the game level to desired levels of engagement, frustration, and challenge as game content is mapped to player experience through the behavioral and expressivity patterns of each player.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring and defining the experience of immersion in games
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.04.004 · Cited by 2,065 · cited 1×
“…advances on computer vision techniques under uncontrolled conditions have allowed the proposal of techniques incorporating notions such as body and head movements [4], eye gaze (with eye gaze usually necessitating specialized hardware, such as infra-red eye trackers [8]) and facial expressions [9].”
BackgroundAutomatic prediction of frustration
Kapoor, A., Burleson, W., & Picard, R. W. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.02.003 · Cited by 592 · cited 1×
“Player experience modeling [3] studies that rely on single or multiple modalities of user input (see [13], [14], [15], [16], [17], [18], [19] among many) have provided some initial benchmark solutions towards achieving such a goal.”
BackgroundIn-Game: From Immersion to Incorporation
Calleja, G. (2011) · doi:10.7551/mitpress/8429.001.0001 · Cited by 488
Automatic analysis of affective postures and body motion to detect engagement with a game companion,
Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P. W., & Paiva, A. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957781 · Cited by 250 · cited 1×
“Typical works are those reported in [10] and [11], where the authors use Bayesian networking on gaze, postural, and contextual data for detecting user engagement with a robot companion [12] posing various expressions.”
BackgroundMultimodal emotion recognition from expressive faces, body gestures and speech
Caridakis, G., Castellano, G., Kessous, L., Raouzaiou, A., Malatesta, L., Asteriadis, S., & Karpouzis, K. (2007) · IFIP The International Federation for Information Processing · doi:10.1007/978-0-387-74161-1_41 · Cited by 225 · cited 1×
“Being in line with Csikszentmihalyi’s flow theory [43], visual features related to arousal were searched for [44] and combined with expressed player states and experience reports.”
BackgroundSelf-citationYannakakis, G. N. (2012) · Proceedings of the 9th conference on Computing Frontiers · doi:10.1145/2212908.2212954 · Cited by 179
Self-citation
Cited by
Boyle, E. A., Hainey, T., Connolly, T. M., Gray, G., Earp, J., Ott, M., Lim, T., Ninaus, M., Ribeiro, C., & Pereira, J. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.003 · Cited by 1,133
Human-Like Playtesting with Deep Learning
Gudmundsson, S. F., Eisen, P., Poromaa, E., Nodet, A., Purmonen, S., Kozakowski, B., Meurling, R., & Cao, L. (2018) · 2018 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490442 · Cited by 90
“Player experience can be measured with various metrics [3], [19], [20].”
BackgroundDynamic difficulty adjustment approaches in video games: a systematic literature review
Mortazavi, F., Moradi, H., & Vahabie, A.-H. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18768-x · Cited by 70
Metadata
- Authors
- Shaker, N., Asteriadis, S., Yannakakis, G. N., & Karpouzis, K.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2013-12
- Volume
- 43
- Issue
- 6
- Pages
- 1519-1531
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2011974988
- Cited by
- 91
- References
- 6
- FWCI
- 11.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fusing Visual and Behavioral Cues for Modeling User Experience in Games. https://app.cochat.ai/papers/10.1109/tcyb.2013.2271738
- The paper
- Shaker, N., Asteriadis, S., Yannakakis, G. N., & Karpouzis, K. (2013). Fusing Visual and Behavioral Cues for Modeling User Experience in Games. IEEE Transactions on Cybernetics. https://doi.org/10.1109/tcyb.2013.2271738
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.