Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS)
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Abstract Challenge is a key element of digital games, but a clear conceptualisation and operationalisation of this player experience were long missing. This made it hard for game researchers to measure this experience in different video games across different skill sets and impeded the synthesis of challenge-related games research. To overcome this, we introduce a systematic, extensive, and reliable instrument to evaluate the level of players’ perceived challenge in digital games. We conceptualise challenge based on a survey of related literature in games user research, design and AI, as well as interviews with researchers and players. Exploratory factor analysis (N=394) highlights four components of experienced challenge: performative, emotional, cognitive and decision-making challenge. Refinement of the items allowed us to devise the Challenge Originating from Recent Gameplay Interaction Scale (CORGIS), which has been further validated in a study with nearly 1000 players. The questionnaire exhibits good construct validity for use by both game developers and researchers to quantify players’ challenge experiences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210
Sample Size in Qualitative Interview Studies: Guided by Information Power
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016) · Qualitative Health Research · doi:10.1177/1049732315617444 · Cited by 12,703
The motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Toward a Theory of Intrinsically Motivating Instruction*
Malone, T. W. (1981) · Cognitive Science · doi:10.1207/s15516709cog0504_2 · Cited by 2,197 · cited 4×
“A player’s perception of challenge largely depends on the difficulty of the game (Adams, 2014; Malone, 1981, 1982).”
InfluentialThe Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 1×
“First, a confirmatory bifactor analysis was done to explore if there was a general factor of challenge underlying the 4-factor model (Reise, 2012).”
Measuring and defining the experience of immersion in games
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.04.004 · Cited by 2,065 · cited 3×
“For instance, a level of challenge that is neither too hard nor too easy is essential to achieving the state of flow (Csikszentmihalyi, 1990) and contributes to players experiencing immersion (Ermi and Mäyrä, 2005; Jennett et al., 2008).”
Self-citationThe game, the player, the world: looking for a heart of gameness
Juul, J. (2003) · DiGRA Digital Library · doi:10.26503/dl.v2003i1.65 · Cited by 648
Cited by
The impact of gamification on learning and instruction: A systematic review of empirical evidence
Zainuddin, Z., Chu, S. K. W., Shujahat, M., & Perera, C. J. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100326 · Cited by 952
Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned Paradigms
Tyack, A., & Mekler, E. D. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3673230 · Cited by 57
Denisova, A., Bromley, S., Mirza-Babaei, P., & Mekler, E. D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677108 · Cited by 5
Self-citation
Metadata
- Authors
- Denisova, A., Cairns, P., Guckelsberger, C., & Zendle, D.
- Venue
- International Journal of Human-Computer Studies
- Publisher
- Elsevier BV
- Published
- 2020-05
- Volume
- 137
- Pages
- 102383
- ISSN
- 1071-5819 (ISSN-L)
- OpenAlex
- W2996368260
- Cited by
- 116
- References
- 8
- FWCI
- 16.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS). https://app.cochat.ai/papers/10.1016/j.ijhcs.2019.102383
- The paper
- Denisova, A., Cairns, P., Guckelsberger, C., & Zendle, D. (2020). Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS). International Journal of Human-Computer Studies. https://doi.org/10.1016/j.ijhcs.2019.102383
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.