Expertise and engagement: re-designing citizen science games with players' minds in mind
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Many studies have already shown that games can be a useful tool to make boring or difficult tasks more engaging. However, with serious game design being a relatively nascent field, such experiences can still be hard to learn and not very motivating. In this paper, we explore the use of learning and motivation frameworks to improve player experience in the well-known citizen science game Foldit. Using Cognitive Load Theory (CLT) and Self Determination Theory (SDT), we developed six interface and mechanical changes to the tutorial levels in Foldit designed to increase engagement and retention. We tested these features with new players of Foldit and collected both behavioral data, using game metrics, and prior experience data, using self-report measures. This study offers three major contributions: (1) we document the process of operationalizing CLT and SDT as new game features, a unique methodology not used in game design previously; (2) the user interface, specifically the level selection screen, significantly impacts how players progress through the game; and (3) a player's expertise, whether from prior domain knowledge or prior gaming experience, increases their engagement. We discuss both implications of these findings as well as how these implementations can generalize to other designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599 · cited 1×
“Much of our understanding of player motivation has come from Self Determination Theory (SDT) and its sub-theory, Cognitive Evaluation Theory [12, 54].”
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666 · cited 1×
“Namely, video games provide intrinsic motivation, rather than extrinsic motivation, by giving the players competence in the game mechanics, autonomy in the execution of their actions, and (to a lesser extent [13]) providing a sense of relatedness to others [14, 17, 48, 53].”
BackgroundSelf-determination theory: A macrotheory of human motivation, development, and health
Deci, E. L., & Ryan, R. M. (2008) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0012801 · Cited by 6,664 · cited 1×
“Namely, video games provide intrinsic motivation, rather than extrinsic motivation, by giving the players competence in the game mechanics, autonomy in the execution of their actions, and (to a lesser extent [13]) providing a sense of relatedness to others [14, 17, 48, 53].”
BackgroundNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“For both SDT and CLT, previous work with these frameworks uses them either theoretically or as a lens to interpret measurements of learning and engagement, such as the NASA Task Load Index (NASA-TLX) [25], the Intrinsic Motivation Inventory (IMI) [55], or through coding interview transcripts [17].”
MethodNine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“The generalized goal of this feature is to reduce cognitive load within the game elements, introduce only one mechanic at a time and explicitly so, thus segmenting the learning needs [37].”
BackgroundThe motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Gamification in theory and action: a survey
Seaborn, K., & Fels, D. I. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.09.006 · Cited by 2,515
Development and use of the ARCS model of instructional design
Keller, J. M. (1987) · Journal of Instructional Development · doi:10.1007/bf02905780 · Cited by 2,332 · cited 1×
“Our findings would undoubtedly have been different had we used a different operationalized definition of the frameworks or different frameworks entirely, such as flow [8], Information Processing Theory [39], or Keller’s ARCS model [32].”
MethodSweetser (2005) · doi:10.1145/1077246.1077253 · Cited by 2,124 · cited 1×
“Engagement with games has been studied thoroughly and goes by many names, including flow, GameFlow, presence, immersion, motivation, enjoyment, and fun [3, 7, 9, 58, 61].”
Background
Cited by
Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned Paradigms
Tyack, A., & Mekler, E. D. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3673230 · Cited by 57
Improving microbial phylogeny with citizen science within a mass-market video game
Sarrazin-Gendron, R., Ghasemloo Gheidari, P., Butyaev, A., Keding, T., Cai, E., Zheng, J., Mutalova, R., Mounthanyvong, J., Zhu, Y., Nazarova, E., et al. (2025) · Nature Biotechnology · doi:10.1038/s41587-024-02175-6 · Cited by 9
Trading Accuracy for Enjoyment? Data Quality and Player Experience in Data Collection Games
Gundry, D., & Deterding, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502025 · Cited by 6
Metadata
- Authors
- Miller, J. A., Narayan, U., Hantsbarger, M., Cooper, S., & El-Nasr, M. S.
- Venue
- Proceedings of the 14th International Conference on the Foundations of Digital Games
- Publisher
- ACM
- Published
- 2019-08-26
- Volume
- 2019
- Pages
- 1-11
- OpenAlex
- W2971725938
- Cited by
- 40
- References
- 23
- FWCI
- 5.69
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Expertise and engagement: re-designing citizen science games with players' minds in mind. https://app.cochat.ai/papers/10.1145/3337722.3337735
- The paper
- Miller, J. A., Narayan, U., Hantsbarger, M., Cooper, S., & El-Nasr, M. S. (2019). Expertise and engagement: re-designing citizen science games with players' minds in mind. Proceedings of the 14th International Conference on the Foundations of Digital Games. https://doi.org/10.1145/3337722.3337735
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.