The DOI matches its Crossref record; 66 of the 68 references it cites were found in a registry or an index.
Shallow Gamification: Testing Psychological Effects of Framing an Activity as a Game
Abstract
This article experimentally dissociates the psychological impact of framing versus game mechanics, when presenting a serious activity as a game. Studies of game elements in nongame contexts tend to describe full packages, with no way of assessing their individual psychological and functional impact. To isolate the effects of framing, students ( N = 90) were assigned to either discuss study environment issues through a list of questions, via a competitive discussion board game, or though the same game artifacts but with no game mechanics. Task engagement and self-reported intrinsic motivation were compared between groups. Results demonstrate that the effects of simply framing the activity as a game though vernacular and artifacts holds almost as much psychological power as the full game mechanics. In both game conditions, interest and enjoyment were significantly superior to controls, but other intrinsic motivation variables remained unchanged. Implications for game design in nongame contexts are discussed, and a framework for differentiating “deep and shallow gamification” in terms of mechanics and framing is developed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The outcomes indicate that engagement and enjoyment increased significantly due to the psychological effects of framing the task as a game. Furthermore, no actual increased interest or enjoyment was measured by adding actual game mechanics to the task, when it was already framed as a game.”
From Gamifying education: what is known, what is believed and what remains uncertain: a critical review (2017) · cites this paper as Lieberoth (2015)
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666
Frame Analysis: An Essay on the Organization of Experience.
Gamson, W. A., & Goffman, E. (1975) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064022 · Cited by 11,891
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
A new scale of social desirability independent of psychopathology.
Crowne, D. P., & Marlowe, D. (1960) · Journal of Consulting Psychology · doi:10.1037/h0047358 · Cited by 8,686
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
REMEMBERING: A STUDY IN EXPERIMENTAL AND SOCIAL PSYCHOLOGY
Bartlett, F. C., & Burt, C. (1933) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1933.tb02913.x · Cited by 7,475
Deci, E. L., Koestner, R., & Ryan, R. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.6.627 · Cited by 7,176
Self-determination theory: A macrotheory of human motivation, development, and health
Deci, E. L., & Ryan, R. M. (2008) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0012801 · Cited by 6,664
Bateson, G. (2000) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226924601.001.0001 · Cited by 5,573
Rules of Play: Game Design Fundamentals
Salen, K., & Zimmerman, E. (2003) · Medical Entomology and Zoology · Cited by 5,438
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
Frame Analysis: An Essay on the Organization of Experience
Schneider, I. (1975) · American Journal of Psychiatry · doi:10.1176/ajp.132.10.1093-a · Cited by 3,850
Kapp, K. M. (2012) · Cited by 3,753
The motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Kronenfeld, D. B. (1978) · Language · doi:10.2307/412850 · Cited by 3,094
Motivations for Play in Online Games
Yee, N. (2006) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9.772 · Cited by 2,939
Scripts, Plans, Goals, and Understanding: An Inquiry into Human Knowledge Structures
Hunt, E. B., Schank, R. C., & Abelson, R. P. (1979) · The American Journal of Psychology · doi:10.2307/1421499 · Cited by 2,938
Reality is Broken Why Games Make Us Better and How They Can Change the World
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6095 · Cited by 2,933
Framing as a Theory of Media Effects
Scheufele, D. A. (1999) · Journal of Communication · doi:10.1111/j.1460-2466.1999.tb02784.x · Cited by 2,179
(2005) · Architecture, Design and Conservation (Aarhus School of Architecture, Design School Kolding, The Royal Danish Academy of Fine Arts, Schools of Architecture, Design and Conservation (KADK)) · Cited by 2,150
On the Elicitation of Preferences for Alternative Therapies
McNeil, B. J., Pauker, S. G., Sox, H. C., & Tversky, A. (1982) · New England Journal of Medicine · doi:10.1056/nejm198205273062103 · Cited by 1,683
Suits, B. (1978) · University of Toronto Press eBooks · doi:10.3138/9781487574338 · Cited by 1,560
Novelty, complexity, and hedonic value
Berlyne, D. E. (1970) · Perception & Psychophysics · doi:10.3758/bf03212593 · Cited by 1,489
The Influence of Framing on Risky Decisions: A Meta-analysis
Kühberger, A. (1998) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1998.2781 · Cited by 1,180
A Theory of Fun for Game Design
Koster, R., & Wright, W. (2004) · Cited by 1,110
Berlyne, D. E. (1954) · British Journal of Psychology General Section · doi:10.1111/j.2044-8295.1954.tb01243.x · Cited by 985
A casual revolution: reinventing video games and their players
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6689 · Cited by 885
The Psychology of Self-Determination.
Crittenden, K. S., & Deci, E. L. (1982) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2067164 · Cited by 842
Demographic differences in perceived benefits from gamification
Koivisto, J., & Hamari, J. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.007 · Cited by 841
Serious games : mechanisms and effects
Ritterfeld, U., Cody, M. J., & Vorderer, P. (2009) · MADOC (University of Mannheim) · Cited by 826
Levin, I. P., Gaeth, G. J., Schreiber, J., & Lauriola, M. (2002) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2001.2983 · Cited by 497
Handbook of Research on Effective Electronic Gaming in Education
Ferdig, R. E. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-808-6 · Cited by 413
de Freitas, S., Rebolledo‐Mendez, G., Liarokapis, F., Magoulas, G. D., & Poulovassilis, A. (2009) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2009.01024.x · Cited by 394
Sicart, M. (2008) · IT University Of Copenhagen (IT University of Copenhagen) · Cited by 373
From game design elements to gamefulness
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. E. (2011) · Cited by 367
Glued to Games: How Video Games Draw Us In and Hold Us Spellbound
Rigby, S., & Ryan, R. M. (2011) · doi:10.5040/9798400658105 · Cited by 362
Glued to games: how video games draw us in and hold us spellbound
(2011) · Choice Reviews Online · doi:10.5860/choice.49-0099 · Cited by 334
Lasgaard, M., Goossens, L., & Elklit, A. (2011) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-010-9442-x · Cited by 258
Game-Based Marketing: Inspire Customer Loyalty Through Rewards, Challenges, and Contests
O’Donohoe, S., & Vedrashko, I. (2011) · International Journal of Advertising · doi:10.2501/ija-30-1-189-190 · Cited by 247
(1913) · Mind · doi:10.1093/mind/xxii.10.601 · Cited by 213
Winning Isn't Everything: Competition, Achievement Orientation, and Intrinsic Motivation
Tauer, J. M., & Harackiewicz, J. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1999.1383 · Cited by 190
Neurobiological and memory models of risky decision making in adolescents versus young adults.
Reyna, V. F., Estrada, S. M., DeMarinis, J. A., Myers, R. M., Stanisz, J. M., & Mills, B. A. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0023943 · Cited by 183
At Least Nine Ways to Play: Approaching Gamer Mentalities
Kallio, K. P., Mäyrä, F., & Kaipainen, K. (2010) · Games and Culture · doi:10.1177/1555412010391089 · Cited by 182
In game, In room, In world: Reconnecting video game play to the rest of kids’ lives
Stevens, R., Satwicz, T., & McCarthy, L. (2008) · Cited by 168
Game-Based Marketing: Inspire Customer Loyalty Through Rewards, Challenges, and Contests
Linder, I. G. Z. I. J. (2010) · Medical Entomology and Zoology · Cited by 164
Adult play : a reversal theory approach
Kerr, J., & Apter, M. J. (1991) · Swets & Zeitlinger eBooks · Cited by 159
(2013) · Choice Reviews Online · doi:10.5860/choice.50-5038 · Cited by 148
A self-regulatory framework for message framing
Cesario, J., Corker, K. S., & Jelinek, S. (2012) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.10.014 · Cited by 141
Games for Persuasion: Argumentation, Procedurality, and the Lie of Gamification
Ferrara, J. (2013) · Games and Culture · doi:10.1177/1555412013496891 · Cited by 126
A Climate Change Board Game for Interdisciplinary Communication and Education
Eisenack, K. (2012) · Simulation & Gaming · doi:10.1177/1046878112452639 · Cited by 124
Reciprocal relationships between contextual and situational motivation in a sport setting
Blanchard, C. M., Mask, L., Vallerand, R. J., de la Sablonnière, R., & Provencher, P. J. (2007) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2007.03.004 · Cited by 97
Epistemic motives moderate the effect of metaphoric framing on attitudes
Landau, M. J., Keefer, L. A., & Rothschild, Z. K. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.03.009 · Cited by 56
Rehn, A. (2008) · Organization · doi:10.1177/1350508408093652 · Cited by 52
Impacts of Forced Serious Game Play on Vulnerable Subgroups
Heeter, C., Lee, Y.-H., Magerko, B. S., & Medler, B. (2011) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/jgcms.2011070103 · Cited by 46
The paradoxical effect of controlling context on intrinsic motivation in another activity
Radel, R., Pelletier, L. G., Baxter, D., Fournier, M., & Sarrazin, P. G. (2013) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.09.004 · Cited by 45
Lieberoth, A., Pedersen, M. K., Marin, A. C., Planke, T., & Sherson, J. F. (2014) · Human Computation · doi:10.15346/hc.v1i2.11 · Cited by 34
Self-citationGamifying Citizen Science: Lessons and Future Directions
Bowser, A., Hansen, D. L., & Preece, J. J. (2013) · Cited by 33
Similarity of Social Information Processes in Games and Rituals
Harviainen, J. T., & Lieberoth, A. (2011) · Simulation & Gaming · doi:10.1177/1046878110392703 · Cited by 30
Self-citationEngaging Consumers through Branded Entertainment and Convergent Media
Parreño, J. M., Mafé, C. R., & Scribner, L. L. (2015) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/978-1-4666-8342-6 · Cited by 28
The implicit rules of board games
Bergström, K. (2010) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/1930488.1930506 · Cited by 24
Serious Games and Seriously Fun Games: Can They Be One and the Same?
Shen, C., Wang, H., & Ritterfeld, U. (2009) · Routledge eBooks · doi:10.4324/9780203891650-12 · Cited by 22
The Game Frame: Systemizing a Goffmanian Approach to Video Game Theory
Deterding, S., & Medienforschung, H.-B.-I. F. (2009) · Cited by 21
Heeter, C. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-808-6.ch047 · Cited by 18
Influences of Situational Characteristics on Intrinsic Motivation
Bumpus, M. A., Olbeter, S., & Glover, S. H. (1998) · The Journal of Psychology · doi:10.1080/00223989809599279 · Cited by 13
Research works printed but not linked: 6
- Bell C. M., 1973, Discovering old board games
- Deterding S., Khaled R., Nacke L., Dixon D. (2011). Gamification: Toward a definition. In Proceedings of CHI 2011 Workshop on Gamification, pp. 12–15, May 7–12 , Vancouver, BC.
- Henriksen T. D., 2010, A little more conversation, a little less action, please
- Sicart M., 2008, Game Studies, 8, 1
- Stevens R., 2008, The ecology of games, 41
- Zichermann G., 2013, The gamification revolution: How leaders leverage game mechanics to crush the competition
Cited by
Sorted by citations
Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.07.045 · Cited by 1,713
Gamifying education: what is known, what is believed and what remains uncertain: a critical review
Dichev, C., & Dicheva, D. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0042-5 · Cited by 2,112
“According to Lieberoth (2015), it might not be the game itself that stimulates individuals, but rather the packaging: the fact that an activity resembles a game.”
Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.048 · Cited by 990
Why do people use gamification services?
Hamari, J., & Koivisto, J. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.04.006 · Cited by 748
de‐Marcos, L., García‐López, E., & García‐Cabot, A. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.12.008 · Cited by 281
Metadata
- Authors
- Lieberoth, A.
- Affiliations
- Aarhus University (DK)
- Corresponding author
- Lieberoth, Andreas
- ORCID
- Lieberoth, Andreas
- Venue
- Games and Culture
- Publisher
- SAGE Publications
- Published
- 2014-12-01
- Volume
- 10
- Issue
- 3
- Pages
- 229-248
- ISSN
- 1555-4120 (ISSN-L)
- 1555-4139
- OpenAlex
- W2321348787
- Cited by
- 208
- References
- 68
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 18 · 2023: 18 · 2022: 29 · 2021: 27 · 2020: 15 · 2019: 24 · 2018: 17 · 2017: 13 · 2016: 12 · 2015: 11
- FWCI
- 28.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Games and Culture (publishedVersion)
- Funders
- Aarhus Universitet
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Social Sciences › Psychology › Social Psychology › Motivation and Self-Concept in Sports
- Keywords
- gamification, framing effects, game mechanics, intrinsic motivation, task engagement, student engagement, interest and enjoyment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review