Investigating the Direct Impact of a Gamified Versus Nongamified Well-Being Intervention: An Exploratory Experiment
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Gamification is a promising strategy to increase the effectiveness of Web-based mental health interventions by enhancing engagement. However, because most studies focus on the longer term effects of gamification (eg, effectiveness or adherence at the end of the intervention period), there is limited insight into how gamification may enhance engagement. Research implies that gamification has a direct impact at the time of use of the intervention, which changes the experience of the users, and thereby motivates users. However, it is unclear what this direct impact of gamification might be and how it can be measured. OBJECTIVE: The objective of this study was to explore the direct impact of gamification on behavioral, cognitive, and affective engagement in the context of a Web-based mental health intervention and to explore whether and how the different components of engagement are related. METHODS: A pilot (n=19) and a real-life (n=75) randomized between-groups experiment was carried out, where participants used a gamified or nongamified version of the same Web-based well-being intervention for a single session. Participants (68%, 64/94 female, mean age 23 years) were asked to use the intervention in one session for research purposes. Gamification elements included a map as visualization of the different lessons, a virtual guide, and badges. Later, behavioral, cognitive, and affective engagement were measured. RESULTS: The pilot experiment showed no differences between the gamified and nongamified intervention. However, in the real-life experiment, participants in the gamified intervention scored higher on cognitive engagement, that is, involvement (P=.02) and some elements of affective engagement, that is, flow as a combination of cognitive and affective engagement (P=.049), and the emotions "interest" (P=.03) and "inspiration" (P=.009). Furthermore, the effect of gamification on cognitive engagement was mediated by the influence of gamification on specific positive emotions. CONCLUSIONS: The gamified intervention seemed to be able to increase cognitive engagement and the combination of cognitive and affective engagement but not behavioral and affective engagement alone. However, positive emotions seem to play an important role in mediating the effect of gamification on engagement. In conclusion, we cannot say that gamification "works" but that the design of an intervention, in this case, gamification, can have an impact on how participants experience the intervention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Measuring the involvement construct
Zaichkowsky, J. L. (1985) · Journal of Consumer Research · doi:10.1086/208520 · Cited by 6,013
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
The broaden–and–build theory of positive emotions
Fredrickson, B. L. (2004) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2004.1512 · Cited by 4,214
Psychological Well-Being Revisited: Advances in the Science and Practice of Eudaimonia
Ryff, C. D. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000353263 · Cited by 2,976 · cited 1×
“Well-being is important to achieve and maintain a healthy life and prevent mental illnesses and generally serves as a basis for resilience [37-40].”
BackgroundMcAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 2×
“Web-based interventions, in which people can improve their health from home, with or without the help of a health care professional, are increasingly used in many health care areas [1-3].”
BackgroundSailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.12.033 · Cited by 2,064 · cited 1×
“A number of studies have shown that gamification, if used correctly, can increase intrinsic motivation for a certain behavior, for example, by satisfying certain psychological needs [26,27].”
BackgroundStudent engagement with school: Critical conceptual and methodological issues of the construct
Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008) · Psychology in the Schools · doi:10.1002/pits.20303 · Cited by 1,956
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 2×
“Research has shown that technology offers ample opportunities for enhancing engagement [12,17].”
BackgroundSelf-citationGamification for health and wellbeing: A systematic review of the literature
Johnson, D., Deterding, S., Kuhn, K.-A., Staneva, A., Stoyanov, S., & Hides, L. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.10.002 · Cited by 1,237
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 1×
“The limited effectiveness of these interventions may be partly attributed to large nonadherence rates [11,12].”
BackgroundPositive Psychology in Clinical Practice
Lee Duckworth, A., Steen, T. A., & Seligman, M. E. P. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.144154 · Cited by 1,095
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.048 · Cited by 990 · cited 1×
“A number of studies have shown that gamification, if used correctly, can increase intrinsic motivation for a certain behavior, for example, by satisfying certain psychological needs [26,27].”
BackgroundSpijkerman, M. P. J., Pots, W. T. M., & Bohlmeijer, E. T. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.009 · Cited by 975 · cited 2×
“However, not all Web-based interventions show beneficial effects and especially the effect sizes of interventions implemented outside the clinical setting with limited or no counselor involvement can be quite small [7,8,10].”
BackgroundA Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · cited 1×
“Many people who start using a Web-based intervention do not finish it or do not use the intervention in the prescribed way, which diminishes its effectiveness [13].”
Griffiths, F., Lindenmeyer, A., Powell, J., Lowe, P., & Thorogood, M. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e10 · Cited by 820 · cited 1×
“Advantages of Web-based interventions compared with face-to-face interventions are, among others, that Web-based interventions can reduce the costs of providing interventions, increase access to care for a large group of people, and are often perceived as more convenient by the users, given their flexibility and anony…”
BackgroundChange in Level of Positive Mental Health as a Predictor of Future Risk of Mental Illness
Keyes, C. L. M., Dhingra, S. S., & Simoes, E. J. (2010) · American Journal of Public Health · doi:10.2105/ajph.2010.192245 · Cited by 778
A Behavior Change Model for Internet Interventions
Ritterband, L. M., Thorndike, F. P., Cox, D. J., Kovatchev, B. P., & Gonder-Frederick, L. A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9133-4 · Cited by 591
Internet-administered cognitive behavior therapy for health problems: a systematic review
Cuijpers, P., van Straten, A., & Andersson, G. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-007-9144-1 · Cited by 555 · cited 1×
“Web-based interventions, in which people can improve their health from home, with or without the help of a health care professional, are increasingly used in many health care areas [1-3].”
BackgroundInternet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · cited 1×
“Web-based interventions, in which people can improve their health from home, with or without the help of a health care professional, are increasingly used in many health care areas [1-3].”
BackgroundSieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8578 · Cited by 331 · cited 1×
“However, this may not be surprising because more is not always better [50].”
BackgroundSelf-citationArnberg, F. K., Linton, S. J., Hultcrantz, M., Heintz, E., & Jonsson, U. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098118 · Cited by 330
Donkin, L., & Glozier, N. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2100 · Cited by 212 · cited 2×
“Cognitive engagement is an important part of engagement, which is seen as an important predictor of both adherence to Web-based interventions and the effectiveness of these interventions [14,16,51].”
BackgroundLamers, S. M. A., Westerhof, G. J., Glas, C. A. W., & Bohlmeijer, E. T. (2015) · The Journal of Positive Psychology · doi:10.1080/17439760.2015.1015156 · Cited by 207 · cited 1×
“Well-being is important to achieve and maintain a healthy life and prevent mental illnesses and generally serves as a basis for resilience [37-40].”
BackgroundHow to increase reach and adherence of web-based interventions: a design research viewpoint
Ludden, G. D., van Rompay, T. J., Kelders, S. M., & van Gemert-Pijnen, J. E. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4201 · Cited by 185 · cited 1×
“Research has shown that technology offers ample opportunities for enhancing engagement [12,17].”
BackgroundSelf-citationAhtinen, A., Mattila, E., Välkkynen, P., Kaipainen, K., Vanhala, T., Ermes, M., Sairanen, E., Myllymäki, T., & Lappalainen, R. (2013) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2596 · Cited by 173 · cited 1×
“Multiple studies have shown the potential of gamification to increase adherence to and effectiveness of health interventions, for example, a mobile intervention for mental health [23] and a Web-based intervention for physical activity [24].”
BackgroundBolier, L., Haverman, M., Kramer, J., Westerhof, G. J., Riper, H., Walburg, J. A., Boon, B., & Bohlmeijer, E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2603 · Cited by 116
Kelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105 · cited 1×
“These interventions have been shown to be effective, for example, decreasing depressive symptoms, increasing well-being, and stimulating people to become more active [2,6-10].”
BackgroundSelf-citationPros and cons of online cognitive–behavioural therapy
Andersson, G., & Cuijpers, P. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054080 · Cited by 101
Thorsteinsen, K., Vittersø, J., & Svendsen, G. B. (2014) · International Journal of Telemedicine and Applications · doi:10.1155/2014/746232 · Cited by 50 · cited 1×
“Multiple studies have shown the potential of gamification to increase adherence to and effectiveness of health interventions, for example, a mobile intervention for mental health [23] and a Web-based intervention for physical activity [24].”
Background
Cited by
The Handbook of Behavior Change
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 407
Changing Behavior Using the Theory of Planned Behavior
Ajzen, I., & Schmidt, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.002 · Cited by 266
Litvin, S., Saunders, R., Maier, M. A., & Lüttke, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237220 · Cited by 177
“[36] found evidence for significantly higher personal involvement and flow in participants who used a gamified versus non-gamified web-based intervention designed to improve well-being in the general population.”
BackgroundInfluentialChanging Behavior Using the Model of Action Phases
Keller, L., Gollwitzer, P. M., & Sheeran, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.006 · Cited by 147
Gkintoni, E., Vantaraki, F., Skoulidi, C., Anastassopoulos, P., & Vantarakis, A. (2024) · Behavioral Sciences · doi:10.3390/bs14020102 · Cited by 137
Metadata
- Authors
- Kelders, S. M., Sommers-Spijkerman, M., & Goldberg, J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-26
- Volume
- 20
- Issue
- 7
- Pages
- e247
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2806818036
- Cited by
- 109
- References
- 34
- FWCI
- 35.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.