The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Does gamification increase engagement with online programs? A systematic review
Open accessAbstract
BACKGROUND: Engagement in online programs is difficult to maintain. Gamification is the recent trend that offers to increase engagement through the inclusion of game-like features like points and badges, in non-game contexts. This review will answer the following question, 'Are gamification strategies effective in increasing engagement in online programs?' METHOD: Eight databases (Web of Science, PsycINFO, Medline, INSPEC, ERIC, Cochrane Library, Business Source Complete and ACM Digital Library) were searched from 2010 to the 28th of October 2015 using a comprehensive search strategy. Eligibility criteria was based on the PICOS format, where "population" included adults, "intervention" involved an online program or smart phone application that included at least one gamification feature. "Comparator" was a control group, "outcomes" included engagement and "downstream" outcomes which occurred as a result of engagement; and "study design" included experimental studies from peer-reviewed sources. Effect sizes (Cohens d and 95% confidence intervals) were also calculated. RESULTS: 1017 studies were identified from database searches following the removal of duplicates, of which 15 met the inclusion criteria. The studies involved a total of 10,499 participants, and were commonly undertaken in tertiary education contexts. Engagement metrics included time spent (n = 5), volume of contributions (n = 11) and occasions visited to the software (n = 4); as well as downstream behaviours such as performance (n = 4) and healthy behaviours (n = 1). Effect sizes typically ranged from medium to large in direct engagement and downstream behaviours, with 12 out of 15 studies finding positive significant effects in favour of gamification. CONCLUSION: Gamification is effective in increasing engagement in online programs. Key recommendations for future research into gamification are provided. In particular, rigorous study designs are required to fully examine gamification's effects and determine how to best achieve sustained engagement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps
Zichermann, G., & Cunningham, C. J. L. (2011) · Cited by 2,378
Flourishing: Positive psychology and the life well-lived.
(2003) · American Psychological Association eBooks · doi:10.1037/10594-000 · Cited by 1,298
Defining gamification: a service marketing perspective
Huotari, K., & Hamari, J. (2012) · Proceeding of the 16th International Academic MindTrek Conference · doi:10.1145/2393132.2393137 · Cited by 1,150
Susi, T., Johannesson, M. P., & Backlund, P. (2007) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 942
Developing a Theory of Gamified Learning: Linking Serious Games and Gamification of Learning
Landers, R. N. (2014) · Simulation & Gaming · doi:10.1177/1046878114563660 · Cited by 918
How to calculate effect sizes from published research: A simplified methodology
Thalheimer, W., & Cook, S. (2002) · Cited by 888
Hamari, J. (2013) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2013.01.004 · Cited by 686
Do badges increase user activity? A field experiment on the effects of gamification
Hamari, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2015.03.036 · Cited by 675
Gamification: What It Is and Why It Matters to Digital Health Behavior Change Developers
Cugelman, B. (2013) · JMIR Serious Games · doi:10.2196/games.3139 · Cited by 531
The Psychology of Competition: A Social Comparison Perspective
Garcia, S. M., Tor, A., & Schiff, T. M. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613504114 · Cited by 520
The effect of virtual achievements on student engagement
Denny, P. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470763 · Cited by 478
Information and Communication Technologies in Tourism 2011
(2011) · Springer eBooks · doi:10.1007/978-3-7091-0503-0 · Cited by 345
Mekler, E. D., Brühlmann, F., Opwis, K., & Tuch, A. N. (2013) · Proceedings of the First International Conference on Gameful Design, Research, and Applications · doi:10.1145/2583008.2583017 · Cited by 314
Gamification: Making work fun, or making fun of work?
Dale, S. (2014) · Business Information Review · doi:10.1177/0266382114538350 · Cited by 279
Allam, A., Kostova, Z., Nakamoto, K., & Schulz, P. J. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3510 · Cited by 274
Increasing Student Intrinsic Motivation And Self-Efficacy Through Gamification Pedagogy
Banfield, J., & Wilkerson, B. (2014) · Contemporary Issues in Education Research (CIER) · doi:10.19030/cier.v7i4.8843 · Cited by 258
Xu, F., Weber, J., & Buhalis, D. (2013) · Springer eBooks · doi:10.1007/978-3-319-03973-2_38 · Cited by 240
Myths and Realities of Respondent Engagement in Online Surveys
Guin, T. D.-L., Baker, R., Mechling, J., & Ruyle, E. (2012) · International Journal of Market Research · doi:10.2501/ijmr-54-5-613-633 · Cited by 237
Turning life into a game: Foursquare, gamification, and personal mobility
Frith, J. (2013) · Mobile Media & Communication · doi:10.1177/2050157912474811 · Cited by 193
The construction of meaning through vital engagement.
Nakamura, J., & Csikzentmihalyi, M. (2003) · Flourishing: Positive psychology and the life well-lived. · doi:10.1037/10594-004 · Cited by 176
Mekler, E. D., Brühlmann, F., Opwis, K., & Tuch, A. N. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468559 · Cited by 160
A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification
Krause, M., Mogalle, M., Pohl, H., & Williams, J. J. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2724665 · Cited by 155
Designing motivation using persuasive ambient mirrors
Nakajima, T., & Lehdonvirta, V. (2011) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0469-y · Cited by 152
Gamification of MOOCs for increasing user engagement
Vaibhav, A., & Gupta, P. (2014) · IEEE International Conference on MOOCs, Innovation and Technology in Education (MITE) · doi:10.1109/mite.2014.7020290 · Cited by 108
Effects of gamification on participation and data quality in a real-world market research domain
Cechanowicz, J., Gutwin, C., Brownell, B., & Goodfellow, L. (2013) · Proceedings of the First International Conference on Gameful Design, Research, and Applications · doi:10.1145/2583008.2583016 · Cited by 103
A Player Model for Adaptive Gamification in Learning Environments
Monterrat, B., Desmarais, M. C., Lavoué, É., & George, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_30 · Cited by 100
Gamification of Online Learning
Jang, J., Park, J., & Yi, M. Y. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_82 · Cited by 62
Low-Cost Gamification of Online Surveys: Improving the User Experience through Achievement Badges
Harms, J., Seitz, D., Wimmer, C., Kappel, K., & Grechenig, T. (2015) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/2793107.2793146 · Cited by 43
Morschheuser, B., Henzi, C., & Alt, R. (2015) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2015.83 · Cited by 36
Kleek, M. G. V., Smith, D. A., Hall, W., & Shadbolt, N. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2487788.2488082 · Cited by 17
Threats of Using Gamification for Motivating Web Page Quality Evaluation
Juźwin, M., Adamska, P., Rafalak, M., Balcerzak, B., Kąkol, M., & Wierzbicki, A. (2014) · doi:10.1145/2643572.2643587 · Cited by 6
Cited by
Bai, S., Hew, K. F., & Huang, B. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100322 · Cited by 994
Using gamification to support learning English as a second language: a systematic review
Dehghanzadeh, H., Fardanesh, H., Hatami, J., Talaee, E., & Noroozi, O. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1648298 · Cited by 358
Vanduhe, V. Z., Nat, M., & Hasan, H. F. (2020) · IEEE Access · doi:10.1109/access.2020.2966179 · Cited by 261
Müller, A. M., Maher, C. A., Vandelanotte, C., Hingle, M., Middelweerd, A., Lopez, M. L., DeSmet, A., Short, C. E., Nathan, N., Hutchesson, M. J., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8954 · Cited by 180
Self-citationPeter, L.-J., Schindler, S., Sander, C., Schmidt, S., Muehlan, H., McLaren, T., Tomczyk, S., Speerforck, S., & Schomerus, G. (2021) · Psychological Medicine · doi:10.1017/s0033291721000854 · Cited by 141
Metadata
- Authors
- Looyestyn, J., Kernot, J., Boshoff, K., Ryan, J., Edney, S., & Maher, C.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-03-31
- Volume
- 12
- Issue
- 3
- Pages
- e0173403
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2597895674
- Cited by
- 411
- References
- 38
- FWCI
- 7.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.