The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Does gamification increase engagement with online programs? A systematic review
Open accessAbstract
BACKGROUND: Engagement in online programs is difficult to maintain. Gamification is the recent trend that offers to increase engagement through the inclusion of game-like features like points and badges, in non-game contexts. This review will answer the following question, 'Are gamification strategies effective in increasing engagement in online programs?' METHOD: Eight databases (Web of Science, PsycINFO, Medline, INSPEC, ERIC, Cochrane Library, Business Source Complete and ACM Digital Library) were searched from 2010 to the 28th of October 2015 using a comprehensive search strategy. Eligibility criteria was based on the PICOS format, where "population" included adults, "intervention" involved an online program or smart phone application that included at least one gamification feature. "Comparator" was a control group, "outcomes" included engagement and "downstream" outcomes which occurred as a result of engagement; and "study design" included experimental studies from peer-reviewed sources. Effect sizes (Cohens d and 95% confidence intervals) were also calculated. RESULTS: 1017 studies were identified from database searches following the removal of duplicates, of which 15 met the inclusion criteria. The studies involved a total of 10,499 participants, and were commonly undertaken in tertiary education contexts. Engagement metrics included time spent (n = 5), volume of contributions (n = 11) and occasions visited to the software (n = 4); as well as downstream behaviours such as performance (n = 4) and healthy behaviours (n = 1). Effect sizes typically ranged from medium to large in direct engagement and downstream behaviours, with 12 out of 15 studies finding positive significant effects in favour of gamification. CONCLUSION: Gamification is effective in increasing engagement in online programs. Key recommendations for future research into gamification are provided. In particular, rigorous study designs are required to fully examine gamification's effects and determine how to best achieve sustained engagement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps
Zichermann, G., & Cunningham, C. J. L. (2011) · Cited by 2,378
Flourishing: Positive psychology and the life well-lived.
(2003) · American Psychological Association eBooks · doi:10.1037/10594-000 · Cited by 1,298
Defining gamification: a service marketing perspective
Huotari, K., & Hamari, J. (2012) · Proceeding of the 16th International Academic MindTrek Conference · doi:10.1145/2393132.2393137 · Cited by 1,150
Susi, T., Johannesson, M. P., & Backlund, P. (2007) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 942
Cited by
Bai, S., Hew, K. F., & Huang, B. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100322 · Cited by 994
Using gamification to support learning English as a second language: a systematic review
Dehghanzadeh, H., Fardanesh, H., Hatami, J., Talaee, E., & Noroozi, O. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1648298 · Cited by 358
Vanduhe, V. Z., Nat, M., & Hasan, H. F. (2020) · IEEE Access · doi:10.1109/access.2020.2966179 · Cited by 261
Müller, A. M., Maher, C. A., Vandelanotte, C., Hingle, M., Middelweerd, A., Lopez, M. L., DeSmet, A., Short, C. E., Nathan, N., Hutchesson, M. J., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8954 · Cited by 180
Self-citationPeter, L.-J., Schindler, S., Sander, C., Schmidt, S., Muehlan, H., McLaren, T., Tomczyk, S., Speerforck, S., & Schomerus, G. (2021) · Psychological Medicine · doi:10.1017/s0033291721000854 · Cited by 141
Metadata
- Authors
- Looyestyn, J., Kernot, J., Boshoff, K., Ryan, J., Edney, S., & Maher, C.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-03-31
- Volume
- 12
- Issue
- 3
- Pages
- e0173403
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2597895674
- Cited by
- 411
- References
- 38
- FWCI
- 7.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does gamification increase engagement with online programs? A systematic review. https://app.cochat.ai/papers/10.1371/journal.pone.0173403
- The paper
- Looyestyn, J., Kernot, J., Boshoff, K., Ryan, J., Edney, S., & Maher, C. (2017). Does gamification increase engagement with online programs? A systematic review. PLOS ONE. https://doi.org/10.1371/journal.pone.0173403
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.