The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Gamification in mobile-assisted language learning: a systematic review of Duolingo literature from public release of 2012 to early 2020
Open accessAbstract
More than 300 million people use the gamified mobile-assisted language learning (MALL) application (app) Duolingo. The challenging tasks, reward incentives, systematic levels, and the ranking of users according to their achievements are just some of the elements that demonstrate strong gamification elements within this popular language learning application. This application’s pervasive reach, flexible functionality, and freemium business model has brought significant attention to gamification in MALL. The present systematic review aims to summarize different methods, frameworks, settings, and research samples used to assess Duolingo’s design and impact on various learning outcomes. We carried out a complete database search for articles focused on the issues of design, application, and pedagogies in the use of Duolingo. Three hundred and sixty-seven records were initially found, and 35 of those were selected for final inclusion based on language choice, theoretical frameworks, design, sampling, data collection, and analyses (see Appendix 1 for full list). The results indicated that the majority of research from 2012-2020 was design-focused, quantitative in nature, and used non-probability sampling methods. The focus on app design marks an emphasis on the creation of tools rather than the process and outcomes of language learning from using these tools. Additional results revealed preferences for performance-based research questions, for English as language of choice in research, and for the USA as the most prominent context for Duolingo research studies. Furthermore, our review highlights research gaps specific to Duolingo, yet generalizable to other MALL applications. The results are useful to researchers seeking to assess, evaluate, and understand MALL, gamification, and Duolingo as well as to practitioners interested in utilizing MALL in formal and informal learning environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
(1978) · Medical Entomology and Zoology · Cited by 53,488
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Designing and Conducting Mixed Methods Research
Robinson, P. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,258
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745
Kapp, K. M. (2012) · Cited by 3,753
Hanus, M. D., & Fox, J. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.08.019 · Cited by 1,918 · cited 1×
“Game-like elements present a motivating environment (Hanus & Fox, 2015; Kapp, 2012; Lui, 2014; Munday, 2016) that can increase language accuracy and confidence (Castañeda & Cho, 2016).”
BackgroundHabermas, J. (2006) · Communication Theory · doi:10.1111/j.1468-2885.2006.00280.x · Cited by 1,839
Individual Differences in Second Language Learning
Skehan, P. (2014) · Routledge eBooks · doi:10.4324/9781315831664 · Cited by 1,518
Cited by
Assessing the Usability of ChatGPT for Formal English Language Learning
Shaikh, S., Yayilgan, S. Y., Klimova, B., & Pikhart, M. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13090140 · Cited by 183
Ding, L., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12402-3 · Cited by 122
The impact of intelligent personal assistants on adolescent EFL learners’ listening comprehension
Tai, T.-Y., & Chen, H. H.-J. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2040536 · Cited by 93
Wen, F., Li, Y., Zhou, Y., An, X., & Zou, Q. (2024) · Journal of Educational Technology Development and Exchange · doi:10.18785/jetde.1701.07 · Cited by 39
“…feedback, and personalized analysis (Ling, 2023) is gradually being closely integrated into EFL learning; thus, solving difficulties such as individual differences, anxiety (Shortt et al., 2021), tension (Rintaningrum, 2018), and lack of practice opportunities (Shazly, 2021) among EFL learners.”
Background
Metadata
- Authors
- Shortt, M., Tilak, S., Kuznetcova, I., Martens, B., & Akinkuolie, B.
- Venue
- Computer Assisted Language Learning
- Publisher
- Informa UK Limited
- Published
- 2021-07-05
- Volume
- 36
- Issue
- 3
- Pages
- 517-554
- ISSN
- 0958-8221 (ISSN-L)
- 1744-3210
- OpenAlex
- W3190536530
- Cited by
- 334
- References
- 67
- FWCI
- 9.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gamification in mobile-assisted language learning: a systematic review of Duolingo literature from public release of 2012 to early 2020. https://app.cochat.ai/papers/10.1080/09588221.2021.1933540
- The paper
- Shortt, M., Tilak, S., Kuznetcova, I., Martens, B., & Akinkuolie, B. (2023). Gamification in mobile-assisted language learning: a systematic review of Duolingo literature from public release of 2012 to early 2020. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2021.1933540
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.