Cited by 340Educational Games and GamificationOnline Learning and AnalyticsDigital Games and Media

The DOI matches its Crossref record; 74 of the 79 references it cites were found in a registry or an index.

The impact of gamification in educational settings on student learning outcomes: a meta-analysis

Huang, Rui, Ritzhaupt, Albert D., Sommer, Max, Zhu, Jiawen, Stephen, Anita, Valle, Natercia, Hampton, John, Li, Jingwei·2020·Educational Technology Research and Development

DOI 10.1007/s11423-020-09807-z

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1007/s11423-020-09807-z

Cites

74 of 76 references verified2 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Untitled work
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“These findings might suggest that peer reviewers have a preference for findings with positive effects from the interventions under investigation, and makes us reflect on the “file drawer problem” (Rosenthal 1979), which results from not publishing statistically non-significant findings.”
Background
A power primer.
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Untitled work
(2008) · Cited by 6,939
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
Untitled work
(1956) · Medical Entomology and Zoology · Cited by 4,596
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Psychological correlates of university students’ academic performance: a systematic review and meta-analysis.
Richardson, M., Abraham, C., & Bond, R. (2012) · Psychological Bulletin · doi:10.1037/a0026838 · Cited by 3,646
Visible Learning
Hattie, J. (2008) · doi:10.4324/9780203887332 · Cited by 3,051
The gamification of learning: a meta-analysis
Sailer, M., & Homner, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09498-w · Cited by 2,594
Gamification in theory and action: a survey
Seaborn, K., & Fels, D. I. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.09.006 · Cited by 2,515
The systematic design of instruction
Dick, W., Carey, L. M., & Carey, J. O. (1978) · Cited by 2,225
Language Learning with Technology
Castillo, D. G. (2021) · Springer eBooks · doi:10.1007/978-981-16-2697-5 · Cited by 2,211
Gamifying learning experiences: Practical implications and outcomes
Domínguez‐Díaz, A., Saenz-de-Navarrete, J., de‐Marcos, L., Sanz, L. F., Pagés, C., & Martínez-Herráiz, J.-J. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.12.020 · Cited by 2,189
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 1×
“Also, the Orwin’s fail-safe N test was calculated to determine the number of missing null studies required to bring the existing effect size to a trivial level (Orwin 1983).”
Method
How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction
Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.12.033 · Cited by 2,064
Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance
Hanus, M. D., & Fox, J. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.08.019 · Cited by 1,918
Handbook of research on educational communications and technology
(2004) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2004.00409_15.x · Cited by 1,854
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716
Untitled work
(2015) · Educational Technology & Society · Cited by 1,551
Introduction to Meta-Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., Rothstein, H. R., & Den, A. B. V. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.121 · Cited by 1,260
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108
Gamified learning in higher education: A systematic review of the literature
Subhash, S., & Cudney, E. A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.05.028 · Cited by 1,043
Towards understanding the effects of individual gamification elements on intrinsic motivation and performance
Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.048 · Cited by 990
Developing a Theory of Gamified Learning: Linking Serious Games and Gamification of Learning
Landers, R. N. (2014) · Simulation & Gaming · doi:10.1177/1046878114563660 · Cited by 918
Gamification and student motivation
Buckley, P. G., & Doyle, E. (2014) · Interactive Learning Environments · doi:10.1080/10494820.2014.964263 · Cited by 883
A mobile gamification learning system for improving the learning motivation and achievements
Su, C., & Cheng, C. (2015) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12088 · Cited by 648
Learning Analytics Dashboard Applications
Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479363 · Cited by 640
Relationships Between Game Attributes and Learning Outcomes: Review and Research Proposals
Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., Orvis, K. L., & Conkey, C. (2009) · Simulation & Gaming · doi:10.1177/1046878108321866 · Cited by 524
Feedback research revisited.
Mory, E. H. (2013) · doi:10.4324/9781410609519-40 · Cited by 496
Effects of the flipped classroom instructional strategy on students’ learning outcomes: a meta-analysis
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-018-9633-7 · Cited by 494
Self-citation
Toward a Taxonomy Linking Game Attributes to Learning: An Empirical Study
Bedwell, W. L., Pavlas, D., Heyne, K., Lazzara, E. H., & Salas, E. (2012) · Simulation & Gaming · doi:10.1177/1046878112439444 · Cited by 393
Learner Control in Hypermedia Environments
Scheiter, K., & Gerjets, P. H. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9046-3 · Cited by 367
Students' learning performance and perceived motivation in gamified flipped-class instruction
Zainuddin, Z. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.003 · Cited by 324
The effects of a mobile gamification app on elementary students’ Spanish achievement and self-efficacy
Rachels, J. R., & Rockinson‐Szapkiw, A. J. (2017) · Computer Assisted Language Learning · doi:10.1080/09588221.2017.1382536 · Cited by 316
Engaging Asian students through game mechanics: Findings from two experiment studies
Hew, K. F., Huang, B., Chu, K. W. S., & Chiu, D. K. W. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.10.010 · Cited by 298
On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking
de‐Marcos, L., García‐López, E., & García‐Cabot, A. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.12.008 · Cited by 281
Understanding feedback: A learning theory perspective
Thurlings, M., Vermeulen, M., Bastiaens, T., & Stijnen, S. (2013) · Educational Research Review · doi:10.1016/j.edurev.2012.11.004 · Cited by 257
The Effects of Gamification in Online Learning Environments: A Systematic Literature Review
Antonaci, A., Klemke, R., & Specht, M. M. (2019) · Informatics · doi:10.3390/informatics6030032 · Cited by 237
Gamification and Education: Achievements, Cognitive Loads, and Views of Students
Turan, Z., Avinc, Z., Kara, K., & Göktaş, Y. (2016) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v11i07.5455 · Cited by 226
Psychological Theory and the Gamification of Learning
Landers, R. N., Bauer, K. N., Callan, R. C., & Armstrong, M. B. (2014) · Springer eBooks · doi:10.1007/978-3-319-10208-5_9 · Cited by 211
Improving Sexual Health Education Programs for Adolescent Students through Game-Based Learning and Gamification
Haruna, H., Hu, X., Chu, S. K. W., Mellecker, R. R., Gabriel, G., & Ndekao, P. S. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15092027 · Cited by 208
The Effects of Mobile-Computer-Supported Collaborative Learning: Meta-Analysis and Critical Synthesis
Sung, Y., Yang, J.-M., & Lee, H.-Y. (2017) · Review of Educational Research · doi:10.3102/0034654317704307 · Cited by 197
Improving argumentative writing: Effects of a blended learning approach and gamification
Lam, Y. W., Hew, K. F., & Chiu, K. F. (2018) · Language learning & technology · doi:10.64152/10125/44583 · Cited by 167
Incorporating meaningful gamification in a blended learning research methods class: Examining student learning, engagement, and affective outcomes
Tan, M., & Hew, K. F. (2016) · Australasian Journal of Educational Technology · doi:10.14742/ajet.2232 · Cited by 164
The Role of Gamification Techniques in Promoting Student Learning: A Review and Synthesis
Alomari, I., Al‐Samarraie, H., & Yousef, R. (2019) · Journal of Information Technology Education Research · doi:10.28945/4417 · Cited by 151
Can Gamification Improve the Benefits of Student Response Systems in Learning? An Experimental Study
Morillas Barrio, C., Munoz-Organero, M., & Sanchez Soriano, J. (2016) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2015.2497459 · Cited by 124
GAMIFICATION IN HIGHER EDUCATION AND STEM: A SYSTEMATIC REVIEW OF LITERATURE
Ortíz-Rojas, M., Chiluiza, K., & Valcke, M. (2016) · EDULEARN proceedings · doi:10.21125/edulearn.2016.0422 · Cited by 102
Gamify Online Courses with Tools Built into Your Learning Management System (LMS) to Enhance Self-Determined and Active Learning
Chen, C. (2018) · Online Learning · doi:10.24059/olj.v22i3.1466 · Cited by 98
Head to head: The role of academic competition in undergraduate anatomical education
Nuland, S. E. V., Roach, V. A., Wilson, T. D., & Belliveau, D. J. (2014) · Anatomical Sciences Education · doi:10.1002/ase.1498 · Cited by 84
Comparing Digital Badges-and-Points with Classroom Token Systems: Effects on Elementary School ESL Students' Classroom Behavior and English Learning
Homer, R., Hew, K. F., & Tan, C. Y. (2018) · The HKU Scholars Hub (University of Hong Kong) · Cited by 61
Gamification for enhancing Web 2.0 based educational activities: The case of pre-service grade school teachers using educational Wiki pages
Özdener, N. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.04.003 · Cited by 60
An Innovative Educational Environment Based on Virtual Reality and Gamification for Learning Search Algorithms
Grivokostopoulou, F., Perikos, I., & Hatzilygeroudis, I. (2016) · 2016 IEEE Eighth International Conference on Technology for Education (T4E) · doi:10.1109/t4e.2016.029 · Cited by 58
Gamification in computer programming : effects on learning, engagement, self-efficacy and intrinsic motivation
Ortíz-Rojas, M., Chiluiza, K., & Valcke, M. (2017) · Ghent University Academic Bibliography (Ghent University) · Cited by 55
Assessing the Efficacy of Incorporating Game Dynamics in a Learning Management System.
Frost, R. D., Matta, V., & macivor, E. (2015) · Journal of the Association for Information Systems · Cited by 47
The impact of a forfeit-or-prize gamified teaching on e-learners’ learning performance
Ge, Z.-G. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.009 · Cited by 46
The effects of Gamification on engineering lab activities
Kim, E., Rothrock, L., & Freivalds, A. (2016) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757442 · Cited by 34
Measurement of the effects of e-learning courses gamification on motivation and satisfaction of students
Bernik, A., Bubaš, G., & Radošević, D. (2018) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2018.8400149 · Cited by 34
Trends and Opportunities in Computer Science OER Development
Dichev, C., Dicheva, D., Agre, G., & Angelova, G. (2015) · Cybernetics and Information Technologies · doi:10.1515/cait-2015-0045 · Cited by 15
Competition and collaboration using a social and gamified online learning platform
Arnab, S., Bhakta, R., Merry, S. K., et al. (2016) · Pure (Coventry University) · Cited by 14
Examination of badges to increase nursing student engagement: A quasi-experimental study
Moritz, S. C. (2017) · ProQuest LLC eBooks · Cited by 6
Study on 3D Meaningful Mobile Gamification Learning Outcome Assessment – An Example of Blood Circulation Lesson
Su, C. H., & Su, P. Y. J. (2015) · Applied Mechanics and Materials · doi:10.4028/www.scientific.net/amm.764-765.1395 · Cited by 4
Open Badges and Student Motivation: A Study of Their Relationship to Student Assessment Scores.
Sullivan, A. L. (2018) · ProQuest LLC eBooks · Cited by 2
Enhancing the Acquisition and Retention of the Navajo Language using Computer-based Instruction and the Effects of Static Pedagogical Agents and Gamification Practice
Shurley, K. A. (2018) · Cited by 1
Untitled work
Moher (2009) · doi:10.1371/journal.pmed1000097
The effects of gamification on self-efficacy and persistence in virtual world familiarization
Cosgrove, P. J. ". (n.d.) · doi:10.32469/10355/56469
Effects of a Gamified Software Intervention on Mathematics Scores Among Jamaican Sixth-Grade Students
Watson-Huggins, J. (2019) · Distance Learning · doi:10.1108/dl-06-2019-0004

Research works printed but not linked: 2

*Rachels, J. R. (2016). The Effect of Gamification on Elementary Students’ Spanish Language Achievement and Academic Self-efficacy (Doctoral dissertation). Retrieved from https://digitalcommons.liberty.edu/doctoral/1246/
*Terrell, J. E. (2016). Instructional Methods and Engagement: The Impact of Gamification on Student Learning of APA Style (Doctoral dissertation). Retrieved from https://scholarworks.uark.edu/etd/1502

Sorted by citations

Gamification in Science Education. A Systematic Review of the Literature
Kalogiannakis, M., Papadakis, S., & Zourmpakis, A.-I. (2021) · Education Sciences · doi:10.3390/educsci11010022 · Cited by 890
Between Level Up and Game Over: A Systematic Literature Review of Gamification in Education
Manzano-León, A., Camacho-Lazarraga, P., Guerrero, M. A., Guerrero-Puerta, L., Aguilar-Parra, J. M., Trigueros, R., & Alias, A. (2021) · Sustainability · doi:10.3390/su13042247 · Cited by 512
“[30] carried out a meta-analysis study where they integrated 30 independent studies in formal educational settings, and it was observed that the effect size on learning outcomes was greater in the gamified groups than in the control groups.”
Background
Virtual reality and gamification in education: a systematic review
Λαμπρόπουλος, Γ., & Kinshuk, K. (2024) · Educational Technology Research and Development · doi:10.1007/s11423-024-10351-3 · Cited by 569
Effects of Gamification on Behavioral Change in Education: A Meta-Analysis
Kim, J.-H., & Castelli, D. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073550 · Cited by 203
“Consequently, this is viewed as one of the leading researches [16,17] to quantify and qualify gamification effects in educational settings using meta-analysis.”
Background
Gamification and active learning in higher education: is it possible to match digital society, academia and students' interests?
Murillo‐Zamorano, L. R., Sánchez, J. Á. L., Caballero, A. L. G., & Muñoz, C. B. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00249-y · Cited by 296

See all 340

Authors: Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J.
Affiliations: University of Florida (US)
Corresponding author: Ritzhaupt, Albert D.
ORCID: Huang, Rui
Ritzhaupt, Albert D.
Sommer, Max
Zhu, Jiawen
Valle, Natercia
Hampton, John
Li, Jingwei
Venue: Educational Technology Research and Development
Publisher: Springer Science and Business Media LLC
Published: 2020-07-20
Volume: 68
Issue: 4
Pages: 1875-1901
ISSN: 1042-1629 (ISSN-L)
1556-6501
DOI: 10.1007/s11423-020-09807-z
OpenAlex: W3042860537
Semantic Scholar: d8b3b078faf3153b0130718a2dc0923633269276
Cited by: 340
References: 79
Citations by year: 2026: 62 · 2025: 79 · 2024: 66 · 2023: 61 · 2022: 45 · 2021: 24 · 2020: 3
FWCI: 7.78
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
www.springer.com/tdm (vor)
Locations: Educational Technology Research and Development (publishedVersion)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
Social Sciences › Sociology and Political Science › Digital Games and Media
Keywords: gamification, learning outcomes, badges, leaderboards, effect size, engineering education, mathematics education, undergraduate students, formal education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The impact of gamification in educational settings on student learning outcomes: a meta-analysis

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks