The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
The effect of challenge-based gamification on learning: An experiment in the context of statistics education
Open accessAbstract
Gamification is increasingly employed in learning environments as a way to increase student motivation and consequent learning outcomes. However, while the research on the effectiveness of gamification in the context of education has been growing, there are blind spots regarding which types of gamification may be suitable for different educational contexts. This study investigates the effects of the challenge-based gamification on learning in the area of statistics education. We developed a gamification approach, called Horses for Courses, which is composed of main game design patterns related to the challenge-based gamification; points, levels, challenges and a leaderboard. Having conducted a 2 (read: yes vs. no) x 2 (gamification: yes vs. no) between-subject experiment, we present a quantitative analysis of the performance of 365 students from two different academic majors: Electrical and Computer Engineering (n=279), and Business Administration (n=86). The results of our experiments show that the challenge-based gamification had a positive impact on student learning compared to traditional teaching methods (compared to having no treatment and treatment involving reading exercises). The effect was larger for females or for students at the School of Electrical and Computer Engineering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baltosser, W. H., & Zar, J. H. (1996) · Ecology · doi:10.2307/2265725 · Cited by 35,166
Use of Ranks in One-Criterion Variance Analysis
Kruskal, W. H., & Wallis, W. A. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483441 · Cited by 13,912
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
A systematic literature review of empirical evidence on computer games and serious games
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.03.004 · Cited by 2,890
Gamification in theory and action: a survey
Seaborn, K., & Fels, D. I. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.09.006 · Cited by 2,515
Forecasting methods and applications
(1993) · Computers & Operations Research · doi:10.1016/0305-0548(93)90040-p · Cited by 2,393
Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps
Zichermann, G., & Cunningham, C. J. L. (2011) · Cited by 2,378
Motivations for Play in Online Games
Yee, N. (2006) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9.772 · Cited by 2,173
Gamifying education: what is known, what is believed and what remains uncertain: a critical review
Dichev, C., & Dicheva, D. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0042-5 · Cited by 2,112 · cited 7×
“…on the impact of gami fi cation, independently of the application domain or used gami fi ed strategy (Buckley and Doyle, 2017; Caponetto et al., 2014; Dichev and Dicheva, 2017; Dicheva et al., 2015; Hanus and Fox, 2015; Koivisto and Hamari, 2019; Lambruschini and Pizarro, 2015; Landers et al., 2018;…”
InfluentialGamifying learning experiences: Practical implications and outcomes
Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernández-Sanz, L., Pagés, C., & Martínez-Herráiz, J.-J. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.12.020 · Cited by 2,007
Hanus, M. D., & Fox, J. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.08.019 · Cited by 1,918 · cited 8×
“Therefore, researchers generally agree on the need for stronger empirical results (Buckley and Doyle, 2017; Hanus and Fox, 2015; Koivisto and Hamari, 2019; Landers et al., 2018; Maican et al., 2016; Morschheuser et al., 2017).”
InfluentialThe End of Business Schools? Less Success Than Meets the Eye
Pfeffer, J., & Fong, C. T. (2002) · Academy of Management Learning & Education · doi:10.5465/amle.2002.7373679 · Cited by 1,850
The rise of motivational information systems: A review of gamification research
Koivisto, J., & Hamari, J. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.10.013 · Cited by 1,750
Self-citationHamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.07.045 · Cited by 1,713
Self-citation(2015) · Educational Technology & Society · Cited by 1,551
Gamification for health and wellbeing: A systematic review of the literature
Johnson, D., Deterding, S., Kuhn, K.-A., Staneva, A., Stoyanov, S., & Hides, L. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.10.002 · Cited by 1,237
A definition for gamification: anchoring gamification in the service marketing literature
Huotari, K., & Hamari, J. (2017) · Electronic Markets · doi:10.1007/s12525-015-0212-z · Cited by 1,080
Self-citationNonparametric Pairwise Multiple Comparisons in Independent Groups using Dunn's Test
Dinno, A. (2015) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1501500117 · Cited by 957
Gamification and student motivation
Buckley, P., & Doyle, E. (2016) · Interactive Learning Environments · doi:10.1080/10494820.2014.964263 · Cited by 879
A social gamification framework for a K-6 learning platform
Simões, J., Redondo, R. D., & Vilas, A. F. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.06.007 · Cited by 854
Demographic differences in perceived benefits from gamification
Koivisto, J., & Hamari, J. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.007 · Cited by 841
Self-citationSquire, K. D. (2003) · Cited by 711
Hamari, J. (2013) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2013.01.004 · Cited by 686
Self-citationForecasting: Methods and Applications
Beaumont, C. (1984) · Journal of the Operational Research Society · doi:10.1057/jors.1984.11 · Cited by 636
Xi, N., & Hamari, J. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.12.002 · Cited by 618
Self-citationOrdinal Methods for Behavioral Data Analysis
Cliff, N. (2014) · Psychology Press eBooks · doi:10.4324/9781315806730 · Cited by 560
Garfield, J., & Ben‐Zvi, D. (2007) · International Statistical Review · doi:10.1111/j.1751-5823.2007.00029.x · Cited by 549
The maturing of gamification research
Nacke, L. E., & Deterding, S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.11.062 · Cited by 493
Gamification of Education: A Review of Literature
Nah, F. F.-H., Zeng, Q., Telaprolu, V. R., Ayyappa, A. P., & Eschenbrenner, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-07293-7_39 · Cited by 477
Cliff´s Delta Calculator: A non-parametric effect size program for two groups of observations
Macbeth, G., Razumiejczyk, E., & Ledesma, R. D. (2010) · Universitas Psychologica · doi:10.11144/javeriana.upsy10-2.cdcp · Cited by 442
A systematic mapping on gamification applied to education
de Sousa Borges, S., Durelli, V. H. S., Reis, H. M., & Isotani, S. (2014) · Proceedings of the 29th Annual ACM Symposium on Applied Computing · doi:10.1145/2554850.2554956 · Cited by 428
The Gamification of Learning and Instruction Fieldbook: Ideas into Practice
Kapp, K. M. (2013) · Cited by 417
Does gamification affect brand engagement and equity? A study in online brand communities
Xi, N., & Hamari, J. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2019.11.058 · Cited by 410
Self-citationThe Analysis of Ranked Data Derived from Completely Randomized Factorial Designs
Scheirer, C. J., Ray, W. S., & Hare, N. (1976) · Biometrics · doi:10.2307/2529511 · Cited by 397
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Konstan, J. A., Ed, H., & Höök, K. (2012) · Cited by 394
Teaching Behaviors, Academic Learning Time, and Student Achievement: An Overview.
Fisher, C., Berliner, D. C., Filby, N. N., Marliave, R., Cahen, L. S., & Dishaw, M. (2015) · The Journal of classroom interaction · Cited by 392
Gamification in assessment: Do points affect test performance?
Attali, Y., & Arieli-Attali, M. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.012 · Cited by 392
Gamification Science, Its History and Future: Definitions and a Research Agenda
Landers, R. N., Auer, E. M., Collmus, A. B., & Armstrong, M. B. (2018) · Simulation & Gaming · doi:10.1177/1046878118774385 · Cited by 388
Gamification in software engineering – A systematic mapping
Pedreira, O., García, F., Brisaboa, N., & Piattini, M. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.08.007 · Cited by 387
Effectiveness of gamification in the engagement of students
da Rocha Seixas, L., Gomes, A. S., & de Melo Filho, I. J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.11.021 · Cited by 382
Player Types: A Meta-synthesis
Hamari, J., & Tuunanen, J. (2014) · Transactions of the Digital Games Research Association · doi:10.26503/todigra.v1i2.13 · Cited by 355
Self-citation(2018) · Tampere University Institutional Repository (Tampere University) · Cited by 349
How to design gamification? A method for engineering gamified software
Morschheuser, B., Hassan, L., Werder, K., & Hamari, J. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2017.10.015 · Cited by 323
Self-citationBuckley, P., & Doyle, E. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.11.009 · Cited by 321
Yildirim, I. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.02.002 · Cited by 320 · cited 4×
“The findings of our empirical study, based on a quantitative analysis of our results, are in line with the positive effects of gamification on learning (Buckley and Doyle, 2016a; Hamari et al., 2016; Kuo and Chuang, 2016; Maican et al., 2016; da Rocha Seixas et al., 2016; Simões et al., 2013; Yildirim, 2017) as well a…”
InfluentialGamified crowdsourcing: Conceptualization, literature review, and future agenda
Morschheuser, B., Hamari, J., Koivisto, J., & Maedche, A. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.04.005 · Cited by 297
Self-citationA case study in the gamification of a university-level games development course
O'Donovan, S., Gain, J., & Marais, P. (2013) · Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference · doi:10.1145/2513456.2513469 · Cited by 287
Strengthening gamification studies: Current trends and future opportunities of gamification research
Rapp, A., Hopfgartner, F., Hamari, J., Linehan, C., & Cena, F. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.11.007 · Cited by 286
Self-citationChristy, K. R., & Fox, J. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.05.005 · Cited by 276 · cited 2×
“To name a few: information technology (Osatuyi et al., 2018), math/ science (Attali and Arieli-Attali, 2015; Christy and Fox, 2014) and taxation (Buckley and Doyle, 2016a; 2017).”
BackgroundKuo, M.-S., & Chuang, T.-Y. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.025 · Cited by 263
Proceedings of the 28th Annual ACM Symposium on Applied Computing
(2013) · doi:10.1145/2480362 · Cited by 249
Gamification in software engineering education: A systematic mapping
Alhammad, M. M., & Moreno, A. M. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.03.065 · Cited by 224
Online gaming motivations scale: development and validation
Yee, N., Ducheneaut, N., & Nelson, L. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208681 · Cited by 219
‘Horses for Courses’ in demand forecasting
Petropoulos, F., Makridakis, S., Assimakopoulos, V., & Nikolopoulos, K. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.02.036 · Cited by 201
Self-citationPublication trends in gamification: A systematic mapping study
Kasurinen, J., & Knutas, A. (2018) · Computer Science Review · doi:10.1016/j.cosrev.2017.10.003 · Cited by 192
Contexts, gaming pleasures, and gendered preferences
Carr, D. (2005) · Simulation & Gaming · doi:10.1177/1046878105282160 · Cited by 187
Frameworks for component-based client/server computing
Lewandowski, S. M. (1998) · ACM Computing Surveys · doi:10.1145/274440.274441 · Cited by 181
The role of gamification in education–a literature review
Surendeleg, G., Murwa, V., Yun, H.-K., & Kim, Y. S. (2014) · Contemporary Engineering Sciences · doi:10.12988/ces.2014.411217 · Cited by 157
Gamification in engineering education and professional training
Markopoulos, A. P., Fragkou, A., Kasidiaris, P. D., & Davim, J. P. (2015) · International Journal of Mechanical Engineering Education · doi:10.1177/0306419015591324 · Cited by 138
Just a game? Gamifying a general science class at university
Sánchez‐Martín, J., Cañada, F. C., & Acedo, M. A. D. (2017) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.05.003 · Cited by 135
Snodgrass, J. G., Dengah, H. J. F., Lacy, M. G., & Fagan, J. M. (2013) · Transcultural Psychiatry · doi:10.1177/1363461513487666 · Cited by 120
Design and evaluation of a gamified system for ERP training
Alcivar, I., & Abad, A. G. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.018 · Cited by 120
Using badges for shaping interactions in online learning environments
McDaniel, R., Lindgren, R., & Friskics, J. (2012) · IEEE International Professional Communication Conference (ProComm) · doi:10.1109/ipcc.2012.6408619 · Cited by 112
Detecting playfulness in educational gamification through behavior patterns
Codish, D., & Ravid, G. (2015) · IBM Journal of Research and Development · doi:10.1147/jrd.2015.2459651 · Cited by 86
Educational resources and implementation of a Greek sign language synthesis architecture
Karpouzis, K. C., Caridakis, G., Fotinea, S., & Efthimiou, E. (2005) · Computers & Education · doi:10.1016/j.compedu.2005.06.004 · Cited by 83
Self-citationSystematic Review of Gamification Research in IS Education: A Multi-method Approach
Osatuyi, B., Osatuyi, T., & de la Rosa, R. (2018) · Communications of the Association for Information Systems · doi:10.17705/1cais.04205 · Cited by 83
Debnath, S. C., Tandon, S., & Pointer, L. V. (2007) · Organizational Behavior Teaching Review · doi:10.1177/1052562906290914 · Cited by 79
Gender Moderation in Gamification: Does One Size Fit All?
Codish, D., & Ravid, G. (2017) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2017.244 · Cited by 73
Interactivia.ro – A study of a gamification framework using zero-cost tools
Maican, C. I., Lixandroiu, R. C., & Constantin, C. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.03.023 · Cited by 71
Breaking the Rules: Gamification of Learning and Educational Materials
González, C. S. G., & Area, M. (2013) · doi:10.5220/0004600900470053 · Cited by 68
A case study on using prediction markets as a rich environment for active learning
Buckley, P. G., Garvey, J., & McGrath, F. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.09.001 · Cited by 26
McNeill, J., Bradshaw, K., Machanick, P., & Tsietsi, M. (2013) · doi:10.1145/2513456 · Cited by 20
Tech — Gamification in university engineering education: Captivating students, generating knowledge
Lambruschini, B. B., & Pizarro, W. G. (2015) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2015.7250259 · Cited by 17
Using web-based collaborative forecasting to enhance information literacy and disciplinary knowledge
Buckley, P. G., & Doyle, E. (2015) · Interactive Learning Environments · doi:10.1080/10494820.2015.1041399 · Cited by 15
Using a Spreadsheet for Active Learning Projects in Operations Management
Gardner, L. (2008) · INFORMS Transactions on Education · doi:10.1287/ited.1070.0004 · Cited by 12
Cited by
Between Level Up and Game Over: A Systematic Literature Review of Gamification in Education
Manzano-León, A., Camacho-Lazarraga, P., Guerrero, M. A., Guerrero-Puerta, L., Aguilar-Parra, J. M., Trigueros, R., & Alias, A. (2021) · Sustainability · doi:10.3390/su13042247 · Cited by 512
Gamification of e-learning in higher education: a systematic literature review
Khaldi, A., Bouzidi, R., & Nader, F. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00227-z · Cited by 409
Tailored gamification in education: A literature review and future agenda
Oliveira, W., Hamari, J., Shi, L., Toda, A. M., Rodrigues, L., Palomino, P. T., & Isotani, S. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11122-4 · Cited by 341
Self-citationKaya, O. S., & Ercag, E. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11585-z · Cited by 121
A Review of Gamification Impact on Student Behavioural and Learning Outcomes
Nurtanto, M., Kholifah, N., Ahdhianto, E., Samsudin, A., & Isnantyo, F. D. (2021) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v15i21.24381 · Cited by 59
Metadata
- Authors
- Legaki, N.-Z., Xi, N., Hamari, J., Karpouzis, K., & Assimakopoulos, V.
- Venue
- International Journal of Human-Computer Studies
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 144
- Pages
- 102496
- ISSN
- 1071-5819 (ISSN-L)
- OpenAlex
- W3034563008
- Cited by
- 328
- References
- 77
- FWCI
- 69.73
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.