The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Empirical Study on the Effect of Achievement Badges in TRAKLA2 Online Learning Environment
Abstract
Achievement badges are a form of gamification that can be used to motivate users and to encourage desired actions. In this study, we describe and evaluate the use of achievement badges in the TRAKLA2 online learning environment where students complete interactive, automatically assessed exercises about data structures and algorithms. The students' activity in TRAKLA2 was logged in order to find out whether the achievement badges had an effect on their behavior. We used a between-subject experimental design where the students (N=281) were randomly divided into a treatment and a control group, with and without achievement badges. Students in the treatment group were awarded achievement badges, for example, for solving exercises with only one attempt, returning exercises early, or completing an exercise round with full points. Course grading was similar for both groups, i.e. collecting badges did not affect the final grade. Our results show that achievement badges can be used to affect the behavior of students even when the badges have no impact on the grading. Statistically significant differences in students' behavior were observed with some badge types, while some badges did not seem to have such an effect. We also found that students in the two studied courses responded differently to the badges. Based on our findings, achievement badges seem like a promising method to motivate students and to encourage desired study practices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402 · cited 1×
“In this study, we describe and evaluate the use of achievement badges in the TRAKLA2 online learning environment where students complete interactive, automatically assessed exercises about data structures and algorithms.”
Method
Cited by
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
The rise of motivational information systems: A review of gamification research
Koivisto, J., & Hamari, J. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.10.013 · Cited by 1,750
A definition for gamification: anchoring gamification in the service marketing literature
Huotari, K., & Hamari, J. (2017) · Electronic Markets · doi:10.1007/s12525-015-0212-z · Cited by 1,080
Do badges increase user activity? A field experiment on the effects of gamification
Hamari, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2015.03.036 · Cited by 675
Why do people use gamification services?
Hamari, J., & Koivisto, J. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.04.006 · Cited by 642
“Working out for likes”: An empirical study on social influence in exercise gamification
Hamari, J., & Koivisto, J. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.04.018 · Cited by 473
Effectiveness of gamification in the engagement of students
da Rocha Seixas, L., Gomes, A. S., & de Melo Filho, I. J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.11.021 · Cited by 382
Kyewski, E., & Krämer, N. C. (2018) · Computers & Education · doi:10.1016/j.compedu.2017.11.006 · Cited by 327
How to design gamification? A method for engineering gamified software
Morschheuser, B., Hassan, L., Werder, K., & Hamari, J. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2017.10.015 · Cited by 323
Engaging Asian students through game mechanics: Findings from two experiment studies
Hew, K. F., Huang, B., Chu, K. W. S., & Chiu, D. K. W. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.10.010 · Cited by 298
Groening, C., & Binnewies, C. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.02.026 · Cited by 249
Li, M., Ma, S., & Shi, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1253549 · Cited by 439
“Dynamics, on the other hand, designates to the behavior of the game mechanics over time and how they interact with each other and with the player (Hakulinen et al., 2013).”
BackgroundInfluentialHakulinen, L., Auvinen, T., & Korhonen, A. (2015) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v10i1.4221 · Cited by 201
“A preliminary analysis on the effect of badges on students’ behavior has previously been presented in [8].”
BackgroundSelf-citationThe Effect of Gamification on Students with Different Achievement Goal Orientations
Hakulinen, L., & Auvinen, T. (2014) · 2014 International Conference on Teaching and Learning in Computing and Engineering · doi:10.1109/latice.2014.10 · Cited by 121
“In our previous study [9], we noticed that badges had a statistically significant impact on some aspects of students’ behavior in an online learning environment (e.”
BackgroundMethodSelf-citationUsing Gamification to Motivate Students with Dyslexia
Gooch, D., Vasalou, A., Benton, L., & Khaled, R. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858231 · Cited by 106
Does gamification engage users in online shopping?
García-Jurado, A., Torres-Jiménez, M., Leal-Rodríguez, A. L., & Castro-González, P. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101076 · Cited by 81
Fostering Development of Work Competencies and Motivation via Gamification
Sailer, M., Hense, J., Mandl, H., & Klevers, M. (2017) · Technical and Vocational Education and Training: Issues, Concerns and Prospects · doi:10.1007/978-3-319-41713-4_37 · Cited by 74
GaTO: An Ontological Model to Apply Gamification in Intelligent Tutoring Systems
Dermeval, D., Albuquerque, J., Bittencourt, I. I., Isotani, S., Silva, A. P., & Vassileva, J. (2019) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2019.00013 · Cited by 43
The affiliation between student achievement and elements of gamification in learning science
Sanmugam, M., Abdullah, Z., Mohamed, H., Aris, B., Zaid, N. M., & Suhadi, S. M. (2016) · 2016 4th International Conference on Information and Communication Technology (ICoICT) · doi:10.1109/icoict.2016.7571962 · Cited by 28
“Another researcher [16] also found that badges can encourage students”
BackgroundGamification and the Trough of Disillusionment
Broer, J. (2014) · Mensch & Computer 2014 - Workshopband · doi:10.1524/9783110344509.389 · Cited by 13
Metadata
- Authors
- Hakulinen, L., Auvinen, T., & Korhonen, A.
- Venue
- 2013 Learning and Teaching in Computing and Engineering
- Publisher
- IEEE
- Published
- 2013-03
- Pages
- 47-54
- OpenAlex
- W2171691785
- Cited by
- 225
- References
- 1
- FWCI
- 48.97
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.