Gamification suffers from the novelty effect but benefits from the familiarization effect: Findings from a longitudinal study
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
There are many claims that gamification (i.e., using game elements outside games) impact decreases over time (i.e., the novelty effect). Most studies analyzing this effect focused on extrinsic game elements, while fictional and collaborative competition have been recently recommended. Additionally, to the best of our knowledge, no long-term research has been carried out with STEM learners from introductory programming courses (CS1), a context that demands encouraging practice and mitigating motivation throughout the semester. Therefore, the main goal of this work is to better understand how the impact of a gamification design, featuring fictional and competitive-collaborative elements, changes over a 14-week period of time, when applied to CS1 courses taken by STEM students (N = 756). In an ecological setting, we followed a 2x7 quasi-experimental design, where Brazilian STEM students completed assignments in either a gamified or non-gamified version of the same system, which provided the measures (number of attempts, usage time, and system access) to assess user behavior at seven points in time. Results indicate changes in gamification’s impact that appear to follow a U-shaped pattern. Supporting the novelty effect, the gamification’s effect started to decrease after four weeks, decrease that lasted between two to six weeks. Interestingly, the gamification’s impact shifted to an uptrend between six and 10 weeks after the start of the intervention, partially recovering its contribution naturally. Thus, we found empirical evidence supporting that gamification likely suffers from the novelty effect, but also benefits from the familiarization effect, which contributes to an overall positive impact on students. These findings may provide some guidelines to inform practitioners about how long the initial contributions of gamification last, and how long they take to recover after some reduction in benefits. It can also help researchers to realize when to apply/evaluate interventions that use gamification by taking into consideration the novelty effect and, thereby, better understand the real impact of gamification on students’ behavior in the long run.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402 · cited 1×
“Game elements have been widely added outside games, approach known as gamification, with the goal of affecting user behavior Deterding et al. (2011); Helmefalk (2019).”
BackgroundDoes Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201 · cited 7×
“First, research context: The literature indicates gamification’s effect varies depending on the context Hamari et al. (2014); Liu et al. (2017); Toda et al. (2020), and a single research analyzed how gamification’s effect changes over time when applied to CS1 students Rodrigues et al. (2021).”
BackgroundInfluentialReconsidering Research on Learning from Media
Clark, R. E. (1983) · Review of Educational Research · doi:10.3102/00346543053004445 · Cited by 2,715 · cited 1×
“That is, it leads to positive outcomes when introduced and, as its novelty goes, so does the positive effect Clark (1983).”
BackgroundThe gamification of learning: a meta-analysis
Sailer, M., & Homner, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09498-w · Cited by 2,594 · cited 9×
“Therefore, considering the design we employed features elements likely to enhance gamification potential Sailer and Homner (2019), their results might be due to the limited intervention duration, or the different gamification design.”
BackgroundResultInfluentialGamification in theory and action: a survey
Seaborn, K., & Fels, D. I. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.09.006 · Cited by 2,515 · cited 1×
“Thus, performing similar studies in different contexts is important to advance the understanding to new contexts Seaborn and Fels (2015).”
BackgroundGamifying education: what is known, what is believed and what remains uncertain: a critical review
Dichev, C., & Dicheva, D. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0042-5 · Cited by 2,112 · cited 1×
“Indeed, gamification studies are often criticized, due to lack of methodological rigor Hamari et al. (2014); Dichev and Dicheva (2017).”
BackgroundHanus, M. D., & Fox, J. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.08.019 · Cited by 1,918 · cited 4×
“Compared to Hanus and Fox Hanus and Fox (2015), Grangeia et al. Grangeia et al. (2019), Sanchez et al. Sanchez et al. (2020), and Tsay et al. Tsay et al. (2020), contexts differ because neither of them involved CS1.”
BackgroundMethodInfluentialThe effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 2×
“We can see attempts as a measure of relevant learning behavior based on the testing effect: the idea that the more one is tested, the more one learns Rowland (2014); Rodrigues et al. (2021); Sanchez et al. (2020).”
BackgroundMethodBai, S., Hew, K. F., & Huang, B. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100322 · Cited by 994 · cited 15×
“This study responds to calls for longitudinal gamification studies Nacke and Deterding (2017); Bai et al. (2020).”
BackgroundInfluentialThe effect of gamification on motivation and engagement
Alsawaier, R. S. (2018) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-02-2017-0009 · Cited by 887
Cited by
Ağırman, N., & Ercoşkun, M. H. (2025) · lnternational Electronic Journal of Elementary Education · doi:10.26822/iejee.2025.410
Metadata
- Authors
- Rodrigues, L., Pereira, F. D., Toda, A. M., Palomino, P. T., Pessoa, M., Carvalho, L. S. G., Fernandes, D., Oliveira, E. H. T., Cristea, A. I., & Isotani, S.
- Venue
- International Journal of Educational Technology in Higher Education
- Published
- 2022-02-15
- Volume
- 19
- Issue
- 1
- ISSN
- 2365-9440 (ISSN-L)
- OpenAlex
- W4212789950
- Cited by
- 173
- References
- 14
- FWCI
- 43.62
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gamification suffers from the novelty effect but benefits from the familiarization effect: Findings from a longitudinal study. https://app.cochat.ai/papers/10.1186/s41239-021-00314-6
- The paper
- Rodrigues, L., Pereira, F. D., Toda, A. M., Palomino, P. T., Pessoa, M., Carvalho, L. S. G., Fernandes, D., Oliveira, E. H. T., Cristea, A. I., & Isotani, S. (2022). Gamification suffers from the novelty effect but benefits from the familiarization effect: Findings from a longitudinal study. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-021-00314-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.