Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index; 31 of the 53 sources its claims cite were checked for support.
Abstract
Background: Previous research showed that computerized cognitive behavioral therapy can effectively reduce depressive symptoms. Some mental health apps incorporate gamification into their app design, yet it is unclear whether features differ in their effectiveness to reduce depressive symptoms over and above mental health apps without gamification. Objective: The aim of this study was to determine whether mental health apps with gamification elements differ in their effectiveness to reduce depressive symptoms when compared to those that lack these elements. Methods: A meta-analysis of studies that examined the effect of app-based therapy, including cognitive behavioral therapy, acceptance and commitment therapy, and mindfulness, on depressive symptoms was performed. A total of 5597 articles were identified via five databases. After screening, 38 studies (n=8110 participants) remained for data extraction. From these studies, 50 total comparisons between postintervention mental health app intervention groups and control groups were included in the meta-analysis. Results: A random effects model was performed to examine the effect of mental health apps on depressive symptoms compared to controls. The number of gamification elements within the apps was included as a moderator. Results indicated a small to moderate effect size across all mental health apps in which the mental health app intervention effectively reduced depressive symptoms compared to controls (Hedges g=–0.27, 95% CI –0.36 to –0.17; P<.001). The gamification moderator was not a significant predictor of depressive symptoms (β=–0.03, SE=0.03; P=.38), demonstrating no significant difference in effectiveness between mental health apps with and without gamification features. A separate meta-regression also did not show an effect of gamification elements on intervention adherence (β=–1.93, SE=2.28; P=.40). Conclusions: The results show that both mental health apps with and without gamification elements were effective in reducing depressive symptoms. There was no significant difference in the effectiveness of mental health apps with gamification elements on depressive symptoms or adherence. This research has important clinical implications for understanding how gamification elements influence the effectiveness of mental health apps on depressive symptoms. ©Stephanie G Six, Kaileigh A Byrne, Thomas P Tibbett, Irene Pericot-Valverde.
Overview
CoChat Summary
## TL;DR
This systematic review and meta-analysis found that mental health apps reduced depressive symptoms overall, but gamification elements did not significantly change symptom reduction or adherence. Across 38 studies and 50 comparisons, the pooled effect favored apps over controls, but the gamification moderator was null.
## Key findings
- Across all eligible studies, mental health apps reduced depressive symptoms versus controls with a small-to-moderate effect size: Hedges g = –0.27, 95% CI –0.36 to –0.17; P<.001.
- Gamification did not significantly predict depressive symptoms: β = –0.03, SE = 0.03/0.04, P = .38, and a CBT-only sensitivity analysis was also null for gamification: β = –0.04, SE = 0.04, P = .31.
- Gamification also did not significantly predict adherence in the secondary meta-regression: β = –1.93, SE = 2.28; P = .40; in CBT-only apps, gamification remained null for adherence: β = 0.17, SE = 2.51; P = .95.
- The review included 38 studies with 8,110 participants and 50 comparisons; 71% (27/38) of studies contained gamification elements.
## Methods
- Systematic review and meta-analysis conducted following PRISMA guidelines; study quality was assessed with the Cochrane Collaboration’s risk of bias tool.
- Search across five databases (PubMed, PsycInfo, Cochrane Clinical Trials Registry, Web of Science, PsyArXiv) plus manual searching; 5,597 articles were identified, 38 studies remained after screening.
- Included human studies of app-based therapies for depression (CBT, ACT, BA, or mindfulness) with pre/post depressive symptom measures; primary analysis used random-effects models with gamification count and intervention duration as moderators, plus sensitivity, adherence, and publication-bias analyses.
## Limitations
- The paper states that several included studies had a high risk of bias, so findings should be interpreted with caution.
- The authors state that analyses were based on aggregated samples, which may have caused ecological bias.
- The paper states heterogeneity was present in all primary analyses; additionally, the meta-analysis was not limited to clinically depressed samples and lacked consistent data on diagnoses or psychiatric comorbidities, so results may not generalize to severe depression or other mental health conditions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
15 Valid · 1 Not valid · 8 Not checked · 40 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, previous systematic reviews and meta-analyses have shown significant reductions in symptoms for depression and other mental disorders while using mental health apps, some of which included cognitive behavioral therapy (CBT) or gamification elements [26,36,37,40,41].”
§ Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis > Introduction
What the sources say
- Supportedcites [26] source
The Results (page not provided) report a statistically significant reduction in self-reported depression symptoms for game-based digital interventions compared with controls. The Discussion identifies CBT-derived interventions among the game applications reviewed. This supports the depression and game-element portion of the multi-cited sentence. (LLM, conf=0.90)
- Partly supportedcites [36] sourceExperimental — accuracy not yet measured
The Introduction (Background; page unavailable) says CBT-delivering psychological AI has reduced depression and anxiety symptoms, and the Discussion (Comparison With Prior Work; page unavailable) reports significant reductions with Tess. But this source is a randomized trial, not a systematic review or meta-analysis of mental health apps, and the cited passages do not establish the claim about gamification elements. (LLM, conf=0.84)
- Supportedcites [37] source
The Results > Depression section reports a significant pooled reduction in depressive symptoms with smartphone apps compared with controls. The Discussion reports significant effects for smoking and for broader analyses of depression and anxiety, while noting that primary-target anxiety was not significant. The Results also identify CBT as a framework for eight eligible apps and gamification in six studies; no page numbers are available in our copy. (LLM, conf=0.92)
- Partly supportedcites [40] sourceExperimental — accuracy not yet measured
The Results > Efficacy section reports that a study of rural participants found significant improvements in depression and anxiety with computerized CBT. The review supports the CBT portion of the claim, but its evidence is specific to computerized CBT for depression and anxiety in rural settings; it does not establish reductions across mental health apps generally or address gamification. No page numbers are available in our copy. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [41] source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Depressive symptoms showed significant reductions in comparison to either wait-list or treatment-as-usual controls [38].”
§ Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis > Introduction
What the sources say
- Supportedcites [38] source
The Results section reports 45 included RCTs. Its “Type of Control Condition” subsection reports significant reductions in depressive symptoms compared with both treatment-as-usual controls (P=.002) and waiting-list controls (P<.001). (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Depression generally has been associated with hyposensitivity to rewards, particularly among those with anhedonic symptoms [11-13,16,17].”
§ Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis > Discussion > Principal Findings
What the sources say
- Supportedcites [11] source
The ‘Dysfunctional Reward-Related Behaviors in Depression’ section (page not supplied) reports that a meta-analysis associated both depression and subclinical anhedonia with reduced reward sensitivity. It distinguishes this from reduced pleasure ratings, which the cited studies did not find. (LLM, conf=0.90)
- Not checked — no full text of the sourcecites [12] source
- Not checked — no full text of the sourcecites [13] source
- Not checked — no full text of the sourcecites [16] source
- Not checked — no full text of the sourcecites [17] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Previous research shows that gamification can increase motivation to engage with mental health apps [42-44], improve mood [45], and activate the ventral striatum, which can enhance individuals’ general reward responsiveness to positive stimuli [21].”
§ Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis > Introduction
What the sources say
- Supportedcites [42] source
The Introduction describes gamification as a promising way to increase engagement and reports a systematic review finding that it can increase engagement with online interventions. The Discussion cautions that this trial did not establish whether gamification caused engagement with its particular depression app; the cited claim makes only the broader, qualified point that gamification can help. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [43] source
- Partly supportedcites [44] sourceExperimental — accuracy not yet measured
The Conclusions (page unavailable) report that one comparison found greater use and time spent on a gamified mental health app, supporting the possibility of increased engagement. But they also say that a positive effect on engagement is not yet established, and they do not report a measured increase in motivation. The citing sentence presents the evidence more firmly than this source does. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
None of the sources cited for this claim have been checked yet.
In the paper
“In terms of gamification elements, four of the apps that were associated with nonsignificant findings included at least two elements of gamification: Kokoro, Headspace, MoodGYM, and Be Good to Yourself [50,52,59,67].”
§ Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis > Discussion > Principal Findings
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 64 claims and every source verdict.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 19
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · cited 1×
“The Egger test [103] was performed to quantify whether there was significant small-study publication bias in the included studies.”
MethodThe Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · cited 1×
“The I(2) statistic was computed to determine heterogeneity across studies: an I(2) value of ≤25% suggests low heterogeneity, ~50% suggests moderate heterogeneity, and ≥75% suggests high heterogeneity across studies [101].”
MethodThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Self-efficacy mechanism in human agency
Bandura, A. (1982) · American Psychologist · doi:10.1037/0003-066x.37.2.122 · Cited by 15,975
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Lovibond, P. F., & Lovibond, S. H. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00075-u · Cited by 14,523 · cited 6×
“11 | e32199 | p. 4https://mental.jmir.org/2021/11/e32199 (page number not for citation purposes) XSL•FO RenderX Adherence rate, %Game elements, nTherapy interventionDepression measureApp classificationFirst author, publication year, and app 75.02CBTPHQ-9InternetMoodGYM Ha, 2020 [49] N/A1CBTBDI-IIMobileSpring Howells,…”
MethodInfluentialBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Research works printed but not linked: 5
- 2010, Depression: The Treatment and Management of Depression in Adults (Updated Edition)
- WoodPBurwellJRawlettKNew study reveals lack of access as root cause for mental health crisis in AmericaNational Council for Mental Wellbeing201810102021-07-15https://www.thenationalcouncil.org/press-releases/new-study-reveals-lack-of-access-as-
- Russoniello, C, 2009, J CyberTherapy Rehabil, 2, 53
- BossoKBThe Effects of Mindfulness Training on BDNF Levels, Depression, Anxiety, and Stress Levels of College Students [undergraduate thesis]2020052021-11-22Boca Raton, FLFlorida Atlantic Universityhttp://fau.digital.flvc.org/islandora/object/fau%3A42592
- Eaton, W, 2004, The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 3rd edition. Volume 3: Instruments for Adults, 363
Cited by
Lipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 225
Potential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review
Koh, J., Tng, G. Y. Q., & Hartanto, A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091376 · Cited by 155
“[28] Thach [48] Thach [49] Anxiety/Depression/Stress/Well-being”
BackgroundGkintoni, E., Vantaraki, F., Skoulidi, C., Anastassopoulos, P., & Vantarakis, A. (2024) · Behavioral Sciences · doi:10.3390/bs14020102 · Cited by 137
“This evolution highlights gamifica-tion’s adaptability and growing significance across different fields and age groups [19].”
BackgroundThe role of gamification in digital mental health
Fleming, T., Poppelaars, M., & Thabrew, H. (2023) · World Psychiatry · doi:10.1002/wps.21041 · Cited by 45
Aschentrup, L., Steimer, P. A., Dadaczynski, K., McCall, T., Fischer, F., & Wrona, K. J. (2024) · BMC Public Health · doi:10.1186/s12889-023-17517-3 · Cited by 68
“However, current literature has not comprehensively focused on prevention and health promotion [11–13].”
BackgroundMethod
Metadata
- Authors
- Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I.
- Affiliations
- Clemson University (US)
- Systems, Applications & Products in Data Processing (United States) (US)
- Corresponding author
- Byrne, Kaileigh A
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2021-11-29
- Volume
- 8
- Issue
- 11
- Pages
- e32199
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC8669581
- OpenAlex
- W3206726477
- Cited by
- 95
- References
- 105
- Citations by year
- 2026: 17 · 2025: 27 · 2024: 27 · 2023: 16 · 2022: 8
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- gamification, mental health apps, depression, depressive symptoms, computerized cognitive behavioral therapy, acceptance and commitment therapy, mindfulness, intervention adherence, digital mental health interventions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.