CoChat

Examining the Effectiveness of Gamification in Mental Health Apps for Depression: Systematic Review and Meta-analysis

Open access
Six, Stephanie G, Byrne, Kaileigh A, Tibbett, Thomas P, Pericot-Valverde, Irene · 2021 · JMIR Mental Health

Published version of a preprint

The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index; 31 of the 53 sources its claims cite were checked for support.

Abstract

Background: Previous research showed that computerized cognitive behavioral therapy can effectively reduce depressive symptoms. Some mental health apps incorporate gamification into their app design, yet it is unclear whether features differ in their effectiveness to reduce depressive symptoms over and above mental health apps without gamification. Objective: The aim of this study was to determine whether mental health apps with gamification elements differ in their effectiveness to reduce depressive symptoms when compared to those that lack these elements. Methods: A meta-analysis of studies that examined the effect of app-based therapy, including cognitive behavioral therapy, acceptance and commitment therapy, and mindfulness, on depressive symptoms was performed. A total of 5597 articles were identified via five databases. After screening, 38 studies (n=8110 participants) remained for data extraction. From these studies, 50 total comparisons between postintervention mental health app intervention groups and control groups were included in the meta-analysis. Results: A random effects model was performed to examine the effect of mental health apps on depressive symptoms compared to controls. The number of gamification elements within the apps was included as a moderator. Results indicated a small to moderate effect size across all mental health apps in which the mental health app intervention effectively reduced depressive symptoms compared to controls (Hedges g=–0.27, 95% CI –0.36 to –0.17; P<.001). The gamification moderator was not a significant predictor of depressive symptoms (β=–0.03, SE=0.03; P=.38), demonstrating no significant difference in effectiveness between mental health apps with and without gamification features. A separate meta-regression also did not show an effect of gamification elements on intervention adherence (β=–1.93, SE=2.28; P=.40). Conclusions: The results show that both mental health apps with and without gamification elements were effective in reducing depressive symptoms. There was no significant difference in the effectiveness of mental health apps with gamification elements on depressive symptoms or adherence. This research has important clinical implications for understanding how gamification elements influence the effectiveness of mental health apps on depressive symptoms. ©Stephanie G Six, Kaileigh A Byrne, Thomas P Tibbett, Irene Pericot-Valverde.

Overview

CoChat Summary

## TL;DR

This systematic review and meta-analysis found that mental health apps reduced depressive symptoms overall, but gamification elements did not significantly change symptom reduction or adherence. Across 38 studies and 50 comparisons, the pooled effect favored apps over controls, but the gamification moderator was null.

## Key findings

  • Across all eligible studies, mental health apps reduced depressive symptoms versus controls with a small-to-moderate effect size: Hedges g = –0.27, 95% CI –0.36 to –0.17; P<.001.
  • Gamification did not significantly predict depressive symptoms: β = –0.03, SE = 0.03/0.04, P = .38, and a CBT-only sensitivity analysis was also null for gamification: β = –0.04, SE = 0.04, P = .31.
  • Gamification also did not significantly predict adherence in the secondary meta-regression: β = –1.93, SE = 2.28; P = .40; in CBT-only apps, gamification remained null for adherence: β = 0.17, SE = 2.51; P = .95.
  • The review included 38 studies with 8,110 participants and 50 comparisons; 71% (27/38) of studies contained gamification elements.

## Methods

  • Systematic review and meta-analysis conducted following PRISMA guidelines; study quality was assessed with the Cochrane Collaboration’s risk of bias tool.
  • Search across five databases (PubMed, PsycInfo, Cochrane Clinical Trials Registry, Web of Science, PsyArXiv) plus manual searching; 5,597 articles were identified, 38 studies remained after screening.
  • Included human studies of app-based therapies for depression (CBT, ACT, BA, or mindfulness) with pre/post depressive symptom measures; primary analysis used random-effects models with gamification count and intervention duration as moderators, plus sensitivity, adherence, and publication-bias analyses.

## Limitations

  • The paper states that several included studies had a high risk of bias, so findings should be interpreted with caution.
  • The authors state that analyses were based on aggregated samples, which may have caused ecological bias.
  • The paper states heterogeneity was present in all primary analyses; additionally, the meta-analysis was not limited to clinically depressed samples and lacked consistent data on diagnoses or psychiatric comorbidities, so results may not generalize to severe depression or other mental health conditions.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/32199

Cites

109 of 109 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Risk of bias across all studies included in the meta-analysis based on the Cochrane Collaboration's risk of bias assessment tool.
Figure 1 Risk of bias across all studies included in the meta-analysis based on the Cochrane Collaboration's risk of bias assessment tool.CC BY · PubMed Central
Figure 2 PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram of the studies included in the systematic review and meta-analysis. ACT: acceptance and commitment therapy; CBT: cognitive behavioral therapy.
Figure 2 PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram of the studies included in the systematic review and meta-analysis. ACT: acceptance and commitment therapy; CBT: cognitive behavioral therapy.CC BY · PubMed Central
Figure 3 Forest plot for all studies (n=50 comparisons) showing the effect sizes for each. Author and year for each study are listed on the y-axis.
Figure 3 Forest plot for all studies (n=50 comparisons) showing the effect sizes for each. Author and year for each study are listed on the y-axis.CC BY · PubMed Central
Figure 4 Funnel plot for all studies (n=50 comparisons) showing the heterogeneity for each.
Figure 4 Funnel plot for all studies (n=50 comparisons) showing the heterogeneity for each.CC BY · PubMed Central

Verification

Claims the paper makes

15 Valid · 1 Not valid · 8 Not checked · 40 Own results and interpretations

24 more claims

Create a free account to see all 64 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 18
  • It may state two separate claims as one. 19

Create a free account to see these claims.

Citations

Cites

Show all 109 references

Research works printed but not linked: 5

  1. 2010, Depression: The Treatment and Management of Depression in Adults (Updated Edition)
  2. WoodPBurwellJRawlettKNew study reveals lack of access as root cause for mental health crisis in AmericaNational Council for Mental Wellbeing201810102021-07-15https://www.thenationalcouncil.org/press-releases/new-study-reveals-lack-of-access-as-
  3. Russoniello, C, 2009, J CyberTherapy Rehabil, 2, 53
  4. BossoKBThe Effects of Mindfulness Training on BDNF Levels, Depression, Anxiety, and Stress Levels of College Students [undergraduate thesis]2020052021-11-22Boca Raton, FLFlorida Atlantic Universityhttp://fau.digital.flvc.org/islandora/object/fau%3A42592
  5. Eaton, W, 2004, The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 3rd edition. Volume 3: Instruments for Adults, 363

Cited by

See all 95

Metadata

Authors
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I.
Affiliations
  • Clemson University (US)
  • Systems, Applications & Products in Data Processing (United States) (US)
Corresponding author
Byrne, Kaileigh A
Venue
JMIR Mental Health
Published
2021-11-29
Volume
8
Issue
11
Pages
e32199
ISSN
2368-7959 (ISSN-L)
OpenAlex
W3206726477
Cited by
95
References
105
Citations by year
2026: 17 · 2025: 27 · 2024: 27 · 2023: 16 · 2022: 8
FWCI
1.99
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
gamification, mental health apps, depression, depressive symptoms, computerized cognitive behavioral therapy, acceptance and commitment therapy, mindfulness, intervention adherence, digital mental health interventions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.