Cited by 37Digital Mental Health InterventionsMindfulness and Compassion InterventionsPsychological Well-being and Life Satisfaction

The Effectiveness of Fully Automated Digital Interventions in Promoting Mental Well-Being in the General Population: Systematic Review and Meta-Analysis

Open access
Groot, Julia, MacLellan, Alexander, Butler, Madelaine, Todor, Elisa, Zulfiqar, Mahnoor, Thackrah, Timothy, Clarke, Christopher, Brosnan, Mark +1 more·2023·JMIR Mental Health

Published version of a preprint

Abstract

BACKGROUND: Recent years have highlighted an increasing need to promote mental well-being in the general population. This has led to a rapidly growing market for fully automated digital mental well-being tools. Although many individuals have started using these tools in their daily lives, evidence on the overall effectiveness of digital mental well-being tools is currently lacking. OBJECTIVE: This study aims to review the evidence on the effectiveness of fully automated digital interventions in promoting mental well-being in the general population. METHODS: Following the preregistration of the systematic review protocol on PROSPERO, searches were carried out in MEDLINE, Web of Science, Cochrane, PsycINFO, PsycEXTRA, Scopus, and ACM Digital (initial searches in February 2022; updated in October 2022). Studies were included if they contained a general population sample and a fully automated digital intervention that exclusively used psychological mental well-being promotion activities. Two reviewers, blinded to each other's decisions, conducted data selection, extraction, and quality assessment of the included studies. Narrative synthesis and a random-effects model of per-protocol data were adopted. RESULTS: We included 19 studies that involved 7243 participants. These studies included 24 fully automated digital mental well-being interventions, of which 15 (63%) were included in the meta-analysis. Compared with no intervention, there was a significant small effect of fully automated digital mental well-being interventions on mental well-being in the general population (standardized mean difference 0.19, 95% CI 0.04-0.33; P=.02). Specifically, mindfulness-, acceptance-, commitment-, and compassion-based interventions significantly promoted mental well-being in the general population (P=.006); insufficient evidence was available for positive psychology and cognitive behavioral therapy-based interventions; and contraindications were found for integrative approaches. Overall, there was substantial heterogeneity, which could be partially explained by the intervention duration, comparator, and study outcomes. The risk of bias was high, and confidence in the quality of the evidence was very low (Grading of Recommendations, Assessment, Development, and Evaluations), primarily because of the high rates of study dropout (average 37%; range 0%-85%) and suboptimal intervention adherence (average 40%). CONCLUSIONS: This study provides a novel contribution to knowledge regarding the effectiveness, strengths, and weaknesses of fully automated digital mental well-being interventions in the general population. Future research and practice should consider these findings when developing fully automated digital mental well-being tools. In addition, research should aim to investigate positive psychology and cognitive behavioral therapy-based tools as well as develop further strategies to improve adherence and reduce dropout in fully automated digital mental well-being interventions. Finally, it should aim to understand when and for whom these interventions are particularly beneficial. TRIAL REGISTRATION: PROSPERO CRD42022310702; https://tinyurl.com/yc7tcwy7.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/44658

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The evidence for the effectiveness of DMHIs has been limited, with a meta-analysis of randomised controlled trials (RCTs) finding only small effect sizes, potential publication bias, and a lack of active controls.

    “However, the evidence for the effectiveness of DMHIs has been limited, with a meta-analysis of randomised controlled trials (RCTs) finding only small effect sizes, potential publication bias, and a lack of active controls8–10.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 73 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. [24]Groot J Ainsworth B Brosnan M Clarke C The effectiveness of digital interventions to enhance mental well-being in the general population: a systematic review PROSPERO 2022 2023-09-11 https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022310702 PMC10623223 37856172
  2. [54]International Wellbeing Group Personal Wellbeing Index: 5th Edition Australian Centre on Quality of Life, Deakin University 2013 2022-09-15 https://www.acqol.com.au/uploads/pwi-a/pwi-a-english.pdf

Cited by

Sorted by citations

Authors
Groot, J., MacLellan, A., Butler, M., Todor, E., Zulfiqar, M., Thackrah, T., Clarke, C., Brosnan, M., & Ainsworth, B.
Affiliations
  • University of Bath (GB)
  • University of Southampton (GB)
Corresponding author
Groot, Julia
Venue
JMIR Mental Health
Published
2023-10-19
Volume
10
Pages
e44658
ISSN
2368-7959 (ISSN-L)
OpenAlex
W4383568698
Cited by
37
References
73
Citations by year
2026: 17 · 2025: 14 · 2024: 5 · 2023: 1
FWCI
1.25
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure (University of Bath) (publishedVersion, cc-by)
  • ePrints Soton (University of Southampton) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • University of Bath
  • Economic and Social Research Council (2572559)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Social Sciences › Psychology › Social Psychology › Psychological Well-being and Life Satisfaction
Keywords
psychological well-being, general population, digital mental health tools, mindfulness-based interventions, acceptance and commitment therapy, compassion-focused therapy, positive psychology interventions, cognitive behavioral therapy, intervention effectiveness, intervention adherence, dropout, risk of bias, mental health promotion, mental health apps, chatbots, online coaching, gamification, wearable devices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review