Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials
Open accessThe DOI matches its Crossref record; 70 of the 73 references it cites were found in a registry or an index; 7 of the 81 sources its claims cite were checked for support.
Abstract
Mobile phone-based interventions have been proposed as a means for reducing the burden of disease associated with mental illness. While numerous randomized controlled trials and meta-analyses have investigated this possibility, evidence remains unclear. We conducted a systematic meta-review of meta-analyses examining mobile phone-based interventions tested in randomized controlled trials. We synthesized results from 14 meta-analyses representing 145 randomized controlled trials and 47,940 participants. We identified 34 effect sizes representing unique pairings of participants, intervention, comparisons, and outcome (PICO) and graded the strength of the evidence as using umbrella review methodology. We failed to find convincing evidence of efficacy (i.e., n > 1000, p < 10−6, I2 < 50%, absence of publication bias); publication bias was rarely assessed for the representative effect sizes. Eight effect sizes provided highly suggestive evidence (i.e., n > 1000, p < 10−6), including smartphone interventions outperforming inactive controls on measures of psychological symptoms and quality of life (d s = 0.32 to 0.47) and text message-based interventions outperforming non-specific controls and active controls for smoking cessation (d s = 0.31 and 0.19, respectively). The magnitude of effects and strength of evidence tended to diminish as comparison conditions became more rigorous (i.e., inactive to active, non-specific to specific). Four effect sizes provided suggestive evidence, 14 effect sizes provided weak evidence, and eight effect sizes were non-significant. Despite substantial heterogeneity, no moderators were identified. Adverse effects were not reported. Taken together, results support the potential of mobile phone-based interventions and highlight key directions to guide providers, policy makers, clinical trialists, and meta-analysts working in this area.
Overview
CoChat Summary
TL;DR
This meta-review of 14 meta-analyses representing 145 randomized controlled trials and 47,940 participants found no convincing evidence for mobile phone-based mental health interventions. Eight of 34 representative effect sizes provided highly suggestive evidence, but effects were generally small and weakened as comparison conditions became more rigorous.
Key findings
- No effect size met criteria for convincing evidence (n > 1000, p < 10−6, I2 < 50%, absence of publication bias); publication bias was tested for only 2 of 34 eligible effect sizes.
- Eight effect sizes provided highly suggestive evidence: smartphone interventions outperformed inactive controls for anxiety (ds = 0.32 and 0.45), depression (d = 0.32), stress (d = 0.47), and quality of life (d = 0.35); mobile phone and text message-based interventions outperformed non-specific controls for smoking cessation (ds = 0.30 and 0.31); text message-based interventions outperformed active controls for smoking cessation (d = 0.19).
- Four effect sizes provided suggestive evidence, 14 provided weak evidence, and 8 were non-significant; effects generally diminished from inactive to active and specific active comparisons.
- No moderators were identified, and adverse events were not reported; only one meta-analysis evaluated adverse events, finding they were not reported in the seven included trials.
Methods
- Preregistered systematic meta-review following PRISMA; searched six databases through October 31, 2020, for meta-analyses of mobile phone-based interventions on mental health outcomes, requiring at least four RCTs, standardized effect sizes with 95% CIs, and comparison conditions categorized as inactive, active, non-specific, specific, or adjunct.
- Included 14 meta-analyses representing 145 unique primary RCTs and 47,940 participants; identified 34 representative effect sizes based on the largest sample per PICO pairing and graded certainty using umbrella review criteria.
- Meta-analysis quality was assessed with the NIH tool (average 7.07/8); risk of bias, publication bias, and moderator tests were extracted when available.
Limitations
- The paper states that findings are limited by the available meta-analytic and primary study literature, possible underestimation of evidence strength due to lack of publication bias assessment, substantial heterogeneity within and between meta-analyses, rare valid moderator tests, and limited standardized assessment of intervention quality.
- The paper also notes diminished confidence due to risk of bias from lack of blinding of personnel/participants and incomplete outcome data, and it states that adverse events were almost entirely absent from the meta-analytic literature.
- Evident from the text: only one meta-analysis tested moderators within an eligible effect size, publication bias was assessed for only 2 of 34 representative effect sizes, and no eligible effect sizes focused exclusively on youth or adolescent samples.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
6 Valid · 1 Not valid · 66 Not checked · 64 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Compared to specific active controls, meditation apps and smartphone interventions were not significantly superior in their effects on anxiety (ds = 0.26 and 0.09, respectively [21, 39]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry source
The ‘Smartphone interventions vs. active comparisons’ section reports a pooled effect of g=0.09 for four comparisons, with a 95% confidence interval of −0.21 to 0.39. Table 1 identifies these as comparisons for generalized anxiety symptoms, supporting the claim that the effect was not statistically significant. The paper labels the effect size g rather than d. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Smartphone interventions did not differ significantly from specific active controls (d = 0.13 [21]) or when tested as an adjunct to treatment (d = 0.26 [21]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry source
The “Smartphone interventions vs. active comparisons” section reports an effect on depressive symptoms of g=0.13 (95% CI: −0.07 to 0.34), which is not statistically significant. Table 1 also reports g=0.26 (95% CI: −0.09 to 0.61) for smartphones used as an adjunct intervention. The source labels these effect sizes g, rather than d, but supports the cited findings. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Compared to inactive controls, smartphone interventions showed highly suggestive evidence of small magnitude effects on stress (d = 0.47 [21]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry sourceExperimental — accuracy not yet measured
Table 2 (page not available in our copy) reports a small effect on stress versus waitlist controls of Hedges’ g=0.47, supporting the numerical result for that inactive-control subgroup. It reports g=0.35 for all control conditions combined, however, and does not classify the evidence as “highly suggestive” or report the subgroup estimate as d. (LLM, conf=0.88)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Apps did not differ from non-specific controls on a combination of smoking and drinking outcomes (d = 0.18 [20]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [20] KK Weisel, 2019, Standalone smartphone apps for mental health—a systematic review and meta-analysis., Npj Digit Med sourceExperimental — accuracy not yet measured
The Results > Substance use section reports no significant difference for pooled smoking and drinking outcomes, with an effect size of 0.18. It reports Hedges’ g, not d, and describes the comparison as against controls rather than a specifically defined group of non-specific controls; the Results table lists several inactive control types. Page numbers are unavailable in our copy. (LLM, conf=0.83)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Apps did not differ from non-specific controls (d = 0.14 [20]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [20] KK Weisel, 2019, Standalone smartphone apps for mental health—a systematic review and meta-analysis., Npj Digit Med sourceExperimental — accuracy not yet measured
The Results section 'Self-injurious thoughts and behaviors' supports the qualitative claim: suicidal ideation was assessed in four comparisons (n = 286, three using the same intervention) and the pooled effect was non-significant (g = −0.14, 95%CI −0.37 to 0.1, P = 0.246), i.e. apps did not differ from controls; the Abstract likewise lists suicidal ideation among the outcomes with no significant effect (g = −0.14 to 0.18). The comparator characterisation is consistent with the review, whose 19 trials all used non-specific/inactive controls (k = 2 no-treatment, k = 9 wait-list, k = 3 information-only, k = 4 sham, k = 1 mood chart; e.g. Tighe 2017 'Inactive: WLC'). However, the number attributed is not what the source reports: it gives Hedges' g = −0.14 (point estimate marginally favouring control), not a positive Cohen's d = 0.14, so the sign/direction and the effect-size metric in the citing sentence are unsupported, even though the magnitude and null result match. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
74 more claims · 1 with their cited sources checked
Create a free account to see all 137 claims and to verify the 74 references still open.
- It may state two separate claims as one. 40
- Probably not a substantial claim. 28
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“There is strong evidence that psychological interventions can be effectively delivered through mHealth115–117.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [116]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the evidence for the effectiveness of DMHIs has been limited, with a meta-analysis of randomised controlled trials (RCTs) finding only small effect sizes, potential publication bias, and a lack of active controls8–10.”
From “It happened to be the perfect thing”: experiences of generative AI chatbots for mental health (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At the same time, a growing body of research shows that interactions with chatbots can contribute to improving their users’ mental health and quality of life, especially if the specific needs of the user match with chatbot capabilities (22, 24, 27, 31, 34, 40, 49–56).”
From Waiting for a digital therapist: three challenges on the path to psychotherapy delivered by artificial intelligence (2023) · cites this paper as [50]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Further, when intervention effects have been compared with those of rigorous control conditions, the effects can be weaker [17].”
In the citing paper
“Another factor affecting the inclusion of DMHIs in routine clinical care is that many of these interventions have been designed as “self-help” or “stand-alone” products [8,43,44].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
“and as weak for 14 effect sizes (38.2%).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Discussion
“Thirteen of the 34 effect sizes provided weak (p < .050) evidence for mobile phone-based interventions.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“and as weak for 14 effect sizes (38.2%).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 38.2 · recomputed 41.176471
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Study characteristics
“Meta-analyses were published between 2015 and 2020.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Study characteristics
“| Gál (2021) [39] | adults | n/a | meditation apps | anxiety, depression, stress, wellbeing | 34 | Cochrane | 7 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Eight effect sizes (26.5%) were non-significant.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 26.5 · recomputed 23.529412
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“25 (73.5%) were significant at p < .050.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 25 · recomputed 26
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“io/ s2t67/) and followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA [31]) guidelines.”
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 1×
“, odds ratio, hazard ratio) were converted into Cohen’s d using standard methods [44].”
Method
Cited by
“It happened to be the perfect thing”: experiences of generative AI chatbots for mental health
Siddals, S., Torous, J., & Coxon, A. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00097-4 · Cited by 241
“However,theevidencefortheeffectivenessofDMHIshasbeenlimited,with ameta-analysisofrandomisedcontrolledtrials(RCTs) fi nding only small effect sizes, potential publication bias, and a lack of active controls 8 – 10 .”
Self-citationLinardon, J., Torous, J., Firth, J., Cuijpers, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2024) · World Psychiatry · doi:10.1002/wps.21183 · Cited by 207
“…complex machine learning algorithms also enable treatment content to be regularly updated and personalized to the needs of the user based on data collected passively (e.g., global positioning system coordinates to infer social determinants of health) and actively (e.g., symptom tracking) 13,14 .”
BackgroundSelf-citationProviding Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
“Although there have been some meta-reviews investigating the effects of DMHIs on mental health [8,51], only 1 scoping review has examined the role of human support in DMHI use [39].”
Assessment of Mental Health Services Available Through Smartphone Apps
Camacho, E., Cohen, A., & Torous, J. B. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.48784 · Cited by 112
Self-citationGrodniewicz, J. P., & Hohol, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1190084 · Cited by 100
Metadata
- Authors
- Goldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S.
- Affiliations
- University of Wisconsin–Madison (US)
- Beth Israel Deaconess Medical Center (US)
- Brown University (US)
- Corresponding author
- Goldberg, Simon B.
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-01-18
- Volume
- 1
- Issue
- 1
- Pages
- e0000002
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC8881800
- OpenAlex
- W4206302417
- Cited by
- 237
- References
- 73
- Citations by year
- 2026: 31 · 2025: 61 · 2024: 62 · 2023: 55 · 2022: 28
- FWCI
- 45.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- National Center for Complementary and Alternative Medicine (K23AT010879, K23AT011173)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- mobile phone intervention, smartphone-based intervention, text messaging intervention, mental health, psychological symptoms, quality of life, smoking cessation, intervention efficacy, publication bias, umbrella review, meta-review
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.