Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials
Open accessThe DOI matches its Crossref record; 70 of the 73 references it cites were found in a registry or an index; 7 of the 81 sources its claims cite were checked for support.
Abstract
Mobile phone-based interventions have been proposed as a means for reducing the burden of disease associated with mental illness. While numerous randomized controlled trials and meta-analyses have investigated this possibility, evidence remains unclear. We conducted a systematic meta-review of meta-analyses examining mobile phone-based interventions tested in randomized controlled trials. We synthesized results from 14 meta-analyses representing 145 randomized controlled trials and 47,940 participants. We identified 34 effect sizes representing unique pairings of participants, intervention, comparisons, and outcome (PICO) and graded the strength of the evidence as using umbrella review methodology. We failed to find convincing evidence of efficacy (i.e., n > 1000, p < 10−6, I2 < 50%, absence of publication bias); publication bias was rarely assessed for the representative effect sizes. Eight effect sizes provided highly suggestive evidence (i.e., n > 1000, p < 10−6), including smartphone interventions outperforming inactive controls on measures of psychological symptoms and quality of life (d s = 0.32 to 0.47) and text message-based interventions outperforming non-specific controls and active controls for smoking cessation (d s = 0.31 and 0.19, respectively). The magnitude of effects and strength of evidence tended to diminish as comparison conditions became more rigorous (i.e., inactive to active, non-specific to specific). Four effect sizes provided suggestive evidence, 14 effect sizes provided weak evidence, and eight effect sizes were non-significant. Despite substantial heterogeneity, no moderators were identified. Adverse effects were not reported. Taken together, results support the potential of mobile phone-based interventions and highlight key directions to guide providers, policy makers, clinical trialists, and meta-analysts working in this area.
Overview
CoChat Summary
TL;DR
This meta-review of 14 meta-analyses representing 145 randomized controlled trials and 47,940 participants found no convincing evidence for mobile phone-based mental health interventions. Eight of 34 representative effect sizes provided highly suggestive evidence, but effects were generally small and weakened as comparison conditions became more rigorous.
Key findings
- No effect size met criteria for convincing evidence (n > 1000, p < 10−6, I2 < 50%, absence of publication bias); publication bias was tested for only 2 of 34 eligible effect sizes.
- Eight effect sizes provided highly suggestive evidence: smartphone interventions outperformed inactive controls for anxiety (ds = 0.32 and 0.45), depression (d = 0.32), stress (d = 0.47), and quality of life (d = 0.35); mobile phone and text message-based interventions outperformed non-specific controls for smoking cessation (ds = 0.30 and 0.31); text message-based interventions outperformed active controls for smoking cessation (d = 0.19).
- Four effect sizes provided suggestive evidence, 14 provided weak evidence, and 8 were non-significant; effects generally diminished from inactive to active and specific active comparisons.
- No moderators were identified, and adverse events were not reported; only one meta-analysis evaluated adverse events, finding they were not reported in the seven included trials.
Methods
- Preregistered systematic meta-review following PRISMA; searched six databases through October 31, 2020, for meta-analyses of mobile phone-based interventions on mental health outcomes, requiring at least four RCTs, standardized effect sizes with 95% CIs, and comparison conditions categorized as inactive, active, non-specific, specific, or adjunct.
- Included 14 meta-analyses representing 145 unique primary RCTs and 47,940 participants; identified 34 representative effect sizes based on the largest sample per PICO pairing and graded certainty using umbrella review criteria.
- Meta-analysis quality was assessed with the NIH tool (average 7.07/8); risk of bias, publication bias, and moderator tests were extracted when available.
Limitations
- The paper states that findings are limited by the available meta-analytic and primary study literature, possible underestimation of evidence strength due to lack of publication bias assessment, substantial heterogeneity within and between meta-analyses, rare valid moderator tests, and limited standardized assessment of intervention quality.
- The paper also notes diminished confidence due to risk of bias from lack of blinding of personnel/participants and incomplete outcome data, and it states that adverse events were almost entirely absent from the meta-analytic literature.
- Evident from the text: only one meta-analysis tested moderators within an eligible effect size, publication bias was assessed for only 2 of 34 representative effect sizes, and no eligible effect sizes focused exclusively on youth or adolescent samples.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
6 Valid · 1 Not valid · 66 Not checked · 64 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Compared to specific active controls, meditation apps and smartphone interventions were not significantly superior in their effects on anxiety (ds = 0.26 and 0.09, respectively [21, 39]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry source
The ‘Smartphone interventions vs. active comparisons’ section reports a pooled effect of g=0.09 for four comparisons, with a 95% confidence interval of −0.21 to 0.39. Table 1 identifies these as comparisons for generalized anxiety symptoms, supporting the claim that the effect was not statistically significant. The paper labels the effect size g rather than d. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Smartphone interventions did not differ significantly from specific active controls (d = 0.13 [21]) or when tested as an adjunct to treatment (d = 0.26 [21]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry source
The “Smartphone interventions vs. active comparisons” section reports an effect on depressive symptoms of g=0.13 (95% CI: −0.07 to 0.34), which is not statistically significant. Table 1 also reports g=0.26 (95% CI: −0.09 to 0.61) for smartphones used as an adjunct intervention. The source labels these effect sizes g, rather than d, but supports the cited findings. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Compared to inactive controls, smartphone interventions showed highly suggestive evidence of small magnitude effects on stress (d = 0.47 [21]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [21] J Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials., World Psychiatry sourceExperimental — accuracy not yet measured
Table 2 (page not available in our copy) reports a small effect on stress versus waitlist controls of Hedges’ g=0.47, supporting the numerical result for that inactive-control subgroup. It reports g=0.35 for all control conditions combined, however, and does not classify the evidence as “highly suggestive” or report the subgroup estimate as d. (LLM, conf=0.88)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Apps did not differ from non-specific controls on a combination of smoking and drinking outcomes (d = 0.18 [20]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [20] KK Weisel, 2019, Standalone smartphone apps for mental health—a systematic review and meta-analysis., Npj Digit Med sourceExperimental — accuracy not yet measured
The Results > Substance use section reports no significant difference for pooled smoking and drinking outcomes, with an effect size of 0.18. It reports Hedges’ g, not d, and describes the comparison as against controls rather than a specifically defined group of non-specific controls; the Results table lists several inactive control types. Page numbers are unavailable in our copy. (LLM, conf=0.83)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Apps did not differ from non-specific controls (d = 0.14 [20]).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
What the sources say
- Partly supportedcites [20] KK Weisel, 2019, Standalone smartphone apps for mental health—a systematic review and meta-analysis., Npj Digit Med sourceExperimental — accuracy not yet measured
The Results section 'Self-injurious thoughts and behaviors' supports the qualitative claim: suicidal ideation was assessed in four comparisons (n = 286, three using the same intervention) and the pooled effect was non-significant (g = −0.14, 95%CI −0.37 to 0.1, P = 0.246), i.e. apps did not differ from controls; the Abstract likewise lists suicidal ideation among the outcomes with no significant effect (g = −0.14 to 0.18). The comparator characterisation is consistent with the review, whose 19 trials all used non-specific/inactive controls (k = 2 no-treatment, k = 9 wait-list, k = 3 information-only, k = 4 sham, k = 1 mood chart; e.g. Tighe 2017 'Inactive: WLC'). However, the number attributed is not what the source reports: it gives Hedges' g = −0.14 (point estimate marginally favouring control), not a positive Cohen's d = 0.14, so the sign/direction and the effect-size metric in the citing sentence are unsupported, even though the magnitude and null result match. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
74 more claims · 1 with their cited sources checked
Create a free account to see all 137 claims and to verify the 74 references still open.
- It may state two separate claims as one. 40
- Probably not a substantial claim. 28
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“There is strong evidence that psychological interventions can be effectively delivered through mHealth115–117.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [116]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the evidence for the effectiveness of DMHIs has been limited, with a meta-analysis of randomised controlled trials (RCTs) finding only small effect sizes, potential publication bias, and a lack of active controls8–10.”
From “It happened to be the perfect thing”: experiences of generative AI chatbots for mental health (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At the same time, a growing body of research shows that interactions with chatbots can contribute to improving their users’ mental health and quality of life, especially if the specific needs of the user match with chatbot capabilities (22, 24, 27, 31, 34, 40, 49–56).”
From Waiting for a digital therapist: three challenges on the path to psychotherapy delivered by artificial intelligence (2023) · cites this paper as [50]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Further, when intervention effects have been compared with those of rigorous control conditions, the effects can be weaker [17].”
In the citing paper
“Another factor affecting the inclusion of DMHIs in routine clinical care is that many of these interventions have been designed as “self-help” or “stand-alone” products [8,43,44].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
“and as weak for 14 effect sizes (38.2%).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Discussion
“Thirteen of the 34 effect sizes provided weak (p < .050) evidence for mobile phone-based interventions.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“and as weak for 14 effect sizes (38.2%).”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 38.2 · recomputed 41.176471
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Study characteristics
“Meta-analyses were published between 2015 and 2020.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Study characteristics
“| Gál (2021) [39] | adults | n/a | meditation apps | anxiety, depression, stress, wellbeing | 34 | Cochrane | 7 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Eight effect sizes (26.5%) were non-significant.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 26.5 · recomputed 23.529412
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“25 (73.5%) were significant at p < .050.”
§ Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials > Results > Synthesis of results
Reported 25 · recomputed 26
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“io/ s2t67/) and followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA [31]) guidelines.”
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 1×
“, odds ratio, hazard ratio) were converted into Cohen’s d using standard methods [44].”
Method
Cited by
“It happened to be the perfect thing”: experiences of generative AI chatbots for mental health
Siddals, S., Torous, J., & Coxon, A. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00097-4 · Cited by 241
“However,theevidencefortheeffectivenessofDMHIshasbeenlimited,with ameta-analysisofrandomisedcontrolledtrials(RCTs) fi nding only small effect sizes, potential publication bias, and a lack of active controls 8 – 10 .”
Self-citationLinardon, J., Torous, J., Firth, J., Cuijpers, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2024) · World Psychiatry · doi:10.1002/wps.21183 · Cited by 207
“…complex machine learning algorithms also enable treatment content to be regularly updated and personalized to the needs of the user based on data collected passively (e.g., global positioning system coordinates to infer social determinants of health) and actively (e.g., symptom tracking) 13,14 .”
BackgroundSelf-citationProviding Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
“Although there have been some meta-reviews investigating the effects of DMHIs on mental health [8,51], only 1 scoping review has examined the role of human support in DMHI use [39].”
Assessment of Mental Health Services Available Through Smartphone Apps
Camacho, E., Cohen, A., & Torous, J. B. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.48784 · Cited by 112
Self-citationGrodniewicz, J. P., & Hohol, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1190084 · Cited by 100
Forbes, A., Keleher, M. R., Venditto, M., & DiBiasi, F. (2023) · Journal of Medical Internet Research · doi:10.2196/43727 · Cited by 94
“Similarly, in a meta-review of meta-analyses examining the outcomes of RCTs of app-based interventions, Goldberg et al [167] reported that digital interventions had a small but significant effect on improving depression symptoms compared with inactive controls but not compared with active controls.”
Regulatory considerations to keep pace with innovation in digital health products
Torous, J., Stern, A. D., & Bourgeois, F. T. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00668-9 · Cited by 80
Self-citationSocial media-based interventions for adolescent and young adult mental health: A scoping review
Kruzan, K. P., Williams, K. D. A., Meyerhoff, J., Yoo, D. W., O’Dwyer, L., Choudhury, M. D., & Mohr, D. C. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100578 · Cited by 114
Goldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75
Self-citationLinardon, J., Messer, M., Goldberg, S. B., & Fuller-Tyszkiewicz, M. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102370 · Cited by 74
Self-citationA common factors perspective on mindfulness-based interventions
Goldberg, S. B. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00090-8 · Cited by 75
Self-citationVerdejo‐García, A., Rezapour, T., Giddens, E., Zonoozi, A. K., Rafei, P., Berry, J., Caracuel, A., Copersino, M. L., Field, M., Garland, E. L., et al. (2022) · Addiction · doi:10.1111/add.16109 · Cited by 76
Davies, J. N., Faschinger, A., Galante, J., & Van Dam, N. T. (2024) · Scientific Reports · doi:10.1038/s41598-024-64562-y · Cited by 56
“The use of 32,33,53 , and research into 31 meditation apps has increased sharply in recent years, with recent cross-sectional data suggesting that between 58–75% of meditators in the US have used a meditation app at least once, with 21–23% using them regularly 43,45,52 .”
BackgroundMaqbali, M. A. H. A., Alsayed, A. R., Hughes, C., Hacker, E. D., & Dickens, G. L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302597 · Cited by 75
Sun, S., Simonsson, O., McGarvey, S. T., Torous, J. B., & Goldberg, S. B. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00119-5 · Cited by 78
Self-citationDigital psychiatry in low-and-middle-income countries: New developments and the way forward
Chakrabarti, S. (2024) · World Journal of Psychiatry · doi:10.5498/wjp.v14.i3.350 · Cited by 57
Litvin, S., Saunders, R., Jefferies, P., Seely, H., Pössel, P., & Lüttke, S. (2023) · JMIR Mental Health · doi:10.2196/47285 · Cited by 43
Tong, F., Lederman, R., D’Alfonso, S., Berry, K., & Bucci, S. (2023) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2851 · Cited by 44
Biagianti, B., Foti, G., Liberto, A. D., Bressi, C., & Brambilla, P. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.01.057 · Cited by 45
Boucher, E. M., Honomichl, R. D., Ward, H. E., Powell, T., Stoeckl, S. E., & Parks, A. C. (2022) · JMIR Aging · doi:10.2196/39851 · Cited by 32
Digitalising mental health care: Practical recommendations from the European Psychiatric Association
Kalman, J. L., Burkhardt, G., Samochowiec, J., Gebhard, C., Dom, G., John, M., Kılıç, Ö., Kurimay, T., Lien, L., Schouler‐Ocak, M., et al. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2466 · Cited by 49
Macrynikola, N., Nguyen, N. S., Lane, E., Yen, S., & Torous, J. B. (2023) · NEJM Catalyst · doi:10.1056/cat.23.0100 · Cited by 36
Self-citationWhen and Why Adults Abandon Lifestyle Behavior and Mental Health Mobile Apps: Scoping Review
Kidman, P. G., Curtis, R., Watson, A., & Maher, C. A. (2024) · Journal of Medical Internet Research · doi:10.2196/56897 · Cited by 55
“Mobile health apps offer a promising avenue for enhancing both physical [4] and mental health outcomes [5] by facilitating improvements in these health behaviors.”
The Use of Mobile Assessments for Monitoring Mental Health in Youth: Umbrella Review
Marciano, L., Vocaj, E., Bekalu, M. A., Tona, A. L., Rocchi, G., & Viswanath, K. (2023) · Journal of Medical Internet Research · doi:10.2196/45540 · Cited by 46
“Similarly, a systematic meta-review [101] on the use of mobile phone–based interventions, including smartphone apps with and without additional support, meditation apps, SMS text message–based interventions, and general mobile phone–based interventions for mental health problems, failed to find…”
Situating Meditation Apps Within the Ecosystem of Meditation Practice: Population-Based Survey Study
Lam, S. U., Xie, Q., & Goldberg, S. B. (2023) · JMIR Mental Health · doi:10.2196/43565 · Cited by 28
Self-citationExploring Adolescents’ Attitudes Toward Mental Health Apps: Concurrent Mixed Methods Study
Høgsdal, H., Kyrrestad, H., Rye, M., & Kaiser, S. (2024) · JMIR Formative Research · doi:10.2196/50222 · Cited by 26
“Some research has failed to illustrate any effect [13,31,32], and others have indicated that mental health apps are promising and have the potential to provide improvement in mental health outcomes [14,33,34].”
BackgroundAccessibility and availability of smartphone apps for schizophrenia
Kwon, S., Firth, J., Joshi, D., & Torous, J. B. (2022) · Schizophrenia · doi:10.1038/s41537-022-00313-0 · Cited by 37
Self-citationZainal, N. H., & Newman, M. G. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2 · Cited by 26
Peake, E. E., Miller, I., Flannery, J., Chen, L., Lake, J. I., & Padmanabhan, A. (2023) · Journal of Medical Internet Research · doi:10.2196/48467 · Cited by 38
“Digital CBT applications have demonstrated promise in treating depression [23,26,49,50], and a BA-focused digital therapeutic may represent an effective and accessible treatment option for adolescents.”
Horwitz, A. G., Mills, E. D., Sen, S., & Bohnert, A. S. B. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.22115 · Cited by 40
Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs
Lim, C. T., Fuchs, C. H., & Torous, J. B. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449474 · Cited by 35
Self-citationFuhrmann, L. M., Weisel, K. K., Harrer, M., Kulke, J. K., Baumeister, H., Cuijpers, P. J., Ebert, D. D., & Berking, M. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100703 · Cited by 28
Faria, M., Zin, S. T. P., Chestnov, R., Novak, A. M., Lev‐Ari, S., & Snyder, M. P. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12216735 · Cited by 32
“Indeed, large meta-analyses have concluded that mobile phone-based [15] and computerized [16] mental health interventions are both safe and effective [17], albeit with notable heterogeneity.”
BackgroundFrank, E., Wallace, M. L., Matthews, M. J., Kendrick, J., Leach, J., Moore, T., Aranovich, G. J., Choudhury, T., Shah, N. R., Framroze, Z., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.870522 · Cited by 24
Kruzan, K. P., Ng, A., Stiles‐Shields, C., Lattie, E. G., Mohr, D. C., & Reddy, M. C. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581209 · Cited by 30
Dietvorst, E., Legerstee, J. S., Vreeker, A., Koval, S., Mens, M. M., Keijsers, L., & Hillegers, M. H. J. (2023) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-022-01982-z · Cited by 24
“It also informs us that this may be the population that is most interested, motivated for and in need of mHealth support [35].”
BackgroundBoucher, E. M., Ward, H. E., Miles, C. J., Vlisides‐Henry, R. D., & Stoeckl, S. E. (2024) · Journal of Medical Internet Research · doi:10.2196/54282 · Cited by 35
“Research has shown that the impact of digital interventions is typically weaker when compared to active control, though these interventions still appear to outperform attentional controls in terms of depression and anxiety [73].”
Sîrbu, V., & David, D. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102515 · Cited by 25
“…latest and most comprehensive meta-review study so far, which synthesized results from 14 meta-analyses on mHealth intervention for mental health (Goldberg et al., 2022) highlighted among others the role of the relevant moderators in trying to explain the variance in the results of a particular…”
InfluentialFrank, A. C., Li, R., Peterson, B. S., & Narayanan, S. S. (2023) · JMIR Mental Health · doi:10.2196/45572 · Cited by 29
Large language models as mental health providers
Rousmaniere, T., Goldberg, S. B., & Torous, J. (2026) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00269-x · Cited by 22
Self-citationPratap, A., Homiar, A., Waninger, L., Herd, C., Suver, C., Volponi, J. J., Anguera, J. A., & Areán, P. A. (2022) · Scientific Data · doi:10.1038/s41597-022-01633-7 · Cited by 24
“When assessing the quality and efficacy of smartphone-based interventions as a supplement to treatments or compared to other therapeutic interventions, there have been varying results across treatment groups 20 .”
ResultE-Mental Health for People with Personality Disorders: A Systematic Review
Xie, Q., Torous, J. B., & Goldberg, S. B. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01360-1 · Cited by 23
Self-citationCrocamo, C., Palpella, D., Cavaleri, D., Nasti, C., Piacenti, S., Morello, P., Lauria, G., Villa, O., Riboldi, I., Bartoli, F., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100878 · Cited by 33
Self-citationAssessing the Dynamics of the Mental Health Apple and Android App Marketplaces
Stoeckl, S. E., Torres-Hernandez, E., Camacho, E., & Torous, J. B. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00300-x · Cited by 23
“Results are more mixed for efficacy, with the most robust data suggesting a small but positive effect that is often less than that marketed (Goldberg et al., 2022).”
BackgroundSelf-citationAn exploratory analysis of the effect size of the mobile mental health Application, mindLAMP
Chang, S. M., Alon, N., & Torous, J. B. (2023) · Digital Health · doi:10.1177/20552076231187244 · Cited by 20
Self-citationCurrent challenges for evaluating mobile health applications
Alon, N., & Torous, J. B. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac244 · Cited by 21
Self-citationRohde, J., Marciniak, M. A., Henninger, M., Homan, S., Ries, A., Paersch, C., Friedman, O. B., Brown, A. D., & Kleim, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305103 · Cited by 36
Wang, T., Tang, C., Jiang, X., Guo, Y., Zhu, S., & Xu, Q. (2024) · Journal of Medical Internet Research · doi:10.2196/47704 · Cited by 30
“Website-based MBIs may offer more content, functionality, and instruction than app-based interventions, which may enhance user engagement, learning, and practice of positive thinking skills [67,68].”
Aschbacher, K., Rivera, L. M., Hornstein, S., Nelson, B. W., Forman‐Hoffman, V. L., & Peiper, N. C. (2023) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001230 · Cited by 20
“to evidence-based mental health care (30).”
Armaou, M., Pears, M., Konstantinidis, S. T., & Blake, H. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21030375 · Cited by 18
“Further, when intervention effects have been compared with those of rigorous control conditions, the effects can be weaker [17].”
BackgroundMoore, C., Kelly, S. A., & Melnyk, B. M. (2024) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12716 · Cited by 23
The correlation between mindfulness and problematic smartphone use: A meta-analysis
Ru, Y., Hassan, N. C., Burhanuddin, N. A. N., Liu, H., & Dong, J. (2025) · Addictive Behaviors · doi:10.1016/j.addbeh.2025.108272 · Cited by 31
At-Home use of App-Based Mindfulness for Children: A Randomized Active-Controlled Trial
Treves, I. N., Olson, H. A., Ozernov‐Palchik, O., Li, C. E., Wang, K. L., Arechiga, X. M., Goldberg, S. B., & Gabrieli, J. D. E. (2023) · Mindfulness · doi:10.1007/s12671-023-02231-3 · Cited by 23
“It is well-established that active control conditions produce smaller effect sizes (Gál et al., 2021; Goldberg et al., 2022b).”
BackgroundSelf-citationBarwick, M. A., Brown, J., Petricca, K., Stevens, B., Powell, B. J., Jaouich, A., Shakespeare, J., & Seto, E. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00402-w · Cited by 15
“The health benefits of digital tools are widely noted in the literature [51, 52], including user accessibility, learnability, navigation, con-trol and input, and data collection [40] and are amenable to the integration of emerging evidence and tools over time [53].”
BackgroundDavies, J. N., Colagiuri, B., Sharpe, L., & Day, M. A. (2023) · Pain · doi:10.1097/j.pain.0000000000002928 · Cited by 17
Kosasih, F. R., Yee, V. T. S., Toh, S. H. Y., & Sündermann, O. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000095 · Cited by 18
“However, comparisons against Active Control often yield significantly weaker and inconsistent results [21,30,32].”
ResultMacrynikola, N., Chen, K., Lane, E., Nguyen, N. S., Pinto, J., Yen, S., & Torous, J. B. (2024) · JMIR Mental Health · doi:10.2196/65222 · Cited by 22
“Despite demonstrating efficacy in reducing depression and anxiety in randomized controlled trials (RCTs) [11], many stand-alone mental health apps fail to sustain engagement after just 10 days in real-world settings [12].”
Self-citationGoldberg, S. B., Kendall, A. D., Hirshberg, M. J., Dahl, C. J., Nahum-Shani, I. B., Davidson, R. J., & Bray, B. C. (2024) · Clinical Psychological Science · doi:10.1177/21677026241266567 · Cited by 16
“It may be that some participants use a meditation app more because they are having difficulties and use a meditation app less when their difficulties cease (Goldberg, 2022).”
Self-citationDeveloping a Mobile App for Young Adults with Nonsuicidal Self-Injury: A Prototype Feedback Study
Kruzan, K. P., Reddy, M. C., Washburn, J. J., & Mohr, D. C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192316163 · Cited by 18
Kirvin-Quamme, A., Kissinger, J. A., Quinlan, L., Montgomery, R. M., Chernenok, M., Pirner, M., Pajarito, S., Rapoport, S., Wicks, P. J., Darcy, A. M., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-078029 · Cited by 19
“Second, a comprehensive and non-repetitive list of relevant keywords used inclusively in these studies (44) was used to develop the keyword search string for the preliminary search.”
MethodHäfner, J., Schönfeld, S., Tokgöz, P., Choroschun, K., Schlubach, A., & Dockweiler, C. (2022) · Healthcare · doi:10.3390/healthcare10102019 · Cited by 15
“However, DHIs might not be acceptable and suitable for all patients [7,9].”
BackgroundBowles, N. I., Davies, J. N., Strohmaier, S., Galante, J., & Van Dam, N. T. (2026) · Journal of Contemplative Studies · doi:10.57010/caxs3076 · Cited by 14
Hossain, A. T., Rahman, H., Manna, R. M., Akter, E., Islam, S. H., Hossain, M. A., Ara, T., Usmani, N. G., Chandra, P., Khan, M. H., et al. (2024) · JMIR Pediatrics and Parenting · doi:10.2196/65912 · Cited by 17
A path towards progress: lessons from the hard things about digital mental health
Torous, J. B. (2022) · World Psychiatry · doi:10.1002/wps.21003 · Cited by 15
Self-citationExpanding, improving, and understanding behaviour research and therapy through digital mental health
Cohen, Z. D., & Schueller, S. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104358 · Cited by 10
Drews‐Windeck, E., Greenwood, K., & Cavanagh, K. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23523 · Cited by 21
Riordan, K. M., Simonsson, O., Frye, C. J., Vack, N. J., Sachs, J., Fitch, D., Goldman, R. I., Chiang, E. S., Dahl, C. J., Davidson, R. J., et al. (2024) · Journal of Counseling Psychology · doi:10.1037/cou0000725 · Cited by 17
Self-citationLapão, L. V., Correia, J. C., & Jevtić, M. (2023) · Sustainability · doi:10.3390/su15054269 · Cited by 16
Rothman, B., Slomkowski, M., Speier, A., Rush, A. J., Trivedi, M. H., Lakhan, S. E., Lawson, E., Fahmy, M., Carpenter, D., Chen, D., et al. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119409 · Cited by 18
Therapeutic Content of Mobile Phone Applications for Substance Use Disorders: An Umbrella Review
Oesterle, T., Hall‐Flavin, D. K., Bormann, N. L., Loukianova, L. L., Fipps, D. C., Breitinger, S. A., Gilliam, W. P., Wu, T. E., da Costa, S. C., Arndt, S. V., et al. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.03.004 · Cited by 14
The impact of podcast-based interventions on mental health: A systematic scoping review
Carrotte, E. R., Hobern, B., Wu, A., Groot, C., Hopgood, F., Blanchard, M., & Phillips, L. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000272 · Cited by 17
“With the rise of the smartphone era, thousands of mental health-related smartphone applications have been released, with evidence supporting their effects on improving psychological symptoms and quality of life [2], as well as generally being perceived by users as acceptable and helpful [3].”
Bowles, N. I., Davies, J., Strohmaier, S., Galante, J., & Van Dam, N. T. (2023) · doi:10.31219/osf.io/zmwtp · Cited by 14
Digital mental health interventions as stand-alone vs. augmented treatment as usual
Nelson, B. W., Peiper, N. C., & Forman‐Hoffman, V. L. (2024) · BMC Public Health · doi:10.1186/s12889-024-18412-1 · Cited by 16
“The omission of stratifying patients by combination of treatment types when combined with a lack of large-scale randomized control trials (RCTs) with active controls has the potential to inflate treatment effects in observational studies [6].”
BackgroundRothman, B., Slomkowski, M., Speier, A., Rush, A. J., Trivedi, M. H., Lawson, E., Fahmy, M., Carpenter, D., Chen, D., & Forbes, A. (2024) · JMIR Research Protocols · doi:10.2196/56960 · Cited by 13
“Given these recent findings and the potential confounding factors when using a nondigital comparator for the control group (eg, waitlist or treatment as usual), a digital comparator is important for a more unbiased and accurate understanding of the effectiveness of a DTx [81-83].”
Naji, G. M. A., Yuan, F., Azzura, N., Danish, F. M., Ateeq, A. A., Ibrahim, S. B., Hakimi, H., Abdollah, A. B., & Iskandar, Y. H. P. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1606273 · Cited by 17
Castro, Ó., Salamanca-Sanabria, A., Alattas, A., Teepe, G. W., Leidenberger, K., Fleisch, E., Car, L. T., Müller‐Riemenschneider, F., & Kowatsch, T. (2024) · Archives of Public Health · doi:10.1186/s13690-024-01424-z · Cited by 11
“Several controlled trials of DHIDs conducted over the past twenty years have shown moderate to large effects for the prevention and treat-ment of depression [10, 17–20].”
BackgroundRuse, J. N., Schraube, E., & Rhodes, P. (2024) · Subjectivity · doi:10.1057/s41286-024-00195-w · Cited by 13
“Other meta-analyses suggest that these effect sizes diminish or disappear when smartphone interventions are compared with more rigorous control groups (Goldberg et al. 2022).”
Zuccolo, P. F., Brunoni, A. R., Borja, T., Matijasevich, A., Polanczyk, G. V., & Fatori, D. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000541311 · Cited by 11
“This decision was based on meta-analytic evidence suggesting app-based interventions for depression have a clinically signi fi cant effect only when compared to waitlist or nonspeci fi c controls [25, 26], while effect sizes can be partially explained by control group choice [9].”
Consumer-Grade Neurofeedback With Mindfulness Meditation: Meta-Analysis
Treves, I. N., Bajwa, Z., Greene, K. D., Bloom, P. A., Kim, N., Wool, E., Goldberg, S. B., Whitfield, S., & Auerbach, R. P. (2025) · Journal of Medical Internet Research · doi:10.2196/68204 · Cited by 18
“Briefly, app-based mindfulness programs, which involve progressing through a series of recorded meditations, can show many of the same benefits as traditional mindfulness [60,61], but with smaller effect sizes [62,63].”
Self-citationFunk, J., Kopf‐Beck, J., Watkins, E. R., & Ehring, T. W. (2023) · Trials · doi:10.1186/s13063-023-07295-z · Cited by 14
“As discussed in a recent metareview on mobile interventions ranging from commercial mediation apps to mobile interventions based on cognitive behavioral therapy [9], the content of the interventions might crucially contribute to whether or not they have an effect on mental health outcomes.”
BackgroundThe current evidence for substance use disorder apps
Manning, V., Whelan, D., & Piercy, H. (2022) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000800 · Cited by 11
Pedroso, I., Kumbhare, S. V., Joshi, B., Saravanan, S. K., Mongad, D., Singh-Rambiritch, S., Uday, T., Muthukumar, K., Irudayanathan, C., Reddy-Sinha, C., et al. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12081237 · Cited by 15
“Digital therapeutics have gained increased attention as a strategy to provide care to large numbers of individuals, and emerging evidence suggests its effectiveness for several chronic diseases [3,4].”
BackgroundChukka, A., Choudhary, S., Dutt, S., Bondre, A. P., Reddy, P. H., Tugnawat, D. K., Rozatkar, A. R., Mehta, U. M., Manjunatha, N., Keshavan, M. S., et al. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00309-2 · Cited by 12
Self-citationYiend, J., Taher, R., Fialho, C., Hampshire, C., Hsu, C.-W., Kabir, T., Keppens, J., McGuire, P. K., Mouchlianitis, E. D., PETERS, E. R., et al. (2024) · Trials · doi:10.1186/s13063-024-08570-3 · Cited by 7
Lenze, E. J., Torous, J. B., & Areán, P. A. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01664-7 · Cited by 12
“One important issue in digital interventions is the need for a proper control condition [82].”
BackgroundSelf-citationSocial-Media-Based Mental Health Interventions: Meta-Analysis of Randomized Controlled Trials
Zhang, Q., Huang, Z., Sui, Y., Lin, F.-H., Guan, H., Li, L., Wang, K., & Neitzel, A. J. (2025) · Journal of Medical Internet Research · doi:10.2196/67953 · Cited by 16
Forman‐Hoffman, V. L., Sihvonen, S., Wielgosz, J., Kuhn, E. R., Nelson, B. W., Peiper, N. C., & Gould, C. E. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.01.057 · Cited by 10
Sîrbu, V., David, D., Sánchez-López, Á., & Blanco, I. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.10.052 · Cited by 14
“…comprehensive review finding limited evidence for their efficacy (Goldberg et al., 2022), the initial highly suggestive evidence in reducing common psychological problems (Goldberg et al., 2022), coupled with the cost-effective potential of these modalities, further support their future research.”
InfluentialPozuelo, J. R., Nabulumba, C., Sikoti, D., Davis, M., Gumikiriza‐Onoria, J. L., Kinyanda, E., Moffett, B., van Heerden, A. C., O’Mahen, H., Craske, M. G., et al. (2024) · JMIR Serious Games · doi:10.2196/59381 · Cited by 10
Goldberg, S. B., Jiwani, Z., Bolt, D. M., Riordan, K. M., Davidson, R. J., & Hirshberg, M. J. (2023) · Clinical Psychological Science · doi:10.1177/21677026231184890 · Cited by 9
“However, engagement with these tools is often poor (Baumel et al., 2019; Linardon & Fuller-Tyszkiewicz, 2020) and effect sizes modest (Goldberg, Lam, et al., 2022).”
BackgroundInfluentialSelf-citationNajavits, L. M., Cha, E., Demce, M. G., Gupta, M., Haney, A. M., Logounov, G., Miket, A., Morency, M., & Schulhof, A. (2023) · Substance Use & Misuse · doi:10.1080/10826084.2023.2280540 · Cited by 10
“A recent meta-analysis of mental health electronic interventions (web-based and/or mobile apps) has found that experimental interventions typically fell short in comparison to a control (Goldberg et al., 2022), especially when control conditions were more rigorous.”
BackgroundXie, Q., Dyer, R. L., Lam, S. U., Frye, C. J., Dahl, C. J., Quanbeck, A., Nahum-Shani, I. B., Davidson, R. J., & Goldberg, S. B. (2024) · Mindfulness · doi:10.1007/s12671-024-02304-x · Cited by 11
“Meditation-based interventions (MedBIs) have the potential to improve psychological symptoms and enhance well-being (Galante et al., 2014; Goldberg et al., 2022b; Xie et al., 2022).”
Self-citationPostma, M. R., Vrancken, S., Daemen, M., der Meulen, I. H.-V., Volbragt, N., Delespaul, P., de Haan, L., van der Pluijm, M., Breedvelt, J., van der Gaag, M., et al. (2024) · BMC Public Health · doi:10.1186/s12889-024-19143-z · Cited by 11
“To enhance the field of EMI research an important challenge is the need for high-quality trials [25, 30, 31].”
BackgroundCastro, Ó., Mair, J. L., Zheng, S., Tan, S. Y. X., Jabir, A. I., Yan, X., Chakraborty, B., Tai, E. S., van Dam, R. M., von Wangenheim, F., et al. (2025) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.107833 · Cited by 6
Characteristics and Outcomes of mHealth Interventions in Psychosis: Systematic Mapping Review
Loh, P. Y., Martinengo, L., Heaukulani, C., Tan, X., Hng, M., Cheah, Y. Y., Morris, R. J. T., Car, L. T., & Lee, J. (2024) · Journal of Medical Internet Research · doi:10.2196/55924 · Cited by 10
“Such heterogeneity may directly impact subsequent evaluations of efficacy—for instance, Goldberg et al [12] noted that effect sizes of mHealth-based mental health interventions were smaller when compared with controls with therapeutic intent.”
Seery, C., Cochrane, R. H., Mulcahy, M., Kilbride, K., Wrigley, M., & Bramham, J. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100807 · Cited by 7
“Mental health apps can offer wide-reaching access to psychological support and are immediately downloadable (Goldberg et al., 2022), as well as offering the opportunity to address information gaps in ADHD (Price et al., 2019).”
Nelson, B. W., Forman‐Hoffman, V. L., & Peiper, N. C. (2023) · Archives of Suicide Research · doi:10.1080/13811118.2023.2262540 · Cited by 5
“…incorporating cognitive-behavioral therapy (CBT) and other evidence-based modalities (e.g., mindfulness, behavioral activation, stress reduction) are more effective than treatment as usual, waitlist controls, and attention controls in reducing common mental health symptoms (Goldberg et al., 2022).”
Moggia, D., Lutz, W., Kazantzis, N., Schwartz, B., & Bakker, D. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.05.014 · Cited by 9
Surveillance Capitalism in Mental Health: When Good Apps Go Rogue (and What Can Be Done about It)
Gross, N. R., & Mothersill, D. (2023) · Social Sciences · doi:10.3390/socsci12120679 · Cited by 8
The effect of cognitive behavioral therapy text messages on mood: A micro-randomized trial
Avalos, M. R. A., Xu, J., Figueroa, C. A., Haro‐Ramos, A. Y., Chakraborty, B., & Aguilera, A. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000449 · Cited by 10
Metadata
- Authors
- Goldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S.
- Affiliations
- University of Wisconsin–Madison (US)
- Beth Israel Deaconess Medical Center (US)
- Brown University (US)
- Corresponding author
- Goldberg, Simon B.
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-01-18
- Volume
- 1
- Issue
- 1
- Pages
- e0000002
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC8881800
- OpenAlex
- W4206302417
- Cited by
- 237
- References
- 73
- Citations by year
- 2026: 31 · 2025: 61 · 2024: 62 · 2023: 55 · 2022: 28
- FWCI
- 45.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- National Center for Complementary and Alternative Medicine (K23AT010879, K23AT011173)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- mobile phone intervention, smartphone-based intervention, text messaging intervention, mental health, psychological symptoms, quality of life, smoking cessation, intervention efficacy, publication bias, umbrella review, meta-review
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.