Current evidence on the efficacy of mental health smartphone apps for symptoms of depression and anxiety. A meta‐analysis of 176 randomized controlled trials
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
The mental health care available for depression and anxiety has recently undergone a major technological revolution, with growing interest towards the potential of smartphone apps as a scalable tool to treat these conditions. Since the last comprehensive meta‐analysis in 2019 established positive yet variable effects of apps on depressive and anxiety symptoms, more than 100 new randomized controlled trials (RCTs) have been carried out. We conducted an updated meta‐analysis with the objectives of providing more precise estimates of effects, quantifying generalizability from this evidence base, and understanding whether major app and trial characteristics moderate effect sizes. We included 176 RCTs that aimed to treat depressive or anxiety symptoms. Apps had overall significant although small effects on symptoms of depression (N=33,567, g=0.28, p<0.001; number needed to treat, NNT=11.5) and generalized anxiety (N=22,394, g=0.26, p<0.001, NNT=12.4) as compared to control groups. These effects were robust at different follow‐ups and after removing small sample and higher risk of bias trials. There was less variability in outcome scores at post‐test in app compared to control conditions (ratio of variance, RoV=–0.14, 95% CI: –0.24 to –0.05 for depressive symptoms; RoV=–0.21, 95% CI: –0.31 to –0.12 for generalized anxiety symptoms). Effect sizes for depression were significantly larger when apps incorporated cognitive behavioral therapy (CBT) features or included chatbot technology. Effect sizes for anxiety were significantly larger when trials had generalized anxiety as a primary target and administered a CBT app or an app with mood monitoring features. We found evidence of moderate effects of apps on social anxiety (g=0.52) and obsessive‐compulsive (g=0.51) symptoms, a small effect on post‐traumatic stress symptoms (g=0.12), a large effect on acrophobia symptoms (g=0.90), and a non‐significant negative effect on panic symptoms (g=–0.12), although these results should be considered with caution, because most trials had high risk of bias and were based on small sample sizes. We conclude that apps have overall small but significant effects on symptoms of depression and generalized anxiety, and that specific features of apps – such as CBT or mood monitoring features and chatbot technology – are associated with larger effect sizes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Santomauro, D. F., Mantilla Herrera, A. M., Shadid, J., Zheng, P., Ashbaugh, C., Pigott, D. M., Abbafati, C., Adolph, C., Amlag, J. O., Aravkin, A. Y., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)02143-7 · Cited by 5,444
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541
The number needed to treat: a clinically useful measure of treatment effect
Cook, R. J., & Sackett, D. L. (1995) · BMJ · doi:10.1136/bmj.310.6977.452 · Cited by 1,885 · cited 1×
“NNT indicates the number of additional participants in the intervention group who would need to be treated in order to observe one participant who shows positive symptom change relative to the control group 34 .”
BackgroundDoing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021) · doi:10.1201/9781003107347 · Cited by 1,850
Self-citationLiu, Q., He, H., Yang, J., Feng, X., Zhao, F., & Lyu, J. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.08.002 · Cited by 1,452
Health App Use Among US Mobile Phone Owners: A National Survey
Krebs, P., & Duncan, D. T. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4924 · Cited by 1,274 · cited 1×
“All this, coupled with the fact that mental health apps for depression and anxiety are some of the most widely publicly offered and down-loaded categories of health apps 19,20 , generates the duty to provide the public with up-to-date information on the evidence base supporting their use 21 .”
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · cited 2×
“However, there are many barriers that prevent people from accessing these traditional forms of treatment, including limited availability of trained psychiatrists and psychologists, high cost of treatment, stigma associated with help-seeking, and low mental health literacy 8,9 .”
BackgroundSelf-citationFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Self-citationTorous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946
Self-citationLinardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860
Self-citationFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“Each of these elements had been raised as critical features absent in this field according to the conclusions drawn by the authors of earlier meta-analyses 13,21,23 .”
MethodSelf-citationInternet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595 · cited 1×
“Empirically validated components of psychological interventions that were once delivered solely in-person have now been translated for delivery via low-cost, private and scalable digital tools 10,11 .”
MethodLinardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573
Self-citationWhy Cognitive Behavioral Therapy Is the Current Gold Standard of Psychotherapy
David, D., Cristea, I., & Hofmann, S. G. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00004 · Cited by 565 · cited 1×
“This finding is not surprising, given that the evidence base for all forms of CBT in depression and anxiety is substantially larger than for other approaches 46 .”
ResultTorous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Self-citationCuijpers, P., Sijbrandij, M., Koole, S. L., Andersson, G., Beekman, A. T., & Reynolds, C. F. (2013) · World Psychiatry · doi:10.1002/wps.20038 · Cited by 540 · cited 1×
“Both psychotherapies and pharmacotherapies can effectively treat symptoms of depression and anxiety 3-7 .”
BackgroundSelf-citationCuijpers, P., Miguel, C., Harrer, M., Plessen, C. Y., Ciharova, M., Ebert, D., & Karyotaki, E. (2023) · World Psychiatry · doi:10.1002/wps.21069 · Cited by 354
Self-citationBower, P., Kontopantelis, E., Sutton, A., Kendrick, T., Richards, D. A., Gilbody, S., Knowles, S., Cuijpers, P., Andersson, G., Christensen, H., et al. (2013) · BMJ · doi:10.1136/bmj.f540 · Cited by 341
Self-citationUsing science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334 · cited 1×
“…with depression and anxiety apps, such as privacy violations; possible easy access to ineffective, inaccurate or potentially harmful content 15,16 ; low rates of engagement 17,18 , and exclusion of the potential therapeutic ingredient represented by the personal relationship between a…”
BackgroundSelf-citationStepped care treatment delivery for depression: a systematic review and meta-analysis
van Straten, A., Hill, J., Richards, D. A., & Cuijpers, P. (2015) · Psychological Medicine · doi:10.1017/s0033291714000701 · Cited by 288 · cited 1×
“This finding aligns with prior meta-analytic evidence that higher baseline severity is associated with better outcomes of digital interventions 43,44 , suggesting that people with moderate to severe depression or anxiety at baseline benefit more from care augmented by these apps 45 .”
ResultSelf-citationInterpersonal Psychotherapy for Mental Health Problems: A Comprehensive Meta-Analysis
Cuijpers, P., Donker, T., Weissman, M. M., Ravitz, P., & Cristea, I. A. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15091141 · Cited by 283
Self-citationHedman‐Lagerlöf, E., Carlbring, P., Svärdman, F., Riper, H., Cuijpers, P., & Andersson, G. (2023) · World Psychiatry · doi:10.1002/wps.21088 · Cited by 259 · cited 1×
“Empirically validated components of psychological interventions that were once delivered solely in-person have now been translated for delivery via low-cost, private and scalable digital tools 10,11 .”
MethodSelf-citationGoldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237 · cited 2×
“…complex machine learning algorithms also enable treatment content to be regularly updated and personalized to the needs of the user based on data collected passively (e.g., global positioning system coordinates to infer social determinants of health) and actively (e.g., symptom tracking) 13,14 .”
BackgroundSelf-citationLinardon, J., Shatte, A., Messer, M., Firth, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000575 · Cited by 218
Self-citationHe, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213 · cited 1×
“It is possible that these innovative technological features offer a greater degree of personalization, are more engaging, foster emotional self-awareness, and keep users more accountable for making progress 47,48 , potentially resulting in greater benefit.”
BackgroundThe digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200
Self-citationChrist, C., Schouten, M. J., Blankers, M., van Schaik, D. J., Beekman, A. T., Wisman, M. A., Stikkelbroek, Y. A., & Dekker, J. J. (2020) · Journal of Medical Internet Research · doi:10.2196/17831 · Cited by 148
Linardon, J. (2020) · Behavior Therapy · doi:10.1016/j.beth.2019.10.002 · Cited by 133
Self-citationSmartphone App to Address Loneliness Among College Students: Pilot Randomized Controlled Trial
Bruehlman-Senecal, E., Hook, C. J., Pfeifer, J. H., FitzGerald, C., Davis, B., Delucchi, K. L., Haritatos, J., & Ramo, D. E. (2020) · JMIR Mental Health · doi:10.2196/21496 · Cited by 80
Michopoulos, I., Furukawa, T. A., Noma, H., Kishimoto, S., Onishi, A., Ostinelli, E. G., Ciharova, M., Miguel, C., Karyotaki, E., & Cuijpers, P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.012 · Cited by 69
Self-citationTorous, J., Myrick, K., & Aguilera, A. (2023) · World Psychiatry · doi:10.1002/wps.21058 · Cited by 64 · cited 1×
“…and anxiety apps, such as privacy violations; possible easy access to ineffective, inaccurate or potentially harmful content 15,16 ; low rates of engagement 17,18 , and exclusion of the potential therapeutic ingredient represented by the personal relationship between a clinician and a patient.”
BackgroundSelf-citation
Research works printed but not linked: 17
- 10.1080/16506073.2018.1560358 · DOI · Paper page
- Poushter J., 2016, Smartphone ownership and internet usage continues to climb in emerging economies, Pew Research Center, 22, 1
- 10.1016/j.jad.2020.05.011 · DOI · Paper page
- 10.1001/jamanetworkopen.2022.48784 · DOI
- 10.1017/S2045796021000664 · DOI · Paper page
- 10.1097/EDE.0000000000001401 · DOI · Paper page
- 10.1371/journal.pbio.3001009 · DOI
- 10.1111/bmsp.12088 · DOI
- 10.7326/0003-4819-151-4-200908180-00135 · DOI · Paper page
- 10.1002/9780470743386 · DOI · Paper page
- Hedges LV, 1985, Statistical methods for meta‐analysis
- 10.1037/0033-2909.112.1.155 · doi:10.1037/0033-2909.112.1.155 · Paper page
- 10.1111/j.0006-341X.2000.00455.x · DOI · Paper page
- 10.1002/sim.1186 · DOI · Paper page
- 10.1002/jrsm.1334 · DOI
- 10.1001/jamapsychiatry.2023.1291 · DOI
- 10.1111/acps.13335 · DOI · Paper page
Cited by
Torous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
Self-citationSystematic review and meta-analysis of adverse events in clinical trials of mental health apps
Linardon, J., Fuller-Tyszkiewicz, M., Firth, J., Goldberg, S. B., Anderson, C., McClure, Z., & Torous, J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01388-y · Cited by 44
Self-citationZuccolo, P. F., Brunoni, A. R., Borja, T., Matijasevich, A., Polanczyk, G. V., & Fatori, D. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000541311 · Cited by 11
Miller, R. K., O'Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P., Li, S., Black, M., Kampel, L., Cockayne, N., et al. (2025) · JMIR Human Factors · doi:10.2196/68789 · Cited by 3
“Early evidence suggests that mobile DMHIs could also be used to effectively treat depression and anxiety, albeit with smaller effect sizes than digital CBT delivered via the internet or computer software [19].”
Kikas, K., O'Moore, K., Miller, R. K., Matheson, J.-A. T., Li, S., Varghese, K., Baldwin, P., Cockayne, N., Whitton, A. E., & Newby, J. M. (2025) · JMIR Human Factors · doi:10.2196/69499 · Cited by 3
“…internet-delivered DMHIs (ie, delivered on websites), smartphone apps targeting depressive and anxiety symptoms have also shown positive results, with small to medium pooled effect sizes for anxiety (Hedges g =0.26; 95% CI 0.21-0.31) and depression (Hedges g =0.50; 95% CI 0.40-0.61) [17,18].”
Influential
Metadata
- Authors
- Linardon, J., Torous, J., Firth, J., Cuijpers, P., Messer, M., & Fuller‐Tyszkiewicz, M.
- Venue
- World Psychiatry
- Publisher
- Wiley
- Published
- 2024-01-12
- Volume
- 23
- Issue
- 1
- Pages
- 139-149
- ISSN
- 1723-8617 (ISSN-L)
- 2051-5545
- OpenAlex
- W4390793875
- Cited by
- 207
- References
- 32
- FWCI
- 74.82
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.