Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
In view of the staggering disease and economic burden of mental disorders, internet and mobile-based interventions (IMIs) targeting mental disorders have often been touted to be cost-effective; however, available evidence is inconclusive and outdated. This review aimed to provide an overview of the cost-effectiveness of IMIs for mental disorders and symptoms. A systematic search was conducted for trial-based economic evaluations published before 10th May 2021. Electronic databases (including MEDLINE, PsycINFO, CENTRAL, PSYNDEX, and NHS Economic Evaluations Database) were searched for randomized controlled trials examining IMIs targeting mental disorders and symptoms and conducting a full health economic evaluation. Methodological quality and risk of bias were assessed. Cost-effectiveness was assumed at or below £30,000 per quality-adjusted life year gained. Of the 4044 studies, 36 economic evaluations were reviewed. Guided IMIs were likely to be cost-effective in depression and anxiety. The quality of most evaluations was good, albeit with some risks of bias. Heterogeneity across studies was high because of factors such as different costing methods, design, comparison groups, and outcomes used. IMIs for anxiety and depression have potential to be cost-effective. However, more research is needed into unguided (preventive) IMIs with active control conditions (e.g., treatment as usual) and longer time horizon across a wider range of disorders. Trial registration: PROSPERO Registration No. CRD42018093808.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846
Estimating the true global burden of mental illness
Vigo, D., Thornicroft, G., & Atun, R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00505-2 · Cited by 2,494
Kassebaum, N. J., Arora, M., Barber, R. M., Bhutta, Z. A., Brown, J., Carter, A., Casey, D. C., Charlson, F. J., Coates, M. M., Coggeshall, M., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31460-x · Cited by 2,163
The global burden of mental disorders: An update from the WHO World Mental Health (WMH) surveys
Kessler, R. C., Aguilar-Gaxiola, S., Alonso, J., Chatterji, S., Lee, S., Ormel, J., Üstün, T. B., & Wang, P. S. (2009) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00001421 · Cited by 1,895
Cost of disorders of the brain in Europe 2010
Gustavsson, A., Svensson, M., Jacobi, F., Allgulander, C., Alonso, J., Beghi, E., Dodel, R., Ekman, M., Faravelli, C., Fratiglioni, L., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.08.008 · Cited by 1,723
Barriers to mental health treatment: results from the WHO World Mental Health surveys
Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., de Graaf, R., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291713001943 · Cited by 1,289
Sleep and mental disorders: a meta-analysis of polysomnographic research
Baglioni, C., Nanovska, S., Regen, W., Spiegelhalder, K., Feige, B., Nissen, C., Reynolds, C. F., & Riemann, D. (2016) · Psychological Bulletin · doi:10.1037/bul0000053 · Cited by 1,074
Research works printed but not linked: 42
- Mack, S. et al. Functional disability and quality of life decrements in mental disorders: results from the Mental Health Module of the German Health Interview and Examination Survey for Adults (DEGS1-MH). Eur. Psychiatry 30, 793–800 (2015). · DOI
- Scott, K. M. et al. Association of mental disorders with subsequent chronic physical conditions. JAMA Psychiatry 73, 150–158 (2016). · DOI · Paper page
- Griffiths, F., Lindenmeyer, A., Powell, J., Lowe, P. & Thorogood, M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J. Med. Internet Res. 8, 1–16 (2006).
- Rosenbaum, S., Newby, J. M., Steel, Z., Andrews, G. & Ward, P. B. Online physical activity interventions for mental disorders: a systematic review. Internet Inter. 2, 214–220 (2015). · DOI · Paper page
- Gomes, M., Murray, E. & Raftery, J. Economic evaluation of digital health interventions: methodological issues and recommendations for practice. Pharmacoeconomics 40, 367–378 (2022). · DOI
- Ophuis, R. R. H. et al. Cost-effectiveness of interventions for treating anxiety disorders: a systematic review. J. Affect. Disord. 210, 1–13 (2017). · DOI
- Conejo-Cerón, S. et al. Health-economic evaluation of psychological interventions for depression prevention: systematic review. Clin. Psychol. Rev. 88, 102064 (2021). · DOI
- Karyotaki, E., Tordrup, D., Buntrock, C., Bertollini, R. & Cuijpers, P. Economic evidence for the clinical management of major depressive disorder: a systematic review and quality appraisal of economic evaluations alongside randomised controlled trials. Epidemiol. Psychiatr. Sci. 26, 501–516 (2017). · DOI
- Drummond, M., Sculpher, M. J., Claxton, K., Stoddart, G. L. & Torrance, G. W. Methods for the Economic Evaluation of Health Care Programmes (Oxford University Press, 2015).
- Ebert, D. D. et al. A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand. J. Work. Environ. Health 44, 171–182 (2018).
- Kählke, F. et al. Economic evaluation of an internet-based stress management intervention alongside a randomized controlled trial. JMIR Ment. Heal. 6, 1–13 (2019).
- Buntrock, C. et al. Guided internet-based cognitive behavioral therapy for insomnia: health-economic evaluation from the societal and public health care perspective alongside a randomized controlled trial. J. Med. Internet Res. 23, 1–15 (2021). · DOI
- Thiart, H. et al. Internet-based cognitive behavioral therapy for insomnia: a health economic evaluation. Sleep 39, 1769–1778 (2016). · DOI · Paper page
- El Alaoui, S., Hedman-Lagerlof, E., Ljotsson, B. & Lindefors, N. Does internet-based cognitive behaviour therapy reduce healthcare costs and resource use in treatment of social anxiety disorder? A cost-minimisation analysis conducted alongside a randomised controlled trial. BMJ Open 7, 1–9 (2017). · DOI
- Brabyn, S. et al. The second Randomised Evaluation of the Effectiveness, cost-effectiveness and Acceptability of Computerised Therapy (REEACT-2) trial: does the provision of telephone support enhance the effectiveness of computer-delivered cognitive behaviour therapy? A randomised controlled trial. Health Technol. Assess. 20, 1–64 (2016). · DOI · Paper page
- Littlewood, E. et al. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Health Technol. Assess. 19, xxi–171 (2015). · DOI · Paper page
- Rantz, M. et al. Randomized trial of intelligent sensor system for early illness alerts in senior housing. J. Am. Med. Dir. Assoc. 18, 860–870 (2017). · DOI
- Buntrock, C. et al. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention corresponding author. J. Med. Internet Res. 19, 1–16 (2017). · DOI · Paper page
- Klein, N. S. et al. Economic evaluation of an internet-based preventive cognitive therapy with minimal therapist support for recurrent depression: randomized controlled trial. J. Med. Internet Res. 20, 1–14 (2018). · DOI · Paper page
- Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977). · DOI · Paper page
- Bolier, L. et al. Cost-effectiveness of online positive psychology: randomized controlled trial. J. Posit. Psychol. 9, 460–471 (2014). · DOI · Paper page
- Yan, C., Rittenbach, K., Souri, S. & Silverstone, P. H. Cost-effectiveness analysis of a randomized study of depression treatment options in primary care suggests stepped-care treatment may have economic benefits. BMC Psychiatry 19, 1–13 (2019). · DOI
- Geraedts, A. S. et al. Economic evaluation of a web-based guided self-help intervention for employees with depressive symptoms: results of a randomized controlled trial. J. Occup. Environ. Med. 57, 666–675 (2015). · DOI · Paper page
- van Luenen, S., Kraaij, V., Garnefski, N., Spinhoven, P. & van den Akker-van Marle, M. E. Cost-utility of a guided Internet-based intervention in comparison with attention only for people with HIV and depressive symptoms: a randomized controlled trial. J. Psychosom. Res. 118, 34–40 (2019). · DOI
- Powell, J. et al. Effectiveness and cost-effectiveness of a self-guided internet intervention for social anxiety symptoms in a general population sample: randomized controlled trial. J. Med. Internet Res. 22, e16804 (2020). · DOI · Paper page
- Andersson, E. et al. Cost-effectiveness of internet-based cognitive behavior therapy for obsessive-compulsive disorder: results from a randomized controlled trial. J. Obsessive. Compuls. Relat. Disord. 4, 47–53 (2015). · DOI
- Andersson, E. et al. Cost-effectiveness of an internet-based booster program for patients with obsessive-compulsive disorder: results from a randomized controlled trial (Provisional abstract). J. Obsessive. Compuls. Relat. Disord. 4, 14–19 (2015). · DOI
- Lenhard, F. et al. Cost-effectiveness of therapist-guided internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: results from a randomised controlled trial. BMJ Open 7, e015246 (2017). · DOI · Paper page
- Lovell, K. et al. Clinical effectiveness, cost-effectiveness and acceptability of low-intensity interventions in the management of obsessive-compulsive disorder: the Obsessive-Compulsive Treatment Efficacy randomised controlled Trial (OCTET). Health Technol. Assess. 21, 1–132 (2017). · DOI · Paper page
- De Bruin, E. J. et al. Cost-effectiveness of group and internet cognitive behavioral therapy for insomnia in adolescents: results from a randomized controlled trial. Sleep 39, 1571–1581 (2016). · DOI · Paper page
- Lindsäter, E. et al. Cost-effectiveness of therapist-guided internet-based cognitive behavioral therapy for stress-related disorders: secondary analysis of a randomized controlled trial. J. Med. Internet Res. 21, e14675 (2019). · DOI · Paper page
- Ebert, D. D. et al. A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand. J. Work. Environ. Heal. 44, 171–182 (2018). · DOI · Paper page
- van Spijker, B. A. J. et al. Reducing suicidal ideation: cost-effectiveness analysis of a randomized controlled trial of unguided web-based self-help. J. Med. Internet Res. 14, e141 (2012). · DOI · Paper page
- McDougall, J. A., Furnback, W. E., Wang, B. C. M. & Mahlich, J. Understanding the global measurement of willingness to pay in health. J. Mark. Access Heal. Policy 8, 1717030 (2020). · DOI · Paper page
- Shiroiwa, T. et al. International survey on willingness-to-pay (WTP) for one additional QALY gained: what is the threshold of cost effectiveness? Health Econ. 19, 422–437 (2010). · DOI · Paper page
- Kan, K. et al. More than cost-effectiveness? Applying a second-stage filter to improve policy decision making. Heal. Expect. 24, 1413–1423 (2021). · DOI
- Fenwick, E., O’Brien, B. & Briggs, A. Cost-effectiveness acceptability curves: facts, fallacies and frequently asked questions. Health Econ. 13, 405–415 (2004). · DOI · Paper page
- Gerlinger, G., Mangiapane, N. & Sander, J. Digital health applications (DiGA) in medical and psychotherapeutic care. Opportunities and challenges from the perspective of the healthcare providers. Bundesgesundheitsblatt Gesundheitsforsch Gesundheitsschutz 64, 1213–1219 (2021). · DOI
- Husereau, D. et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Eur. J. Heal. Econ. 14, 367–372 (2013). · DOI · Paper page
- Thielen, F. W. et al. How to prepare a systematic review of economic evaluations for clinical practice guidelines: database selection and search strategy development (part 2/3). Expert Rev. Pharmacoecon. Outcomes Res. 16, 705–721 (2016). · DOI · Paper page
- van Mastrigt, G. A. P. G. et al. How to prepare a systematic review of economic evaluations for informing evidence-based healthcare decisions: a five-step approach (part 1/3). Expert Rev. Pharmacoecon. Outcomes Res 16, 689–704 (2016). · DOI · Paper page
- McCabe, C., Claxton, K. & Culyer, A. J. The NICE cost-effectiveness threshold: what it is and what that means. Pharmacoeconomics 26, 733–744 (2008). · DOI · Paper page
Cited by
Catarino, A., Harper, S., Malcolm, R., Stainthorpe, A., Warren, G., Margoum, M., Hooper, J., Blackwell, A. D., & Welchman, A. E. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00106-z · Cited by 36
Kählke, F., Hasking, P., Küchler, A.-M., & Baumeister, H. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1284661 · Cited by 18
“…of mental disorders (69) and mental health promotion (64) and prevention (66); they are low-threshold, can reach students (with mental disorders, no intention of seeking help, and no treatment experience) who would otherwise not receive care, and have the potential to be cost-effective (68).”
Self-citationKikas, K., O'Moore, K., Miller, R. K., Matheson, J.-A. T., Li, S., Varghese, K., Baldwin, P., Cockayne, N., Whitton, A. E., & Newby, J. M. (2025) · JMIR Human Factors · doi:10.2196/69499 · Cited by 3
“…of adults with lived and living experience by including relevant therapeutic content and sustaining their interest with appealing design features and functionality, especially given that user engagement is associated with better treatment outcomes [15,53] and more cost-effective treatment [54,55].”
Metadata
- Authors
- Kählke, F., Buntrock, C., Smit, F., & Ebert, D. D.
- Venue
- npj Digital Medicine
- Published
- 2022-11-23
- Volume
- 5
- Issue
- 1
- Pages
- 175-175
- ISSN
- 2398-6352 (ISSN-L)
- OpenAlex
- W4309912649
- Cited by
- 61
- References
- 43
- FWCI
- 2.44
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems. https://app.cochat.ai/papers/10.1038/s41746-022-00702-w
- The paper
- Kählke, F., Buntrock, C., Smit, F., & Ebert, D. D. (2022). Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems. npj Digital Medicine. https://doi.org/10.1038/s41746-022-00702-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.