CoChat

Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems

Open access
Kählke, Fanny, Buntrock, Claudia, Smit, Filip, Ebert, David Daniel · 2022 · npj Digital Medicine
Cited by 61

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Abstract

In view of the staggering disease and economic burden of mental disorders, internet and mobile-based interventions (IMIs) targeting mental disorders have often been touted to be cost-effective; however, available evidence is inconclusive and outdated. This review aimed to provide an overview of the cost-effectiveness of IMIs for mental disorders and symptoms. A systematic search was conducted for trial-based economic evaluations published before 10th May 2021. Electronic databases (including MEDLINE, PsycINFO, CENTRAL, PSYNDEX, and NHS Economic Evaluations Database) were searched for randomized controlled trials examining IMIs targeting mental disorders and symptoms and conducting a full health economic evaluation. Methodological quality and risk of bias were assessed. Cost-effectiveness was assumed at or below £30,000 per quality-adjusted life year gained. Of the 4044 studies, 36 economic evaluations were reviewed. Guided IMIs were likely to be cost-effective in depression and anxiety. The quality of most evaluations was good, albeit with some risks of bias. Heterogeneity across studies was high because of factors such as different costing methods, design, comparison groups, and outcomes used. IMIs for anxiety and depression have potential to be cost-effective. However, more research is needed into unguided (preventive) IMIs with active control conditions (e.g., treatment as usual) and longer time horizon across a wider range of disorders. Trial registration: PROSPERO Registration No. CRD42018093808.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-022-00702-w

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 43 references

Research works printed but not linked: 42

  1. Mack, S. et al. Functional disability and quality of life decrements in mental disorders: results from the Mental Health Module of the German Health Interview and Examination Survey for Adults (DEGS1-MH). Eur. Psychiatry 30, 793–800 (2015). · DOI
  2. Scott, K. M. et al. Association of mental disorders with subsequent chronic physical conditions. JAMA Psychiatry 73, 150–158 (2016). · DOI · Paper page
  3. Griffiths, F., Lindenmeyer, A., Powell, J., Lowe, P. & Thorogood, M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J. Med. Internet Res. 8, 1–16 (2006).
  4. Rosenbaum, S., Newby, J. M., Steel, Z., Andrews, G. & Ward, P. B. Online physical activity interventions for mental disorders: a systematic review. Internet Inter. 2, 214–220 (2015). · DOI · Paper page
  5. Gomes, M., Murray, E. & Raftery, J. Economic evaluation of digital health interventions: methodological issues and recommendations for practice. Pharmacoeconomics 40, 367–378 (2022). · DOI
  6. Ophuis, R. R. H. et al. Cost-effectiveness of interventions for treating anxiety disorders: a systematic review. J. Affect. Disord. 210, 1–13 (2017). · DOI
  7. Conejo-Cerón, S. et al. Health-economic evaluation of psychological interventions for depression prevention: systematic review. Clin. Psychol. Rev. 88, 102064 (2021). · DOI
  8. Karyotaki, E., Tordrup, D., Buntrock, C., Bertollini, R. & Cuijpers, P. Economic evidence for the clinical management of major depressive disorder: a systematic review and quality appraisal of economic evaluations alongside randomised controlled trials. Epidemiol. Psychiatr. Sci. 26, 501–516 (2017). · DOI
  9. Drummond, M., Sculpher, M. J., Claxton, K., Stoddart, G. L. & Torrance, G. W. Methods for the Economic Evaluation of Health Care Programmes (Oxford University Press, 2015).
  10. Ebert, D. D. et al. A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand. J. Work. Environ. Health 44, 171–182 (2018).
  11. Kählke, F. et al. Economic evaluation of an internet-based stress management intervention alongside a randomized controlled trial. JMIR Ment. Heal. 6, 1–13 (2019).
  12. Buntrock, C. et al. Guided internet-based cognitive behavioral therapy for insomnia: health-economic evaluation from the societal and public health care perspective alongside a randomized controlled trial. J. Med. Internet Res. 23, 1–15 (2021). · DOI
  13. Thiart, H. et al. Internet-based cognitive behavioral therapy for insomnia: a health economic evaluation. Sleep 39, 1769–1778 (2016). · DOI · Paper page
  14. El Alaoui, S., Hedman-Lagerlof, E., Ljotsson, B. & Lindefors, N. Does internet-based cognitive behaviour therapy reduce healthcare costs and resource use in treatment of social anxiety disorder? A cost-minimisation analysis conducted alongside a randomised controlled trial. BMJ Open 7, 1–9 (2017). · DOI
  15. Brabyn, S. et al. The second Randomised Evaluation of the Effectiveness, cost-effectiveness and Acceptability of Computerised Therapy (REEACT-2) trial: does the provision of telephone support enhance the effectiveness of computer-delivered cognitive behaviour therapy? A randomised controlled trial. Health Technol. Assess. 20, 1–64 (2016). · DOI · Paper page
  16. Littlewood, E. et al. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Health Technol. Assess. 19, xxi–171 (2015). · DOI · Paper page
  17. Rantz, M. et al. Randomized trial of intelligent sensor system for early illness alerts in senior housing. J. Am. Med. Dir. Assoc. 18, 860–870 (2017). · DOI
  18. Buntrock, C. et al. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention corresponding author. J. Med. Internet Res. 19, 1–16 (2017). · DOI · Paper page
  19. Klein, N. S. et al. Economic evaluation of an internet-based preventive cognitive therapy with minimal therapist support for recurrent depression: randomized controlled trial. J. Med. Internet Res. 20, 1–14 (2018). · DOI · Paper page
  20. Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977). · DOI · Paper page
  21. Bolier, L. et al. Cost-effectiveness of online positive psychology: randomized controlled trial. J. Posit. Psychol. 9, 460–471 (2014). · DOI · Paper page
  22. Yan, C., Rittenbach, K., Souri, S. & Silverstone, P. H. Cost-effectiveness analysis of a randomized study of depression treatment options in primary care suggests stepped-care treatment may have economic benefits. BMC Psychiatry 19, 1–13 (2019). · DOI
  23. Geraedts, A. S. et al. Economic evaluation of a web-based guided self-help intervention for employees with depressive symptoms: results of a randomized controlled trial. J. Occup. Environ. Med. 57, 666–675 (2015). · DOI · Paper page
  24. van Luenen, S., Kraaij, V., Garnefski, N., Spinhoven, P. & van den Akker-van Marle, M. E. Cost-utility of a guided Internet-based intervention in comparison with attention only for people with HIV and depressive symptoms: a randomized controlled trial. J. Psychosom. Res. 118, 34–40 (2019). · DOI
  25. Powell, J. et al. Effectiveness and cost-effectiveness of a self-guided internet intervention for social anxiety symptoms in a general population sample: randomized controlled trial. J. Med. Internet Res. 22, e16804 (2020). · DOI · Paper page
  26. Andersson, E. et al. Cost-effectiveness of internet-based cognitive behavior therapy for obsessive-compulsive disorder: results from a randomized controlled trial. J. Obsessive. Compuls. Relat. Disord. 4, 47–53 (2015). · DOI
  27. Andersson, E. et al. Cost-effectiveness of an internet-based booster program for patients with obsessive-compulsive disorder: results from a randomized controlled trial (Provisional abstract). J. Obsessive. Compuls. Relat. Disord. 4, 14–19 (2015). · DOI
  28. Lenhard, F. et al. Cost-effectiveness of therapist-guided internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: results from a randomised controlled trial. BMJ Open 7, e015246 (2017). · DOI · Paper page
  29. Lovell, K. et al. Clinical effectiveness, cost-effectiveness and acceptability of low-intensity interventions in the management of obsessive-compulsive disorder: the Obsessive-Compulsive Treatment Efficacy randomised controlled Trial (OCTET). Health Technol. Assess. 21, 1–132 (2017). · DOI · Paper page
  30. De Bruin, E. J. et al. Cost-effectiveness of group and internet cognitive behavioral therapy for insomnia in adolescents: results from a randomized controlled trial. Sleep 39, 1571–1581 (2016). · DOI · Paper page
  31. Lindsäter, E. et al. Cost-effectiveness of therapist-guided internet-based cognitive behavioral therapy for stress-related disorders: secondary analysis of a randomized controlled trial. J. Med. Internet Res. 21, e14675 (2019). · DOI · Paper page
  32. Ebert, D. D. et al. A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand. J. Work. Environ. Heal. 44, 171–182 (2018). · DOI · Paper page
  33. van Spijker, B. A. J. et al. Reducing suicidal ideation: cost-effectiveness analysis of a randomized controlled trial of unguided web-based self-help. J. Med. Internet Res. 14, e141 (2012). · DOI · Paper page
  34. McDougall, J. A., Furnback, W. E., Wang, B. C. M. & Mahlich, J. Understanding the global measurement of willingness to pay in health. J. Mark. Access Heal. Policy 8, 1717030 (2020). · DOI · Paper page
  35. Shiroiwa, T. et al. International survey on willingness-to-pay (WTP) for one additional QALY gained: what is the threshold of cost effectiveness? Health Econ. 19, 422–437 (2010). · DOI · Paper page
  36. Kan, K. et al. More than cost-effectiveness? Applying a second-stage filter to improve policy decision making. Heal. Expect. 24, 1413–1423 (2021). · DOI
  37. Fenwick, E., O’Brien, B. & Briggs, A. Cost-effectiveness acceptability curves: facts, fallacies and frequently asked questions. Health Econ. 13, 405–415 (2004). · DOI · Paper page
  38. Gerlinger, G., Mangiapane, N. & Sander, J. Digital health applications (DiGA) in medical and psychotherapeutic care. Opportunities and challenges from the perspective of the healthcare providers. Bundesgesundheitsblatt Gesundheitsforsch Gesundheitsschutz 64, 1213–1219 (2021). · DOI
  39. Husereau, D. et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Eur. J. Heal. Econ. 14, 367–372 (2013). · DOI · Paper page
  40. Thielen, F. W. et al. How to prepare a systematic review of economic evaluations for clinical practice guidelines: database selection and search strategy development (part 2/3). Expert Rev. Pharmacoecon. Outcomes Res. 16, 705–721 (2016). · DOI · Paper page
  41. van Mastrigt, G. A. P. G. et al. How to prepare a systematic review of economic evaluations for informing evidence-based healthcare decisions: a five-step approach (part 1/3). Expert Rev. Pharmacoecon. Outcomes Res 16, 689–704 (2016). · DOI · Paper page
  42. McCabe, C., Claxton, K. & Culyer, A. J. The NICE cost-effectiveness threshold: what it is and what that means. Pharmacoeconomics 26, 733–744 (2008). · DOI · Paper page

Cited by

See all 61

Metadata

Authors
Kählke, F., Buntrock, C., Smit, F., & Ebert, D. D.
Venue
npj Digital Medicine
Published
2022-11-23
Volume
5
Issue
1
Pages
175-175
ISSN
2398-6352 (ISSN-L)
OpenAlex
W4309912649
Cited by
61
References
43
FWCI
2.44
Type
journal article
Language
en
Open access
gold
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems. https://app.cochat.ai/papers/10.1038/s41746-022-00702-w
The paper
Kählke, F., Buntrock, C., Smit, F., & Ebert, D. D. (2022). Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems. npj Digital Medicine. https://doi.org/10.1038/s41746-022-00702-w

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.