CoChat

Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews

Open access
Barnett, Phoebe, Goulding, Lucy, Casetta, Cecilia, Jordan, Harriet, Sheridan-Rains, Luke, Steare, Thomas, Williams, Julie, Wood, Lisa, Gaughran, Fiona, Johnson, Sonia · 2021 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 285 of the 285 references it cites were found in a registry or an index; 43 of the 151 sources its claims cite were checked for support.

Abstract

Background: Telemental health care has been rapidly adopted for maintaining services during the COVID-19 pandemic, and a substantial interest is now being devoted in its future role. Service planning and policy making for recovery from the pandemic and beyond should draw on both COVID-19 experiences and the substantial research evidence accumulated before this pandemic. Objective: We aim to conduct an umbrella review of systematic reviews available on the literature and evidence-based guidance on telemental health, including both qualitative and quantitative literature. Methods: Three databases were searched between January 2010 and August 2020 for systematic reviews meeting the predefined criteria. The retrieved reviews were independently screened, and those meeting the inclusion criteria were synthesized and assessed for risk of bias. Narrative synthesis was used to report these findings. Results: In total, 19 systematic reviews met the inclusion criteria. A total of 15 reviews examined clinical effectiveness, 8 reported on the aspects of telemental health implementation, 10 reported on acceptability to service users and clinicians, 2 reported on cost-effectiveness, and 1 reported on guidance. Most reviews were assessed to be of low quality. The findings suggested that video-based communication could be as effective and acceptable as face-to-face formats, at least in the short term. Evidence on the extent of digital exclusion and how it can be overcome and that on some significant contexts, such as children and young people’s services and inpatient settings, was found to be lacking. Conclusions: This umbrella review suggests that telemental health has the potential to be an effective and acceptable form of service delivery. However, we found limited evidence on the impact of its large-scale implementation across catchment areas. Combining previous evidence and COVID-19 experiences may allow realistic planning for the future implementation of telemental health.

Overview

CoChat Summary

TL;DR

This rapid umbrella review synthesized 19 systematic reviews on telemental health published before COVID-19, finding that video-based communication may be as effective and acceptable as face-to-face formats, at least in the short term. It identified limited evidence on large-scale implementation, digital exclusion, and some contexts such as children and young people’s services and inpatient settings.

Key findings

  • In total, 19 systematic reviews met inclusion criteria, reporting 239 individual studies and 20 guidance documents; 15 reviews examined clinical effectiveness, 8 implementation, 10 acceptability, 2 cost-effectiveness, and 1 guidance. Most reviews were assessed as low quality.
  • Video-based communication could be as effective and acceptable as face-to-face formats, at least in the short term. For PTSD, one meta-analysis found no difference between telehealth and face-to-face postintervention (g=–0.05, 95% CI –0.31 to 0.20, n=7), but face-to-face was favored at 3- to 6-month follow-up (g=–0.25, 95% CI –0.44 to –0.07, n=5); for anxiety, therapist-supported iCBT versus face-to-face CBT showed SMD=0.06 (95% CI –0.25 to 0.37).
  • Cost-effectiveness evidence was limited: one review concluded telepsychiatry can be cost-effective, particularly in rural areas; another found 60% (15/25) of included studies reported telepsychiatry as less expensive, while 8 found it more expensive and 1 found no difference, with long-term veterans telepsychiatry costs ranging from US $930 to US $2116 per patient.
  • Evidence was lacking on digital exclusion and on contexts including children and young people’s services, inpatient settings, crisis services, sensory or cognitive impairments, and comorbid mental and physical health conditions.

Methods

  • Rapid umbrella review guided by the World Health Organization rapid review guide, PRISMA, and umbrella review guidance; protocol registered on PROSPERO (CRD42020208085). PsycINFO, PubMed, and the Cochrane Database of Systematic Reviews were searched from January 2010 to August 2020; 1086 reviews were returned, 292 full texts were assessed, and 19 reviews were included.
  • Included systematic reviews, realist reviews, and qualitative meta-syntheses searching at least three databases; quantitative reviews also required quality appraisal. Populations included mental health staff, people receiving mental health care, family members or carers, and people with dementia, neurodevelopmental disorders, or addiction; interventions were spoken or written communication via internet or telephone between mental health professionals and patients, service users, family, carers, or other professionals. Apps and websites not facilitating direct therapeutic contact were excluded.
  • Seven reviewers extracted data, with 10% double checked; quality was assessed using AMSTAR 2. Heterogeneity prevented quantitative pooling, so a narrative synthesis was conducted.

Limitations

  • The paper states that umbrella reviews rely on the quality and accuracy of included reviews and lose nuance; follow-up periods were often unclear; most included reviews lacked high-quality attributes such as prespecified protocols and duplicate study selection; only two reviews addressed cost-effectiveness and only one comprehensively; and pre-COVID evidence may not generalize to the pandemic or post-pandemic context, especially large-scale catchment-area implementation, digital exclusion, and inequality exacerbation.
  • The paper also states that including reviews of non-randomized studies and guidance increased methodological variability, and that the rapid review was limited to English-language reviews published since January 2010.
  • Evident from the text: most included reviews were low or critically low quality; heterogeneity prevented meta-analysis; primary studies overlapped across reviews (26 appeared in 2 reviews and 27 in 3 or more); and evidence was limited for children and young people, inpatient or crisis services, and sensory or cognitive impairments.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/26492

Cites

285 of 285 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) diagram.
Figure 1 PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) diagram.CC BY · PubMed Central

Verification

Claims the paper makes

31 Valid · 1 Not valid · 51 Not checked · 68 Own results and interpretations

85 more claims · 23 with their cited sources checked

Create a free account to see all 151 claims and to verify the 108 references still open.

See all claims — free account
  • It may state two separate claims as one. 48
  • Probably not a substantial claim. 23

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 285 references

Research works printed but not linked: 6

  1. Primm, A, 2010, Prev Chronic Dis, 7, A20
  2. Tricco, A, 2017, Rapid Reviews to Strengthen Health Policy and Systems: A Practical Guide, 1
  3. Davis, LL, 2004, J Ment Health Aging, 10, 31
  4. Hilty, DM, 2007, Psychiatry (Edgmont), 4, 58
  5. Manguno-Mire, GM, 2007, J Am Acad Psychiatry Law, 35, 481
  6. Stefan, S, 2013, J Cognit Behav Psychother, 13, 299

Cited by

Items 101–135 of 135

Metadata

Authors
Barnett, P., Goulding, L., Casetta, C., Jordan, H., Sheridan-Rains, L., Steare, T., Williams, J., Wood, L., Gaughran, F., & Johnson, S.
Affiliations
  • University College London (GB)
  • King's College London (GB)
Corresponding author
Barnett, Phoebe
Venue
Journal of Medical Internet Research
Published
2021-07-20
Volume
23
Issue
7
Pages
e26492
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3165823851
Cited by
136
References
285
Citations by year
2026: 7 · 2025: 20 · 2024: 29 · 2023: 38 · 2022: 31 · 2021: 11
FWCI
4.85
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Research Portal (King's College London) (submittedVersion, other-oa)
Funders
  • South London and Maudsley NHS Foundation Trust
  • King's College Hospital NHS Foundation Trust
  • Maudsley Charity
  • National Institute for Health and Care Research
  • Department of Health and Social Care
  • Guy's and St Thomas' Charity
  • King's College London
  • King's Health Partners
  • National Institute for Health Research Applied Research Collaboration South London
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Dentistry › General Dentistry › Dental Research and COVID-19
Keywords
telemental health, telehealth implementation, video communication, clinical effectiveness, acceptability, cost-effectiveness, digital exclusion, psychiatric inpatient care, COVID-19 pandemic, service delivery
MeSH terms
Systematic Reviews as Topic, COVID-19, Humans, Mental Health Services, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.