Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews
Open accessPublished version of a preprint
The DOI matches its Crossref record; 285 of the 285 references it cites were found in a registry or an index; 43 of the 151 sources its claims cite were checked for support.
Abstract
Background: Telemental health care has been rapidly adopted for maintaining services during the COVID-19 pandemic, and a substantial interest is now being devoted in its future role. Service planning and policy making for recovery from the pandemic and beyond should draw on both COVID-19 experiences and the substantial research evidence accumulated before this pandemic. Objective: We aim to conduct an umbrella review of systematic reviews available on the literature and evidence-based guidance on telemental health, including both qualitative and quantitative literature. Methods: Three databases were searched between January 2010 and August 2020 for systematic reviews meeting the predefined criteria. The retrieved reviews were independently screened, and those meeting the inclusion criteria were synthesized and assessed for risk of bias. Narrative synthesis was used to report these findings. Results: In total, 19 systematic reviews met the inclusion criteria. A total of 15 reviews examined clinical effectiveness, 8 reported on the aspects of telemental health implementation, 10 reported on acceptability to service users and clinicians, 2 reported on cost-effectiveness, and 1 reported on guidance. Most reviews were assessed to be of low quality. The findings suggested that video-based communication could be as effective and acceptable as face-to-face formats, at least in the short term. Evidence on the extent of digital exclusion and how it can be overcome and that on some significant contexts, such as children and young people’s services and inpatient settings, was found to be lacking. Conclusions: This umbrella review suggests that telemental health has the potential to be an effective and acceptable form of service delivery. However, we found limited evidence on the impact of its large-scale implementation across catchment areas. Combining previous evidence and COVID-19 experiences may allow realistic planning for the future implementation of telemental health.
Overview
CoChat Summary
TL;DR
This rapid umbrella review synthesized 19 systematic reviews on telemental health published before COVID-19, finding that video-based communication may be as effective and acceptable as face-to-face formats, at least in the short term. It identified limited evidence on large-scale implementation, digital exclusion, and some contexts such as children and young people’s services and inpatient settings.
Key findings
- In total, 19 systematic reviews met inclusion criteria, reporting 239 individual studies and 20 guidance documents; 15 reviews examined clinical effectiveness, 8 implementation, 10 acceptability, 2 cost-effectiveness, and 1 guidance. Most reviews were assessed as low quality.
- Video-based communication could be as effective and acceptable as face-to-face formats, at least in the short term. For PTSD, one meta-analysis found no difference between telehealth and face-to-face postintervention (g=–0.05, 95% CI –0.31 to 0.20, n=7), but face-to-face was favored at 3- to 6-month follow-up (g=–0.25, 95% CI –0.44 to –0.07, n=5); for anxiety, therapist-supported iCBT versus face-to-face CBT showed SMD=0.06 (95% CI –0.25 to 0.37).
- Cost-effectiveness evidence was limited: one review concluded telepsychiatry can be cost-effective, particularly in rural areas; another found 60% (15/25) of included studies reported telepsychiatry as less expensive, while 8 found it more expensive and 1 found no difference, with long-term veterans telepsychiatry costs ranging from US $930 to US $2116 per patient.
- Evidence was lacking on digital exclusion and on contexts including children and young people’s services, inpatient settings, crisis services, sensory or cognitive impairments, and comorbid mental and physical health conditions.
Methods
- Rapid umbrella review guided by the World Health Organization rapid review guide, PRISMA, and umbrella review guidance; protocol registered on PROSPERO (CRD42020208085). PsycINFO, PubMed, and the Cochrane Database of Systematic Reviews were searched from January 2010 to August 2020; 1086 reviews were returned, 292 full texts were assessed, and 19 reviews were included.
- Included systematic reviews, realist reviews, and qualitative meta-syntheses searching at least three databases; quantitative reviews also required quality appraisal. Populations included mental health staff, people receiving mental health care, family members or carers, and people with dementia, neurodevelopmental disorders, or addiction; interventions were spoken or written communication via internet or telephone between mental health professionals and patients, service users, family, carers, or other professionals. Apps and websites not facilitating direct therapeutic contact were excluded.
- Seven reviewers extracted data, with 10% double checked; quality was assessed using AMSTAR 2. Heterogeneity prevented quantitative pooling, so a narrative synthesis was conducted.
Limitations
- The paper states that umbrella reviews rely on the quality and accuracy of included reviews and lose nuance; follow-up periods were often unclear; most included reviews lacked high-quality attributes such as prespecified protocols and duplicate study selection; only two reviews addressed cost-effectiveness and only one comprehensively; and pre-COVID evidence may not generalize to the pandemic or post-pandemic context, especially large-scale catchment-area implementation, digital exclusion, and inequality exacerbation.
- The paper also states that including reviews of non-randomized studies and guidance increased methodological variability, and that the rapid review was limited to English-language reviews published since January 2010.
- Evident from the text: most included reviews were low or critically low quality; heterogeneity prevented meta-analysis; primary studies overlapped across reviews (26 appeared in 2 reviews and 27 in 3 or more); and evidence was limited for children and young people, inpatient or crisis services, and sensory or cognitive impairments.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
31 Valid · 1 Not valid · 51 Not checked · 68 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Telemental health care has been rapidly adopted for maintaining services during the COVID-19 pandemic”
- Also stated in: § Background · plain
“it has taken a central role internationally in maintaining mental health services during the COVID-19 pandemic [1].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Abstract > Background
What the sources say
- Supportedcites [1] source
The Findings section (“Service adaptation and innovations in community settings”) says telehealth tools were rapidly implemented in community mental health services across the globe, allowing care to continue at least to some extent. The Discussion (“Main findings and implications”) likewise reports swift adoption. This supports the claim about rapid international adoption to maintain services, without implying that remote care fully replaced in-person care. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Policy makers and mental health professionals, along with mental health service users, now express interest in continuing some use of these technologies long term, even in the absence of pandemic-related social distancing requirements [1-3].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Introduction > Background
What the sources say
- Partly supportedcites [1] sourceExperimental — accuracy not yet measured
The Findings section (Service adaptation and innovations in community settings) and the Discussion (Main findings and implications) support the clinicians-and-service-users part: telemedicine 'appears to be welcomed for use in some contexts by many clinicians and service users, who expect this to outlast the pandemic' and 'both clinician and service user responses suggest it may well endure after the pandemic'. Two parts of the claim are not supported by this source: it nowhere reports policy makers expressing interest in continuing telemental health (policy makers appear only as one type of public-domain account in the Background, and the Discussion frames legal/regulatory challenges as still to be addressed), and it states the expectation hedgedly ('appears', 'suggest it may well endure') where the citing sentence asserts it as expressed interest. Note also the claim rests on three citations [1-3], so the policy-maker element may come from the other sources. (LLM, conf=0.75)
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
Our copy supports the professional half of the claim: the 'Future hopes and concerns' section reports that two-thirds (67.8%) of surveyed UK mental health care staff wished to retain pandemic-era changes, 'a large majority involved keeping some aspects of remote working… selective use of technology platforms… has potential long-term benefits', and the Discussion states 'both our quantitative and qualitative data suggest clear support for its partial adoption in the longer term… its use should remain selective, complementing rather than replacing face-to-face contact'. However, this is a staff survey: no passage reports policy makers' interest in continuing telemental health, and service users were not surveyed — service-user views appear only as staff-reported preferences (some strongly prefer face-to-face, some do not engage with remote contacts) and in the lived-experience commentary, which stresses difficulties and the need to assess suitability per individual rather than expressing interest in long-term continuation. The claim's attribution to policy makers and to service users is therefore not supported by this source (the sentence carries citations [1-3], so those elements may rest on the other sources). (LLM, conf=0.78)
- Partly supportedcites [3] sourceExperimental — accuracy not yet measured
Our copy of Daigle et al. (2020) supports only the 'continuing beyond the pandemic' element, and only as the authors' own advocacy: the Abstract concludes that 'shifting specialized mental health care from in-person to remotely delivered services as much as possible could be beneficial beyond the current pandemic,' and the Introduction frames the pandemic as 'an opportunity to shift to such remotely delivered services as much as needed,' with conclusions offered to 'assist other mental health services and policy makers.' Nothing in our copy reports that policy makers, mental health professionals, or service users express interest in continued telemental health use — no survey, interview or stakeholder statement of that kind appears. The only stakeholder attitudes our copy records run the other way and are pre-pandemic: Section 2 notes 'some resistance to remotely delivered health care was expressed by some of the NSOSIC's psychotherapists ... as well as by some of the other providers ... and by some service users and their families.' So the attributed assertion of current, multi-stakeholder expressed interest is not supported by this source. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Implementation outcomes were reported in eight reviews [21,24,25,27,28,30,32,38].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Results > Implementation Outcomes
What the sources say
- Not checked yetcites [21] source
- Not checked yetcites [24] source
- Supportedcites [25] source
Christensen et al. (2020) is a systematic review (21 included studies) whose extracted quantitative data were 'gender, age, diagnosis, satisfaction, usability and acceptability' (Methods/Accepted Article), i.e. classic implementation outcomes rather than clinical ones; its tables and themes report feasibility and acceptance ('VC was feasible and acceptable to the psychiatrist, staff and patients'; Frank et al. aimed 'to examine the feasibility and acceptance of CBASP by using VCs') and barriers/challenges to utilizing the program (Accepted Article, qualitative findings; Conn et al. 2013). The review also explicitly links acceptance to 'the implementation of new technology' (Accepted Article). It never uses the phrase 'implementation outcomes' itself, and it notes in Limitations that no included study measured sustainability of gains, but as an identification citation for a review reporting acceptability/feasibility/usability outcomes it is supported. (LLM, conf=0.80)
- Not checked yetcites [27] source
- Not checked yetcites [28] source
- Not checked yetcites [30] source
- Not checked yetcites [32] source
- Not checked yetcites [38] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Relevant outcomes included assessment comparability (n=2 reviews), fidelity to intervention and competence of therapists (n=1) [38], patient adherence to intervention (n=3) [21,24,28], patient attendance (n=4) [21,25,30,38], safety (n=2) [24,38], and technical difficulties (n=3) [24,25,38].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Results > Implementation Outcomes
What the sources say
- Not checked yetcites [21] source
- Partly supportedcites [25] sourceExperimental — accuracy not yet measured
Our copy of Christensen et al. (2020) never lists 'patient attendance' among the outcomes it extracted: the Methods ('Accepted Article') state that 'The quantitative data included gender, age, diagnosis, satisfaction, usability and acceptability,' and the results are organised around satisfaction, acceptability, availability/access, convenience, expectations and technical difficulties. The nearest content is retention/attendance-type data reported for individual included trials in Table 1 ('retention was better in the video group as well; older subjects were more likely to complete the study'; 'high drop-out'; 'high non-completion rate') plus the call for research on 'why patients refuse to participate in VCs' (Additional information), so the review touches engagement/dropout but does not present patient attendance as an outcome of its own, nor frame its outcomes in implementation-outcome terms. The part of the claim this source does not support is therefore the identification of patient attendance as a relevant (implementation) outcome in this review. (LLM, conf=0.62)
- Not checked yetcites [30] source
- Not checked yetcites [38] source
plainn = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although some have argued that problems with building rapport [6] along with privacy and safety concerns may hinder the implementation of remote care, service users have been found to report such apprehensions less than clinicians [7].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Introduction > Background
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The 'Summary of patient and provider satisfaction' section states point (2): 'patients acknowledge potential changes to the therapeutic alliance inherent in providing services remotely but are less concerned than providers', which directly supports the rapport/therapeutic-alliance half of the claim as a patient-vs-clinician comparison. However, the paper's treatment of privacy and safety is at a different level: the 'Patient satisfaction' section lists privacy concerns among patients' own negative themes, and the 'Legal issues' section and Abstract discuss concerns about loss of confidentiality and limited capacity to respond to psychiatric emergencies without comparing patient versus provider levels of apprehension about them. So the comparative 'less than clinicians' is stated only for rapport/therapeutic alliance, not for privacy and safety. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
85 more claims · 23 with their cited sources checked
Create a free account to see all 151 claims and to verify the 108 references still open.
- It may state two separate claims as one. 48
- Probably not a substantial claim. 23
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Telehealth, which has been shown to have comparable feasibility, outcomes in assessment and symptom reduction, and satisfaction as in-person care, may circumvent this barrier and improve access to mental health interventions [10-12].”
From Implementation Considerations for Family-Based Telehealth Interventions for Youth in Foster Care: Focus Group Study With Child Welfare System Professionals (2023) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“498 (n=66) | Depression or psychiatric comorbidities with depression symptoms (n=9) | 54 (NR) | Hispanic, 243 (52)”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Methods > Quality Assessment
Reported 52 · recomputed 48.795181
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Results > Quality of Included Reviews
“The reviews eliciting higher confidence (moderate) were two Cochrane reviews [31,36].”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Methods > Quality Assessment
“United States (n=10); Canada (n=2); Denmark (n=1) | Moderate |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Internet CBT with therapist email or telephone support (n=37); internet behavioral therapy with exposure (n=1) | Waitlist or attentional control (n=20); face to face (n=7); other internet therapies (n=6; multiple control groups (n=5) | Up to 2015 | 30”
§ Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews > Methods > Quality Assessment
Reported 30 · recomputed 38
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 2×
“A rapid umbrella review was conducted guided by the World Health Organization practical guide for Rapid Reviews to Strengthen Health Policy and Systems [14] and adhering to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [15] and umbrella review guidance [16].”
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 13×
“AMSTAR: Assessment of Multiple Systematic Reviews ARC: Applied Research Collaboration BAME: Black, Asian, and minority ethnic NHS: National Health Service NIHR: National Institute for Health Research PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses PTSD: posttraumatic stress disorder J Med In…”
MethodInfluentialDevelopment of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
How mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840 · cited 1×
“To plan the effective and acceptable deployment of telemental health beyond the pandemic, it is crucial that we now review all the relevant evidence regarding potential impacts, challenges, and outcomes of widespread remote technology utilization and identify the key mechanisms for its acceptable integration into rout…”
BackgroundSelf-citationSystematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318 · cited 1×
“Umbrella reviews are useful in summarizing a broad evidence base to inform policy [13].”
BackgroundThe Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048 · cited 1×
“For service users across a range of populations, settings, and conditions [5],”
BackgroundTorous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946
Ten simple rules for conducting umbrella reviews
Fusar-Poli, P., & Radua, J. (2018) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300014 · Cited by 724 · cited 1×
“A rapid umbrella review was conducted guided by the World Health Organization practical guide for Rapid Reviews to Strengthen Health Policy and Systems [14] and adhering to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [15] and umbrella review guidance [16].”
Method
Research works printed but not linked: 6
- Primm, A, 2010, Prev Chronic Dis, 7, A20
- Tricco, A, 2017, Rapid Reviews to Strengthen Health Policy and Systems: A Practical Guide, 1
- Davis, LL, 2004, J Ment Health Aging, 10, 31
- Hilty, DM, 2007, Psychiatry (Edgmont), 4, 58
- Manguno-Mire, GM, 2007, J Am Acad Psychiatry Law, 35, 481
- Stefan, S, 2013, J Cognit Behav Psychother, 13, 299
Cited by
Items 101–135 of 135
Ward, M. M., Carter, K. D., Bhagianadh, D., Ullrich, F. A., Merchant, K. A. S., Marcin, J. P., Law, K. B., McCord, C., Neufeld, J. D., Nelson, E., et al. (2023) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2022.0445 · Cited by 3
Jones, L. S., Russell, A., & Brosnan, M. (2023) · School Mental Health · doi:10.1007/s12310-023-09619-5 · Cited by 3
“…of service provision (including direct specialist care) via videoconference technology (Barnett et al., 2021), which is important for future planning of organisational aspects of child mental health service pro-vision in a post-COVID-19 world (Barnett et al., 2021; Jones et al., 2020).”
Sorry About the Connection: Client-Reported Telehealth Technology Competency and Difficulties
Hynes, K. C., Tambling, R. R., Kingzette, A., & Bischoff, T. (2023) · Journal of Technology in Human Services · doi:10.1080/15228835.2023.2283216 · Cited by 2
“Systematic reviews indicate that psychotherapy provided via telehealth have comparable outcomes to psychotherapy treatment provided face-to-face (Barnett et al., 2021; Langarizadeh et al., 2017).”
BackgroundJuras, M. M., Coêlho, A. C. F., Vázquez, A. L., Ribeiro, M. R., Kohlsdorf, M., Custódio, A. L., Buenabad, N. G. A., Pérez, L. V., Hooley, C., Barnett, M. L., et al. (2024) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-024-00295-1 · Cited by 1
“To continue to provide services, mental health organizations encouraged and supported the transition to tele-health services during the pandemic (Barnett et al., 2021; Schmidt et al., 2020; Schoebel et al., 2021).”
BackgroundTelepsychology: Does it Bridge the Social Justice Theory and Action Gap?
Jain, S. (2021) · Advances in psychology, mental health, and behavioral studies (APMHBS) book series · doi:10.4018/978-1-7998-7991-6.ch014
Lee, K., Bolton, J. M., Shterenberg, R., Bolton, J. M., & Hensel, J. M. (2022) · doi:10.2196/preprints.39861
Makanjuola, A., Granger, R., Pisavadia, K., & Edwards, R. T. (2023) · medRxiv · doi:10.1101/2023.01.20.23284835 · Cited by 1
“the long-term impact of remote services [64].”
Distance in Distant Care: Qualitative Content Analysis of Providers’ Experiences in Tele–Mental Care
Åhs, J. W., Ranheim, A., Mattelin, E., Eriksson, H., & Mazaheri, M. (2023) · Journal of Medical Internet Research · doi:10.2196/38568
Examining Telemental Health in Mississippi: Brief Report
Sobrino, M. D., Coleman, M. L., Springfield, J., Keith, S. N., & Winburn, A. (2023) · Journal of Counseling Research and Practice · doi:10.56731/2688-3996.1066
Using Technology to Impact Maternal and Perinatal Mental Healthcare Service Delivery in South Africa
Whittaker, T., Lachman, A., & Salie, M. (2023) · Africa Journal of Nursing and Midwifery · doi:10.25159/2520-5293/13655
Virtual Behavioral Health for Army Soldiers: Soldier Perspectives and Patterns of Treatment
Hepner, K. A., Breslau, J. A., Sousa, J., Roth, C. P., Ruder, T., González, I. E., Montemayor, C., & Griffin, B. A. (2023) · Rand health quarterly · doi:10.7249/rhq-11-01-05
Moro, G. L., Scaioli, G., Conrado, F., Linot, C., Bert, F., & Siliquini, R. (2023) · Counselling and Psychotherapy Research · doi:10.1002/capr.12720 · Cited by 1
Verma, A., Kaur, D., Singh, A., Dere, S. S., & Ghildiyal, R. (2024) · MGM Journal of Medical Sciences · doi:10.4103/mgmj.mgmj_55_23
IoHT-FL model to support remote therapies for children with psychomotor deficit
Arteaga, J. M., Carlos, M. L. A., & Rojano-Cáceres, J. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13897-3.00016-3
Aguerrebere, P. M., Pacanowski, T. G., & Catalán-Matamoros, D. (2024) · Observatorio (OBS*) · doi:10.15847/obsobs18220242338 · Cited by 1
Coomans, S. K., Virtanen, L., Kaihlanen, A., Rantanen, T., Clemens, T., & Heponiemi, T. (2024) · Discover Mental Health · doi:10.1007/s44192-024-00088-z · Cited by 4
Recommendations to strengthen hybrid mental health policy in primary care services in Chile
Muñoz, F. C., Flores, C. C., Soto, M., Castillo, P. M., Basualto, P., Saavedra, R. Q., Cortés, I. A. B., Garzón, M. M., & Aracena, M. (2024) · Latin American Policy · doi:10.1111/lamp.12367 · Cited by 1
“…shown to be effective to increase the access to care (Connolly et al., 2020) and the management of various mental health problems (Ali et al., 2021; Barnett et al., 2021; Secchi et al., 2021) such as anxiety, Alzheimer, dementia, obsessive ‐ compulsive disorders, aggression, and posttraumatic…”
Mompol, C. M. T., & Salcedo, B. F. (2025) · EPRA International Journal of Multidisciplinary Research (IJMR) · doi:10.36713/epra19892
Key skills in telemental health
Munro, M., & Ridler, B. (2025) · Oxford University Press eBooks · doi:10.1093/med/9780192864048.003.0011
Kruger, M., Bautista, C. A., & Klemanski, D. H. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00501-6 · Cited by 2
“Specifically, many patients have expressed high satisfaction and have reported a seamless transition to remote care, while others have cited challenges such as fatigue from video interactions, privacy concerns, and technological limitations (Barnett et al., 2021; Mish-kind et al., 2021).”
Hidalgo-Padilla, L., Dabbous, M., Halvorsrud, K., Beaney, T. E., Gideon, G., Gogarty, E., Greenfield, G., Hayhoe, B. W. J., Kerr, G. K., Raine, R., et al. (2025) · Online Journal of Public Health Informatics · doi:10.2196/66672 · Cited by 1
“…both patients and health care professionals, there are disadvantages, such as the loss of nonverbal communication, inability to perform physical examinations, increased workloads for health care professionals, and insufficient institutional resources to support remote care effectively [3,23-26].”
Self-citationMacías, J. (2025) · Revista de Psicoterapia · doi:10.5944/rdp.v36i131.44546 · Cited by 4
Vey, T., Foussias, G., Wang, W., Wong, A. H. C., Voineskos, A. N., Davis-Faroque, N., Kozloff, N., & Polillo, A. (2025) · doi:10.2196/preprints.81313
Kohlsdorf, M., Hooley, C., Vázquez, A. L., Juras, M. M., Decker, G., Iskalis, T., Miller, K. B., Tompkins, K. L., Buenabad, N. G. A., Ribeiro, M. R., et al. (2025) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-025-00360-3
“…the use of global psychological telehealth services: social distancing, school and service closure, and an increased need for mental health services have yielded a mass crossover to online platforms, particularly for those requiring routine services initiated pre-pandemic (Barnett et al., 2021).”
Charvát, M., Jochmannová, L., Sluková, P. Z., & Viktorová, L. (2025) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.70010
“…with tra - ditional therapy in terms of effectiveness, strong therapeutic alliance, and a perceived sense of safety, rated by both clients and providers (Andersson et al., 2014; Barnett et al., 2021; Hilty et al., 2013; Hines et al., 2015 ; Jenkins-Guarnieri et al., 2015; Martin et al., 2000).”
Roos, R., Witteveen, A. B., Ayuso-Mateos, J. L., Barbui, C., Bryant, R. A., Félez-Nóbrega, M., Figueiredo, N., Kalisch, R., Haro, J. M., McDaid, D., et al. (2024) · Figshare · doi:10.6084/m9.figshare.24494502
Rains, L. S., Dalton‐Locke, C., Landau, S., Needle, J. J., & Johnson, S. (2024) · Figshare · doi:10.6084/m9.figshare.26552683
Self-citationMcEwen, F. S., Khatib, H. E., Hadfield, K., Pluess, K., Chehade, N., Bosqui, T. J., Skavenski, S. V. W., Murray, L. K., Weierstall‐Pust, R., Karam, E., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26667259
Roos, R., Witteveen, A. B., Ayuso-Mateos, J. L., Barbui, C., Bryant, R. A., Félez-Nóbrega, M., Figueiredo, N., Kalisch, R., Haro, J. M., McDaid, D., et al. (2023) · Figshare · doi:10.6084/m9.figshare.24494112
Understanding preferences for telemedicine among long Covid patients: a cross-sectional studyPreprint
Łaszewska, A., Kienreich-Nitsche, G., Gamillscheg, P., & Mayer, S. (2026) · Research Square · doi:10.21203/rs.3.rs-9244683/v1
Al-Mahrouqi, T., AlHarthi, A. S., Al-Alawi, K., Sinawi, H. A., Al-Zaabi, A., Obeidani, A. A., Balushi, F. A., & Al‐Alawi, M. (2026) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1468_25
“[13,14] While the use of telepsychology is evident, most participants agreed that face‑to‑face sessions remain essential in mental healthcare delivery, particularly for patients who require rich nonverbal communication.”
Walton, C. J., Skerven, K., White, A., & Davine, T. P. (2026) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465826101337
“Across systematic reviews, evidence suggests that mental health treatment delivered via telehealth can be as effective as in-person treatment, as well as being as acceptable (Barnett et al ., 2021).”
Therapists’ Personal Identity Factors and Professional Self-Efficacy: A Path Analysis Model
Gori, A., & Topino, E. (2026) · Behavioral Sciences · doi:10.3390/bs16081425
“Evidence indicates that eTherapy can be effective across different therapeutic approaches, diagnostic and assessment contexts, and populations, with treatment outcomes comparable to those of in-person interventions (Barnett et al., 2021; Bashshur et al., 2016; Hilty et al., 2013; Lin et al., 2022).”
Telemental Health Approaches for Rural Opioid Use Treatment: An Integrative Review
Weber, J., Vandermause, R. K., & Schmidt, C. M. (2026) · Journal of the American Psychiatric Nurses Association · doi:10.1177/10783903261473928
Standal, B., Kenter, R. M. F., Gullslett, M. K., Nordgreen, T., & Teig, I. L. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1955151
Metadata
- Authors
- Barnett, P., Goulding, L., Casetta, C., Jordan, H., Sheridan-Rains, L., Steare, T., Williams, J., Wood, L., Gaughran, F., & Johnson, S.
- Affiliations
- University College London (GB)
- King's College London (GB)
- Corresponding author
- Barnett, Phoebe
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-07-20
- Volume
- 23
- Issue
- 7
- Pages
- e26492
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8335619
- OpenAlex
- W3165823851
- Semantic Scholar
- 809a829db8ac91e9de9909f71b9fd8ffd09eb4d0
- Cited by
- 136
- References
- 285
- Citations by year
- 2026: 7 · 2025: 20 · 2024: 29 · 2023: 38 · 2022: 31 · 2021: 11
- FWCI
- 4.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Research Portal (King's College London) (submittedVersion, other-oa)
- Funders
- South London and Maudsley NHS Foundation Trust
- King's College Hospital NHS Foundation Trust
- Maudsley Charity
- National Institute for Health and Care Research
- Department of Health and Social Care
- Guy's and St Thomas' Charity
- King's College London
- King's Health Partners
- National Institute for Health Research Applied Research Collaboration South London
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Dentistry › General Dentistry › Dental Research and COVID-19
- Keywords
- telemental health, telehealth implementation, video communication, clinical effectiveness, acceptability, cost-effectiveness, digital exclusion, psychiatric inpatient care, COVID-19 pandemic, service delivery
- MeSH terms
- Systematic Reviews as Topic, COVID-19, Humans, Mental Health Services, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
