The DOI matches its Crossref record; 106 of the 106 references it cites were found in a registry or an index; 73 of the 134 sources its claims cite were checked for support.
Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation
Open accessAbstract
INTRODUCTION: Patients and policy makers alike have high expectations for the use of digital technologies as tools to improve health care service quality at a sustainable cost. Many countries within the Organisation for Economic Co-operation and Development (OECD) are investing in telemedicine initiatives, and a large and growing body of peer-reviewed studies on the topic has developed, as a consequence. Nonetheless, telemedicine is still not used at scale within the OECD. Seeking to provide a snapshot of the evidence on the use of telemedicine in the OECD, this umbrella review of systematic reviews summarizes findings on four areas of policy relevance: clinical and cost-effectiveness, patient experience, and implementation. METHODS: This review followed a prior written, unregistered protocol. Four databases (PubMed/Medline, CRD, and Cochrane Library) were searched for systematic reviews or meta-analyses published between January 2014 and February 2019. Based on the inclusion criteria, 98 systematic reviews were selected for analysis. Due to substantial heterogeneity, a meta-analysis was not conducted. The quality of included reviews was assessed using the AMSTAR 2 tool. RESULTS: Most reviews (n = 53) focused on effectiveness, followed by cost-effectiveness (n = 18), implementation (n = 17) and patient experience (n = 15). Eighty-three percent of clinical effectiveness reviews found telemedicine at least as effective as face-to-face care, and thirty-nine percent of cost-effectivenss reviews found telemedicine to be cost saving or cost-effective. Patients reported high acceptance of telemedicine and the most common barriers to implementation were usability and lack of reimbursement. However, the methodological quality of most reviews was low to critically low which limits generalizability and applicability of findings. CONCLUSION: This umbrella review finds that telemedicine interventions can improve glycemic control in diabetic patients; reduce mortality and hospitalization due to chronic heart failure; help patients manage pain and increase their physical activity; improve mental health, diet quality and nutrition; and reduce exacerbations associated with respiratory diseases like asthma. In certain disease and specialty areas, telemedicine may be a less effective way to deliver care. While there is evidence that telemedicine can be cost-effective, generalizability is hindered by poor quality and reporting standards. This umbrella review also finds that patients report high levels of acceptance and satisfaction with telemedicine interventions, but that important barriers to wider use remain.
Overview
CoChat Summary
TL;DR
This umbrella review of 98 systematic reviews summarizes evidence on telemedicine in OECD countries, covering clinical and cost-effectiveness, patient experience, and implementation. It finds telemedicine is generally at least as effective as face-to-face care and highly acceptable to patients, but the included evidence is mostly low quality and cost-effectiveness remains uncertain.
Key findings
- Among 53 clinical effectiveness reviews, 83% (44/53) found telemedicine at least as effective as face-to-face care; 2 reviews (4%) found it ineffective, and 7 (13%) were uncertain.
- Among 18 cost-effectiveness reviews, 7 (39%) found telemedicine cost-effective or cost saving, 5 (28%) found it might be, 2 (11%) could not conclude, and 4 (22%) found it not cost-effective.
- Fifteen reviews addressed patient experience; all six acceptability reviews found telemedicine acceptable, and six satisfaction reviews reported positive experiences, though barriers included lack of training, usability problems, technical issues, and lack of reimbursement.
- Methodological quality was low: 8% (8/98) of reviews were high quality, while 92% (90/98) were low to critically low quality.
Methods
- Umbrella review following a prior written, unregistered protocol; PubMed/Medline, CRD, and Cochrane Library were searched for systematic reviews or meta-analyses published January 2014–February 2019, yielding 98 included reviews.
- Quality was assessed with AMSTAR 2; meta-analysis was not conducted because of heterogeneity across populations, interventions, comparators, duration, and outcomes.
- Results were synthesized narratively at the level of the systematic review, not the primary studies.
Limitations
- The paper states that synthesizing reviews may lose primary-study details; a small number of primary studies (5%) were from non-OECD countries; included reviews were mostly low quality; economic evaluations had poor reporting or unavailable data; publication bias was noted in some reviews; non-English studies were excluded; and older primary studies may make conclusions less timely.
- Evident from the text: the review did not examine health care utilization, and cost-effectiveness findings are limited by heterogeneity, provider-perspective analyses, and poor comparability across settings and specialties.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
62 Valid · 5 Not valid · 44 Not checked · 107 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Similarly, three other reviews found web-based CBT with remote monitoring, and remote therapist support was as effective as usual care in reducing symptoms of depression [41–43].”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
What the sources say
- Partly supportedcites [41] M Deady, 2017, eHealth interventions for the prevention of depression and anxiety in the general population: a systematic review and meta-analysis, BMC Psychiatry sourceExperimental — accuracy not yet measured
The Results (Effects at post-intervention outcomes; page unavailable) support symptom reduction: eHealth interventions had a small positive effect on depression symptoms compared with control groups. But the paper does not establish equivalence to usual care or isolate web-based CBT with remote monitoring and therapist support; the Discussion says few included studies provided therapist feedback. (LLM, conf=0.88)
- Partly supportedcites [42] S van Beugen, 2014, Internet-Based Cognitive Behavioral Therapy for Patients With Chronic Somatic Conditions: A Meta-Analytic Review, J Med Internet Res sourceExperimental — accuracy not yet measured
The Methods and Therapist Contact and Peer Contact sections describe web-based CBT with remote therapist guidance, and General Psychological Outcomes reports small, generally statistically significant effects on depressive symptoms. But the review does not establish that it was *as effective as usual care*: its pooled depression comparison used passive controls, mostly waiting lists, with only two studies using care-as-usual controls. The cited passages also do not establish remote monitoring as a feature of the interventions. No page numbers are provided in our copy. (LLM, conf=0.86)
- Disputedcites [43] K Linde, 2015, Effectiveness of psychological treatments for depressive disorders in primary care: systematic review and meta-analysis., Ann Fam Med sourceExperimental — accuracy not yet measured
The Efficacy / Effectiveness section reports that remote therapist-led CBT reduced depressive symptoms more than usual care, not merely as effectively (pooled standardized mean difference −0.43, 95% CI −0.62 to −0.24). The Study Selection section also identifies only one of its three remote therapist-led CBT trials as online; the other two used telephone CBT. Page numbers are unavailable in our copy. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“One high-quality review found that remote monitoring can improve the control of blood glucose in diabetic patients [1]”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
What the sources say
- Supportedcites [1] G Flodgren, 2015, Interactive telemedicine: effects on professional practice and health care outcomes., Cochrane Database Syst Rev source
The Background states that telemedicine may improve glucose control in people with diabetes. The HbA1c results section reports lower levels in telemedicine groups than in controls across 16 studies, and the review describes remote monitoring among the interventions studied. The claim’s cautious wording is consistent with those findings. (LLM, conf=0.92)
states a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In one high-quality review, 74% of included studies found that remote monitoring through mobile devices to support data collection was cost-effective, economically beneficial, or cost saving at base case from a provider or societal perspective [64].”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Cost-effectiveness
What the sources say
- Partly supportedcites [64] SJ Iribarren, 2017, What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions., PLoS One sourceExperimental — accuracy not yet measured
The Results (Study characteristics; page not provided) report positive base-case costing outcomes for 26 studies (74.3%) in which mHealth was the primary intervention. That figure does not describe remote monitoring or data collection: the table reports positive outcomes for 4 of 7 data-collection studies (57.1%). The same table lists varied costing perspectives, including 16 studies that did not report one, so the provider-or-societal qualification is not supported for the 74% figure. (LLM, conf=0.89)
states a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“one concluded that telephone or remote monitoring interventions compared to nurse home visits had no significant improvement on readmission or mortality in heart failure patients [26]”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
What the sources say
- Supportedcites [26] HGC Van Spall, 2017, Comparative effectiveness of transitional care services in patients discharged from the hospital with heart failure: a systematic review and network meta-analysis, Eur J Heart Fail source
The Discussion (page unavailable) reports that nurse home visits ranked most effective for all-cause mortality and readmissions, with no significant differences in comparative effectiveness among strategies. It also reports that telephone support and telemonitoring did not significantly reduce either outcome versus usual care. Together, these findings support the narrower claim that the remote interventions showed no significant improvement over nurse home visits, although the paper states their individual outcome estimates against usual care. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“while the second review found promising evidence of the efficacy of telemedicine with remote behavioral support for weight loss to prevent or delay Type 2 diabetes.”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
What the sources say
- Not checked — no full text of the sourcecites [9] H Tchero, 2017, Telemedicine in Diabetic Foot Care: A Systematic Literature Review of Interventions and Meta-analysis of Controlled Trials., Int J Low Extrem Wounds source
- Supportedcites [10] KL Joiner, 2017, Lifestyle interventions based on the diabetes prevention program delivered via eHealth: A systematic review and meta-analysis, Prev Med (Baltim) source
The Abstract reports promising evidence that DPP-based eHealth interventions produce weight loss, including interventions with remotely delivered counselor support. The Introduction identifies preventing or delaying type 2 diabetes as the purpose of DPP-based weight loss; the review assessed weight loss, not diabetes incidence. (LLM, conf=0.90)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
109 more claims · 30 with their cited sources checked
Create a free account to see all 218 claims and every source verdict.
- It may state two separate claims as one. 77
- Probably not a substantial claim. 36
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Assessment of the usability of web-based intervention programs before launching the program may also increase the likelihood of its future use [44].”
From Recruitment and Retention Strategies Among Racial and Ethnic Minorities in Web-Based Intervention Trials: Retrospective Qualitative Analysis (2021) · cites this paper as [44]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“recent umbrella reviews [10,11] that consider older primary studies have potentially made conclusions based on noncontemporary data.”
From Interactive Remote Patient Monitoring Devices for Managing Chronic Health Conditions: Systematic Review and Meta-analysis (2022) · cites this paper as [10]
In the citing paper
“Recent evidence has deemed telemedicine feasible for patients with long-term conditions and effective in terms of improving medical care [10].”
From Interactive Remote Patient Monitoring Devices for Managing Chronic Health Conditions: Systematic Review and Meta-analysis (2022) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
“Eleven reviews evaluated the effectiveness of telemedicine interventions for diabetes management”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
“Three out of the remaining ten reviews assessed the effectiveness of remote self-monitoring interventions on gestational diabetes.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
“Ten reviews assessed the effectiveness of telemedicine interventions in mental health and behavioral conditions compared to usual care or no intervention.”
§ Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation > Results > Clinical effectiveness
“Eight studies had depression and/or anxiety as a primary outcome, while the remaining three focused on symptom reduction for obsessive compulsive disorder (OCD), insomnia, and reduction of alcohol consumption.”
Citations
Cites
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 1×
“All three authors assessed the methodological quality of included reviews using the AMSTAR 2 tool [3].”
MethodInteractive telemedicine: effects on professional practice and health care outcomes
Flodgren, G., Rachas, A., Farmer, A. J., Inzitari, M., & Shepperd, S. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002098.pub2 · Cited by 806
Cottrell, M. A., Galea, O. A., O’Leary, S. P., Hill, A. J., & Russell, T. G. (2017) · Clinical Rehabilitation · doi:10.1177/0269215516645148 · Cited by 708
Feltner, C., Jones, C. D., Cené, C. W., Zheng, Z.-J., Sueta, C. A., Coker-Schwimmer, E. J. L., Arvanitis, M., Lohr, K. N., Middleton, J. C., & Jonas, D. E. (2014) · Annals of Internal Medicine · doi:10.7326/m14-0083 · Cited by 681 · cited 1×
“One review produced mixed results, and found that telemedicine delivered through structured telephone support reduced heart failure specific readmissions but not all cause mortality readmissions [25].”
ResultIribarren, S. J., Cato, K., Falzon, L., & Stone, P. W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0170581 · Cited by 519 · cited 1×
“In one high-quality review, 74% of included studies found that remote monitoring through mobile devices to support data collection was cost-effective, economically beneficial, or cost saving at base case from a provider or societal perspective [64].”
BackgroundMental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review.
Grist, R., Porter, J., & Stallard, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7332 · Cited by 518 · cited 1×
“Mobile-app based remote monitoring interventions were acceptable to children and adolescents with mental health conditions [78].”
Backgroundde la Torre-Díez, I., López-Coronado, M., Vaca, C., Aguado, J. S., & de Castro, C. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0053 · Cited by 495
Widmer, R. J., Collins, N. M., Collins, C. S., West, C. P., Lerman, L. O., & Lerman, A. (2015) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2014.12.026 · Cited by 416
The Current State Of Telehealth Evidence: A Rapid Review.
Shigekawa, E., Fix, M., Corbett, G., Roby, D. H., & Coffman, J. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.05132 · Cited by 406
Van Spall, H. G. C., Rahman, T., Mytton, O., Ramasundarahettige, C., Ibrahim, Q., Kabali, C., Coppens, M., Brian Haynes, R., & Connolly, S. (2017) · European Journal of Heart Failure · doi:10.1002/ejhf.765 · Cited by 381
Research works printed but not linked: 4
- T Toma, 2014, Online social networking services in the management of patients with diabetes mellitus: systematic review and meta-analysis of randomised controlled trials, Diabetes Res Clin Pract, 106, 200, 10.1016/j.diabres.2014.06.008 · DOI · Paper page
- M Agostini, 2015, Telerehabilitation and recovery of motor function: a systematic review and meta-analysis, J Telemed Telecare, 21, 202, 10.1177/1357633X15572201 · DOI · Paper page
- D Sherifali, 2017, The Effectiveness of eHealth Technologies on Weight Management in Pregnant and Postpartum Women: Systematic Review and Meta-Analysis., J Med Internet Res, 19, e337, 10.2196/jmir.8006 · DOI · Paper page
- R Speyer, 2018, Effects of telehealth by allied health professionals and nurses in rural and remote areas: A systematic review and meta-analysis., J Rehabil Med, 50, 225, 10.2340/16501977-2297 · DOI · Paper page
Cited by
The COVID-19 Pandemic and the Future of Telemedicine
OECD (2023) · OECD Health Policy Studies · doi:10.1787/ac8b0a27-en · Cited by 437
The clinical effectiveness of telehealth: A systematic review of meta-analyses from 2010 to 2019
Snoswell, C. L., Chelberg, G., De Guzman, K. R., Haydon, H. M., Thomas, E. E., Caffery, L. J., & Smith, A. C. (2023) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x211022907 · Cited by 397
Mseke, E. P., Jessup, B., & Barnett, T. (2024) · Journal of Transport & Health · doi:10.1016/j.jth.2024.101819 · Cited by 209
Technologies in Home-Based Digital Rehabilitation: Scoping Review
Arntz, A. R., Weber, F., Handgraaf, M., Lällä, K., Korniloff, K., Murtonen, K.-P., Chichaeva, J., Kidritsch, A., Heller, M., Sakellari, Ε., et al. (2023) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/43615 · Cited by 160
A 3-Item Measure of Digital Health Care Literacy: Development and Validation Study
Nelson, L. A., Pennings, J. S., Sommer, E. C., Popescu, F., & Barkin, S. L. (2022) · JMIR Formative Research · doi:10.2196/36043 · Cited by 109
Metadata
- Authors
- Eze, N. D., Mateus, C., & Cravo Oliveira Hashiguchi, T.
- Affiliations
- Lancaster University (GB)
- Corresponding author
- Eze, Nkiruka D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-08-13
- Volume
- 15
- Issue
- 8
- Pages
- e0237585
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7425977
- OpenAlex
- W3049731354
- Cited by
- 345
- References
- 105
- Citations by year
- 2026: 35 · 2025: 71 · 2024: 71 · 2023: 72 · 2022: 64 · 2021: 30 · 2020: 2
- FWCI
- 7.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- Funders
- Organisation de Coopération et de Développement Économiques
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Keywords
- telemedicine, clinical effectiveness, cost-effectiveness, patient experience, implementation barriers, digital health technologies, chronic heart failure, pain management, mental health, asthma exacerbations, reimbursement, usability, OECD countries
- MeSH terms
- Chronic Disease, Cost-Benefit Analysis, Health Plan Implementation, Humans, Self Care, Telemedicine, Disease Management, Organisation for Economic Co-Operation and Development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation. https://app.cochat.ai/papers/10.1371/journal.pone.0237585
- The paper
- Eze, N. D., Mateus, C., & Cravo Oliveira Hashiguchi, T. (2020). Telemedicine in the OECD: An umbrella review of clinical and cost-effectiveness, patient experience and implementation. PLoS ONE. https://doi.org/10.1371/journal.pone.0237585
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

