The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview
Open accessThe DOI matches its Crossref record; 113 of the 114 references it cites were found in a registry or an index; 28 of the 91 sources its claims cite were checked for support.
Abstract
BACKGROUND: Telehealthcare involves the use of information and communication technologies to deliver healthcare at a distance and to support patient self-management through remote monitoring and personalised feedback. It is timely to scrutinise the evidence regarding the benefits, risks and costs of telehealthcare. METHODS AND FINDINGS: Two reviewers searched for relevant systematic reviews published from January 1997 to November 2011 in: The Cochrane Library, MEDLINE, EMBASE, LILACS, IndMed and PakMed. Reviewers undertook independent quality assessment of studies using the Critical Appraisal Skills Programme (CASP) tool for systematic reviews. 1,782 review articles were identified, from which 80 systematic reviews were selected for inclusion. These covered a range of telehealthcare models involving both synchronous (live) and asynchronous (store-and-forward) interactions between provider and patients. Many studies showed no differences in outcomes between telehealthcare and usual care. Several reviews highlighted the large number of short-term (<12 months) feasibility studies with under 20 participants. Effects of telehealthcare on health service indicators were reported in several reviews, particularly reduced hospitalisations. The reported clinical effectiveness of telehealthcare interventions for patients with long-term conditions appeared to be greatest in those with more severe disease at high-risk of hospitalisation and death. The failure of many studies to adequately describe the intervention makes it difficult to disentangle the contributions of technological and human/organisational factors on the outcomes reported. Evidence on the cost-effectiveness of telehealthcare remains sparse. Patient safety considerations were absent from the evaluative telehealthcare literature. CONCLUSIONS: Policymakers and planners need to be aware that investment in telehealthcare will not inevitably yield clinical or economic benefits. It is likely that the greatest gains will be achieved for patients at highest risk of serious outcomes. There is a need for longer-term studies in order to determine whether the benefits demonstrated in time limited trials are sustained.
Overview
CoChat Summary
TL;DR
This systematic overview of systematic reviews found that telehealthcare often shows no outcome differences versus usual care, but may reduce hospitalisations and mortality in higher-risk patients, especially chronic heart failure. Evidence on cost-effectiveness and patient safety was sparse, and many primary studies were small, short-term, and poorly described.
Key findings
- From 1,782 identified review articles, 80 systematic reviews were selected for inclusion and quality appraisal; the Results section reports 81 meeting inclusion criteria. These reviews synthesised 2,396 original articles, including 579 randomised controlled trials.
- Many studies showed no differences in outcomes between telehealthcare and usual care. Where benefits appeared, they were greatest in patients with more severe disease at high risk of hospitalisation and death.
- Several reviews reported reduced hospitalisations, particularly in chronic heart failure: for example, telemonitoring reduced all-cause mortality with relative risk 0.66 (95% CI 0.54–0.81), and home telemonitoring reduced all-cause hospitalisations with relative risk 0.8 (95% CI 0.7–0.9). In asthma, hospitalisations were reduced across four studies with risk ratio 0.3 (95% CI 0.09–0.7).
- Surrogate endpoints showed at best modest effects, such as small and inconsistent HbA1c reductions in diabetes and small blood pressure changes in hypertension. Patient safety considerations were absent from the evaluative telehealthcare literature, and cost-effectiveness evidence remained sparse.
Methods
- Design: systematic review of systematic reviews (“systematic overview”) to synthesise evidence on telehealthcare’s impact on quality and safety of care.
- Data sources: searched The Cochrane Library, MEDLINE, EMBASE, LILACS, IndMed and PakMed for systematic reviews published January 1997 to November 2011, plus Google Scholar and PROSPERO.
- Analysis: at least two reviewers independently selected reviews and assessed quality using the Critical Appraisal Skills Programme (CASP) tool; disagreements were resolved by discussion or third-reviewer arbitration. Data extraction was piloted and focused on benefits and risks for patients, professionals, and the healthcare system.
Limitations
- The paper states that overviews are constrained by what existing reviews report and by the time lag between primary and secondary literature; inconsistent terminology and poor descriptions of telehealthcare interventions made it difficult to disentangle technological from human/organisational factors.
- The paper states that primary studies were generally of low quality, with many small short-term (<12 months) feasibility studies under 20 participants, some lacking power calculations and using non-randomised or observational designs; cost-effectiveness evidence was weak, small-scale, short-duration, and often took only a provider perspective.
- Evident in the text: the abstract reports 80 selected reviews while the Results section reports 81 meeting inclusion criteria, with 80 quality appraised; several reviews did not clearly detail included study designs or intervention components, and few results came from low- and medium-income settings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Valid · 7 Not valid · 57 Not checked · 51 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In diabetes, there were small but statistically significant pooled decreases in HbA1c - In Type 1 diabetes (−0.4% difference, 95% C.I. 0.0 to −0.8) [40]”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Clinical Outcomes
What the sources say
- Partly supportedcites [40] Montori VM, Helgemoe PK, Guyatt GH, Dean DS, Leung TW, et al (2004) Telecare for patients with type 1 diabetes and inadequate glycemic control: a randomized controlled trial and meta-analysis. Diabetes Care 27: 1088– 1094. 15111526 sourceExperimental — accuracy not yet measured
The “Systematic review and meta-analysis of the literature” section reports a pooled HbA1c difference of 0.4% (95% CI 0–0.8) for studies of adults with type 1 diabetes, matching the cited magnitude. But the claim omits the adults-only restriction and describes the result as statistically significant; the paper says the overall eight-study pooled result was not significantly different from usual care. No page number is available in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“There was also no change in mortality in this trial.”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Clinical Outcomes
What the sources say
- Supportedcites [64] McLean S, Nurmatov U, Liu JLY, Pagliari C, Car J, et al.. (2011) Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev: CD007718. PMC8939044 21735417 source
The Deaths section reports no statistically significant mortality difference between groups in Finkelstein 2006. The review also found no significant difference in deaths across three COPD trials; it supports 'no change' as a statement about statistical significance, not identical death counts. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“There was also no difference in secondary prevention of coronary heart disease mortality with a telephone-mediated health behaviour change programme [92], [93].”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Clinical Outcomes
What the sources say
- Partly supportedcites [92] Neubeck L, Redfern J, Fernandez R, Briffa T, Bauman A, et al.. (2009) Telehealth interventions for the secondary prevention of coronary heart disease: a systematic review (Structured abstract). European Journal of Cardiovascular Prevention and Rehabilitation. 281–289. 19407659 sourceExperimental — accuracy not yet measured
The All-cause mortality section (and Abstract) of Neubeck et al. 2009 report a nonsignificant difference in mortality for telehealth versus usual care in CHD secondary-prevention patients (RR = 0.70, 95% CI 0.45-1.1, P = 0.12; ~1% absolute risk reduction), so the 'no difference in mortality' part is supported. However, the outcome the source meta-analysed is ALL-CAUSE mortality, not coronary heart disease-specific mortality, and the paper states it could not evaluate nonfatal cardiovascular events/readmissions because only one trial reported them (Other end points section) — so the CHD-mortality specificity of the claim is not supported by this source. The Conclusion also frames the result as a nonsignificant '30% improvement in survival' requiring larger trials rather than a flat absence of difference, and the pooled evidence spans nine telephone plus two Internet-delivered programs (Description of telehealth interventions), though the Discussion does state telephone-based interventions carry the greatest weight of evidence. (LLM, conf=0.72)
- Partly supportedcites [93] Taylor R, Dalal H, Jolly K, Moxham T, Zawada A (2010) Home-based versus centre-based cardiac rehabilitation. Cochrane Database Syst Rev: CD007130. 26282071 sourceExperimental — accuracy not yet measured
The Results (Effects of interventions, Mortality; page not provided) found no significant difference in all-cause mortality between home- and centre-based cardiac rehabilitation. The included studies did not report cardiac-specific deaths separately, and the comparison was not specifically a telephone-mediated health behaviour change programme. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the pooling of all-cause mortality data from 15 studies structured telephone support resulted in a non-significant relative risk of 0.88 (95% C.I. 0.76 to 1.01) [46]”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Clinical Outcomes
What the sources say
- Supportedcites [46] Inglis SC, Clark RA, McAlister FA, Ball J, Lewinter C, et al.. (2010) Structured telephone support or telemonitoring programmes for patients with chronic heart failure. Cochrane Database of Systematic Reviews: CD007228. 20687083 source
The Effects of interventions—All-cause mortality section reports data from 15 peer-reviewed studies comparing structured telephone support with usual care. It gives a pooled RR of 0.88 (95% CI 0.76 to 1.01) and states that the effect was not statistically significant. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In asthma there was significant reduction in hospitalisations over a 12 month period across four studies with a variety of telehealthcare interventions, including web-based diary and interaction with professionals, telephone calls from a nurse educator, telemonitoring with oversight for severe asthma and electronic diary with email or telephone follow up from a physician (risk ratio of 0.3 (95% C.”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Health Service Utilisation
What the sources say
- Partly supportedcites [61] McLean S, Chandler D, Nurmatov U, Liu J, Pagliari C, et al.. (2010) Telehealthcare for asthma. Cochrane Database of Systematic Reviews. Chichester, UK: John Wiley & Sons, Ltd. PMC8936049 20927763 sourceExperimental — accuracy not yet measured
The Hospitalisations section reports a significant reduction in hospitalisations across four telehealthcare studies with 12-month outcomes. It reports an odds ratio of 0.21 (95% CI 0.07–0.61), however, not the claimed risk ratio of 0.3 (95% CI 0.09–0.7). (LLM, conf=0.92)
- Supportedcites [62] McLean S, Chandler D, Nurmatov U, Liu J, Pagliari C, et al (2011) Telehealthcare for asthma: a Cochrane review. CMAJ Canadian Medical Association Journal 183: E733– 742. 21746825 PMC3153544 source
The Effectiveness of telehealthcare section (p. 6) reports exactly what the claim attributes: a meta-analysis of the four studies reporting patients admitted to hospital once or more within 12 months gave summary RR 0.25 (95% CI 0.09 to 0.66) in 499 patients, 'suggests that telehealthcare reduced the risk of admission to hospital'; the abstract (p. 1) states the same as a significant reduction. The claim's 'risk ratio 0.3 (95% CI 0.09 to 0.7)' is that estimate rounded to one decimal, and p. 5 confirms six studies reported admissions with only four of them over 12 months (the other two, refs 30 and 35, at three months). The 'variety of telehealthcare interventions' framing is consistent with the review's included studies (telephone, Internet-based and other networked systems, refs 22, 28, 34, 39), and the outcome is admission to hospital rather than a hospitalisation rate. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
65 more claims · 7 with their cited sources checked
Create a free account to see all 139 claims and to verify the 12 references still open.
- It may state two separate claims as one. 52
- The quote only partly states this claim. 2
- Probably not a substantial claim. 22
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A meta-analysis of 80 systematic reviews of telehealth care (3 of which were with COPD) found that mortality for COPD patients was not affected but hospitalizations were reduced and quality of life was increased”
From Using Robots at Home to Support Patients With Chronic Obstructive Pulmonary Disease: Pilot Randomized Controlled Trial (2018) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There are few rigorous systematic evaluations on the clinical benefits of TM and the impact of TM on the quality and safety of care [15].”
From Diagnostic Concordance of Telemedicine as Compared With Face-to-Face Care in Primary Health Care Clinics in Rural India: Randomized Crossover Trial (2023) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recent reviews agree that there is a need for more research on the safety of care [4] and the quality and safety of prescribing through remote consultations [4,32].”
From Impact of Remote Consultations on Antibiotic Prescribing in Primary Health Care: Systematic Review (2020) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“McLean et al. (2013) [9] found that rural populations tend to be more satisfied with remote care, preferring it to the physical model”
From Patient safety risk associated with synchronous telehealth: A scoping review (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredIn the citing paper
“Telecare products and services have the potential to alleviate this burden by supporting self-management, remote monitoring of health conditions, and the delivery of interventions [4-6].”
From Experiences of Multidisciplinary Development Team Members During User-Centered Design of Telecare Products and Services: A Qualitative Study (2014) · cites this paper as [4]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Quality of Life
“In COPD, there was a significant increase in pooled quality of life in telehealthcare compared to control”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Quality of Life
“(mean difference −6.6, 95% C.I. −13.7 to 0.5).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Results > Overview of the Evidence
“Re-running the searches to cover the period up to and including November 2011 resulted in a total of 81 systematic reviews meeting our inclusion criteria”
§ The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview > Abstract > Methods and Findings
“1,782 review articles were identified, from which 80 systematic reviews were selected for inclusion.”
Citations
Cites
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2015) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,533
Projections of Global Mortality and Burden of Disease from 2002 to 2030
Mathers, C. D., & Loncar, D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030442 · Cited by 11,386
Pharmacological interventions for somatoform disorders in adults
Kleinstäuber, M., Witthöft, M., Steffanowski, A., van Marwijk, H., Hiller, W., & Lambert, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010628.pub2 · Cited by 11,335
Barnett, K., Mercer, S. W., Norbury, M., Watt, G., Wyke, S., & Guthrie, B. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60240-2 · Cited by 6,972
Lopez, A. D., Mathers, C. D., Ezzati, M., Jamison, D. T., & Murray, C. J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68770-9 · Cited by 5,630 · cited 1×
“This has accompanied the realisation that traditional models of health service delivery may be unable to cope with future levels of chronic disease in ageing populations [3,4,5,6].”
BackgroundRealist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 1×
“The technique of ‘‘realistic evaluation’’ – where mid-range theories structured around emergent context-mechanism-outcome (CMO) groupings – are then supported or refuted by further scrutiny of the evidence, holds significant potential for the further understanding of telehealthcare [101,102,103,104].”
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Self-citationRay, K. K., Seshasai, S. R. K., Wijesuriya, S., Sivakumaran, R., Nethercott, S., Preiss, D., Erqou, S., & Sattar, N. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60697-8 · Cited by 1,383
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Telemonitoring in patients with heart failure
Chaudhry, S. I., Mattera, J. A., Curtis, J. P., Spertus, J. A., Herrin, J., Lin, Z., Phillips, C. O., Hodshon, B. V., Cooper, L. S., & Krumholz, H. M. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1010029 · Cited by 1,232
Research works printed but not linked: 5
- Commission (2009) Opinion of the European Economic and Social Commitee on the Communication from the Commission to the European Parliament, the Council, the EU Social commitee and the Committee of the Refions of telemedicine for the benefit of patients healthcare systems and society. Official Journal of the European Union 689 C 317/84.
- Pagliari C (2004) Literature review and conceptual map of the field of eHealth. Final report to the SDO programme. The University of Edinburgh.
- Deshpande A, Khoja S, Lorca J, McKibbon A, Rizo C, et al.. (2009) Asynchronous telehealth: systematic review of analytic studies and environmental scan of relevant initiatives (Structured abstract). Ottawa: Canadian Agency for Drugs and Technologies in Health (CADTH): Canadian Agency for Drugs and Technologies in Health (CADTH).
- Pawson P, Bellamy JL (2003) Realist synthesis: an explanatory focus for systematic review in Moving beyond effectiveness in evidence synthesis: Methodological issues in the synthesis of diverse sources of evidence. London: NICE. 83–93 p.
- Pawson R, Tilley N (1997) Realistic Evaluation: SAGE.
Cited by
Dorsey, E. R., & Topol, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1601705 · Cited by 1,211
Use of Telehealth During the COVID-19 Pandemic: Scoping Review
Doraiswamy, S., Abraham, A., Mamtani, R., & Cheema, S. (2020) · Journal of Medical Internet Research · doi:10.2196/24087 · Cited by 698
“This finding is in line with that of many past reviews on the subject [9,44-46].”
Hanlon, P., Daines, L., Campbell, C., McKinstry, B., Weller, D., & Pinnock, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6688 · Cited by 499
“…may be grouped and considered under the following headings: Given the wide variety of technologies and interventions that telehealth encompasses [2], and the varied nature of self-management interventions [12], we aimed to gain a broad overview of the evidence for telehealth-mediated…”
InfluentialSkowyra, J., Pietrzak, K., & Alhnan, M. A. (2015) · European Journal of Pharmaceutical Sciences · doi:10.1016/j.ejps.2014.11.009 · Cited by 530
Patient Satisfaction With Telemedicine During the COVID-19 Pandemic: Retrospective Cohort Study
Ramaswamy, A., Yu, M., Drangsholt, S., Ng, E., Culligan, P. J., Schlegel, P. N., & Hu, J. C. (2020) · Journal of Medical Internet Research · doi:10.2196/20786 · Cited by 475
“Of all studies evaluating quality in telemedicine, four systematic reviews demonstrate there is limited published evidence to evaluate patient satisfaction as a metric for comparison to in-person visits [29-32].”
BackgroundKitsiou, S., Paré, G., & Jaana, M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4174 · Cited by 327
“An additional inhibiting factor that has been cited by several researchers [7,9,64] includes the lack of a commonly accepted taxonomy for classifying HT interventions into meaningful groups according to the technology in use and other key characteristics (eg, intensity and complexity, health care…”
InfluentialSadia, M., Sośnicka, A., Arafat, B., Isreb, A., Ahmed, W., Kelarakis, A., & Alhnan, M. A. (2016) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2016.09.050 · Cited by 323
Usefulness of telepsychiatry: A critical evaluation of videoconferencing-based approaches
Chakrabarti, S. (2015) · World Journal of Psychiatry · doi:10.5498/wjp.v5.i3.286 · Cited by 292
Okwuosa, T. C., Stefaniak, D., Arafat, B., Isreb, A., Wan, K.-W., & Alhnan, M. A. (2016) · Pharmaceutical Research · doi:10.1007/s11095-016-1995-0 · Cited by 294
Sligo, J., Gauld, R., Roberts, V., & Villa, L. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.09.007 · Cited by 264
Schwamm, L. H., Chumbler, N., Brown, E., Fonarow, G. C., Berube, D., Nystrom, K., Suter, R., Zavala, M., Polsky, D., Radhakrishnan, K., et al. (2017) · Circulation · doi:10.1161/cir.0000000000000475 · Cited by 198
Varsi, C., Ekstedt, M., Gammon, D., & Ruland, C. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.5091 · Cited by 191
How to measure costs and benefits of ehealth interventions: An overview of methods and frameworks
Bergmo, T. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4521 · Cited by 181
Lake, R., Georgiou, A., Li, J., Li, L., Byrne, M. W., Robinson, M., & Westbrook, J. I. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2564-x · Cited by 190
Telemedicine application in patients with chronic disease: a systematic review and meta-analysis
Ma, Y., Zhao, C., Zhao, Y., Lu, J., Jiang, H., Cao, Y., & Xu, Y. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01845-2 · Cited by 158
eHealth and quality in health care: implementation time
Ossebaard, H. C., & Van Gemert-Pijnen, L. (2016) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzw032 · Cited by 142
Virtual Visits — Confronting the Challenges of Telemedicine
Kahn, J. M. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1500533 · Cited by 139
Dykgraaf, S. H., Desborough, J., de Toca, L., Davis, S. I., Roberts, L., Munindradasa, A., McMillan, A., Kelly, P., & Kidd, M. R. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104483 · Cited by 138
Adibi, S., Rajabifard, A., Shojaei, D., & Wickramasinghe, N. S. (2024) · Sensors · doi:10.3390/s24092793 · Cited by 169
Telehealth by an Interprofessional Team in Patients With CKD: A Randomized Controlled Trial
Ishani, A., Christopher, J., Palmer, D., Otterness, S., Clothier, B. A., Nugent, S. M., Nelson, D. B., Rosenberg, M. E., Atwood, M. A., Bangerter, A. K., et al. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.01.018 · Cited by 131
Implementing Telerehabilitation After Stroke: Lessons Learned from Canadian Trials
Caughlin, S., Mehta, S., Corriveau, H., Eng, J. J., Eskes, G. A., Kairy, D., Meltzer, J. A., Sakakibara, B. M., & Teasell, R. W. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2019.0097 · Cited by 126
Broadbent, E., Garrett, J., Jepsen, N., Li Ogilvie, V., Ahn, H. S., Robinson, H., Peri, K., Kerse, N., Rouse, P., Pillai, A., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8640 · Cited by 119
Telemedicine in Urology: State of the Art
Ellimoottil, C., Skolarus, T. A., Gettman, M. T., Boxer, R. J., Kutikov, A., Lee, B. R., Shelton, J. B., & Morgan, T. M. (2016) · Urology · doi:10.1016/j.urology.2016.02.061 · Cited by 88
Greenhalgh, T., Shaw, S., Wherton, J., Hughes, G., Lynch, J., A'Court, C., Hinder, S., Fahy, N., Byrne, E., Finlayson, A., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010208 · Cited by 85
A telehealth system for automated diagnosis of asthma and chronical obstructive pulmonary disease
Gurbeta, L., Badnjević, A., Maksimović, M., Omanović-Mikličanin, E., & Sejdić, E. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy055 · Cited by 85
Impact of Remote Consultations on Antibiotic Prescribing in Primary Health Care: Systematic Review
Han, S. M., Greenfield, G., Majeed, A., & Hayhoe, B. (2020) · Journal of Medical Internet Research · doi:10.2196/23482 · Cited by 80
“More recent reviews agree that there is a need for more research on the safety of care [4] and the quality and safety of prescribing through remote consultations [4,32].”
The Effect of Telehealth on Hospital Services Use: Systematic Review and Meta-analysis
Peters, G. M., Kooij, L., Lenferink, A., van Harten, W. H., & Doggen, C. J. M. (2021) · Journal of Medical Internet Research · doi:10.2196/25195 · Cited by 91
O’Brien, K. M., Hodder, R. K., Wiggers, J., Williams, A. J., Campbell, E. M., Wolfenden, L., Yoong, S. L., Tzelepis, F., Kamper, S. J., & Williams, C. M. (2018) · PeerJ · doi:10.7717/peerj.5846 · Cited by 75
A virtual asthma clinic for children: fewer routine outpatient visits, same asthma control
van den Wijngaart, L. S., Roukema, J., Boehmer, A. L. M., Brouwer, M. L., Hugen, C. A. C., Niers, L. E. M., Sprij, A. J., Rikkers-Mutsaerts, E. R. V. M., Rottier, B. L., Donders, A. R. T., et al. (2017) · European Respiratory Journal · doi:10.1183/13993003.00471-2017 · Cited by 61
Bertoncello, C., Colucci, M., Baldovin, T., Buja, A., & Baldo, V. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207332 · Cited by 75
Telerehabilitation and emerging virtual reality approaches to stroke rehabilitation
Putrino, D. F. (2014) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000152 · Cited by 70
Telerehabilitation services: a successful paradigm for occupational therapy clinical services?
Sarsak, H. I. (2020) · International Physical Medicine & Rehabilitation Journal · doi:10.15406/ipmrj.2020.05.00237 · Cited by 79
Introducing Twitter as an assessed component of the undergraduate nursing curriculum: case study
Jones, R. B., Kelsey, J., Nelmes, P., Chinn, N., Chinn, T., & Proctor‐Childs, T. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.12935 · Cited by 65
Home telemonitoring and remote feedback between clinic visits for asthma
Kew, K. M., & Cates, C. J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011714.pub2 · Cited by 61
Patient Autonomy and Quality of Care in Telehealthcare
Rubeis, G., Schochow, M., & Steger, F. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9885-3 · Cited by 59
Shah, M. N., Wasserman, E. B., Gillespie, S. M., Wood, N. E., Wang, H., Noyes, K., Nelson, D., Dozier, A., & McConnochie, K. M. (2015) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2015.07.009 · Cited by 50
Practice-level quality improvement interventions in primary care: a review of systematic reviews
Irwin, R., Stokes, T., & Marshall, T. P. (2015) · Primary Health Care Research & Development · doi:10.1017/s1463423615000274 · Cited by 58
Effectiveness of Telemedicine for Controlling Asthma Symptoms: A Systematic Review and Meta-analysis
Zhao, J., Zhai, Y.-K., Zhu, W.-J., & Sun, D.-X. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0119 · Cited by 54
“A more recent review of telehealthcare in general by McLean et al., 32 which included 80 systematic reviews, found large variation in the length of studies and number of participants and that many studies did not adequately describe the interventions, making it difficult to distinguish the effects…”
Tashkandi, E. M., Zeeneldin, A. A., Alabdulwahab, A. S., Elemam, O., Elsamany, S. A., Jastaniah, W. A., Abdullah, S., Alfayez, M., Jazieh, A. R., & Al-Shamsi, H. O. (2020) · Journal of Medical Internet Research · doi:10.2196/19691 · Cited by 57
Remote versus face-to-face check-ups for asthma
Kew, K. M., & Cates, C. J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011715.pub2 · Cited by 65
eHealth Apps Replacing or Complementing Health Care Contacts: Scoping Review on Adverse Effects
Stevens, W. J. M., van der Sande, R., Beijer, L. J., Gerritsen, M. G., & Assendelft, W. J. (2019) · Journal of Medical Internet Research · doi:10.2196/10736 · Cited by 63
Digital technologies in nursing: An umbrella review
Schlicht, L., Wendsche, J., Melzer, M., Tschetsche, L., & Rösler, U. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104950 · Cited by 82
Providing Specialty Consultant Expertise to Primary Care: An Expanding Spectrum of Modalities
Kirsh, S. R., Ho, P. M., & Aron, D. C. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2014.04.016 · Cited by 49
Ferorelli, D., Nardelli, L., Spagnolo, L., Corradi, S., Silvestre, M. E. A., Misceo, F., Marrone, M., Zotti, F. D., Mandarelli, G., Solarino, B., et al. (2020) · Journal of Primary Care & Community Health · doi:10.1177/2150132720985055 · Cited by 57
Telemedical Asthma Education and Health Care Outcomes for School-Age Children: A Systematic Review
Culmer, N. P., Smith, T., Stager, C. G., Wright, A. L., Burgess, K., Johns, S., Watt, M. J., & Desch, M. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.02.005 · Cited by 46
Steventon, A., Bardsley, M., Doll, H., Tuckey, E., & Newman, S. P. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-334 · Cited by 40
Hobson, E., Baird, W. O., Cooper, C. L., Mawson, S., Shaw, P. J., & McDermott, C. J. (2016) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.3109/21678421.2016.1165255 · Cited by 45
Melchiorre, M. G., Lamura, G., & Barbabella, F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207292 · Cited by 41
Plantier, M., Havet, N., Durand, T., Caquot, N., Amaz, C., Biron, P., Philip, I., & Perrier, L. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.04.002 · Cited by 60
Lee, M., Wang, M., Liu, J., & Holbrook, A. (2018) · Journal of Thrombosis and Thrombolysis · doi:10.1007/s11239-018-1609-2 · Cited by 40
Gillespie, S. M., Shah, M. N., Wasserman, E. B., Wood, N. E., Wang, H., Noyes, K., Nelson, D. L., Dozier, A. M., & McConnochie, K. M. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0152 · Cited by 38
Enabling Guidelines for the Adoption of eHealth Solutions: Scoping Review
Støme, L. N., Wilhelmsen, C. R., & Kværner, K. J. (2021) · JMIR Formative Research · doi:10.2196/21357 · Cited by 44
PENERAPAN TELENURSING DALAM PELAYANAN KESEHATAN : Literature Review
(2019) · doi:10.36341/jka.v3i2.837 · Cited by 38
Teleconsulta: uma Revisão Integrativa da Interação Médico-Paciente Mediada pela Tecnologia
Catapan, S. D. C., & Calvo, M. C. M. (2020) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v44.1-20190224.ing · Cited by 108
Video Teleconferencing for Disease Prevention, Diagnosis, and Treatment: A Rapid Review
Albritton, J., Ortiz, A., Wines, R., Booth, G., DiBello, M., Brown, S. L., Gartlehner, G., & Crotty, K. (2021) · Annals of Internal Medicine · doi:10.7326/m21-3511 · Cited by 34
Hanley, J., Fairbrother, P., Krishan, A., McCloughan, L., Padfield, P., Paterson, M., Pinnock, H., Sheikh, A., Sudlow, C., Todd, A., et al. (2015) · Trials · doi:10.1186/s13063-015-0628-y · Cited by 34
Self-citationYulzari, R., Bretler, S., Avraham, Y., Sharabi‐Nov, A., Even-Tov, E., & Gilbey, P. (2017) · Annals of Otology Rhinology & Laryngology · doi:10.1177/0003489417745089 · Cited by 38
Vermeulen, J., Verwey, R., Hochstenbach, L. M., van der Weegen, S., Man, Y. P., & de Witte, L. P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3195 · Cited by 35
Barbour, P. J., Arroyo, J., High, S., Fichera, L. B., Staska-Pier, M. M., & McMahon, M. K. (2016) · Hospital Practice · doi:10.1080/21548331.2016.1166922 · Cited by 34
“Proven benefits include reductions in hospital admissions and length of stay as well as decreases in emergency department visits.[2,3] Telehealth has also been effective in improving access to varying areas of specialty care, including stroke,[4] cancer,[5] mental health,[6]”
BackgroundHsiehchen, D., Muquith, M., Haque, W. Z., Espinoza, M., Yopp, A. C., & Beg, M. S. (2021) · JCO Oncology Practice · doi:10.1200/op.21.00092 · Cited by 32
Online asthma management for children is cost-effective
van den Wijngaart, L. S., Kievit, W., Roukema, J., Boehmer, A. L. M., Brouwer, M. L., Hugen, C. A. C., Niers, L. E. M., Sprij, A., Rikkers-Mutsaerts, E. R. V. M., Rottier, B. L., et al. (2017) · European Respiratory Journal · doi:10.1183/13993003.01413-2017 · Cited by 30
Systematic Review of Telehealth Cost Minimization for Patients and Health Systems in Otolaryngology
Cabrera, C. I., Ning, A. Y., Cai, Y., & D’Anza, B. (2020) · The Laryngoscope · doi:10.1002/lary.29321 · Cited by 38
Mobile Health Self-management Support for Spinal Cord Injury: Systematic Literature Review
Bernard, R. M., Seijas, V., Davis, M., Volkova, A., Diviani, N., Lüscher, J., & Sabariego, C. (2023) · JMIR mhealth and uhealth · doi:10.2196/42679 · Cited by 31
Agastiya, I. M. C., Kurianto, E., Akalili, H., & Wicaksana, A. L. (2022) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2022.102485 · Cited by 40
Bishop, G. T., Evans, B. A., Kyle, K. L., & Kogan, L. R. (2018) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.253.9.1151 · Cited by 35
Telemedicine in Primary Care: Qualitative Work Towards a Framework for Appropriate Use
Segal, J. B., Dukhanin, V., & Davis, S. L. (2022) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2022.03.210229 · Cited by 38
Ramanadhan, S., Ganapathy, K., Nukala, L., Rajagopalan, S., & Camillus, J. C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0261907 · Cited by 32
Valdivieso, B., García‐Sempere, A., Sanfélix‐Gimeno, G., Faubel, R., Librero, J., Soriano, E., & Peiró, S. (2018) · Medicina Clínica · doi:10.1016/j.medcli.2018.03.013 · Cited by 40
Optimizing the Communication with Cancer Patients During the COVID-19 Pandemic: Patient Perspectives
Tashkandi, E., BaAbdullah, M., Zeeneldin, A., AlAbdulwahab, A., Elemam, O., Elsamany, S., Alfayez, M., Dabash, Y., Khayat, E., Hassanin, F., et al. (2020) · Patient Preference and Adherence · doi:10.2147/ppa.s263022 · Cited by 30
Chancen und Risiken der Telemedizin in der Orthopädie und Unfallchirurgie
Holderried, M., Schlipf, M., Hoeper, A., Meier, R., Stöckle, U., & Kraus, T. M. (2017) · Zeitschrift für Orthopädie und Unfallchirurgie · doi:10.1055/s-0043-116941 · Cited by 32
Ask the eConsultant: Improving access to haematology expertise using an asynchronous eConsult system
Fogel, A., Khamisa, K., Afkham, A., Liddy, C., & Keely, E. (2017) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16644095 · Cited by 29
“There is a lack of literature in the area of patient safety and asynchronous eConsultations.(24) We demonstrated that in 4% of cases PCPs were not planning on sending the patient for a traditional face-to-face referral; however, the eConsultant recommended one due to the potential high-acuity nature or complexity of t…”
BackgroundComputer-assisted initial diagnosis of rare diseases
Alves, R., Piñol, M., Vilaplana, J., Teixidó, I., Corella, J. C., Comas, J., Vilaprinyó, E., Albert Sorribas, B., & Solsona, F. (2016) · PeerJ · doi:10.7717/peerj.2211 · Cited by 33
Verma, N., Buch, B., Taralekar, R., & Acharya, S. (2023) · JMIR Formative Research · doi:10.2196/42775 · Cited by 30
Gaveikaite, V., Grundstrom, C., Winter, S., Chouvarda, I., Maglaveras, N., & Priori, R. (2019) · Respiratory Medicine · doi:10.1016/j.rmed.2019.09.005 · Cited by 36
The Role of Telemedicine in Providing Thoracic Oncology Care to Remote Areas of British Columbia
Humer, M. F., & Campling, B. G. (2017) · Current Oncology Reports · doi:10.1007/s11912-017-0612-7 · Cited by 28
Maccabi proactive Telecare Center for chronic conditions – the care of frail elderly patients
Porath, A., Irony, A., Borobick, A. S., Nasser, S., Malachy, A., Fund, N., & Kaufman, G. (2017) · Israel Journal of Health Policy Research · doi:10.1186/s13584-017-0192-x · Cited by 27
A qualitative study of midwives’ perceptions on using video‐calling in early labor
Spiby, H., Faucher, M. A., Sands, G., Roberts, J. L., & Kennedy, H. P. (2018) · Birth · doi:10.1111/birt.12364 · Cited by 29
Lynch, J. K., Glasby, J., & Robinson, S. (2018) · Critical Social Policy · doi:10.1177/0261018318762737 · Cited by 34
Bishop, G. T., Rishniw, M., & Kogan, L. R. (2021) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.258.12.1372 · Cited by 31
Colucci, M., Baldo, V., Baldovin, T., & Bertoncello, C. (2017) · Health Informatics Journal · doi:10.1177/1460458217747109 · Cited by 31
Patel, N., Jones, P., Adamson, V., Spiteri, M. A., & Kinmond, K. (2015) · Qualitative Health Research · doi:10.1177/1049732315573013 · Cited by 24
Gallagher, J., James, S., Keane, C., Fitzgerald, A., Travers, B., Quigley, E., Hecht, C., Zhou, S., Watson, C. J., Ledwidge, M. T., et al. (2017) · ESC Heart Failure · doi:10.1002/ehf2.12163 · Cited by 22
Survey of Telemedicine by Pediatric Nephrologists During the COVID-19 Pandemic
Raina, R., Nair, N., Yap, H., Filler, G., Sethi, S. K., Bagga, A., Hari, P., Bunchman, T. E., Bartosh, S. M., Twombley, K. E., et al. (2021) · Kidney International Reports · doi:10.1016/j.ekir.2021.06.026 · Cited by 27
Kazawa, K., Osaki, K., Rahman, M. M., & Moriyama, M. (2020) · BMC Nursing · doi:10.1186/s12912-020-0409-0 · Cited by 26
Cancer care in a time of COVID: lung cancer patient’s experience of telehealth and connectedness
Fraser, A., McNeill, R., & Robinson, J. (2021) · Supportive Care in Cancer · doi:10.1007/s00520-021-06528-8 · Cited by 23
Patient’s Perspectives of Telepsychiatry: The Past, Present and Future
Naik, S. S., Manjunatha, N., Kumar, C. N., Math, S. B., & Moirangthem, S. (2020) · Indian Journal of Psychological Medicine · doi:10.1177/0253717620963341 · Cited by 18
Elhadi, M. K., Msherghi, A., Elhadi, A., Ashini, A., Alsoufi, A., Alshiteewi, F. B., Elmabrouk, A., Alsuyihili, A., Elgherwi, A., Elkhafeefi, F., et al. (2021) · JMIR Medical Informatics · doi:10.2196/23335 · Cited by 25
Sannino, G., Pietro, G. D., & Verde, L. (2019) · Springer eBooks · doi:10.1007/978-3-030-27844-1_11 · Cited by 30
Caring for Older Persons in a Technologically Advanced Nursing Future
Pepito, J. A., Locsin, R. C., & Constantino, R. E. (2019) · Health · doi:10.4236/health.2019.115039 · Cited by 21
Postoperative Telehealth Visits: Assessment of Quality and Preferences of Veterans
Vella, M. A., Kummerow Broman, K., Tarpley, J. L., Dittus, R. S., & Roumie, C. L. (2015) · JAMA Surgery · doi:10.1001/jamasurg.2015.2660 · Cited by 18
Graves, M., & Doucet, S. A. (2016) · Journal of Research in Interprofessional Practice and Education · doi:10.22230/jripe.2017v6n2a234 · Cited by 26
Rambur, B., Palumbo, M. V., & Nurkanovic, M. (2019) · Policy Politics & Nursing Practice · doi:10.1177/1527154419836752 · Cited by 22
Effect of Telehealth Interventions on Hospitalization Indicators: A Systematic Review.
Kalankesh, L. R., Pourasghar, F., Nicholson, L., Ahmadi, S., & Hosseini, M. (2016) · PubMed Central · Cited by 23
Steventon, A., Grieve, R., & Bardsley, M. (2015) · Medical Decision Making · doi:10.1177/0272989x15585131 · Cited by 20
Telehealth treatment for nonspecific low back pain: A review of the current state in mobile health
TABACOF, L. R., Baker, T. S., Durbin, J. R., Desai, V., Zeng, Q., Sahasrabudhe, A., Herrera, J. E., & Putrino, D. F. (2021) · PM&R · doi:10.1002/pmrj.12738 · Cited by 20
Telepsychiatry in the developing world: Whither promised joy?
Chakrabarti, S., & Shah, R. (2016) · Indian Journal of Social Psychiatry · doi:10.4103/0971-9962.193200 · Cited by 13
Integrating and safeguarding care: The potential role of health information technologies
Desmedt, M., Pless, S., Dessers, E., & Vandijck, D. M. (2017) · International Journal of Care Coordination · doi:10.1177/2053434517715781 · Cited by 16
Nurse Practitioner Student Perceptions of a Pilot Simulated Gerontologic Telehealth Visit
LaManna, J. B., Eckhoff, D. O., Duncan, J., & Anderson, M. (2021) · Journal of Nursing Education · doi:10.3928/01484834-20210616-10 · Cited by 15
Metadata
- Authors
- McLean, S., Sheikh, A., Cresswell, K., Nurmatov, U., Mukherjee, M., Hemmi, A., & Pagliari, C.
- Affiliations
- University of Edinburgh (GB)
- Corresponding author
- McLean, Susannah
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-08-19
- Volume
- 8
- Issue
- 8
- Pages
- e71238
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3747134
- OpenAlex
- W2084454453
- Semantic Scholar
- f2823b63a47059b458851c52fd051535b29f4ea8
- Cited by
- 255
- References
- 114
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 18 · 2023: 18 · 2022: 19 · 2021: 27 · 2020: 26 · 2019: 21 · 2018: 21 · 2017: 26 · 2016: 36 · 2015: 17 · 2014: 7 · 2013: 2
- FWCI
- 2.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
- Keywords
- telemedicine, quality of care, patient safety, remote monitoring, patient self-management, store-and-forward telemedicine, synchronous telehealth, chronic disease, hospitalization reduction, cost-effectiveness, feasibility study, high-risk patients
- MeSH terms
- Delivery of Health Care, United Kingdom, Hospitalization, Humans, Quality of Health Care, Databases, Bibliographic, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.