Telemedicine with clinical decision support for critical care: a systematic review
Open accessThe DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Telemedicine applications aim to address variance in clinical outcomes and increase access to specialist expertise. Despite widespread implementation, there is little robust evidence about cost-effectiveness, clinical benefits, and impact on quality and safety of critical care telemedicine. The primary objective was to determine the impact of critical care telemedicine (with clinical decision support available 24/7) on intensive care unit (ICU) and hospital mortality and length of stay in adults and children. The secondary objectives included staff and patient experience, costs, protocol adherence, and adverse events. METHODS: Data sources included MEDLINE, EMBASE, CINAHL, Cochrane Library databases, Health Technology Assessment Database, Web of Science, OpenGrey, OpenDOAR, and the HMIC through to December 2015. Randomised controlled trials and quasi-experimental studies were eligible for inclusion. Eligible studies reported on differences between groups using the telemedicine intervention and standard care. Two review authors screened abstracts and assessed potentially eligible studies using Cochrane guidance. RESULTS: Two controlled before-after studies met the inclusion criteria. Both were assessed as high risk of bias. Meta-analysis was not possible as we were unable to disaggregate data between the two studies. One study used a non-randomised stepped-wedge design in seven ICUs. Hospital mortality was the primary outcome which showed a reduction from 13.6 % (CI, 11.9-15.4 %) to 11.8 % (CI, 10.9-12.8 %) during the intervention period with an adjusted odds ratio (OR) of 0.40 (95 % CI, 0.31-0.52; p = .005). The second study used a non-randomised, unblinded, pre-/post-assessment of telemedicine interventions in 56 adult ICUs. Hospital mortality (primary outcome) reduced from 11 to 10 % (adjusted hazard ratio (HR) = 0.84; CI, 0.78-0.89; p = <.001). CONCLUSIONS: This review highlights the poor methodological quality of most studies investigating critical care telemedicine. The results of the two included studies showed a reduction in hospital mortality in patients receiving the intervention. Further multi-site randomised controlled trials or quasi-experimental studies with accompanying process evaluations are urgently needed to determine effectiveness, implementation, and associated costs. TRIAL REGISTRATION: PROSPERO CRD42014007406.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,226
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Critical care and the global burden of critical illness in adults
Adhikari, N. K., Fowler, R. A., Bhagwanjee, S., & Rubenfeld, G. D. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60446-1 · Cited by 1,304
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162 · cited 1×
“Our review adds to others that have found that the evidence regarding the effectiveness of telemedicine is incomplete and the quality of much of the research is poor [12, 34].”
BackgroundRothschild, J. M., Landrigan, C. P., Cronin, J. W., Kaushal, R., Lockley, S. W., Burdick, E., Stone, P. H., Lilly, C. M., Katz, J. T., Czeisler, C. A., et al. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000171609.91035.bd · Cited by 925
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Interactive telemedicine: effects on professional practice and health care outcomes
Flodgren, G., Rachas, A., Farmer, A. J., Inzitari, M., & Shepperd, S. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002098.pub2 · Cited by 806 · cited 2×
“The telemedicine delivers clinical information and permits consultation and discussion between healthcare professionals and patients regardless of where the patient is located, for example, the remote monitoring of patients with chronic conditions at home, the provision of specialist consultations for patients via vid…”
BackgroundRamsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000576 · Cited by 703
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Research works printed but not linked: 2
- 23. Effective Practice and Organisation of Care (EPOC) What study designs should be included in an EPOC review? EPOC resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013.
- 41. Walley P, Rayment J, Cooke M. Clinical systems improvement in NHS hospital trusts and their PCTs—a snapshot of current practice. Warwick University NHS Institute for Innovation and Improvement; 2006. https://www.researchgate.net/profile/Matthew_Cooke2/publication/265158209_Clinical_Systems_Improvement_in_NHS_Hospital_Trusts_and_their_PCTs_-a_snapshot_of_current_practice/links/546de5070cf2193b94c5eee3.pdf. Accessed 14 Oct 2016.
Cited by
Telemedicine/Virtual ICU: Where Are We and Where Are We Going?
Udeh, C., Udeh, B. L., Rahman, N., Canfield, C. M., Campbell, J. A., & Hata, J. S. (2018) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcj-14-2-126 · Cited by 108
Kindle, R. D., Badawi, O., Celi, L. A., & Sturland, S. (2019) · Critical Care Clinics · doi:10.1016/j.ccc.2019.02.005 · Cited by 81
Interventions To Decrease Hospital Length of Stay
Tipton, K. N., Leas, B. F., Mull, N. K., Siddique, S. M., Greysen, S. R., Lane-Fall, M. B., & Tsou, A. Y. (2021) · doi:10.23970/ahrqepctb40 · Cited by 69
Digital maturity: are we ready to use technology in the NHS?
Johnston, D. S. (2017) · Future Healthcare Journal · doi:10.7861/futurehosp.4-3-189 · Cited by 55
Telemedicine in Intensive Care Units: Scoping Review
Guinemer, C., Boeker, M., Fürstenau, D., Poncette, A.-S., Weiß, B., Mörgeli, R., & Balzer, F. (2021) · Journal of Medical Internet Research · doi:10.2196/32264 · Cited by 51
Remote Surveillance Technologies: Realizing the Aim of Right Patient, Right Data, Right Time
Safavi, K. C., Driscoll, W. D., & Wiener-Kronish, J. P. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003948 · Cited by 44
Wiwatkunupakarn, N., Aramrat, C., Pliannuom, S., Buawangpong, N., Pinyopornpanish, K., Nantsupawat, N., Mallinson, P. A. C., Kinra, S., & Angkurawaranon, C. (2023) · Journal of Medical Internet Research · doi:10.2196/45944 · Cited by 43
Nadar, M., Jouvet, P. A., Tucci, M., Toledano, B. J., & Sicotte, C. (2018) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000001733 · Cited by 43
21st Century critical care medicine: an overview
Padte, S., Samala Venkata, V., Mehta, P., Tawfeeq, S., Kashyap, R., & Surani, S. (2024) · World Journal of Critical Care Medicine · doi:10.5492/wjccm.v13.i1.90176 · Cited by 26
“Similarly, a review done by Mackintosh showed improved patient mortality with Tele-ICU[36].”
Telemedicine in the intensive care unit: A vehicle to improve quality of care?
Weiß, B., Paul, N., Balzer, F., Noritomi, D. T., & Spies, C. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2020.09.036 · Cited by 22
Review of Systematic Reviews in the Field of Telemedicine
Goharinejad, S., Hajesmaeel-Gohari, S., Jannati, N., Goharinejad, S., & Bahaadinbeigy, K. (2021) · Medical Journal of The Islamic Republic of Iran · doi:10.47176/mjiri.35.184 · Cited by 18
Trauma THOMPSON: Clinical Decision Support for the Frontline Medic
Birch, E. M., Couperus, K. S., Gorbatkin, C., Kirkpatrick, A. W., Wachs, J. P., Candelore, R., Jiang, N., Tran, O., Beck, J., Couperus, C., et al. (2023) · Military Medicine · doi:10.1093/milmed/usad087 · Cited by 18
University of California Technology Wellness Index
Nakagawa, K., & Yellowlees, P. (2019) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2019.08.005 · Cited by 16
Li, L., & Cotton, A. (2018) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2018.0006 · Cited by 15
MAGIMEL-PELONNIER, E., Marjanovic, N. S., Couvreur, R., Drugeon, B., Mimoz, O., & Guénézan, J. (2022) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-022-01026-0 · Cited by 11
Diagnoses and Health Care Utilization for After-Hours Telemedicine Versus Primary Care Visits
Leventer‐Roberts, M., Shimoni, N., Feldman, B., Bachrach, A., Selah, T., Wolff, L., & Waisman, Y. (2021) · Academic Pediatrics · doi:10.1016/j.acap.2021.07.012 · Cited by 11
Childs, H. (2020) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25886/f8z9-t868 · Cited by 11
Murray, N. M., Marshall, S., Hoesch, R. E., Hobbs, K. S., Smith, S. M., Roller, D., Thomas, K. P., Meier, K., & Püttgen, H. A. (2022) · Neurocritical Care · doi:10.1007/s12028-022-01632-x · Cited by 10
Udeh, C., Perez-Protto, S. E., Canfield, C. M., Sreedharan, R., Factora, F. N., & Hata, J. S. (2022) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2021.0465 · Cited by 9
Under the Tech Umbrella: Assessing the Landscape of Telemedicine Innovations (Telemechron Study)
Morelli, S., D’Avenio, G., Daniele, C., Grigioni, M., & Giansanti, D. (2024) · Healthcare · doi:10.3390/healthcare12060615 · Cited by 9
Tele-Medicine, Tele-Rounds, and Tele-Intensive Care Unit in the COVID-19 Pandemic
Rangappa, P., Rao, K., Chandra, T., Karanth, S., & Chacko, J. (2021) · Indian Journal of Medical Specialities · doi:10.4103/injms.injms_100_20 · Cited by 8
Patient safety risk associated with synchronous telehealth: A scoping review
Oliveira, J. S. R. D., Fernandez, R. S., Molina, M. R., Pinto, A. C. P. N., Rocha-Filho, C. R., Ferreira, T. M., & Peres, S. V. (2025) · PLoS One · doi:10.1371/journal.pone.0336992 · Cited by 7
Pscheidl, T., Benstoem, C., Ansems, K., Saal-Bauernschubert, L., Ritter, A., Zorger, A.-M., Dahms, K., Dohmen, S. M., Steinfeld, E., Dormann, J., et al. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0001126 · Cited by 7
Latif, A., Atiq, H., Zaki, M., Hussain, S., Ghayas, A., Shafiq, O., Daudpota, A. A., Abbas, Q., Ariff, S., Asghar, M. A., et al. (2025) · Bulletin of the World Health Organization · doi:10.2471/blt.23.290926 · Cited by 7
Teleneurocritical Care: Lessons Learned in Standardizing Care
Murray, N. M., Hobbs, K. S., Smith, S. M., & Püttgen, H. A. (2022) · Neurocritical Care · doi:10.1007/s12028-022-01478-3 · Cited by 7
Automation: A revolutionary vision of artificial intelligence in theranostics
Panesar, G., Batra, S., & Sharma, S. (2022) · Bulletin du Cancer · doi:10.1016/j.bulcan.2022.10.009 · Cited by 7
Telemedicine in Intensive Care Units: Protocol for a Scoping Review
Guinemer, C., Boeker, M., Weiß, B., Fuerstenau, D., Balzer, F., & Poncette, A.-S. (2020) · JMIR Research Protocols · doi:10.2196/19695 · Cited by 7
Qualitätssteigerung in der Intensivmedizin durch Telemedizin: Beispiel ERIC
Weiß, B., Paul, N., Kraufmann, B., Spies, C., & das ERIC-Konsortium, U. (2021) · AINS - Anästhesiologie · Intensivmedizin · Notfallmedizin · Schmerztherapie · doi:10.1055/a-1130-4996 · Cited by 6
Morley, J. E. (2016) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2016.11.001 · Cited by 6
Nurses’ Perceptions of Telemedicine Adoption in the Intensive Care Unit
Kaplow, R., & Zellinger, M. J. (2021) · American Journal of Critical Care · doi:10.4037/ajcc2021205 · Cited by 5
Udeh, C., Briskin, I. N., & Canfield, C. M. (2021) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0453 · Cited by 5
Jayousi, S., Cinelli, M., Bigazzi, R., Bianchi, S., Scalvini, S., Borghi, G., Bernocchi, P., Inchiostro, S., Giovanazzi, A., Mastellaro, M., et al. (2025) · Technologies · doi:10.3390/technologies13020044 · Cited by 4
Mominkhan, D. M., Aldahmashi, F., Almudeer, A., Alhmod, A. S., Alharbi, M., Alzubaidi, L. M. Y., Alwehaibi, N. K., Alobeiwi, K. N., Balharith, M., Alahmari, A., et al. (2025) · Telemedicine Reports · doi:10.1089/tmr.2024.0088 · Cited by 3
Tele-Yoğun Bakım ve Türkiye’deki Mevcut Durum, Fırsatlar, Kısıtlamalar
Uğur, Y. L., & Gökmen, A. N. (2021) · Türk yoğun bakım derneği dergisi/Türk yoğun bakım dergisi · doi:10.4274/tybd.galenos.2021.96530 · Cited by 3
Telemedicine, Teleanesthesia, and Telesurgery
Murray, W. B., Vaduva, S., & Berg, B. W. (2018) · Oxford University Press eBooks · doi:10.1093/med/9780190495756.003.0033 · Cited by 2
Quality Improvement and Telemedicine Intensive Care Unit
Sanghavi, D., Guru, P. K., & Franco, P. M. (2019) · Critical Care Clinics · doi:10.1016/j.ccc.2019.02.003 · Cited by 2
Pioneering a Framework for Robust Telemedicine Technology Assessment (Telemechron Study)
Morelli, S., Daniele, C., D’Avenio, G., Grigioni, M., & Giansanti, D. (2024) · Technologies · doi:10.3390/technologies12030037 · Cited by 2
Telemedicine in Pediatric Critical Care: At Home and Abroad
Murtha, T. D., Hooper, M. C., & Canarie, M. F. (2017) · Current Treatment Options in Pediatrics · doi:10.1007/s40746-017-0093-9 · Cited by 1
Impact de la télémédecine sur la régulation d'un malaise
Dubocage, M., Delelis-Fanien, H., & Guénézan, J. (2018) · Annales françaises de médecine d’urgence · doi:10.3166/afmu-2018-0005 · Cited by 1
People with Diabetes Group, Bawab, N., People with Diabetes Group, on behalf of co-investigators of ASPIRES, coinvestigators, A. S., Consortia, O. B. O. A. S. R.-D., Moullin, J. C., Bugnon, O., Perraudin, C., Morrow, A., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-01062-3 · Cited by 1
Mathiebe, J., Müller, G., Schmitt, J. M., Brenner, S., Winkler, S., Schawohl, A., Waurig, F., & Scheibe, M. (2025) · Children · doi:10.3390/children12030313 · Cited by 1
Waddell, K., & Wilson, M. G. (2017) · MacSphere (McMaster University) · doi:10.71548/2958
de Armas, I. A. S., Marcano, J. E., Patel, J., Akay, M. H., Patel, M., Akkant, B., Jumean, M. F., Kumar, S., Radovancevic, R., Nathan, S. S., et al. (2021) · The VAD Journal · doi:10.11589/vad/e2021715
Telehealth in the intensive care unit: Current insights and future directions
Xyrichis, A., & Iliopoulou, K. (2023) · Intensive and Critical Care Nursing · doi:10.1016/j.iccn.2023.103412
Self-citationEvaluation of clinical decision support
Benson, N. M., Salmasian, H., & Bates, D. W. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91200-6.00026-7
Kappler, K. E., & Neft, F. (2025) · Soziologie des Wertens und Bewertens · doi:10.1007/978-3-658-46989-4_4
Giannini, B. (2018) · CINECA IRIS Institutial Research Information System (University of Genoa) · doi:10.15167/giannini-barbara_phd2018-02-13
Franke, C. S. (2025) · Refubium (Universitätsbibliothek der Freien Universität Berlin) · doi:10.17169/refubium-48264
Bridging critical care gaps with tele-intensive care units: A mini-review
Jafri, A. D., Singh, R. K., & Sanjeev, O. P. (2026) · Journal of Indira Gandhi Institute Of Medical Sciences · doi:10.4103/jigims.jigims_71_25
Tumina, M. S. (2025) · Jurnal Penelitian Perawat Profesional · doi:10.37287/jppp.v7i2.6233
Metadata
- Authors
- Mackintosh, N., Terblanche, M., Maharaj, R., Xyrichis, A., Franklin, K., Keddie, J., Larkins, E., Maslen, A., Skinner, J., Newman, S., De Sousa Magalhaes, J. H., & Sandall, J.
- Affiliations
- St Thomas' Hospital (GB)
- King's College London (GB)
- King's College Hospital NHS Foundation Trust (GB)
- Guy's and St Thomas' NHS Foundation Trust (GB)
- Corresponding author
- Mackintosh, Nicola
- Venue
- Systematic Reviews
- Published
- 2016-10-18
- Volume
- 5
- Issue
- 1
- Pages
- 176-176
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5070369
- OpenAlex
- W2533054615
- Cited by
- 46
- References
- 53
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 3 · 2023: 4 · 2022: 6 · 2021: 10 · 2020: 3 · 2019: 3 · 2018: 6 · 2017: 2 · 2016: 1
- FWCI
- 0.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (King's College London) (acceptedVersion, other-oa)
- Funders
- Guy's and St Thomas' Charity (G101013)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Keywords
- telemedicine, clinical decision support, intensive care, intensive care unit, in-hospital mortality, length of hospital stay, cost-effectiveness, protocol adherence, adverse events
- MeSH terms
- Critical Care, Humans, Intensive Care Units, Length of Stay, Hospital Mortality, Telemedicine, Decision Support Systems, Clinical, Controlled Before-After Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
