Telemedicine with clinical decision support for critical care: a systematic review
Open accessThe DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Telemedicine applications aim to address variance in clinical outcomes and increase access to specialist expertise. Despite widespread implementation, there is little robust evidence about cost-effectiveness, clinical benefits, and impact on quality and safety of critical care telemedicine. The primary objective was to determine the impact of critical care telemedicine (with clinical decision support available 24/7) on intensive care unit (ICU) and hospital mortality and length of stay in adults and children. The secondary objectives included staff and patient experience, costs, protocol adherence, and adverse events. METHODS: Data sources included MEDLINE, EMBASE, CINAHL, Cochrane Library databases, Health Technology Assessment Database, Web of Science, OpenGrey, OpenDOAR, and the HMIC through to December 2015. Randomised controlled trials and quasi-experimental studies were eligible for inclusion. Eligible studies reported on differences between groups using the telemedicine intervention and standard care. Two review authors screened abstracts and assessed potentially eligible studies using Cochrane guidance. RESULTS: Two controlled before-after studies met the inclusion criteria. Both were assessed as high risk of bias. Meta-analysis was not possible as we were unable to disaggregate data between the two studies. One study used a non-randomised stepped-wedge design in seven ICUs. Hospital mortality was the primary outcome which showed a reduction from 13.6 % (CI, 11.9-15.4 %) to 11.8 % (CI, 10.9-12.8 %) during the intervention period with an adjusted odds ratio (OR) of 0.40 (95 % CI, 0.31-0.52; p = .005). The second study used a non-randomised, unblinded, pre-/post-assessment of telemedicine interventions in 56 adult ICUs. Hospital mortality (primary outcome) reduced from 11 to 10 % (adjusted hazard ratio (HR) = 0.84; CI, 0.78-0.89; p = <.001). CONCLUSIONS: This review highlights the poor methodological quality of most studies investigating critical care telemedicine. The results of the two included studies showed a reduction in hospital mortality in patients receiving the intervention. Further multi-site randomised controlled trials or quasi-experimental studies with accompanying process evaluations are urgently needed to determine effectiveness, implementation, and associated costs. TRIAL REGISTRATION: PROSPERO CRD42014007406.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,171
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Critical care and the global burden of critical illness in adults
Adhikari, N. K., Fowler, R. A., Bhagwanjee, S., & Rubenfeld, G. D. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60446-1 · Cited by 1,304
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162 · cited 1×
“Our review adds to others that have found that the evidence regarding the effectiveness of telemedicine is incomplete and the quality of much of the research is poor [12, 34].”
BackgroundRothschild, J. M., Landrigan, C. P., Cronin, J. W., Kaushal, R., Lockley, S. W., Burdick, E., Stone, P. H., Lilly, C. M., Katz, J. T., Czeisler, C. A., et al. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000171609.91035.bd · Cited by 925
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Interactive telemedicine: effects on professional practice and health care outcomes
Flodgren, G., Rachas, A., Farmer, A. J., Inzitari, M., & Shepperd, S. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002098.pub2 · Cited by 806
Ramsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000576 · Cited by 703
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Variation in critical care services across North America and Western Europe*
Wunsch, H., Angus, D. C., Harrison, D. A., Collange, O., Fowler, R., Hoste, E. A. J., de Keizer, N. F., Kersten, A., Linde-Zwirble, W. T., Sandiumenge, A., et al. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e318186aec8 · Cited by 624
Hospital Volume and the Outcomes of Mechanical Ventilation
Kahn, J. M., Goss, C. H., Heagerty, P. J., Kramer, A. A., O'Brien, C. R., & Rubenfeld, G. D. (2006) · New England Journal of Medicine · doi:10.1056/nejmsa053993 · Cited by 509
Currell, R., Urquhart, C., Wainwright, P., & Lewis, R. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002098 · Cited by 463 · cited 3×
“The telemedicine delivers clinical information and permits consultation and discussion between healthcare professionals and patients regardless of where the patient is located, for example, the remote monitoring of patients with chronic conditions at home, the provision of specialist consultations for patients via vid…”
BackgroundAngus, D. C., Shorr, A. F., White, A., Dremsizov, T. T., Schmitz, R. J., & Kelley, M. A. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000206105.05626.15 · Cited by 441
Evaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307
Prevention of Ventilator-Associated Pneumonia: An Evidence-Based Systematic Review
Collard, H. R., Saint, S., & Matthay, M. A. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-6-200303180-00015 · Cited by 304
Resisting and promoting new technologies in clinical practice: the case of telepsychiatry
May, C., Gask, L., Atkinson, T., Ellis, N., Mair, F., & Esmail, A. (2001) · Social Science & Medicine · doi:10.1016/s0277-9536(00)00305-1 · Cited by 251
Young, L. B., Chan, P. S., Lu, X., Nallamothu, B. K., Sasson, C., & Cram, P. M. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.61 · Cited by 247
Needham, D. M., Bronskill, S. E., Calinawan, J. R., Sibbald, W. J., Pronovost, P. J., & Laupacis, A. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000155992.21174.31 · Cited by 239
Thomas, E. J. (2009) · JAMA · doi:10.1001/jama.2009.1902 · Cited by 236
Perceptions of safety culture vary across the intensive care units of a single institution*
Huang, D. T., Clermont, G., Sexton, B. J., Karlo, C. A., Miller, R. G., Weissfeld, L. A., Rowan, K. M., & Angus, D. C. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000251505.76026.cf · Cited by 236
The effect of telemedicine in critically ill patients: systematic review and meta-analysis
Wilcox, M. E., & Adhikari, N. K. (2012) · Critical Care · doi:10.1186/cc11429 · Cited by 227
A Multicenter Study of ICU Telemedicine Reengineering of Adult Critical Care
Lilly, C. M., McLaughlin, J. M., Zhao, H., Baker, S. P., Cody, S., & Irwin, R. S. (2014) · Chest · doi:10.1378/chest.13-1973 · Cited by 219
Brown, C., Hofer, T., Johal, A., Thomson, R., Nicholl, J., Franklin, B. D., & Lilford, R. J. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023648 · Cited by 186
Hirsh, J., Dalen, J. E., & Guyatt, G. (2001) · Chest · doi:10.1378/chest.119.1_suppl.1s · Cited by 170
Morrison, J. L., Cai, Q., Davis, N., Yan, Y., Berbaum, M. L., Ries, M., & Solomon, G. (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181b78fa8 · Cited by 141
The Costs of Critical Care Telemedicine Programs
Kumar, G., Falk, D. M., Bonello, R. S., Kahn, J. M., Perencevich, E. N., & Cram, P. M. (2013) · CHEST Journal · doi:10.1378/chest.11-3031 · Cited by 129
Santamaria, J., Tobin, A., & Holmes, J. (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181cb0ff1 · Cited by 125
Garland, A. (2005) · CHEST Journal · doi:10.1378/chest.127.6.2165 · Cited by 117
Interventions to reduce mortality among patients treated in Intensive Care Units
Pronovost, P. J., Rinke, M. L., Emery, K., Himmelfarb, C. D., Blackledge, C. G., & Berenholtz, S. M. (2004) · Journal of Critical Care · doi:10.1016/j.jcrc.2004.07.003 · Cited by 115
Impact of an Intensive Care Unit Telemedicine Program on a Rural Health Care System
Zawada, E. T., Herr, P., Larson, D., Fromm, R., Kapaska, D., & Erickson, D. (2009) · Postgraduate Medicine · doi:10.3810/pgm.2009.05.2016 · Cited by 113
Benn, J., Burnett, S. J., Parand, A., Pinto, A., Iskander, S., & Vincent, C. A. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.09.051 · Cited by 113
Clinical outcomes after telemedicine intensive care unit implementation*
Willmitch, B., Golembeski, S., Kim, S. S., Nelson, L. D., & Gidel, L. (2012) · Critical Care Medicine · doi:10.1097/ccm.0b013e318232d694 · Cited by 90
Nassar, B. S., Vaughan-Sarrazin, M. S., Jiang, L., Reisinger, H. S., Bonello, R., & Cram, P. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.1503 · Cited by 79
Moser, D. K., Kimble, L. P., Alberts, M. J., Alonzo, A. A., Croft, J. B., Dracup, K., Evenson, K. R., Go, A. S., Hand, M. M., Kothari, R., et al. (2007) · The Journal of Cardiovascular Nursing · doi:10.1097/01.jcn.0000278963.28619.4a · Cited by 75
Brown, C., Hofer, T. P., Johal, A., Thomson, R., Nicholl, J. P., Franklin, B. D., & Lilford, R. J. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2007.023663 · Cited by 74
Telemedicine Intervention Improves ICU Outcomes
Sadaka, F., Palagiri, A., Trottier, S., Deibert, W., Gudmestad, D., Sommer, S. E., & Veremakis, C. (2013) · Critical Care Research and Practice · doi:10.1155/2013/456389 · Cited by 71
Critical care: the impact of organization and management on outcomes
Nguyen, Y.-L., Wunsch, H., & Angus, D. C. (2010) · Current Opinion in Critical Care · doi:10.1097/mcc.0b013e32833d9180 · Cited by 67
A National ICU Telemedicine Survey
Lilly, C. M., Fisher, K. A., Ries, M. H., Pastores, S. M., Vender, J. S., Pitts, J. A., & Hanson, C. W. (2012) · CHEST Journal · doi:10.1378/chest.12-0310 · Cited by 62
A qualitative study of the variable effects of audit and feedback in the ICU
Sinuff, T., Muscedere, J., Rozmovits, L., Dale, C., & Scales, D. C. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-003978 · Cited by 59
The effect of ICU telemedicine on mortality and length of stay
Kohl, B., Mullen‐Fortino, M., Praestgaard, A. H., Hanson, C. W., Dimartino, J., & Ochroch, E. A. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.120208 · Cited by 54
The Use and Misuse of ICU Telemedicine
Kahn, J. M. (2011) · JAMA · doi:10.1001/jama.2011.716 · Cited by 47
Dainty, K. N., Scales, D. C., Sinuff, T., & Zwarenstein, M. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001166 · Cited by 44
Centralized Monitoring and Virtual Consultant Models of Tele-ICU Care: A Systematic Review
Ramnath, V. R., Ho, L. A., Maggio, L. A., & Khazeni, N. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0352 · Cited by 43
The PRISMA Extension Statement
Hutton, B., Moher, D., & Cameron, C. (2015) · Annals of Internal Medicine · doi:10.7326/l15-5144-2 · Cited by 42
Preventing Ventilator-Associated Pneumonia: An Evidence-Based Approach of Modifiable Risk Factors
Isakow, W., & Kollef, M. H. (2006) · Seminars in Respiratory and Critical Care Medicine · doi:10.1055/s-2006-933668 · Cited by 42
Critical Care Evidence—New Directions
Marini, J. J., Vincent, J., & Annane, D. (2015) · JAMA · doi:10.1001/jama.2014.18484 · Cited by 32
Harty, R. F., & Ancha, H. B. (2006) · Current Treatment Options in Gastroenterology · doi:10.1007/s11938-006-0034-3 · Cited by 22
Improving acute coronary syndrome care: the ACC/AHA guidelines and critical pathways.
Cannon, C. P. (2003) · PubMed · Cited by 7
274: EICU CAN SAVE LIVES IN MYOCARDIAL INFARCTION IN REMOTE AREAS IN THE DEVELOPING WORLD
Gupta, S., Varma, A., Dewan, S., & Kaushal, A. (2013) · Critical Care Medicine · doi:10.1097/01.ccm.0000439420.28386.60 · Cited by 4
Dhakal, A., Pathak, L., & Dhakal, B. (2013) · CHEST Journal · doi:10.1378/chest.1702466 · Cited by 2
Research works printed but not linked: 2
- Effective Practice and Organisation of Care (EPOC). What study designs should be included in an EPOC review? EPOC resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013. Available at: http://epoc.cochrane.org/epoc-specific-resources-review-authors .
- Walley P, Rayment J, Cooke M. Clinical systems improvement in NHS hospital trusts and their PCTs—a snapshot of current practice. Warwick University NHS Institute for Innovation and Improvement; 2006. https://www.researchgate.net/profile/Matthew_Cooke2/publication/265158209_Clinical_Systems_Improvement_in_NHS_Hospital_Trusts_and_their_PCTs_-a_snapshot_of_current_practice/links/546de5070cf2193b94c5eee3.pdf . Accessed 14 Oct 2016.
Cited by
Telemedicine/Virtual ICU: Where Are We and Where Are We Going?
Udeh, C., Udeh, B. L., Rahman, N., Canfield, C. M., Campbell, J. A., & Hata, J. S. (2018) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcj-14-2-126 · Cited by 108
Kindle, R. D., Badawi, O., Celi, L. A., & Sturland, S. (2019) · Critical Care Clinics · doi:10.1016/j.ccc.2019.02.005 · Cited by 81
Interventions To Decrease Hospital Length of Stay
Tipton, K. N., Leas, B. F., Mull, N. K., Siddique, S. M., Greysen, S. R., Lane-Fall, M. B., & Tsou, A. Y. (2021) · doi:10.23970/ahrqepctb40 · Cited by 69
Digital maturity: are we ready to use technology in the NHS?
Johnston, D. S. (2017) · Future Healthcare Journal · doi:10.7861/futurehosp.4-3-189 · Cited by 55
Telemedicine in Intensive Care Units: Scoping Review
Guinemer, C., Boeker, M., Fürstenau, D., Poncette, A.-S., Weiß, B., Mörgeli, R., & Balzer, F. (2021) · Journal of Medical Internet Research · doi:10.2196/32264 · Cited by 51
Metadata
- Authors
- Mackintosh, N., Terblanche, M., Maharaj, R., Xyrichis, A., Franklin, K., Keddie, J., Larkins, E., Maslen, A., Skinner, J., Newman, S., De Sousa Magalhaes, J. H., & Sandall, J.
- Affiliations
- St Thomas' Hospital (GB)
- King's College London (GB)
- King's College Hospital NHS Foundation Trust (GB)
- Guy's and St Thomas' NHS Foundation Trust (GB)
- Corresponding author
- Mackintosh, Nicola
- Venue
- Systematic Reviews
- Published
- 2016-10-18
- Volume
- 5
- Issue
- 1
- Pages
- 176-176
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5070369
- OpenAlex
- W2533054615
- Cited by
- 46
- References
- 53
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 3 · 2023: 4 · 2022: 6 · 2021: 10 · 2020: 3 · 2019: 3 · 2018: 6 · 2017: 2 · 2016: 1
- FWCI
- 0.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (King's College London) (acceptedVersion, other-oa)
- Funders
- Guy's and St Thomas' Charity (G101013)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Keywords
- telemedicine, clinical decision support, intensive care, intensive care unit, in-hospital mortality, length of hospital stay, cost-effectiveness, protocol adherence, adverse events
- MeSH terms
- Critical Care, Humans, Intensive Care Units, Length of Stay, Hospital Mortality, Telemedicine, Decision Support Systems, Clinical, Controlled Before-After Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
