CoChat

Moving from bytes to bedside: a systematic review on the use of artificial intelligence in the intensive care unit

Open access

The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 3 of the 68 sources its claims cite were checked for support.

Abstract

PURPOSE: Due to the increasing demand for intensive care unit (ICU) treatment, and to improve quality and efficiency of care, there is a need for adequate and efficient clinical decision-making. The advancement of artificial intelligence (AI) technologies has resulted in the development of prediction models, which might aid clinical decision-making. This systematic review seeks to give a contemporary overview of the current maturity of AI in the ICU, the research methods behind these studies, and the risk of bias in these studies. METHODS: A systematic search was conducted in Embase, Medline, Web of Science Core Collection and Cochrane Central Register of Controlled Trials databases to identify eligible studies. Studies using AI to analyze ICU data were considered eligible. Specifically, the study design, study aim, dataset size, level of validation, level of readiness, and the outcomes of clinical trials were extracted. Risk of bias in individual studies was evaluated by the Prediction model Risk Of Bias ASsessment Tool (PROBAST). RESULTS: Out of 6455 studies identified through literature search, 494 were included. The most common study design was retrospective [476 studies (96.4% of all studies)] followed by prospective observational [8 (1.6%)] and clinical [10 (2%)] trials. 378 (80.9%) retrospective studies were classified as high risk of bias. No studies were identified that reported on the outcome evaluation of an AI model integrated in routine clinical practice. CONCLUSION: The vast majority of developed ICU-AI models remain within the testing and prototyping environment; only a handful were actually evaluated in clinical practice. A uniform and structured approach can support the development, safe delivery, and implementation of AI to determine clinical benefit in the ICU.

Overview

CoChat Summary

TL;DR

This systematic review of 494 studies found that most artificial intelligence models for the intensive care unit remain in retrospective testing and prototyping, with few clinically evaluated and none evaluated after integration into routine clinical practice. The authors conclude that a uniform, structured approach is needed to move ICU-AI safely from development to bedside benefit.

Key findings

  • Of 494 included studies, 476 (96.4%) were retrospective, 8 (1.6%) were prospective observational, and 10 (2%) were clinical studies; the clinical studies comprised 5 non-randomized trials and 5 randomized clinical trials.
  • Risk of bias was high in 378 of 467 (80.9%) retrospective development studies assessed with PROBAST, most often in the “participants” and “analysis” domains.
  • On the readiness scale, 441 studies (89.3%) scored level 4 or below, 35 (7.1%) reached external validation (level 5), 8 (1.6%) integrated an AI model clinically without exposing staff to results (level 6), and 10 (2%) clinically evaluated model performance (level 8); no studies reported outcome evaluation of an AI model integrated in routine clinical practice (level 9).
  • Among 10 clinical studies, 8 provided complete information on study characteristics and patient outcomes, and 7 showed significant improvement in patient outcomes.

Methods

  • Systematic review prepared according to PRISMA and registered in PROSPERO, with searches in Embase, MEDLINE ALL, Web of Science Core Collection, Cochrane Central Register of Controlled Trials, and Google Scholar from March to July 28, 2020.
  • Eligible studies included adults (≥17 years), assessed AI or ML algorithms for clinical impact, used data gathered during ICU stay, were original research, and were available in English full text.
  • Data extracted included study design, aim, dataset size, level of validation, AI readiness level adapted from NASA technology readiness levels, and clinical trial outcomes; PROBAST was used to assess risk of bias in retrospective development studies, and no quantitative synthesis was conducted.

Limitations

  • The authors state that the review focused specifically on AI models developed in the ICU, so models translatable from other specialties may have been missed; PROBAST was designed for conventional prediction models rather than AI-based models; the literature search may have missed eligible studies; and PROBAST did not assess discrimination, calibration, algorithmic bias, or racial and minority bias.
  • The text also makes evident an inconsistency in the reported number of studies identified through the electronic search: the abstract states 6455, while the Results section states 8645.
  • The review did not assess applicability because no specific therapeutic question was defined, and it conducted no quantitative synthesis.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s00134-021-06446-7

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 PRISMA 2009 flow diagram of the study review process and the exclusion of studies; from [19]
Fig. 1 PRISMA 2009 flow diagram of the study review process and the exclusion of studies; from [19]CC BY-NC · PubMed Central
Fig. 2 Proportion (%) of studies according to their design and the number of patients analyzed. *Studies with a retrospective design were stratified according to their level of validation (e.g. internal, external and no reported validation)
Fig. 2 Proportion (%) of studies according to their design and the number of patients analyzed. *Studies with a retrospective design were stratified according to their level of validation (e.g. internal, external and no reported validation)CC BY-NC · PubMed Central
Fig. 3 Number of studies published according to their level of readiness and year of publication. The total number of studies reporting on model development and prototyping (level 3 and 4), increased rapidly from 30 studies per year in 2017 to 92 studies per year in 2019. Furthermore, the number of studies per year reporting on external validation (level 5) increased from two in 2017 to seven in 2019. The current movement is mainly horizontal whereas the desired movement is diagonal, i.e. towards clinical evaluation
Fig. 3 Number of studies published according to their level of readiness and year of publication. The total number of studies reporting on model development and prototyping (level 3 and 4), increased rapidly from 30 studies per year in 2017 to 92 studies per year in 2019. Furthermore, the number of studies per year reporting on external validation (level 5) increased from two in 2017 to seven in 2019. The current movement is mainly horizontal whereas the desired movement is diagonal, i.e. towards clinical evaluationCC BY-NC · PubMed Central
Fig. 4 Percentage risk of bias according to the domain of assessment for all studies with a retrospective study design; assessed using PROBAST [23]
Fig. 4 Percentage risk of bias according to the domain of assessment for all studies with a retrospective study design; assessed using PROBAST [23]CC BY-NC · PubMed Central

Verification

Claims the paper makes

3 Valid · 1 Not valid · 48 Not checked · 57 Own results and interpretations

61 more claims

Create a free account to see all 109 claims and to verify the 64 references still open.

See all claims — free account
  • It may state two separate claims as one. 18
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 31

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

4 of 4

Citations

Cites

Show all 63 references

Cited by

See all 279

Metadata

Authors
van de Sande, D., van Genderen, M. E., Huiskens, J., Gommers, D., & van Bommel, J.
Affiliations
Erasmus MC (NL)
Corresponding author
van Genderen, Michel E.
Venue
Intensive Care Medicine
Published
2021-06-05
Volume
47
Issue
7
Pages
750-760
ISSN
  • 0342-4642 (ISSN-L)
  • 1432-1238
OpenAlex
W3164057767
Cited by
279
References
59
Citations by year
2026: 54 · 2025: 68 · 2024: 62 · 2023: 47 · 2022: 38 · 2021: 9
FWCI
3.25
Type
journal article
Language
en
Open access
Licence
Locations
  • Intensive Care Medicine (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
  • RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
artificial intelligence, intensive care unit, clinical decision support, prediction model, risk of bias, PROBAST, retrospective analysis, clinical implementation of AI, AI model validation
MeSH terms
Artificial Intelligence, Humans, Intensive Care Units, Retrospective Studies, Observational Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-11-17, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-17 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Moving from bytes to bedside: a systematic review on the use of artificial intelligence in the intensive care unit. https://app.cochat.ai/papers/10.1007/s00134-021-06446-7
The paper
van de Sande, D., van Genderen, M. E., Huiskens, J., Gommers, D., & van Bommel, J. (2021). Moving from bytes to bedside: a systematic review on the use of artificial intelligence in the intensive care unit. Intensive Care Medicine. https://doi.org/10.1007/s00134-021-06446-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.