Systematic Review and Comparison of Publicly Available ICU Data Sets—A Decision Guide for Clinicians and Data Scientists
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: As data science and artificial intelligence continue to rapidly gain traction, the publication of freely available ICU datasets has become invaluable to propel data-driven clinical research. In this guide for clinicians and researchers, we aim to: 1) systematically search and identify all publicly available adult clinical ICU datasets, 2) compare their characteristics, data quality, and richness and critically appraise their strengths and weaknesses, and 3) provide researchers with suggestions, which datasets are appropriate for answering their clinical question. DATA SOURCES: A systematic search was performed in Pubmed, ArXiv, MedRxiv, and BioRxiv. STUDY SELECTION: We selected all studies that reported on publicly available adult patient-level intensive care datasets. DATA EXTRACTION: A total of four publicly available, adult, critical care, patient-level databases were included (Amsterdam University Medical Center data base [AmsterdamUMCdb], eICU Collaborative Research Database eICU CRD], High time-resolution intensive care unit dataset [HiRID], and Medical Information Mart for Intensive Care-IV). Databases were compared using a priori defined categories, including demographics, patient characteristics, and data richness. The study protocol and search strategy were prospectively registered. DATA SYNTHESIS: Four ICU databases fulfilled all criteria for inclusion and were queried using SQL (PostgreSQL version 12; PostgreSQL Global Development Group) and analyzed using R (R Foundation for Statistical Computing, Vienna, Austria). The number of unique patient admissions varied between 23,106 (AmsterdamUMCdb) and 200,859 (eICU-CRD). Frequency of laboratory values and vital signs was highest in HiRID, for example, 5.2 (±3.4) lactate values per day and 29.7 (±10.2) systolic blood pressure values per hour. Treatment intensity varied with vasopressor and ventilatory support in 69.0% and 83.0% of patients in AmsterdamUMCdb versus 12.0% and 21.0% in eICU-CRD, respectively. ICU mortality ranged from 5.5% in eICU-CRD to 9.9% in AmsterdamUMCdb. CONCLUSIONS: We identified four publicly available adult clinical ICU datasets. Sample size, severity of illness, treatment intensity, and frequency of reported parameters differ markedly between the databases. This should guide clinicians and researchers which databases to best answer their clinical questions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ICUs are at the forefront of data sharing efforts, offering several publicly available datasets for use by the research community [75].”
From Implementing Artificial Intelligence in Critical Care Medicine: a consensus of 22. (2025) · cites this paper as [75]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Centralizing data collection from multiple ICUs, or federating them into structured networks, enhances external validity and reliability by enabling a scale of data volume that would be unattainable for individual institutions alone [74].”
From Implementing Artificial Intelligence in Critical Care Medicine: a consensus of 22. (2025) · cites this paper as [74]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Self-citationPollard, T. J., Johnson, A. E. W., Raffa, J. D., Celi, L. A., Mark, R. G., & Badawi, O. (2018) · Scientific Data · doi:10.1038/sdata.2018.178 · Cited by 1,993 · cited 1×
“Of note, the definitions used in this article can differ from prior publications (8, 9, 21), as different researchers may have used slightly different definitions or querying approaches.”
ResultSelf-citationSaeed, M., Villarroel, M., Reisner, A. T., Clifford, G., Lehman, L.-W., Moody, G., Heldt, T., Kyaw, T. H., Moody, B., & Mark, R. G. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820a92c6 · Cited by 1,162 · cited 10×
“After removal of duplicate publications and earlier versions of the same database (e.g., MIMIC-III), four unique databases were identified ( Fig.”
BackgroundInfluentialEarly prediction of circulatory failure in the intensive care unit using machine learning
Hyland, S. L., Faltys, M., Hüser, M., Lyu, X., Gumbsch, T., Esteban, C., Bock, C., Horn, M., Moor, M., Rieck, B., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0789-4 · Cited by 477 · cited 1×
“Prior research already described how each of the databases was built, outlined their structures, and provided a limited, summary of patient characteristics (8, 23–25).”
MethodSelf-citationThe myth of generalisability in clinical research and machine learning in health care
Futoma, J., Simons, M., Panch, T., Doshi-Velez, F., & Celi, L. A. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30186-2 · Cited by 467
Self-citationThoral, P. J., Peppink, J. M., Driessen, R. H., Sijbrands, E. J. G., Kompanje, E. J. O., Kaplan, L., Bailey, H., Kesecioglu, J., Cecconi, M., Churpek, M., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004916 · Cited by 257
Self-citationTemporal bias in case-control design: preventing reliable predictions of the future
Yuan, W., Beaulieu-Jones, B. K., Yu, K.-H., Lipnick, S. L., Palmer, N., Loscalzo, J., Cai, T., & Kohane, I. S. (2021) · Nature Communications · doi:10.1038/s41467-021-21390-2 · Cited by 86 · cited 1×
“From a clinical perspective, researchers should consider the observational nature of the data and be mindful of statistical and epidemiological pitfalls, including selection bias (which patients get admitted to the ICU), temporal biases, or patient data not missing at random (11).”
BackgroundPhysioNet: a research resource for studies of complex physiologic and biomedical signals
Moody, G. B., Mark, R. G., & Goldberger, A. L. (2002) · Computers in cardiology · doi:10.1109/cic.2000.898485 · Cited by 77 · cited 1×
“As data availability continued to increase in subsequent decades, medical data science was significantly propelled by the worldwide web— which simplified data sharing—as well as the publication of electronic patient data through platforms such as PhysioNet (5).”
Background
Research works printed but not linked: 2
- Caceres, 1968, Telemetry in medicine and biology., Adv Biomed Eng Med Phys, 1, 279
- Sauer, 2021, Comparison of publicly available ICU data sets - a guide for clinicians and data scientists., PROSPERO, CRD42021223377
Cited by
Leveraging electronic health records for data science: common pitfalls and how to avoid them
Sauer, C. M., Chen, L.-C., Hyland, S. L., Girbes, A., Elbers, P., & Celi, L. A. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00154-6 · Cited by 166
Self-citationUse of artificial intelligence in critical care: opportunities and obstacles
Pinsky, M. R., Bedoya, A., Bihorac, A., Celi, L., Churpek, M., Economou-Zavlanos, N. J., Elbers, P., Saria, S., Liu, V., Lyons, P. G., et al. (2024) · Critical Care · doi:10.1186/s13054-024-04860-z · Cited by 160
“Most are described and accessible on the Phy-sionet platform [5].”
BackgroundSelf-citationWieruszewski, P. M., Léone, M., Kaas‐Hansen, B. S., Dugar, S. P., Legrand, M. M., McKenzie, C., Bissell, B. D., Messina, A., Nasa, P., Schorr, C., et al. (2024) · Critical Care Medicine · doi:10.1097/ccm.0000000000006176 · Cited by 98
Rockenschaub, P., Hilbert, A., Kossen, T., Elbers, P., von Dincklage, F., Madai, V. I., & Frey, D. (2024) · Critical Care Medicine · doi:10.1097/ccm.0000000000006359 · Cited by 123
Self-citationImplementing Artificial Intelligence in Critical Care Medicine: a consensus of 22.
Cecconi, M., Greco, M., Shickel, B., Angus, D. C., Bailey, H., Bignami, E., Calandra, T., Celi, L. A., Einav, S., Elbers, P., et al. (2025) · Critical Care · doi:10.1186/s13054-025-05532-2 · Cited by 80
“ICUs are at the forefront of data sharing efforts, offering several publicly available datasets for use by the research community [75].”
Self-citation
Metadata
- Authors
- Sauer, C. M., Dam, T. A., Celi, L. A., Faltys, M., de la Hoz, M. A. A., Adhikari, L., Ziesemer, K. A., Girbes, A., Thoral, P. J., & Elbers, P.
- Affiliations
- Amsterdam University Medical Centers (NL)
- University of Bern (CH)
- Laboratory for Computational Physiology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA.
- Philips (United States) (US)
- Vrije Universiteit Amsterdam (NL)
- ORCID
- Venue
- Critical Care Medicine
- Published
- 2022-03-02
- Volume
- 50
- Issue
- 6
- Pages
- e581-e588
- ISSN
- 0090-3493 (ISSN-L)
- PMC
- PMC9150442
- OpenAlex
- W4214864397
- Cited by
- 104
- References
- 17
- Citations by year
- 2026: 30 · 2025: 25 · 2024: 19 · 2023: 22 · 2022: 8
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- green
- research.vumc.nl
- Licence
- other-oa
- Locations
- Critical Care Medicine (publishedVersion)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- PubMed Central (acceptedVersion)
- Pure Amsterdam UMC (submittedVersion, cc-by)
- RISalud Institutional Health Repository of Andalucía (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- ZonMw (10430012010003)
- National Institutes of Health (5r01eb017205-07)
- National Institute of Biomedical Imaging and Bioengineering (R01-EB017205)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- eICU-CRD, MIMIC-IV, data quality, data richness, treatment intensity, ICU mortality, laboratory parameters, vital signs
- MeSH terms
- Data Accuracy, Systematic Reviews as Topic, Adult, Artificial Intelligence, Critical Care, Humans, Intensive Care Units, Databases, Factual, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Systematic Review and Comparison of Publicly Available ICU Data Sets—A Decision Guide for Clinicians and Data Scientists. https://app.cochat.ai/papers/10.1097/ccm.0000000000005517
- The paper
- Sauer, C. M., Dam, T. A., Celi, L. A., Faltys, M., de la Hoz, M. A. A., Adhikari, L., Ziesemer, K. A., Girbes, A., Thoral, P. J., & Elbers, P. (2022). Systematic Review and Comparison of Publicly Available ICU Data Sets—A Decision Guide for Clinicians and Data Scientists. Critical Care Medicine. https://doi.org/10.1097/ccm.0000000000005517
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.