Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

The MIMIC Code Repository: enabling reproducibility in critical care research

Open access
Johnson, Alistair E W, Stone, David J, Celi, Leo A, Pollard, Tom J · 2018 · Journal of the American Medical Informatics Association

Abstract

Objective: Lack of reproducibility in medical studies is a barrier to the generation of a robust knowledge base to support clinical decision-making. In this paper we outline the Medical Information Mart for Intensive Care (MIMIC) Code Repository, a centralized code base for generating reproducible studies on an openly available critical care dataset. Materials and Methods: Code is provided to load the data into a relational structure, create extractions of the data, and reproduce entire analysis plans including research studies. Results: Concepts extracted include severity of illness scores, comorbid status, administrative definitions of sepsis, physiologic criteria for sepsis, organ failure scores, treatment administration, and more. Executable documents are used for tutorials and reproduce published studies end-to-end, providing a template for future researchers to replicate. The repository’s issue tracker enables community discussion about the data and concepts, allowing users to collaboratively improve the resource. Discussion: The centralized repository provides a platform for users of the data to interact directly with the data generators, facilitating greater understanding of the data. It also provides a location for the community to collaborate on necessary concepts for research progress and share them with a larger audience. Consistent application of the same code for underlying concepts is a key step in ensuring that research studies on the MIMIC database are comparable and reproducible. Conclusion: By providing open source code alongside the freely accessible MIMIC-III database, we enable end-to-end reproducible analysis of electronic health records.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocx084

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Comparison of severity of illness score distributions.
Figure 1. Comparison of severity of illness score distributions.CC BY-NC · PubMed Central
Figure 2. Comparison of areas under the receiver operating curve for SOFA scores calculated from MIMIC code and a prior research report.
Figure 2. Comparison of areas under the receiver operating curve for SOFA scores calculated from MIMIC code and a prior research report.CC BY-NC · PubMed Central
Figure 3. Logic behind the query for converting aperiodically recorded ventilator settings into durations of mechanical ventilation.
Figure 3. Logic behind the query for converting aperiodically recorded ventilator settings into durations of mechanical ventilation.CC BY-NC · PubMed Central
Figure 4. Example of a patient who was both mechanically ventilated and receiving vasopressors for cardiovascular support.
Figure 4. Example of a patient who was both mechanically ventilated and receiving vasopressors for cardiovascular support.CC BY-NC · PubMed Central
Figure 5. Comparison of 3 methods for calculating presence of a comorbidity for a patient using billing data: an updated coding from the AHRQ which uses diagnosis-related group (DRG) codes to mask non-comorbid conditions, the same coding without the DRG masking, and finally an alternative coding that does not use DRG masking, proposed by Quan et al.28
Figure 5. Comparison of 3 methods for calculating presence of a comorbidity for a patient using billing data: an updated coding from the AHRQ which uses diagnosis-related group (DRG) codes to mask non-comorbid conditions, the same coding without the DRG masking, and finally an alternative coding that does not use DRG masking, proposed by Quan et al.28CC BY-NC · PubMed Central
Figure 6. Example of a notebook providing a tutorial with MIMIC-III data.
Figure 6. Example of a notebook providing a tutorial with MIMIC-III data.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 36 references

Cited by

See all 442

Metadata

Authors
Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J.
Affiliations
  • Massachusetts Institute of Technology (US)
  • University of Virginia (US)
  • Beth Israel Deaconess Medical Center (US)
Corresponding author
Johnson, Alistair E W
Venue
Journal of the American Medical Informatics Association
Published
2017-09-27
Volume
25
Issue
1
Pages
32-39
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2757504960
Cited by
442
References
36
Citations by year
2026: 44 · 2025: 67 · 2024: 56 · 2023: 72 · 2022: 57 · 2021: 62 · 2020: 39 · 2019: 24 · 2018: 17 · 2017: 3
FWCI
17.77
Type
journal article
Language
en
Open access
Locations
  • Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Funders
National Institutes of Health (NIH-R01-EB017205, NIH-R01-EB001659)
Topics
  • Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
reproducibility, critical care research, intensive care unit data, open-source code, electronic health records, sepsis definitions, disease severity index, organ failure scores, data extraction, research data sharing, community collaboration
MeSH terms
Critical Care, Humans, ROC Curve, Severity of Illness Index, Therapeutics, Reproducibility of Results, Comorbidity, Databases, Factual, Sepsis, Access to Information, Biomedical Research, Data Mining, Electronic Health Records, Organ Dysfunction Scores

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The MIMIC Code Repository: enabling reproducibility in critical care research. https://app.cochat.ai/papers/10.1093/jamia/ocx084
The paper
Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J. (2018). The MIMIC Code Repository: enabling reproducibility in critical care research. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocx084

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.