The MIMIC Code Repository: enabling reproducibility in critical care research
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Objective: Lack of reproducibility in medical studies is a barrier to the generation of a robust knowledge base to support clinical decision-making. In this paper we outline the Medical Information Mart for Intensive Care (MIMIC) Code Repository, a centralized code base for generating reproducible studies on an openly available critical care dataset. Materials and Methods: Code is provided to load the data into a relational structure, create extractions of the data, and reproduce entire analysis plans including research studies. Results: Concepts extracted include severity of illness scores, comorbid status, administrative definitions of sepsis, physiologic criteria for sepsis, organ failure scores, treatment administration, and more. Executable documents are used for tutorials and reproduce published studies end-to-end, providing a template for future researchers to replicate. The repository’s issue tracker enables community discussion about the data and concepts, allowing users to collaboratively improve the resource. Discussion: The centralized repository provides a platform for users of the data to interact directly with the data generators, facilitating greater understanding of the data. It also provides a location for the community to collaborate on necessary concepts for research progress and share them with a larger audience. Consistent application of the same code for underlying concepts is a key step in ensuring that research studies on the MIMIC database are comparable and reproducible. Conclusion: By providing open source code alongside the freely accessible MIMIC-III database, we enable end-to-end reproducible analysis of electronic health records.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The MIMIC Code Repository was originally created for MIMIC-III to enable researchers to share and reuse code24.”
From MIMIC-IV, a freely accessible electronic health record dataset (2023) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250 · cited 1×
“21 The precise onset of sepsis is not typically documented in the EHR, and is, in fact, a difficult item to capture clinically.”
BackgroundVincent, J. L., Moreno, R., Takala, J., Willatts, S., De Mendonça, A., Bruining, H., Reinhart, C. K., Suter, P. M., & Thijs, L. G. (1996) · Intensive Care Medicine · doi:10.1007/bf01709751 · Cited by 11,674 · cited 1×
“Some scores assess multiple organ systems: the SOFA score 12 and LODS 13 both assess 6 organ systems for failure.”
BackgroundCoding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669 · cited 1×
“27 Finally, Quan et al. 28 proposed an enhanced ICD-9 coding methodology based on examining inconsistencies among previous definitions.”
MethodComorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921 · cited 4×
“Van Walraven et al. 29 later aggregated comorbidities codified by Elixhauser et al. 26 into a single point score for in-hospital mortality prediction, which is also available in the repository.”
BackgroundMethodInfluentialAngus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503 · cited 3×
“The criteria as proposed by Angus et al. 23 were validated in a later study by Iwashyna et al. 25 These 3 criteria – explicit coding, those proposed by Angus et al., 23 and those proposed by Martin et al. 24 – are available in the repository.”
MethodMIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · cited 1×
“3,4 The database comprises detailed clinical information regarding > 60000 stays in ICUs at the Beth Israel Deaconess Medical Center in Boston, Massachusetts, collected as part of routine clinical care.”
BackgroundSelf-citationLe Gall, J.-R. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.270.24.2957 · Cited by 7,773
Acute Kidney Injury Network: report of an initiative to improve outcomes in acute kidney injury
Mehta, R. L., Kellum, J. A., Shah, S. V., Molitoris, B. A., Ronco, C., Warnock, D. G., Levin, A., & the Acute Kidney Injury Network (2007) · Critical Care · doi:10.1186/cc5713 · Cited by 7,048 · cited 1×
“Examples include the Model for End-stage Liver Disease, 14 the Risk/Injury/Failure/Loss/End-stage renal disease criteria, 15 the Acute Kidney Injury Network classification, 16 and the Kidney Disease: Improving Global Outcomes criteria.”
BackgroundThe epidemiology of sepsis in the United States from 1979 through 2000
Martin, G. S., Mannino, D. M., Eaton, S., & Moss, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa022139 · Cited by 5,841 · cited 4×
“The criteria as proposed by Angus et al. 23 were validated in a later study by Iwashyna et al. 25 These 3 criteria – explicit coding, those proposed by Angus et al., 23 and those proposed by Martin et al. 24 – are available in the repository.”
BackgroundInfluential1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · cited 1×
“Concerns about the reproducibility of results in science are becoming increasingly prominent in both scientific and mainstream literature.(1) Some commentators have gone so far as to call the current state a crisis, citing causes such as pressure to publish positive results, the cost of replicating studies such as dou…”
Background
Research works printed but not linked: 2
- Torio CM, Andrews RM National inpatient hospital costs: The most expensive conditions by payer, 2011. hCUP statistical brief #160. Agency for Healthcare Research and Quality, Rockville, MD [Internet]. 2013 http://www.hcup-us.ahrq.gov/reports/statbriefs/sb160.pdf. Accessed May 25, 2017. 24199255
- Torio CM, Moore BJ National inpatient hospital costs: The most expensive conditions by payer, 2013. hCUP statistical brief #204. Agency for Healthcare Research and Quality, Rockville, MD [Internet]. 2016 http://www.hcup-us.ahrq.gov/reports/statbriefs/sb204-Most-Expensive-Hospital-Conditions.pdf. Accessed May 25, 2017. 27359025
Cited by
Items 401–442 of 442
Bouvarel, B., Carrat, F., & Lapidus, N. (2024) · Figshare · doi:10.6084/m9.figshare.26613856
Gao, Y., Hong, Z., Shen, R., Zhang, S., You, G., Chen, J., Guo, X., Peng, S., & Huang, K. (2021) · Figshare · doi:10.6084/m9.figshare.16674714
Coombes, C. E., Coombes, K. R., & Fareed, N. (2021) · Figshare · doi:10.6084/m9.figshare.14190129
Davidson, S. M., Villarroel, M., Harford, M., Finnegan, E., Jorge, J., Young, D., Watkinson, P., & Tarassenko, L. (2021) · Figshare · doi:10.6084/m9.figshare.14471496
Liao, Q., Pu, Y., Jin, X., Zhuang, Z., Xu, X., Ren, X., Liu, G., & Ding, Q. (2024) · Figshare · doi:10.6084/m9.figshare.26576315
Yu, X., Zhang, K., Lv, H., Ma, G., Lin, Z., Chen, X., & Tan, Y. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356567
$\mathrm{D}^{2}$ KGMed: Dynamic Diagnostic Knowledge Graphs for Medical Diagnosis Prediction
Zhang, J., Zheng, G., Lv, H., Luo, L., Ma, G., Lin, Z., Chen, X., & Tan, Y. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11357158
Shao, C., Cheng, C., & Chen, B. (2026) · Journal of Endovascular Therapy · doi:10.1177/15266028261420062
Meyer-Eschenbach, F., Schmiedler, R., Stoephasius, J. V., Zhang, C. L., Kronfli, L., Frey, N., Näher, A., Ehret, J., Nothacker, J., Kalle, C. V., et al. (2026) · medRxiv · doi:10.64898/2026.02.27.26347259 · Cited by 1
X4FL: Explainability for Federated Learning in ICU Mortality Prediction
Mondrejevski, L., Miliou, I., Montanino, A., Diez, C., & Papapetrou, P. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00098
“…from Beth Israel Deaconess Medical Center (2001–2012) and we followed the data pre-processing, feature extraction, and cohort selection procedures described in the FLICU study by Mondrejevski et al. [17], utilizing and extending the publicly available code from the mimic-code repository [8], [20].”
AI and Mental Health Innovations in Detection, Prevention, and Support for Learners
Murshidi, G. H. A., Munir, S., Munir, Z., Opoku, M. P., Nuryana, Z., & Zaabi, A. A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4222-1.ch019
AI for multilingual, human-centered personalization, and public health
Mishra, A. K., Dudhagara, C. R., Rahul, M., & Shaina (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-45252-9.00004-9
ULoR: Uncertainty-Aware Leave-One-Out Refinement Framework for Diagnosis Prediction
Zhang, J., Shao, W., & Tan, Y. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792963
CARE-Agent: Multi-Agent Collaboration with Conflict-Aware Routing Mechanism for Diagnosis Prediction
Zhan, P., Cai, B., Zhang, J., Lv, H., Tan, Y., Lin, Z., Chen, X., & Yang, C. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464147
“We evaluate CARE-Agent on two real-world EHR datasets: MIMIC-III [14] and MIMIC-IV [15].”
Appiah, K. N., Adu, N., Singh, D. K., & Nartey, E. E. (2026) · Research Square · doi:10.21203/rs.3.rs-9175702/v1
A Context-Adaptive Gated Embedding Framework for Advanced Clinical Decision-Making
Kim, D., Kim, D., & Jeong, O. (2026) · Mathematics · doi:10.3390/math14081397
SHARK: Modeling Semantic Hierarchy of Medical Code via Residual K-Means Quantization
Zhang, K., Lv, H., Tan, Y., Lin, Z., Zhang, H., Chen, X., & Yang, C. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462768
“%) on the MIMIC-III [12] and MIMIC-IV [13] datasets.”
Noise in Brazilian Clinical Anamnesis: An Empirical Study
Carvalho, L. A., Oliveira, T. M. D. S., Sousa, F. R. C., & Filho, J. B. F. (2026) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.5753/sbsi.2026.248362
“By providing vast quantities of data for training and evaluation, these databases have catalyzed the development of sophisticated models and driven innovation across a range of clinical tasks [Johnson et al. 2018].”
GHOSTS: Validated generation of synthetic hospital time series
Zhumagambetov, R., Giesa, N., Boie, S. D., & Haufe, S. (2026) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2026.103443 · Cited by 1
Jatav, N., Tiwari, V., & Singh, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-23577-0_1
How Are Researchers Using MIMIC? A Methods-Focused Review of Studies in Critical CarePreprint
Kenarangi, T., Barnett, A. G., Suen, J. Y., & White, N. M. (2026) · Research Square · doi:10.21203/rs.3.rs-9962098/v1
Liu, C. X., Shi, J., Wang, F. H., Ma, L., Hu, H., Zhang, L., Song, J., Jin, H., Yang, D., Guo, X., et al. (2026) · Journal of intelligent medicine. · doi:10.1002/jim4.70048 · Cited by 1
Liu, W. T., Chen, Q., Huang, T., Liu, J., Li, H., & Guo, Q. (2026) · Therapeutic Advances in Cardiovascular Disease · doi:10.1177/17539447261457542
EviCare: Enhancing Diagnosis Prediction with Deep Model-Guided Evidence for In-Context Reasoning
Zhang, H., Zhang, X., Zhan, P., Luo, L., Lv, H., Tan, Y., Pan, S., & Yang, C. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3780257 · Cited by 1
Zhang, L., Hao, Z.-Y., Li, M. T., Liu, J., Su, M., Zhang, Z.-H., Yue, S., Liu, Y.-Y., Li, C., & Ma, J. X. (2026) · BMC Geriatrics · doi:10.1186/s12877-026-07918-5 · Cited by 1
“Baseline serum creatinine was derived directly from the final scr_baseline variable in the MIMIC-IV derived creatinine_baseline table, which is generated by the MIMIC-IV baseline creatinine concept query from the MIMIC Code Repository [21, 22].”
Li, G., & Wei, W. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1889258
Gao, X., Xu, Z., Liao, L., & Qian, J. (2026) · International Journal of Clinical Practice · doi:10.1155/ijcp/2645261
Lv, H., Guo, Z., Tan, Y., Shao, W., Zhang, H., & Yang, C. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3780297 · Cited by 3
ICU mortality prediction via multimodal learning on MIMIC-IV clinical data
Falcone, A., Forestiero, A., Malivindi, R., & Settino, M. (2026) · Bioinformatics Advances · doi:10.1093/bioadv/vbag214
“The MIMIC code repository facilitates public discussion and code sharing, promoting transparency, reproducibility, and collaboration between research groups (Johnson et al. 2018).”
HazardFlow: Enhancing Health Status Representations via Score-based Energy Modeling
Chen, Q., Li, X., Zhang, Y., & Wang, M. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817616
Cao, T. H., Whisenant, M., Wang, H., Brady, V. J., Lee, D., Liu, Z., Zhou, J., Gu, Y., Maliackal, A., Merem, S., et al. (2026) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000001609
Arzu, G. E., Umar, M., Fayaz, M., Ali, U., Dang, L. M., & Moon, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116901
Wang, B., Ma, J., Zang, Z., Gao, Z., Chen, W., Xing, H., & Jiang, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-10364462/v1
Karim, P., Huang, I., Chen, J., Sanvitti, M., Canelli, R. J., & Bilotta, F. (2026) · Journal of Intensive Care Medicine · doi:10.1177/08850666261483519
Yuting, Y., Guo, L., & Sun, X. (2026) · Science Progress · doi:10.1177/00368504261484901
“21 The authors had no access to direct personal identifiers and did not attempt to re-identify any individual.”
Katyal, A. (2026) · Research Square · doi:10.21203/rs.3.rs-11124716/v1
DeWitt, P. E., Russell, S., Feinstein, J. A., Rebull, M. N., & Bennett, T. D. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag182
Shao, L., Li, Y., Wang, L., & Sun, W. (2026) · medRxiv · doi:10.64898/2026.09.28.26364145
Toppin, P. J., Correia, M. D. T., Chang, Y., Adhikari, L., McLaverty, B. P., & Natarajan, A. (2026) · Intensive Care Medicine Experimental · doi:10.1186/s40635-026-00972-8
“To facilitate comparison of doses, all vasoactive drug doses were converted to norepinephrine-equivalent doses (NED) as previously described using the MIMIC-IV data [34].”
How are researchers using MIMIC? A sampling-based methods review
Kenarangi, T., Barnett, A. G., Suen, J. Y., & White, N. M. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106744
Huang, T.-C., Pan, M.-Y., Pan, L.-F., Liang, P., Mou, C.-L., & Lu, J.-Y. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1918792
Picheta, P., & Deniziak, S. R. (2026) · SoftwareX · doi:10.1016/j.softx.2026.103083
Metadata
- Authors
- Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J.
- Affiliations
- Massachusetts Institute of Technology (US)
- University of Virginia (US)
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Johnson, Alistair E W
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-09-27
- Volume
- 25
- Issue
- 1
- Pages
- 32-39
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6381763
- OpenAlex
- W2757504960
- Cited by
- 442
- References
- 36
- Citations by year
- 2026: 44 · 2025: 67 · 2024: 56 · 2023: 72 · 2022: 57 · 2021: 62 · 2020: 39 · 2019: 24 · 2018: 17 · 2017: 3
- FWCI
- 17.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (NIH-R01-EB017205, NIH-R01-EB001659)
- Topics
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- reproducibility, critical care research, intensive care unit data, open-source code, electronic health records, sepsis definitions, disease severity index, organ failure scores, data extraction, research data sharing, community collaboration
- MeSH terms
- Critical Care, Humans, ROC Curve, Severity of Illness Index, Therapeutics, Reproducibility of Results, Comorbidity, Databases, Factual, Sepsis, Access to Information, Biomedical Research, Data Mining, Electronic Health Records, Organ Dysfunction Scores
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.