The MIMIC Code Repository: enabling reproducibility in critical care research
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Objective: Lack of reproducibility in medical studies is a barrier to the generation of a robust knowledge base to support clinical decision-making. In this paper we outline the Medical Information Mart for Intensive Care (MIMIC) Code Repository, a centralized code base for generating reproducible studies on an openly available critical care dataset. Materials and Methods: Code is provided to load the data into a relational structure, create extractions of the data, and reproduce entire analysis plans including research studies. Results: Concepts extracted include severity of illness scores, comorbid status, administrative definitions of sepsis, physiologic criteria for sepsis, organ failure scores, treatment administration, and more. Executable documents are used for tutorials and reproduce published studies end-to-end, providing a template for future researchers to replicate. The repository’s issue tracker enables community discussion about the data and concepts, allowing users to collaboratively improve the resource. Discussion: The centralized repository provides a platform for users of the data to interact directly with the data generators, facilitating greater understanding of the data. It also provides a location for the community to collaborate on necessary concepts for research progress and share them with a larger audience. Consistent application of the same code for underlying concepts is a key step in ensuring that research studies on the MIMIC database are comparable and reproducible. Conclusion: By providing open source code alongside the freely accessible MIMIC-III database, we enable end-to-end reproducible analysis of electronic health records.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The MIMIC Code Repository was originally created for MIMIC-III to enable researchers to share and reuse code24.”
From MIMIC-IV, a freely accessible electronic health record dataset (2023) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250 · cited 1×
“21 The precise onset of sepsis is not typically documented in the EHR, and is, in fact, a difficult item to capture clinically.”
BackgroundVincent, J. L., Moreno, R., Takala, J., Willatts, S., De Mendonça, A., Bruining, H., Reinhart, C. K., Suter, P. M., & Thijs, L. G. (1996) · Intensive Care Medicine · doi:10.1007/bf01709751 · Cited by 11,674 · cited 1×
“Some scores assess multiple organ systems: the SOFA score 12 and LODS 13 both assess 6 organ systems for failure.”
BackgroundCoding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669 · cited 1×
“27 Finally, Quan et al. 28 proposed an enhanced ICD-9 coding methodology based on examining inconsistencies among previous definitions.”
MethodComorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921 · cited 4×
“Van Walraven et al. 29 later aggregated comorbidities codified by Elixhauser et al. 26 into a single point score for in-hospital mortality prediction, which is also available in the repository.”
BackgroundMethodInfluentialAngus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503 · cited 3×
“The criteria as proposed by Angus et al. 23 were validated in a later study by Iwashyna et al. 25 These 3 criteria – explicit coding, those proposed by Angus et al., 23 and those proposed by Martin et al. 24 – are available in the repository.”
MethodMIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · cited 1×
“3,4 The database comprises detailed clinical information regarding > 60000 stays in ICUs at the Beth Israel Deaconess Medical Center in Boston, Massachusetts, collected as part of routine clinical care.”
BackgroundSelf-citationLe Gall, J.-R. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.270.24.2957 · Cited by 7,773
Acute Kidney Injury Network: report of an initiative to improve outcomes in acute kidney injury
Mehta, R. L., Kellum, J. A., Shah, S. V., Molitoris, B. A., Ronco, C., Warnock, D. G., Levin, A., & the Acute Kidney Injury Network (2007) · Critical Care · doi:10.1186/cc5713 · Cited by 7,048 · cited 1×
“Examples include the Model for End-stage Liver Disease, 14 the Risk/Injury/Failure/Loss/End-stage renal disease criteria, 15 the Acute Kidney Injury Network classification, 16 and the Kidney Disease: Improving Global Outcomes criteria.”
BackgroundThe epidemiology of sepsis in the United States from 1979 through 2000
Martin, G. S., Mannino, D. M., Eaton, S., & Moss, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa022139 · Cited by 5,841 · cited 4×
“The criteria as proposed by Angus et al. 23 were validated in a later study by Iwashyna et al. 25 These 3 criteria – explicit coding, those proposed by Angus et al., 23 and those proposed by Martin et al. 24 – are available in the repository.”
BackgroundInfluential1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · cited 1×
“Concerns about the reproducibility of results in science are becoming increasingly prominent in both scientific and mainstream literature.(1) Some commentators have gone so far as to call the current state a crisis, citing causes such as pressure to publish positive results, the cost of replicating studies such as dou…”
Background
Research works printed but not linked: 2
- Torio CM, Andrews RM National inpatient hospital costs: The most expensive conditions by payer, 2011. hCUP statistical brief #160. Agency for Healthcare Research and Quality, Rockville, MD [Internet]. 2013 http://www.hcup-us.ahrq.gov/reports/statbriefs/sb160.pdf. Accessed May 25, 2017. 24199255
- Torio CM, Moore BJ National inpatient hospital costs: The most expensive conditions by payer, 2013. hCUP statistical brief #204. Agency for Healthcare Research and Quality, Rockville, MD [Internet]. 2016 http://www.hcup-us.ahrq.gov/reports/statbriefs/sb204-Most-Expensive-Hospital-Conditions.pdf. Accessed May 25, 2017. 27359025
Cited by
MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-022-01899-x · Cited by 3,401
“The MIMIC Code Repository was originally created for MIMIC-III to enable researchers to share and reuse code 24 .”
MethodSelf-citationMIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports
Johnson, A. E. W., Pollard, T. J., Berkowitz, S. J., Greenbaum, N. R., Lungren, M. P., Deng, C.-Y., Mark, R. G., & Horng, S. (2019) · Scientific Data · doi:10.1038/s41597-019-0322-0 · Cited by 1,816
“We believe that publicly accessible code using publicly available data will accelerate research in the field and ensure reproducibility of future studies 26,27 .”
MethodSelf-citationSerpa Neto, A., Deliberato, R. O., Johnson, A. E. W., Bos, L. D., Amorim, P., Pereira, S. M., Cazati, D. C., Cordioli, R. L., Correa, T. D., Pollard, T. J., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5375-6 · Cited by 613
Self-citationOpen science saves lives: lessons from the COVID-19 pandemic
Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, E., Deforet, M., & Leyrat, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01304-y · Cited by 249
“An open code repository has been created [90] and many scientific journals are now asking researchers to publish the source code alongside their findings.”
BackgroundTransthoracic echocardiography and mortality in sepsis: analysis of the MIMIC-III database
Feng, M., McSparron, J. I., Kien, D. T., Stone, D. J., Roberts, D. H., Schwartzstein, R. M., Vieillard-Baron, A., & Celi, L. A. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5208-7 · Cited by 239
“Discussions around reliability of specific data elements are captured in a community white board to guide future investigators who may be interested in exploring similar concepts [21].”
Self-citationtableone: An open source Python package for producing summary statistics for research papers
Pollard, T. J., Johnson, A. E. W., Raffa, J. D., & Mark, R. G. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy012 · Cited by 184
“10,11 According to Glantz, many statisticians would prefer not to spend their time “grinding out garden-variety statistics for other people”, and that the job of summarizing data is often best done by the investigators themselves.”
BackgroundSelf-citationMIMIC-Extract: a data extraction, preprocessing, and representation pipeline for MIMIC-III
Wang, S., McDermott, M. B. A., Chauhan, G., Ghassemi, M., Hughes, M. C., & Naumann, T. (2020) · Proceedings of the ACM Conference on Health, Inference, and Learning · doi:10.1145/3368555.3384469 · Cited by 147
Expert-augmented machine learning
Gennatas, E. D., Friedman, J. H., Ungar, L. H., Pirracchio, R., Eaton, E., Reichmann, L. G., Interian, Y., Luna, J. M., Simone, C. B., Auerbach, A., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906831117 · Cited by 120
The Search for Optimal Oxygen Saturation Targets in Critically Ill Patients
van den Boom, W., Hoy, M., Sankaran, J., Liu, M., Chahed, H., Feng, M., & See, K. C. (2019) · CHEST Journal · doi:10.1016/j.chest.2019.09.015 · Cited by 144
Xu, J., Li, T., Yao, J., Guo, Z., Lui, K. Y., Hu, X., Cao, L., Zhu, Y., Fa, H., Guan, X., et al. (2018) · Shock · doi:10.1097/shk.0000000000001253 · Cited by 104
ISeeU: Visually interpretable deep learning for mortality prediction inside the ICU
Caicedo-Torres, W., & Gutierrez, J. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103269 · Cited by 95
Machine Learning Techniques to Predict Mental Health Diagnoses: A Systematic Literature Review
Madububambachu, U., Ukpebor, A., & Ihezue, U. (2024) · Clinical Practice and Epidemiology in Mental Health · doi:10.2174/0117450179315688240607052117 · Cited by 147
The impact of commercial health datasets on medical research and health-care algorithms
Alberto, I. R. I., Alberto, N. R. I., Ghosh, A. K., Jain, B., Jayakumar, S., Martinez-Martin, N., McCague, N., Moukheiber, D., Moukheiber, L., Moukheiber, M., et al. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00025-0 · Cited by 86
Self-citationEvaluating Reinforcement Learning Algorithms in Observational Health Settings
Gottesman, O., Johansson, F., Meier, J., Dent, J., Lee, D., Srinivasan, S., Zhang, L., Ding, Y., Wihl, D., Peng, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12298 · Cited by 80
“We use a cohort of sepsis patients curated from the MIMIC III dataset [Johnson et al., 2017, Raghu et al., 2017].”
MethodSelf-citationQuality-informed semi-automated event log generation for process mining
Andrews, R., van Dun, C., Wynn, M. T., Kratsch, W., Röglinger, M., & ter Hofstede, A. H. M. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113265 · Cited by 90
Xie, F., Zhou, J. R., Lee, J. W., Tan, M., Li, S., Rajnthern, L. S. O., Chee, M. L., Chakraborty, B., Wong, A.-K. I., Dagan, A. S., et al. (2022) · Scientific Data · doi:10.1038/s41597-022-01782-9 · Cited by 129
Li, X., Zheng, R., Zhang, T., Zeng, Z., Li, H., & Liu, J. (2021) · Annals of Palliative Medicine · doi:10.21037/apm-21-2937 · Cited by 76
“All patient data were divided into different lists and organized into tables in the corresponding CSV format, including (in total) 26 tables, which are available for interested researchers to query and download (11).”
MethodEvaluation of leukopenia during sepsis as a marker of sepsis-defining organ dysfunction
Belok, S. H., Bosch, N. A., Klings, E. S., & Walkey, A. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252206 · Cited by 82
A novel GA-ELM model for patient-specific mortality prediction over large-scale lab event data
Krishnan, G. S., & Kamath, S. S. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.04.019 · Cited by 66
Hadweh, P., Niset, A., Salvagno, M., Barajraji, M. A., Hadwe, S. E., Taccone, F. S., & Barrit, S. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14124026 · Cited by 86
“…machine learning algorithms capable of handling high-dimensional data with non-linear relationships; and (IV) the creation of publicly available critical care databases such as the Medical Information Mart for Intensive Care (MIMIC), which fostered open research and benchmarking [35,36].”
Open Science Saves Lives: Lessons from the COVID-19 PandemicPreprint
Besançon, L., Peiffer‐Smadja, N., Ségalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, É., Déforet, M., & Leyrat, C. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.13.249847 · Cited by 59
Big Data Analysis y Machine Learning en medicina intensiva
Reiz, A. N., de la Hoz, M. Á. A., & García, M. S. (2018) · Medicina Intensiva · doi:10.1016/j.medin.2018.10.007 · Cited by 73
Gao, C. A., Markov, N. S., Stoeger, T., Pawlowski, A. E., Kang, M., Nannapaneni, P., Grant, R. A., Pickens, C. I., Walter, J. M., Kruser, J. M., et al. (2023) · Journal of Clinical Investigation · doi:10.1172/jci170682 · Cited by 57
“code from the MIMIC Code Repository (50).”
Yu, R., Zheng, Y., Zhang, R., Jiang, Y., & Poon, C. C. Y. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2916667 · Cited by 57
“Time series measurements, similar to those included in SAPSII [1], on the first day of patients’ ICU admissions were extracted following the implementations in [18].”
MethodLuo, M., Chen, Y., Cheng, Y., Li, N., & Qing, H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265758 · Cited by 51
Cosgriff, C. V., Celi, L. A., & Stone, D. J. (2019) · Biomedical Engineering and Computational Biology · doi:10.1177/1179597219856564 · Cited by 49
“15 The availability of this code accelerates research and promotes reproducibility by ensuring that common concepts are implemented consistently across studies.”
BackgroundSelf-citationOrphan G-protein coupled receptors: novel drug targets for the pharmaceutical industry.
Wilson, S., & Bergsma, D. J. (2000) · PubMed · Cited by 57
Developing machine learning models for prediction of mortality in the medical intensive care unit
Nistal‐Nuño, B. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106663 · Cited by 57
Alam, M. U., & Rahmani, R. (2023) · Sensors · doi:10.3390/s23020970 · Cited by 64
“We used EHRs from the MIMIC-III (Multiparameter Intelligent Monitoring in Intensive Care) database, version 1.4 [32].”
MethodInfluentialSauer, C. M., Dong, J., Celi, L. A., & Ramazzotti, D. (2018) · Cancer Research and Treatment · doi:10.4143/crt.2018.360 · Cited by 52
“the MIMIC Code Repository was used to generate comorbidity scores and risk scores [10].”
MethodSelf-citationChen, Q., Zhang, L., Ge, S., He, W., & Zeng, M. (2019) · PeerJ · doi:10.7717/peerj.7083 · Cited by 62
MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-III
Wang, S., McDermott, M. B. A., Chauhan, G., Hughes, M. C., Naumann, T., & Ghassemi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.08322 · Cited by 35
“Many papers do not share code used to extract study-specific data (Johnson et al., 2017a), leading to unnecessary variance in reported results.”
BackgroundResultLin, S., Lu, W., Wang, T., Wang, Y., Leng, X., Chi, L., Jin, P., & Bian, J. (2024) · Renal Failure · doi:10.1080/0886022x.2024.2303395 · Cited by 59
“The SQL script codes needed for extracting patient information were obtained from the GitHub repository located at (https://github.com/MIT-LCP/ mimic-code/tree/main/mimic-iv) [10], ensuring methodological transparency and replicability.”
MethodMachine Learning for Pulmonary and Critical Care Medicine: A Narrative Review
Mlodzinski, E., Stone, D. J., & Celi, L. A. (2020) · Pulmonary Therapy · doi:10.1007/s41030-020-00110-z · Cited by 48
“In addition to MIMIC, the MIT group also maintains a public repository of reusable codes and queries to extract common ICU concepts in order to promote reproducibility and to allow investigators to build on each other’s research [38].”
BackgroundSelf-citationWu, S., Zhou, Q., Cai, Y., & Duan, X. (2023) · Renal Failure · doi:10.1080/0886022x.2023.2194436 · Cited by 47
“com/MIT-LCP/mimic-code/tree/main/mimic-iv) [10].”
Mini-InternVL: a flexible-transfer pocket multi-modal model with 5% parameters and 90% performance
Gao, Z., Chen, Z., Cui, E., Ren, Y., Wang, W., Zhu, J., Tian, H., Ye, S., He, J., Zhu, X., et al. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00067-6 · Cited by 159
“The datasets include PMC-OA [136], MedICaT [137], PMC-Image [104, 136, 138], Open-i [139], MedPix [140], Quilt-1M [141], RP3D [138], MIMIC-CXR [142], and Retina Image Bank [143], which together provide a substantial collection of medical images.”
Roggeveen, L., el Hassouni, A., Ahrendt, J., Guo, T., Fleuren, L., Thoral, P., Girbes, A. R., Hoogendoorn, M., & Elbers, P. W. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.102003 · Cited by 41
Lee, S. M., Lee, G., Kim, T. K., Le, T. T., Hao, J., Jung, Y. M., Park, C., Park, J. S., Jun, J. K., Lee, H., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.46637 · Cited by 46
MIMIC-IV on FHIR: converting a decade of in-patient data into an exchangeable, interoperable format
Bennett, A. M., Ulrich, H., van Damme, P., Wiedekopf, J., & Johnson, A. E. W. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad002 · Cited by 52
“system (PostgreSQL v11, PostgreSQL Global Development Group) using code from the publicly available MIMIC code repository.(25)”
MethodSelf-citationLiu, C., Liu, X., Mao, Z., HU, P., Li, X., Hu, J., Hong, Q., Geng, X., Chi, K., Zhou, F., et al. (2021) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002674 · Cited by 46
“We aimed to construct a risk prediction model based on the eICU Collaborative Research Database (eICU-CRD) (15) and the Medical Information Mart for Intensive Care III (MIMIC-III) (16) to help identify patients at the time of hospital admission who are at high risk of death.”
MethodJhou, H., Chen, P., Yang, L., Chang, S., & Lee, C. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11101004 · Cited by 41
“The MIMIC-IV contains clinical information of patients in the intensive care unit (ICU) at BIDMC between 2008 and 2019.”
MethodGao, Z., Liu, X., Kang, Y., Hu, P., Zhang, X., Yan, W., Yan, M., Yu, P., Zhang, Q., Xiao, W., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/54363 · Cited by 40
Regulatory Sandboxes: A Cure for mHealth Pilotitis?
Bhatia, A., Matthan, R., Khanna, T., & Balsari, S. (2020) · Journal of Medical Internet Research · doi:10.2196/21276 · Cited by 53
“For example, are data better utilized for research if they are secured at source and queried remotely with a role-based access, as with the Research Patient Data Registry (RPDR) by Partners Healthcare in Massachusetts [43]; or if datasets are exported for a fee with time and purpose limitations as with research data f…”
MethodMultitask deep label distribution learning for blood pressure prediction
Qin, K., Huang, W. X., & Zhang, T. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.02.019 · Cited by 39
An AI based digital-twin for prioritising pneumonia patient treatment
Chakshu, N. K., & Nithiarasu, P. (2022) · Proceedings of the Institution of Mechanical Engineers Part H Journal of Engineering in Medicine · doi:10.1177/09544119221123431 · Cited by 45
He, L., Yang, D., Ding, Q., Su, Y., & Ding, N. (2022) · Infectious Diseases and Therapy · doi:10.1007/s40121-022-00736-3 · Cited by 40
Real-world characterization of blood glucose control and insulin use in the intensive care unit
Baker, L., Maley, J. H., Arévalo, A. R., DeMichele, F., Mateo-Collado, R., Finkelstein, S. N., & Celi, L. A. (2020) · Scientific Reports · doi:10.1038/s41598-020-67864-z · Cited by 40
Self-citationIncidence, prognosis, and risk factors of sepsis-induced cardiomyopathy
Liang, Y., Zhu, Y., Zhang, R., Zhang, M., Ye, X., & Wei, J. (2021) · World Journal of Clinical Cases · doi:10.12998/wjcc.v9.i31.9452 · Cited by 43
Migrating a research data warehouse to a public cloud: challenges and opportunities
Kahn, M. G., Mui, J. Y., Ames, M. J., Yamsani, A. K., Pozdeyev, N. V., Rafaels, N. M., & Brooks, I. M. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab278 · Cited by 47
Knowledge Graph Embeddings for ICU readmission prediction
Carvalho, R. M. S., Oliveira, D., & Pesquita, C. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02070-7 · Cited by 53
“MIMIC-III [31] is an extensive, freely available database possessing records related to 53, 423 distinct hospital admissions of adult patients (aged 16 years or above) who stayed in the Beth Israel Deaconess Medical Center intensive care units between 2001 and 2012 [32].”
BackgroundMethodSerum anion gap on admission predicts intensive care unit mortality in patients with aortic aneurysm
Chen, Q., Chen, Q., Li, L., Lin, X., Chang, S., Li, Y., Tian, Z., Liu, W., & Huang, K. (2018) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2018.6391 · Cited by 41
“com/MIT-LCP/mimic-code) (22) to extract data from the database.”
Patterns of diuretic use in the intensive care unit
McCoy, I. E., Chertow, G. M., & Chang, T. I. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217911 · Cited by 36
Schenck, E. J., Hoffman, K. L., Cusick, M. M., Kabariti, J., Sholle, E., & Campion, T. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103789 · Cited by 40
Jian, L., Zhang, Z., Zhou, Q., Duan, X., Xu, H., & Ge, L. (2023) · BMC Cardiovascular Disorders · doi:10.1186/s12872-023-03200-3 · Cited by 35
“0) is an updated version of the MIMIC-III [18], comprising de-identified healthrelated information from individuals who lived in Beth Israel Deaconess Medical Centre critical care units between 2008 and 2019.”
BackgroundInfluentialContext-Aware Safe Medication Recommendations with Molecular Graph and DDI Graph Embedding
Chen, Q., Li, X., Geng, K., & Wang, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25861 · Cited by 56
“We evaluated our model on MIMIC-III [Johnson et al. 2016] and MIMC-IV [Johnson et al. 2018].”
MethodMachine Learning Models for Early Prediction of Sepsis on Large Healthcare Datasets
Camacho-Cogollo, J. E., Bonet, I., Gil, B., & Iadanza, E. (2022) · Electronics · doi:10.3390/electronics11091507 · Cited by 44
“4, which contains patient data from the Beth Israel Deaconess Medical Center (BIDMC, Boston, MA, USA) [63].”
BackgroundMethodDo Thresholds for Invasive Ventilation in Hypoxemic Respiratory Failure Exist? A Cohort Study
Yarnell, C. J., Johnson, A. E. W., Dam, T. A., Jonkman, A. H., Liu, K., Wunsch, H., Brochard, L. J., Celi, L. A., de Grooth, H., Elbers, P., et al. (2022) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.202206-1092oc · Cited by 37
Self-citationYe, W., Chen, X., Huang, Y., Li, Y., Xu, Y., Liang, Z., Wu, D., Liu, X., & Li, Y. (2020) · Journal of Thoracic Disease · doi:10.21037/jtd-20-1169 · Cited by 34
Rogers, P. B., Wang, D., & Lu, Z. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.691626 · Cited by 40
“With time frames and release dates shown in Table 1 , all four MIMIC versions are accessible and available to the public, supporting the concept of reproducibility within ICU research (Johnson et al., 2018).”
BackgroundQin, Z., Liao, N., Lu, X., Duan, X., Zhou, Q., & Ge, L. (2022) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s350588 · Cited by 32
“This database was identified according to the Health Insurance Portability and Accountability Act Safe Harbor provision and has approval from the Massachusetts Institute of Technology and the Institutional Review Board of Beth Israel Deaconess Medical Center (BIDMC).(13) The MIMIC-IV database contains the clinical inf…”
MethodMaxwell, L., Shreedhar, P., Dauga, D., McQuilton, P., Terry, R. F., Denisiuk, A., Molnár‐Gábor, F., Saxena, A., & Sansone, S. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00129-2 · Cited by 41
Kumar, R. R., Sporn, K., Waisberg, E., Ong, J., Paladugu, P., Vadhera, A. S., Amiri, D., Ngo, A., Jagadeesan, R., Tavakkoli, A., et al. (2025) · Health Care Analysis · doi:10.1007/s10728-025-00537-y · Cited by 38
Big Data Analysis and Machine Learning in Intensive Care Units
Reiz, A. N., de la Hoz, M. Á. A., & García, M. S. (2019) · Medicina Intensiva (English Edition) · doi:10.1016/j.medine.2019.06.012 · Cited by 33
“24,25 This causes the studies to be subject to additional quality control, and allows anyone to check both the methods and the results obtained.”
BackgroundYan, D., Xie, X. W., Fu, X., Pei, S., Wang, Y., Deng, Y., Yao, R., & Li, N. (2023) · Shock · doi:10.1097/shk.0000000000002203 · Cited by 30
“Furthermore, the SOFA score (26), Logistic Organ Dysfunction System (LODS) score (27), Simplified Acute Physiology Score II (SAPSII) (28), and systemic inflammatory response syndrome (SIRS) score (29) were calculated using the SQL code provided by Johnson et al. (30).”
MethodWang, Y., Gao, Z., Zhang, Y., Lu, Z., & Sun, F. (2025) · Internal and Emergency Medicine · doi:10.1007/s11739-024-03732-2 · Cited by 29
“Our objective was to construct a risk forecasting algorithm utilizing the MIMIC-IV dataset to detect sepsis patients with a heightened likelihood of mortality upon admission to the hospital [10] and validate.”
Huang, S., Zhou, Q., Guo, N., Zhang, Z., Luo, L., Luo, Y., Qin, Z., & Ge, L. (2021) · Medicine · doi:10.1097/md.0000000000025404 · Cited by 29
“We extracted data from the MIMIC-III database, which included more than 40,000 intensive care unit (ICU) patients treated in a variety of critical care units (medical, surgical, coronary care, and neonatal) at the Beth Israel Deaconess Medical Center (Boston, MA) from 2001 to 2012.([20,21]) Our Access to the database…”
MethodFLICU: A Federated Learning Workflow for Intensive Care Unit Mortality Prediction
Mondrejevski, L., Miliou, I., Montanino, A., Pitts, D., Hollmén, J., & Papapetrou, P. (2022) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms55023.2022.00013 · Cited by 42
“[13] for the pre-processing and feature extraction steps, expanding on the publicly available code of the mimic-code GitHub repository [22], [23].”
MethodIntelligent Intensive Care Unit: Current and Future Trends
Mao, Z., Liu, C., Li, Q., Cui, Y., & Zhou, F. (2023) · Intensive Care Research · doi:10.1007/s44231-023-00036-5 · Cited by 28
“In particular, the establishment and use of the medical information mart for intensive care (MIMIC) database in recent years has provided the basis for big data [20].”
BackgroundXu, C., Sun, L., Dong, M., Ullah, H., Ullah, H., Zhou, J., & Yuan, Z. (2022) · International Journal of General Medicine · doi:10.2147/ijgm.s336701 · Cited by 27
“Data Extraction and Outcomes Data was extracted by structured query language (SQL).(16) After including only first admissions of patients to ICU, we identified a total of 1877 AMI patients who were older than 18 years old.”
MethodLi, P., Xie, C., Pollard, T., Johnson, A. E. W., Cao, D., Kang, H., Liang, H., Zhang, Y., Liu, X., Fan, Y., et al. (2017) · JMIR Medical Informatics · doi:10.2196/medinform.7380 · Cited by 35
“Projects originating from past datathons have led to publications and valuable code contributions to the MIMIC code repository, a shared open access storehouse of codes for querying and analyzing MIMIC [24].”
Self-citationLin, S., Ge, S., He, W., & Zeng, M. (2020) · BioMed Research International · doi:10.1155/2020/5781913 · Cited by 27
“The code and website used for the MIMIC-III database are publicly available [18].”
MethodSerum phosphate is associated with mortality among patients admitted to ICU for acute pancreatitis
Hedjoudje, A., Farha, J., Cheurfa, C., Grabar, S., Weiss, E., Badurdeen, D., Kumbhari, V., Prat, F., Lévy, P., & Piton, G. (2021) · United European Gastroenterology Journal · doi:10.1002/ueg2.12059 · Cited by 27
“Given the fact that all patients were de‐identified in a Health Insurance Portability and Accountability Act‐compliant manner, the institutional review boards (IRBs) of BIDMC and MIT approved the useof theMIMIC‐III database.(17,18) It is possible to access this database by passing an examination and obtaining the cert…”
BackgroundAl-Shwaheen, T. I., Hau, Y. W., Ass'Ad, N., & AbuAlSamen, M. M. (2020) · IEEE Access · doi:10.1109/access.2020.3047186 · Cited by 32
“4% during the interval between 2008 and 2014 [100].”
BackgroundBoussi Rahmouni, H., Hassine, N. B. E. H., Chouchen, M., Ceylan, H. İ., Muntean, R. I., Bragazzi, N. L., & Dergaa, I. (2025) · Healthcare · doi:10.3390/healthcare13202553 · Cited by 25
“The MIMIC-III database enabled extensive validation of machine learning approaches for ICU applications [63].”
Liu, J., & Hu, X. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295602 · Cited by 33
“This database is approved by the Institutional Review Boards (IRBs) of Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center (BIDMC) [17].”
MethodDiversity-Inducing Policy Gradient: Using Maximum Mean Discrepancy to Find a Set of Diverse Policies
Masood, M., & Doshi‐Velez, F. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/821 · Cited by 54
Analysis of adult disease characteristics and mortality on MIMIC-III
Dai, Z. Y., Liu, S., Wu, J., Li, M., Liu, J., & Li, K. (2020) · PLoS ONE · doi:10.1371/journal.pone.0232176 · Cited by 27
Ge, S., Lin, S., Zhang, L., & Zeng, M. (2020) · Therapeutics and Clinical Risk Management · doi:10.2147/tcrm.s268523 · Cited by 25
“com/MIT-LCP/mimic-code).(17) Patients’ information consists of age, gender, mechanical ventilation on the first day, renal replacement therapy on the first day, ICU length of stay, Sequential Organ Failure Assessment (SOFA) scores, Elixhauser Comorbidity Index (SID30), comorbidities, and laboratory parameters which co…”
BackgroundKramer, A. A., Zimmerman, J. E., & Knaus, W. A. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004924 · Cited by 28
“With these limitations in mind, MIMIC-III was introduced (38, 39).”
MethodCaicedo-Torres, W., & Gutiérrez, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117190 · Cited by 29
Huang, X., Yuan, S., Ling, Y., Tan, S., Huang, T., Cheng, H., & Lyu, J. (2022) · International Journal of Clinical Practice · doi:10.1155/2022/7141216 · Cited by 27
Zhao, H., Zhao, Y., Wu, Z., Cheng, Y., & Zhao, N. (2021) · Journal of International Medical Research · doi:10.1177/0300060520980587 · Cited by 23
“The MIMIC-III database includes more than 50,000 patients who were admitted to the intensive care unit at Beth Israel Deaconess Medical Center from 2001 to 2012.(19,20) A detailed description of this database has been published elsewhere.”
MethodClinical impact of visually assessed right ventricular dysfunction in patients with septic shock
Hiraiwa, H., Kasugai, D., Ozaki, M., Goto, Y., Jingushi, N., Higashi, M., Nishida, K., Kondo, T., Furusawa, K., Morimoto, R., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-98397-8 · Cited by 25
Variable selection for causal mediation analysis using LASSO-based methods
Ye, Z., Zhu, Y., & Coffman, D. L. (2021) · Statistical Methods in Medical Research · doi:10.1177/0962280221997505 · Cited by 27
“A code repository is available for the MIMIC-III database and researchers are encouraged to make contributions to the code repository, to enhance reproducibility in health research.(8) Using the MIMIC-III database, we are interested in investigating how the use of transthoracic echocardiography (TTE) affects 28-day mo…”
MethodSwart, P., Deliberato, R. O., Johnson, A. E. W., Pollard, T., Bulgarelli, L., Pelosi, P. P., de Abreu, M. G., Schultz, M. J., & Neto, A. S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253933 · Cited by 23
“We aimed to determine whether this sex difference in use of LTVV has narrowed over the years, we assessed the databases of 2 large longitudinal projects, the ‘Medical Information Mart for Intensive Care III’ (MIMIC–III) [23, 24] and the ‘eICU Collaborative Research DataBase’ (eICU) [25].”
BackgroundMethodSelf-citationGao, Y., Hong, Z., Shen, R., Zhang, S., You, G., Chen, J., Guo, X., Peng, S., & Huang, K. (2021) · BMC Cardiovascular Disorders · doi:10.1186/s12872-021-02263-4 · Cited by 24
“Creation of materialized view and extraction of relevant data were conducted in PostgreSQL (Version: 10.12) through mimic-code for MIMIC-III [13, 14].”
InfluentialYang, S., Cao, L., Zhou, Y., & Hu, C. (2023) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s416943 · Cited by 30
“Advances in computer technology and the establishment of specialized databases such as MIMIC have helped more doctors recognize and focus on machine learning, and machine learning methods are gaining acceptance, providing opportunities for data science and machine learning.(10,11) In addition, machine learning can det…”
BackgroundAssociation mapping in biomedical time series via statistically significant shapelet mining
Bock, C., Gumbsch, T., Moor, M., Rieck, B., Roqueiro, D., & Borgwardt, K. M. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty246 · Cited by 25
Cao, B., Chen, Q., Tang, T., Li, H., Zhong, X., Peng, H., He, Q., & Chen, Y. (2022) · Annals of Translational Medicine · doi:10.21037/atm-22-3457 · Cited by 22
“The data included in the MIMIC-III dataset can be used free of charge after passing the official assessment (14) and has been widely used by researchers around the world to forecast model development, epidemiological investigations, and other studies.”
Lifting Hospital Electronic Health Record Data Treasures: Challenges and Opportunities
Maletzky, A., Böck, C., Tschoellitsch, T., Roland, T., Ludwig, H., Thumfart, S., Giretzlehner, M., Hochreiter, S., & Meier, J. M. (2022) · JMIR Medical Informatics · doi:10.2196/38557 · Cited by 30
“The authors of FIDDLE and Clairvoyance claim that their systems are sufficiently general to accommodate not only data extracted from MIMIC-III and eICU-CRD but also any EHR data available in a particular form.”
BackgroundInfluentialAssociation between alkaline phosphatase to albumin ratio and mortality among patients with sepsis
Liu, S., Zhao, K., Shao, C., Xu, L., Cui, X., & Wang, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-53384-7 · Cited by 25
“The definition of suspected infection is sending a pathogenetic test within 24 h after applying antibiotics or applying an antibiotic within 72 h after sending a pathogenetic test 20 .”
MethodData-driven curation process for describing the blood glucose management in the intensive care unit
Arévalo, A. R., Maley, J. H., Baker, L., Vieira, S. M., Sousa, J. M. C., Finkelstein, S. N., Mateo-Collado, R., Raffa, J. D., Celi, L. A., & DeMichele, F. (2021) · Scientific Data · doi:10.1038/s41597-021-00864-4 · Cited by 24
Self-citationZheng, Z. Q., Luo, J., Zhu, Y., Du, L., Lan, L., Zhou, X., Yang, X., & Huang, S. (2025) · Journal of Medical Internet Research · doi:10.2196/69293 · Cited by 35
“These resources were used to map and unify variables and codes in the 2 databases, creating consistent clinical definitions and ensuring data comparability [34].”
Chen, D., Du, J., Xie, Y., Li, M., Wang, R., & Tian, R. (2021) · International Urology and Nephrology · doi:10.1007/s11255-020-02724-3 · Cited by 21
Day-to-day progression of vital-sign circadian rhythms in the intensive care unit
Davidson, S. M., Villarroel, M., Harford, M., Finnegan, E., Jorge, J., Young, D., Watkinson, P., & Tarassenko, L. (2021) · Critical Care · doi:10.1186/s13054-021-03574-w · Cited by 31
“The inherently subjective nature of consciousness scores, combined with intermittent recording and the use of different scoring methodologies between different hospitals across multiple regions, makes it challenging to consistently establish and compare the wakefulness of patients [32].”
BackgroundLiu, C., Shi, J., Wang, F., Li, D., Luo, Y., Yang, B., Zhao, Y., Zhang, L., Yang, D., Jin, H., et al. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103438 · Cited by 28
“0), 24,25”
Yarnell, C. J., Angriman, F., Ferreyro, B. L., Liu, K., de Grooth, H., Burry, L. D., Munshi, L., Mehta, S., Celi, L. A., Elbers, P., et al. (2023) · Critical Care · doi:10.1186/s13054-023-04307-x · Cited by 24
“ICU Intensive care unit MIMIC-IV Medical information mart for intensive care version IV AmsterdamUMCdb Amsterdam University Medical Centers Database BIDMC Beth Israel Deaconess Medical Centre Amsterdam UMC Amsterdam University Medical Centers STROBE Strengthening The Reporting of Observational Studies in Epidemiology…”
MethodInfluentialSelf-citationChen, Y., Chen, L., Meng, Z., Li, Y. W., Tang, J., Liu, S., Li, L., Zhang, P., Chen, Q., & Liu, Y. (2023) · BMC Infectious Diseases · doi:10.1186/s12879-023-08384-9 · Cited by 21
“Sepsis patients frequently have anemia, and a few studies have found that hemoglobin levels equal to or below 8 g/dL in the first 48 h after ICU admission are associated with a higher risk of death from sepsis [18, 19].”
BackgroundDAI-Net: Dual Adaptive Interaction Network for Coordinated Medication Recommendation
Zou, X. G., He, X., Zheng, X., Zhang, W., Chen, J., & Tang, C. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3425833 · Cited by 24
“Dataset: To demonstrate the effectiveness of our proposed DAI-Netmodel,weconductedexperimentsunderpubliclyavail-ableEHRdatasets,i.e.,MIMIC-III[49],MIMIC-IV[50]and eICU[51]datasets.”
MethodLi, B., Li, J., Xin, M., Yang, S., Tian, F., Song, X., & Liu, J. (2024) · Frontiers in Neurology · doi:10.3389/fneur.2024.1331626 · Cited by 20
Metadata
- Authors
- Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J.
- Affiliations
- Massachusetts Institute of Technology (US)
- University of Virginia (US)
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Johnson, Alistair E W
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-09-27
- Volume
- 25
- Issue
- 1
- Pages
- 32-39
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6381763
- OpenAlex
- W2757504960
- Cited by
- 442
- References
- 36
- Citations by year
- 2026: 44 · 2025: 67 · 2024: 56 · 2023: 72 · 2022: 57 · 2021: 62 · 2020: 39 · 2019: 24 · 2018: 17 · 2017: 3
- FWCI
- 17.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (NIH-R01-EB017205, NIH-R01-EB001659)
- Topics
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- reproducibility, critical care research, intensive care unit data, open-source code, electronic health records, sepsis definitions, disease severity index, organ failure scores, data extraction, research data sharing, community collaboration
- MeSH terms
- Critical Care, Humans, ROC Curve, Severity of Illness Index, Therapeutics, Reproducibility of Results, Comorbidity, Databases, Factual, Sepsis, Access to Information, Biomedical Research, Data Mining, Electronic Health Records, Organ Dysfunction Scores
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.