MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care.
Open accessThe DOI matches its Crossref record; 26 of the 28 references it cites were found in a registry or an index; 3 of the 17 sources its claims cite were checked for support.
Abstract
The rise of digital data and computing power have contributed to significant advancements in artificial intelligence (AI), leading to the use of classification and prediction models in health care to enhance clinical decision-making for diagnosis, treatment and prognosis. However, such advances are limited by the lack of reporting standards for the data used to develop those models, the model architecture, and the model evaluation and validation processes. Here, we present MINIMAR (MINimum Information for Medical AI Reporting), a proposal describing the minimum information necessary to understand intended predictions, target populations, and hidden biases, and the ability to generalize these emerging technologies. We call for a standard to accurately and responsibly report on AI in health care. This will facilitate the design and implementation of these models and promote the development and use of associated clinical decision support tools, as well as manage concerns regarding accuracy and bias.
Overview
CoChat Summary
TL;DR
MINIMAR is a proposal for minimum reporting standards for medical AI, covering study population and setting, patient demographics, model architecture, and model evaluation. It argues that transparent reporting of training data, model development, and validation is needed to assess bias, reproducibility, and generalizability in health care.
Key findings
- Proposes MINIMAR around 4 essential components: (1) study population and setting, (2) patient demographic characteristics, (3) model architecture, and (4) model evaluation.
- Argues that lack of reporting standards limits understanding of intended predictions, target populations, hidden biases, and the ability to generalize AI models in health care.
- Cites an empirical evaluation of 81 studies comparing AI models against clinicians that showed major problems with lack of transparency, bias, and unjustified claims, likely because key details were often missing.
- Calls for a standard to accurately and responsibly report AI in health care, including transparency on training data, model design/development, evaluation, validation, and code/data sharing.
Methods
- Design: a proposal/commentary, not an empirical study; MINIMAR is presented as a starting point for broader community discussion.
- Data or sample: no primary dataset; the paper draws on literature and uses two cited example studies in Table 1 to illustrate proposed reporting fields.
- Main analysis: narrative rationale and a proposed checklist/table of 4 reporting components with features, descriptions, and examples.
Limitations
- The paper states MINIMAR is a starting point for broader community discussion and hopes it will stimulate discussion and improvement; no formal validation or consensus process is reported.
- Evident from the text: MINIMAR is not empirically tested for usability, reliability, or impact, and the illustrative examples are limited to two cited studies.
- Evident from the text: no formal Delphi process, stakeholder validation, or adoption study is described.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 10 Not checked · 4 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Therefore, the data used for training and the definition of the task—be it classification or prediction—become more important than the specifics of the machine learning algorithm.7”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Supportedcites [7] Obermeyer, 2019, Dissecting racial bias in an algorithm used to manage the health of populations, Science source
The Discussion (p. 8) states the comparison the citing sentence attributes directly: 'Changing the procedures by which we fit algorithms (for instance, by using a new statistical technique for decorrelating predictors with race...) is not required. Rather, we must change the data we feed the algorithm - specifically, the labels we give it,' and 'labels are the key determinant of both predictive quality and predictive bias.' The Problem formulation section (p. 6) calls label choice 'perhaps the single most important decision made in the development of a prediction algorithm,' and Experiments on label choice (p. 6) shows algorithms held constant in training method whose labels differ produce nearly twofold variation in the Black share of the highest-risk group. Our copy frames 'definition of the task' as label choice / 'problem formulation' (turning an amorphous concept into a concrete predictable variable) rather than a classification-versus-prediction distinction, but the substance of the attributed claim - data and task definition outweighing algorithmic specifics - is stated explicitly. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is clear that the performance of any AI model broadly depends on its reliability and its ability to generalize to the setting and population in which it is applied, rather than its performance represented by the training and test data alone.10”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Partly supportedcites [10] Riley, 2016, External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges, BMJ sourceExperimental — accuracy not yet measured
The source states the substance of the claim for clinical prediction models: the Summary points section defines external validation as using 'new participant level data, external to those used for model development, to examine whether the model's predictions are reliable... in individuals from potential population(s) for clinical use'; 'Current shortcomings of external validation studies' says predictive performance 'tends to vary across settings, populations and periods' so that multiple external validations are needed 'to fully appreciate the generalisability of a prediction model'; and the Conclusions state that reporting only overall (averaged) performance 'is not sufficient' and that users need to know whether a model is 'reliable or transportable to all the settings, populations, and groups'. What the source does not support is the claim's scope: our copy frames this entirely around statistical multivariable regression risk models (Framingham, QRISK2, Nottingham prognostic index, Wells score) and never mentions artificial intelligence or machine-learning models, and its contrast is with development-data/overall averaged performance rather than with a modern AI 'training and test split'. So the generalisability-and-reliability principle is confirmed, but the extension to 'any AI model' is not this paper's. (LLM, conf=0.72)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A lack of transparency regarding the training data used for model development directly affects the reproducibility, generalizability, and interpretability of a proposed model.”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the characteristics of the data necessary to assess how these predictive models perform are not being adequately reported in the literature,11 leaving uncertainty and doubt about the application in the broader healthcare setting.”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Not checked yetcites [11] Bozkurt, 2020, Reporting of demographic data, representativeness and transparency in machine learning models using electronic health records, JAMA Netw Open
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Detailed knowledge of the data used to train the model (ie, the training data) and the population those data represent—or often, does not represent—is essential to understanding the validity and generalizability of the “AI solution.””
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
5 more claims
Create a free account to see all 17 claims and to verify the 14 references still open.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Standardized reporting checklists such as the Prediction Model Risk of Bias Assessment (PROBAST) tool have been developed to assess the risk of imbalanced data biases, which allows both developers and downstream users (e.g., physicians, hospitals) to better understand the suitability and limitations of AI-based systems in specific clinical settings [54–56].”
From Bias in medical AI: Implications for clinical decision-making (2024) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One significant gap is the absence of guidance on how to report post-deployment model evaluation, particularly in terms of their impact on equitable health outcomes.”
From Advancing Health Equity through Multi-Level Fairness in Health Informatics (2026) · cites this paper as [12]
Experimental — accuracy not yet measuredIn the citing paper
“This includes MINIMAR (MINimum Information for Medical AI Reporting), which defines a minimal set of reporting elements covering study population and setting, patient demographics, model architecture, and model evaluation (198)”
From Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions (2024) · cites this paper as [198]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“Therefore, the data used for training and the definition of the task—be it classification or prediction—become more important than the specifics of the machine learning algorithm.(7) Detailed knowledge of the data used to train the model (ie, the training data) and the population those data represent—or often, does no…”
BackgroundMethodSPIRIT 2013 Statement: defining standard protocol items for clinical trials.
Chan, A., Tetzlaff, J., Altman, D. G., Laupacis, A., Gøtzsche, P. C., A-Jerić, K. K., Hrobjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2015) · PubMed · Cited by 4,986
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Research works printed but not linked: 1
- Villarosa, 2018, Why America’s black mothers and babies are in a life-or-death crisis, The New York Times Magazine, 11
Cited by
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Díaz-Rodríguez, N., Del Ser, J., Coeckelbergh, M., López de Prado, M., Herrera-Viedma, E., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101896 · Cited by 800
Bias in medical AI: Implications for clinical decision-making
Cross, J. L., Choma, M. A., & Onofrey, J. A. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000651 · Cited by 607
Ethical and Bias Considerations in Artificial Intelligence/Machine Learning
Hanna, M. G., Pantanowitz, L., Jackson, B., Palmer, O., Visweswaran, S., Pantanowitz, J., Deebajah, M., & Rashidi, H. H. (2025) · Modern Pathology · doi:10.1016/j.modpat.2024.100686 · Cited by 535
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
The potential of artificial intelligence to improve patient safety: a scoping review
Bates, D. W., Levine, D., Syrowatka, A., Kuznetsova, M., Craig, K. J. T., Rui, A., Jackson, G. P., & Rhee, K. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00423-6 · Cited by 323
Chen, H., Gomez, C., Huang, C.-M., & Unberath, M. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00699-2 · Cited by 300
The value of standards for health datasets in artificial intelligence-based applications
Arora, A., Alderman, J. E., Palmer, J., Ganapathi, S., Laws, E., McCradden, M. D., Oakden-Rayner, L., Pfohl, S. R., Ghassemi, M., McKay, F., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02608-w · Cited by 294
Cabitza, F., Campagner, A., Soares, F., García de Guadiana-Romualdo, L., Challa, F., Sulejmani, A., Seghezzi, M., & Carobene, A. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106288 · Cited by 284
“In these settings, ML models must be robust, that is capable to reliably work also in contexts that may be more or less subtly different from the one from which the training data has been obtained [30, 59, 66].”
BackgroundThe need to separate the wheat from the chaff in medical informatics
Cabitza, F., & Campagner, A. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104510 · Cited by 276
Reproducibility standards for machine learning in the life sciences
Heil, B. J., Hoffman, M. M., Markowetz, F., Lee, S.-I., Greene, C. S., & Hicks, S. C. (2021) · Nature Methods · doi:10.1038/s41592-021-01256-7 · Cited by 255
Digital twins for predictive oncology will be a paradigm shift for precision cancer care
Hernandez-Boussard, T., Macklin, P., Greenspan, E. J., Gryshuk, A. L., Stahlberg, E., Syeda-Mahmood, T., & Shmulevich, I. (2021) · Nature Medicine · doi:10.1038/s41591-021-01558-5 · Cited by 219
Self-citationMalgaroli, M., Hull, T. D., Zech, J. M., & Althoff, T. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02592-2 · Cited by 201
Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions
Lotter, W., Hassett, M. J., Schultz, N., Kehl, K. L., Van Allen, E. M., & Cerami, E. (2024) · Cancer Discovery · doi:10.1158/2159-8290.cd-23-1199 · Cited by 196
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Self-citationEvaluation and Mitigation of Racial Bias in Clinical Machine Learning Models: Scoping Review
Huang, J., Galal, G., Etemadi, M., & Vaidyanathan, M. (2022) · JMIR Medical Informatics · doi:10.2196/36388 · Cited by 186
“The proposed Minimum Information for Medical AI Reporting guideline addresses these concerns by recommending that clinical ML studies report information necessary for understanding potential biases, including relevant demographic information of patient data used for model development [64].”
Sanmarchi, F., Fanconi, C., Golinelli, D., Gori, D., Hernandez‐Boussard, T., & Capodici, A. (2023) · Journal of Nephrology · doi:10.1007/s40620-023-01573-4 · Cited by 176
Self-citationThe METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review
Schwabe, D., Becker, K., Seyferth, M., Klaß, A., & Schaeffter, T. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01196-4 · Cited by 169
Crossnohere, N. L., Elsaid, M. I., Paskett, J., Bose‐Brill, S., & Bridges, J. F. P. (2022) · Journal of Medical Internet Research · doi:10.1016/j.jval.2022.04.1285 · Cited by 167
Methods for clinical evaluation of artificial intelligence algorithms for medical diagnosis
Park, S. H., Han, K., Jang, H. Y., Park, J. E., Lee, J.-G., Kim, D. W., & Choi, J. (2023) · Radiology · doi:10.1148/radiol.220182 · Cited by 163
Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis
Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D., & Kather, J. N. (2024) · Communications Medicine · doi:10.1038/s43856-024-00492-0 · Cited by 160
The digital scribe in clinical practice: a scoping review and research agenda
van Buchem, M. M., Boosman, H., Bauer, M. P., Kant, I. M. J., Cammel, S. A., & Steyerberg, E. W. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00432-5 · Cited by 152
A deep-learning algorithm to classify skin lesions from mpox virus infection
Thieme, A. H., Zheng, Y., Machiraju, G., Sadée, C., Mittermaier, M., Gertler, M., Salinas, J. L., Srinivasan, K., Gyawali, P., Carrillo‐Pérez, F., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02225-7 · Cited by 146
Self-citationGeneralizability of FDA-Approved AI-Enabled Medical Devices for Clinical Use
Windecker, D., Baj, G., Shiri, I., Kazaj, P. M., Kaesmacher, J., Gräni, C., & Siontis, G. C. M. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.8052 · Cited by 142
Trustworthy Augmented Intelligence in Health Care
Crigger, E., Reinbold, K., Hanson, C., Kao, A., Blake, K., & Irons, M. (2022) · Journal of Medical Systems · doi:10.1007/s10916-021-01790-z · Cited by 132
“Other ongoing efforts include a machine learning-focused version of the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis statement (TRIPOD-ML) [37] and Minimum Information for Medical AI Reporting (MINIMAR) [38].”
MethodSpadarella, G., Stanzione, A., D’Antonoli, T. A., Андрейченко, А. Е., Fanni, S. C., Ugga, L., Kotter, E., & Cuocolo, R. (2022) · European Radiology · doi:10.1007/s00330-022-09187-3 · Cited by 129
Cai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., Yin, Z., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03273-7 · Cited by 122
Svennberg, E., Han, J. K., Caiani, E. G., Engelhardt, S., Ernst, S., Friedman, P. A., Garcia, R., Ghanbari, H., Hindricks, G., Man, S. H., et al. (2025) · EP Europace · doi:10.1093/europace/euaf071 · Cited by 121
McCradden, M. D., Joshi, S., Anderson, J. A., Mazwi, M., Goldenberg, A., & Zlotnik Shaul, R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa085 · Cited by 111
Hurkmans, C., Bibault, J.-E., Brock, K. K., van Elmpt, W., Feng, M., David Fuller, C., Jereczek-Fossa, B. A., Korreman, S., Landry, G., Madesta, F., et al. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2024.110345 · Cited by 110
Reporting Use of AI in Research and Scholarly Publication—JAMA Network Guidance
Flanagin, A., Pirracchio, R., Khera, R., Berkwits, M., Hswen, Y., & Bibbins-Domingo, K. (2024) · JAMA · doi:10.1001/jama.2024.3471 · Cited by 103
Nuclear Medicine and Artificial Intelligence: Best Practices for Algorithm Development
Bradshaw, T. J., Boellaard, R., Dutta, J., Jha, A. K., Jacobs, P., Li, Q., Liu, C., Sitek, A., Saboury, B., Scott, P. J. H., et al. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.262567 · Cited by 94
Digital Health Equity: Addressing Power, Usability, and Trust to Strengthen Health Systems
Koehle, H., Kronk, C. A., & Lee, Y. J. (2022) · Yearbook of Medical Informatics · doi:10.1055/s-0042-1742512 · Cited by 90
Fraser, A. G., Biasin, E., Bijnens, B., Bruining, N., Caiani, E. G., Cobbaert, K., Davies, R. H., Gilbert, S. H., Hovestadt, L., Kamenjasevic, E., et al. (2023) · Expert Review of Medical Devices · doi:10.1080/17434440.2023.2184685 · Cited by 88
Stephens, A. F., Šeman, M., Diehl, A., Pilcher, D. V., Barbaro, R. P., Brodie, D., Pellegrino, V. A., Kaye, D. M., Gregory, S. D., & Hodgson, C. L. (2023) · Intensive Care Medicine · doi:10.1007/s00134-023-07157-x · Cited by 87
Enhancing trust in AI through industry self-governance.
Roski, J., Maier, E. J., Vigilante, K., Kane, E. A., & Matheny, M. E. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab065 · Cited by 83
“…management process 5,30–32 PHASE 2: Development • Data bias 33–38 • Lack of representative & equitable population 33,39 • Lack of data management 37,40 • No accounting for causal pathways 41 • Data transparency & reporting 32,37,40,42–46 • Model provenance records 40 • Equitable/diverse…”
BackgroundTransparency of medical artificial intelligence systems
Kim, C., Gadgil, S. U., & Lee, S. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00363-w · Cited by 81
Harnessing the potential of machine learning for advancing “Quality by Design” in biomanufacturing
Walsh, I., Myint, M., Nguyen-Khuong, T., Ho, Y. S., Ng, S. K., & Lakshmanan, M. (2022) · mAbs · doi:10.1080/19420862.2021.2013593 · Cited by 81
Artificial intelligence in liver cancer — new tools for research and patient management
Caldéraro, J., Žigutytė, L., Truhn, D., Jaffe, A., & Kather, J. N. (2024) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/s41575-024-00919-y · Cited by 79
Banerjee, A., Chen, S., Fatemifar, G., Zeina, M., Lumbers, R. T., Mielke, J., Gill, S., Kotecha, D., Freitag, D. F., Denaxas, S., et al. (2021) · BMC Medicine · doi:10.1186/s12916-021-01940-7 · Cited by 78
Artificial Intelligence for Clinical Decision Support in Acute Ischemic Stroke: A Systematic Review
Akay, E. M. Z., Hilbert, A., Carlisle, B. G., Madai, V. I., Mutke, M. A., & Frey, D. (2023) · Stroke · doi:10.1161/strokeaha.122.041442 · Cited by 77
Bias at warp speed: how AI may contribute to the disparities gap in the time of COVID-19
Röösli, E., Rice, B., & Hernandez-Boussard, T. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa210 · Cited by 76
Self-citationArtificial Intelligence in Nutrition and Dietetics: A Comprehensive Review of Current Research
Panayotova, G. G. (2025) · Healthcare · doi:10.3390/healthcare13202579 · Cited by 75
Kasartzian, D.-I., & Tsiampalis, T. (2025) · Life · doi:10.3390/life15010094 · Cited by 74
Peeking into a black box, the fairness and generalizability of a MIMIC-III benchmarking model.
Röösli, E., Bozkurt, S., & Hernandez-Boussard, T. (2022) · Scientific Data · doi:10.1038/s41597-021-01110-7 · Cited by 73
Self-citationStafford, I. S., Gosink, M. M., Mossotto, E., Ennis, S., & Hauben, M. (2022) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izac115 · Cited by 71
AI Reporting Guidelines: How to Select the Best One for Your Research
Klontzas, M. E., Gatti, A. A., Tejani, A. S., & Kahn, C. E. (2023) · Radiology: Artificial Intelligence · doi:10.1148/ryai.230055 · Cited by 66
Shelmerdine, S. C., Arthurs, O. J., Denniston, A., & Sebire, N. J. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100385 · Cited by 66
Petersen, C., Smith, J., Freimuth, R. R., Goodman, K. W., Jackson, G. P., Kannry, J., Liu, H., Madhavan, S., Sittig, D. F., & Wright, A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa319 · Cited by 65
Bozkurt, S., Cahan, E. M., Seneviratne, M. G., Sun, R., Lossio-Ventura, J. A., Ioannidis, J. P. A., & Hernandez-Boussard, T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa164 · Cited by 65
Self-citationZhang, Q., Fotaki, A., Ghadimi, S., Wang, Y., Doneva, M., Wetzl, J., Delfino, J. G., O’Regan, D. P., Prieto, C., & Epstein, F. H. (2024) · Journal of Cardiovascular Magnetic Resonance · doi:10.1016/j.jocmr.2024.101051 · Cited by 65
Machine Learning in Laboratory Medicine: Recommendations of the IFCC Working Group
Master, S. R., Badrick, T. C., Bietenbeck, A., & Haymond, S. (2023) · Clinical Chemistry · doi:10.1093/clinchem/hvad055 · Cited by 64
Oncologic Imaging and Radiomics: A Walkthrough Review of Methodological Challenges
Stanzione, A., Cuocolo, R., Ugga, L., Verde, F., Romeo, V., Brunetti, A., & Maurea, S. (2022) · Cancers · doi:10.3390/cancers14194871 · Cited by 64
Progress and challenges of artificial intelligence in lung cancer clinical translation
Zhu, E., Muneer, A., Zhang, J., Yang, X., Li, X., Zhou, C., Heymach, J. V., Wu, J., & Le, X. (2025) · npj Precision Oncology · doi:10.1038/s41698-025-00986-7 · Cited by 64
Reporting guidelines for artificial intelligence in healthcare research
Ibrahim, H., Liu, X., & Denniston, A. K. (2021) · Clinical & Experimental Ophthalmology · doi:10.1111/ceo.13943 · Cited by 61
Artificial Intelligence in Dentistry: A Concise Review of Reporting Checklists and Guidelines
Khurshid, Z., Osathanon, T., Shire, M. A., Schwendicke, F., & Samaranayake, L. P. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.109322 · Cited by 61
Khoury, P., Srinivasan, R., Kakumanu, S., Ochoa, S., Keswani, A., Sparks, R., & Rider, N. L. (2022) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2022.01.047 · Cited by 60
Klement, W., & El Emam, K. (2023) · Journal of Medical Internet Research · doi:10.2196/48763 · Cited by 59
External validation of AI-based scoring systems in the ICU: a systematic review and meta-analysis
Rockenschaub, P., Akay, E. M., Carlisle, B. G., Hilbert, A., Wendland, J., Meyer-Eschenbach, F., Näher, A.-F., Frey, D., & Madai, V. I. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02830-7 · Cited by 58
Phạm, Q., Gamble, A., Hearn, J., & Cafazzo, J. A. (2021) · Journal of Medical Internet Research · doi:10.2196/22320 · Cited by 56
Cresswell, K. M., Rigby, M., Magrabi, F., Scott, P., Brender, J., Craven, C. K., Wong, Z. S.-Y., Kukhareva, P., Ammenwerth, E., Georgiou, A., et al. (2023) · Health Policy · doi:10.1016/j.healthpol.2023.104889 · Cited by 56
Multimorbidity in dementia: Current perspectives and future challenges
Stirland, L., Choate, R., Zanwar, P., Zhang, P., Watermeyer, T., Valletta, M., Torso, M., Tamburin, S., Saeed, U., Ridgway, G. R., et al. (2025) · Alzheimer s & Dementia · doi:10.1002/alz.70546 · Cited by 56
Niemiec, E. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221089079 · Cited by 55
Natural language processing for clinical notes in dentistry: A systematic review
Pethani, F., & Dunn, A. G. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104282 · Cited by 54
Lu, J. H., Callahan, A., Patel, B. S., Morse, K. E., Dash, D., Pfeffer, M. A., & Shah, N. H. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.27779 · Cited by 52
Self-citationCorbin, C. K., Maclay, R., Acharya, A., Mony, S., Punnathanam, S., Thapa, R., Kotecha, N., Shah, N. H., & Chen, J. H. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad114 · Cited by 50
Self-citationBig Data in Laboratory Medicine—FAIR Quality for AI?
Blatter, T. U., Witte, H., Nakas, C. T., & Leichtle, A. B. (2022) · Diagnostics · doi:10.3390/diagnostics12081923 · Cited by 50
Williams, M. C., Weir-McCall, J. R., Baldassarre, L. A., Cecco, C. N. D., Choi, A. D., Dey, D., Dweck, M. R., Išgum, I., Kolossváry, M., Leipsic, J. A., et al. (2024) · Journal of cardiovascular computed tomography · doi:10.1016/j.jcct.2024.08.003 · Cited by 50
Machine Learning for Health: Algorithm Auditing & Quality Control
Oala, L., Murchison, A. G., Balachandran, P., Choudhary, S., Fehr, J., Leite, A. W., Goldschmidt, P. G., Johner, C., Schörverth, E. D. M., Nakasi, R., et al. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01783-y · Cited by 48
Siontis, G. C. M., Sweda, R., Noseworthy, P. A., Friedman, P. A., Siontis, K. C., & Patel, C. J. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100466 · Cited by 48
Ng, M. Y., Youssef, A., Miner, A. S., Sarellano, D., Long, J., Larson, D. B., Hernandez‐Boussard, T., & Langlotz, C. P. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.45892 · Cited by 47
Self-citationWang, Y., Li, N., Chen, L., Wu, M., Meng, S., Dai, Z., Zhang, Y., & Clarke, M. (2023) · Journal of Medical Internet Research · doi:10.2196/46089 · Cited by 45
Peterson, D. J., Ostberg, N. P., Blayney, D. W., Brooks, J. D., & Hernandez‐Boussard, T. (2021) · JCO Clinical Cancer Informatics · doi:10.1200/cci.21.00116 · Cited by 45
Self-citationvan Dijk, L. V., & Fuller, C. D. (2021) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_320951 · Cited by 44
Carobene, A., Milella, F., Famiglini, L., & Cabitza, F. (2022) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2022-0182 · Cited by 44
Current State and Prospects of Artificial Intelligence in Allergy
van Breugel, M., Fehrmann, R. S. N., Bügel, M., Rezwan, F. I., Holloway, J. W., Nawijn, M. C., Fontanella, S., Custovic, A., & Koppelman, G. H. (2023) · Allergy · doi:10.1111/all.15849 · Cited by 43
Framework for AI Adoption in Healthcare Sector: Integrated DELPHI, ISM–MICMAC Approach
Gupta, A. K., & Srivastava, M. K. (2024) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2024.3386580 · Cited by 43
Moassefi, M., Rouzrokh, P., Conte, G. M., Vahdati, S., Fu, T., Tahmasebi, A., Younis, M., Farahani, K., Gentili, A., Kline, T. L., et al. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00870-5 · Cited by 43
Yang, H. S., Rhoads, D. D., Sepulveda, J. L., Zang, C., Chadburn, A., & Wang, F. (2022) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2021-0635-ra · Cited by 42
Morone, G., De Angelis, L., Martino Cinnera, A., Carbonetti, R., Bisirri, A., Ciancarelli, I., Iosa, M., Negrini, S., Kiekens, C., & Negrini, F. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1550731 · Cited by 41
Artificial intelligence tool development: what clinicians need to know?
Chew, B.-H., & Ngiam, K. Y. (2025) · BMC Medicine · doi:10.1186/s12916-025-04076-0 · Cited by 41
Considerations in the reliability and fairness audits of predictive models for advance care planning
Lu, J., Sattler, A., Wang, S., Khaki, A. R., Callahan, A., Fleming, S., Fong, R., Ehlert, B., Li, R. C., Shieh, L., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.943768 · Cited by 40
Self-citationEvaluating the impact of the Radiomics Quality Score: a systematic review and meta-analysis
Barry, N., Kendrick, J., Molin, K., Li, S., Rowshanfarzad, P., Hassan, G. M., Dowling, J., Parizel, P. M., Hofman, M. S., & Ebert, M. A. (2025) · European Radiology · doi:10.1007/s00330-024-11341-y · Cited by 40
Benedum, C. M., Sondhi, A., Fidyk, E., Cohen, A. B., Nemeth, S., Adamson, B. J. S., Estévez, M., & Bozkurt, S. (2023) · Cancers · doi:10.3390/cancers15061853 · Cited by 40
Self-citationInterplay between Federated Learning and Explainable Artificial Intelligence: a Scoping ReviewPreprint
López-Ramos, L. M., Leiser, F., Rastogi, A., Hicks, S., Strümke, I., Madai, V. I., Budig, T., Sunyaev, A., & Hilbert, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.05874 · Cited by 40
Dwyer, B., Flathers, M., Sano, A., Dempsey, A. G., Cipriani, A., Gazi, A. H., Hill, B., Gorban, C., Rodríguez, C. I., Stromeyer, C., et al. (2025) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-025-00049-6 · Cited by 39
Robustness and reproducibility for AI learning in biomedical sciences: RENOIR
Barberis, A., Aerts, H. J. W. L., & Buffa, F. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-51381-4 · Cited by 39
Artificial intelligence and spine imaging: limitations, regulatory issues and future direction
Hornung, A. L., Hornung, C. M., Mallow, G. M., Barajas, J. N., Orías, A. A. E., Galbusera, F., Wilke, H., Colman, M. W., Phillips, F. M., An, H. S., et al. (2022) · European Spine Journal · doi:10.1007/s00586-021-07108-4 · Cited by 39
Bias Mitigation in Primary Health Care Artificial Intelligence Models: Scoping Review
Sasseville, M., Ouellet, S., Rhéaume, C., Sahlia, M., Couture, V., Després, P., Paquette, J.-S., Darmon, D., Bergeron, F., & Gagnon, M.-P. (2025) · Journal of Medical Internet Research · doi:10.2196/60269 · Cited by 38
“Based on reporting standards for AI in health care [21], we extracted the following information (title of the paper, year of publication, lead author, and country), study objective, discipline and study design, AI model features, study population and setting, AI model architecture and evaluation,…”
Miao, Y., Zhao, Y., Luo, Y., Wang, H., & Wu, Y. (2025) · Journal of Medical Internet Research · doi:10.2196/80557 · Cited by 38
Automated diagnosis of autism with artificial intelligence: State of the art
Valizadeh, A., Moassefi, M., Nakhostin-Ansari, A., Some’eh, S. H., Hosseini-Asl, S. H., Torbati, M. S., Aghajani, R., Ghorbani, Z. M., Oskouie, I. M., Aghajani, F., et al. (2023) · Reviews in the Neurosciences · doi:10.1515/revneuro-2023-0050 · Cited by 38
GaNDLF: the generally nuanced deep learning framework for scalable end-to-end clinical workflows
Pati, S., Thakur, S. P., Hamamcı, İ. E., Baid, U., Baheti, B., Bhalerao, M., Güley, O., Mouchtaris, S., Lang, D., Thermos, S., et al. (2023) · Communications Engineering · doi:10.1038/s44172-023-00066-3 · Cited by 38
Lorde, N., Mahapatra, S., & Kalaria, T. (2024) · Diagnostics · doi:10.3390/diagnostics14161808 · Cited by 37
van Dijk, D. P. J., Volmer, L., Brecheisen, R., Martens, B., Dolan, R. D., Bryce, A. S., Chang, D. K.-F., McMillan, D. C., Stoot, J. H. M. B., West, M. A., et al. (2024) · British Journal of Radiology · doi:10.1093/bjr/tqae191 · Cited by 37
Khan, S. D., Hoodbhoy, Z., Raja, M. H. R., Kim, J. Y., Hogg, H. D. J., Manji, A. A. A., Gulamali, F., Hasan, A., Shaikh, A., Tajuddin, S., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000514 · Cited by 36
“Frameworks highlight the need to select clinically relevant problems and identify the need for acquiring an AI tool before initiating the procurement process [27,34–36].”
BackgroundSoe, N. N., Yu, Z. T., Latt, P. M., Lee, D. M., Ong, J. J., Ge, Z., Fairley, C. K., & Zhang, L. (2024) · BMC Medicine · doi:10.1186/s12916-024-03512-x · Cited by 36
Governance for safe and responsible AI in healthcare organisations: a scoping review of frameworks
Wang, A., Freeman, S., & Magrabi, F. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02679-2 · Cited by 35
AI Quality Standards in Health Care: Rapid Umbrella Review
Kuziemsky, C. E., Chrimes, D., Minshall, S. R., Mannerow, M., & Lau, F. (2024) · Journal of Medical Internet Research · doi:10.2196/54705 · Cited by 34
Kuttan, N., Pundkar, A., Gadkari, C. P., Patel, A., & Kumar, A. (2025) · Multidisciplinary Reviews · doi:10.31893/multirev.2025285 · Cited by 34
Metadata
- Authors
- Hernandez-Boussard, T., Bozkurt, S., Ioannidis, J. P. A., & Shah, N. H.
- Affiliations
- Department of Medicine, Stanford University, Stanford, California, USA
- Stanford Medicine (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-06-28
- Volume
- 27
- Issue
- 12
- Pages
- 2011-2015
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7727333
- OpenAlex
- W3037405958
- Cited by
- 410
- References
- 28
- Citations by year
- 2026: 94 · 2025: 77 · 2024: 80 · 2023: 65 · 2022: 51 · 2021: 38 · 2020: 5
- FWCI
- 11.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (R01CA183962)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- reporting guidelines, artificial intelligence in healthcare, clinical decision support, model transparency, algorithmic bias, generalizability, clinical prediction model
- MeSH terms
- Artificial Intelligence, Delivery of Health Care, Humans, Electronic Health Records, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.