MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care.
Open accessThe DOI matches its Crossref record; 26 of the 28 references it cites were found in a registry or an index; 3 of the 17 sources its claims cite were checked for support.
Abstract
The rise of digital data and computing power have contributed to significant advancements in artificial intelligence (AI), leading to the use of classification and prediction models in health care to enhance clinical decision-making for diagnosis, treatment and prognosis. However, such advances are limited by the lack of reporting standards for the data used to develop those models, the model architecture, and the model evaluation and validation processes. Here, we present MINIMAR (MINimum Information for Medical AI Reporting), a proposal describing the minimum information necessary to understand intended predictions, target populations, and hidden biases, and the ability to generalize these emerging technologies. We call for a standard to accurately and responsibly report on AI in health care. This will facilitate the design and implementation of these models and promote the development and use of associated clinical decision support tools, as well as manage concerns regarding accuracy and bias.
Overview
CoChat Summary
TL;DR
MINIMAR is a proposal for minimum reporting standards for medical AI, covering study population and setting, patient demographics, model architecture, and model evaluation. It argues that transparent reporting of training data, model development, and validation is needed to assess bias, reproducibility, and generalizability in health care.
Key findings
- Proposes MINIMAR around 4 essential components: (1) study population and setting, (2) patient demographic characteristics, (3) model architecture, and (4) model evaluation.
- Argues that lack of reporting standards limits understanding of intended predictions, target populations, hidden biases, and the ability to generalize AI models in health care.
- Cites an empirical evaluation of 81 studies comparing AI models against clinicians that showed major problems with lack of transparency, bias, and unjustified claims, likely because key details were often missing.
- Calls for a standard to accurately and responsibly report AI in health care, including transparency on training data, model design/development, evaluation, validation, and code/data sharing.
Methods
- Design: a proposal/commentary, not an empirical study; MINIMAR is presented as a starting point for broader community discussion.
- Data or sample: no primary dataset; the paper draws on literature and uses two cited example studies in Table 1 to illustrate proposed reporting fields.
- Main analysis: narrative rationale and a proposed checklist/table of 4 reporting components with features, descriptions, and examples.
Limitations
- The paper states MINIMAR is a starting point for broader community discussion and hopes it will stimulate discussion and improvement; no formal validation or consensus process is reported.
- Evident from the text: MINIMAR is not empirically tested for usability, reliability, or impact, and the illustrative examples are limited to two cited studies.
- Evident from the text: no formal Delphi process, stakeholder validation, or adoption study is described.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 10 Not checked · 4 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Therefore, the data used for training and the definition of the task—be it classification or prediction—become more important than the specifics of the machine learning algorithm.7”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Supportedcites [7] Obermeyer, 2019, Dissecting racial bias in an algorithm used to manage the health of populations, Science source
The Discussion (p. 8) states the comparison the citing sentence attributes directly: 'Changing the procedures by which we fit algorithms (for instance, by using a new statistical technique for decorrelating predictors with race...) is not required. Rather, we must change the data we feed the algorithm - specifically, the labels we give it,' and 'labels are the key determinant of both predictive quality and predictive bias.' The Problem formulation section (p. 6) calls label choice 'perhaps the single most important decision made in the development of a prediction algorithm,' and Experiments on label choice (p. 6) shows algorithms held constant in training method whose labels differ produce nearly twofold variation in the Black share of the highest-risk group. Our copy frames 'definition of the task' as label choice / 'problem formulation' (turning an amorphous concept into a concrete predictable variable) rather than a classification-versus-prediction distinction, but the substance of the attributed claim - data and task definition outweighing algorithmic specifics - is stated explicitly. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is clear that the performance of any AI model broadly depends on its reliability and its ability to generalize to the setting and population in which it is applied, rather than its performance represented by the training and test data alone.10”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Partly supportedcites [10] Riley, 2016, External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges, BMJ sourceExperimental — accuracy not yet measured
The source states the substance of the claim for clinical prediction models: the Summary points section defines external validation as using 'new participant level data, external to those used for model development, to examine whether the model's predictions are reliable... in individuals from potential population(s) for clinical use'; 'Current shortcomings of external validation studies' says predictive performance 'tends to vary across settings, populations and periods' so that multiple external validations are needed 'to fully appreciate the generalisability of a prediction model'; and the Conclusions state that reporting only overall (averaged) performance 'is not sufficient' and that users need to know whether a model is 'reliable or transportable to all the settings, populations, and groups'. What the source does not support is the claim's scope: our copy frames this entirely around statistical multivariable regression risk models (Framingham, QRISK2, Nottingham prognostic index, Wells score) and never mentions artificial intelligence or machine-learning models, and its contrast is with development-data/overall averaged performance rather than with a modern AI 'training and test split'. So the generalisability-and-reliability principle is confirmed, but the extension to 'any AI model' is not this paper's. (LLM, conf=0.72)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A lack of transparency regarding the training data used for model development directly affects the reproducibility, generalizability, and interpretability of a proposed model.”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the characteristics of the data necessary to assess how these predictive models perform are not being adequately reported in the literature,11 leaving uncertainty and doubt about the application in the broader healthcare setting.”
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
What the sources say
- Not checked yetcites [11] Bozkurt, 2020, Reporting of demographic data, representativeness and transparency in machine learning models using electronic health records, JAMA Netw Open
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Detailed knowledge of the data used to train the model (ie, the training data) and the population those data represent—or often, does not represent—is essential to understanding the validity and generalizability of the “AI solution.””
§ MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care > INTRODUCTION
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
5 more claims
Create a free account to see all 17 claims and to verify the 14 references still open.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Standardized reporting checklists such as the Prediction Model Risk of Bias Assessment (PROBAST) tool have been developed to assess the risk of imbalanced data biases, which allows both developers and downstream users (e.g., physicians, hospitals) to better understand the suitability and limitations of AI-based systems in specific clinical settings [54–56].”
From Bias in medical AI: Implications for clinical decision-making (2024) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One significant gap is the absence of guidance on how to report post-deployment model evaluation, particularly in terms of their impact on equitable health outcomes.”
From Advancing Health Equity through Multi-Level Fairness in Health Informatics (2026) · cites this paper as [12]
Experimental — accuracy not yet measuredIn the citing paper
“This includes MINIMAR (MINimum Information for Medical AI Reporting), which defines a minimal set of reporting elements covering study population and setting, patient demographics, model architecture, and model evaluation (198)”
From Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions (2024) · cites this paper as [198]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“Therefore, the data used for training and the definition of the task—be it classification or prediction—become more important than the specifics of the machine learning algorithm.(7) Detailed knowledge of the data used to train the model (ie, the training data) and the population those data represent—or often, does no…”
BackgroundMethodSPIRIT 2013 Statement: defining standard protocol items for clinical trials.
Chan, A., Tetzlaff, J., Altman, D. G., Laupacis, A., Gøtzsche, P. C., A-Jerić, K. K., Hrobjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2015) · PubMed · Cited by 4,986
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Research works printed but not linked: 1
- Villarosa, 2018, Why America’s black mothers and babies are in a life-or-death crisis, The New York Times Magazine, 11
Cited by
Items 101–200 of 474
Promoting Equity In Clinical Decision Making: Dismantling Race-Based Medicine
Hernandez‐Boussard, T., Siddique, S. M., Bierman, A. S., Hightower, M., & Burstin, H. R. (2023) · Health Affairs · doi:10.1377/hlthaff.2023.00545 · Cited by 34
Self-citationHuang, R. J., Kwon, N. S., Tomizawa, Y., Choi, A. Y., Hernandez‐Boussard, T., & Hwang, J. H. (2022) · JCO Clinical Cancer Informatics · doi:10.1200/cci.22.00039 · Cited by 34
Self-citationHu, Y., Lui, A., Goldstein, M., Sudarshan, M., Tinsay, A., Tsui, C. L., Maidman, S. D., Medamana, J. L., Jethani, N., Puli, A., et al. (2024) · European Heart Journal Acute Cardiovascular Care · doi:10.1093/ehjacc/zuae037 · Cited by 33
A robust and parsimonious machine learning method to predict ICU admission of COVID-19 patients
Famiglini, L., Campagner, A., Carobene, A., & Cabitza, F. (2022) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-022-02543-x · Cited by 33
de Hond, A., van Buchem, M. M., Fanconi, C., Roy, M., Blayney, D. W., Kant, I. M. J., Steyerberg, E. W., & Hernandez‐Boussard, T. (2024) · JMIR Medical Informatics · doi:10.2196/51925 · Cited by 33
Self-citationEstévez, M., Benedum, C. M., Jiang, C., Cohen, A. B., Phadke, S., Sarkar, S., & Bozkurt, S. (2022) · Cancers · doi:10.3390/cancers14133063 · Cited by 33
Self-citationVasudevan, L., Kibria, M. G., Kucirka, L. M., Shieh, K., Wei, M., Masoumi, S., Balasubramanian, S., Victor, A., Conklin, J., Gürcan, M. N., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/68225 · Cited by 33
Biometric contrastive learning for data-efficient deep learning from electrocardiographic images
Sangha, V., Khunte, A., Holste, G., Mortazavi, B. J., Wang, Z., Oikonomou, E. K., & Khera, R. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae002 · Cited by 31
Prasad, N., Chien, I., Regan, T. W., Enrique, Á., Palacios, J. E., Keegan, D., Munir, U., Tanno, R., Richardson, H., Nori, A., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0272685 · Cited by 31
Evaluating Large Language Model (LLM) Performance on Established Breast Classification Systems
Haider, S. A., Pressman, S. M., Borna, S., Gomez-Cabello, C. A., Sehgal, A., Leibovich, B. C., & Forte, A. J. (2024) · Diagnostics · doi:10.3390/diagnostics14141491 · Cited by 31
Artificial Intelligence in Cardiovascular Disease Prevention: Is it Ready for Prime Time?
Parsa, S., Somani, S. S., Dudum, R., Jain, S. S., & Rodríguez, F. (2024) · Current Atherosclerosis Reports · doi:10.1007/s11883-024-01210-w · Cited by 31
A systematic review and meta-analysis of disease clusters in multimorbidity
Ferris, J. K., Fiedeldey, L., Kim, B., Clemens, F., Irvine, M. A., Hosseini, S. H., Smolina, K., & Wister, A. (2025) · Nature Communications · doi:10.1038/s41467-025-67372-6 · Cited by 31
Eken, A., Nassehi, F., & Eroğul, O. (2024) · Reviews in the Neurosciences · doi:10.1515/revneuro-2023-0117 · Cited by 31
Famiglini, L., Bini, G., Carobene, A., Campagner, A., & Cabitza, F. (2021) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms52027.2021.00065 · Cited by 31
Stephanian, B., Karki, S., Debnath, K., Saltychev, M., Rossi-Meyer, M. K., Kandathil, C. K., & Most, S. P. (2024) · Facial Plastic Surgery & Aesthetic Medicine · doi:10.1089/fpsam.2024.0204 · Cited by 30
External validation of Machine Learning models for COVID-19 detection based on Complete Blood Count
Campagner, A., Carobene, A., & Cabitza, F. (2021) · Health Information Science and Systems · doi:10.1007/s13755-021-00167-3 · Cited by 30
Machine Learning Approaches to Understand Cognitive Phenotypes in People With HIV
Mukerji, S. S., Petersen, K. J., Pohl, K. M., Dastgheyb, R. M., Fox, H. S., Bilder, R. M., Brouillette, M., Gross, A. L., Scott‐Sheldon, L. A. J., Paul, R. H., et al. (2023) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiac293 · Cited by 30
AI-enabled clinical decision support tools for mental healthcare: A product review
Kleine, A., Kokje, E., Hummelsberger, P., Lermer, E., Schaffernak, I., & Gaube, S. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103052 · Cited by 29
Machine Learning in Healthcare: Current Trends and the Future
Usmani, U. A., & Jaafar, J. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-2183-3_64 · Cited by 29
Zhong, J., Xing, Y., Lu, J. A., Zhang, G., Mao, S., Chen, H., Yin, Q., Cen, Q., Jiang, R., Hu, Y., et al. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02117-x · Cited by 28
Danilatou, V., Dimopoulos, D., Κωστούλας, Θ., & Douketis, J. D. (2024) · Thrombosis and Haemostasis · doi:10.1055/a-2299-4758 · Cited by 28
Miner, A. S., Fleming, S. L., Haque, A., Fries, J., Althoff, T., Wilfley, D. E., Agras, W. S., Milstein, A. S., Hancock, J. T., Asch, S. M., et al. (2022) · npj Mental Health Research · doi:10.1038/s44184-022-00020-9 · Cited by 28
Self-citationJeliazkova, N., Longhin, E., Yamani, N. E., Rundén‐Pran, E., Moschini, E., Serchi, T., Vrček, I. V., Burgum, M. J., Doak, S. H., Cimpan, M. R., et al. (2024) · Nature Protocols · doi:10.1038/s41596-024-00993-1 · Cited by 28
Checklist for Reproducibility of Deep Learning in Medical Imaging
Moassefi, M., Singh, Y., Conte, G. M., Khosravi, B., Rouzrokh, P., Vahdati, S., Safdar, N. M., Moy, L. P., Kitamura, F., Gentili, A., et al. (2024) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-024-01065-2 · Cited by 28
Artificial Intelligence in Healthcare: Lost In Translation?Preprint
Madai, V. I., & Higgins, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.13454 · Cited by 28
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., CALSTER, B. V., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2025) · Ewha Medical Journal · doi:10.12771/emj.2025.00668 · Cited by 28
Pham, N., Hill, V. B., Rauschecker, A. M., Lui, Y. W., Niogi, S. N., Filippi, C. G., Chang, P., Zaharchuk, G., & Wintermark, M. (2023) · American Journal of Neuroradiology · doi:10.3174/ajnr.a7850 · Cited by 27
Chalkidou, A., Shokraneh, F., Kijauskaite, G., Taylor‐Phillips, S., Halligan, S., Wilkinson, L., Glocker, B., Garrett, P., Denniston, A. K., Mackie, A., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00186-8 · Cited by 27
Atkins, D., Makridis, C. A., Alterovitz, G., Ramoni, R. B., & Clancy, C. M. (2022) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-122220-110053 · Cited by 27
Douglas, M. J., Callcut, R. A., Celi, L. A., & Merchant, N. C. (2023) · Surgical Clinics of North America · doi:10.1016/j.suc.2022.11.004 · Cited by 27
Chen, T. L., Buddhiraju, A., Seo, H. H., Subih, M. A., Tuchinda, P., & Kwon, Y. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.01.065 · Cited by 26
Fiske, A., Blacker, S., Geneviève, L. D., Willem, T., Fritzsche, M.-C., Buyx, A., Celi, L. A., & McLennan, S. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.01.003 · Cited by 26
Fettiplace, M. R., Bhatia, A., Chen, Y., Orebaugh, S. L., Gofeld, M., Gabriel, R. A., Sessler, D. I., Lonsdale, H., Bungart, B. L., Cheng, C., et al. (2025) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2025-106852 · Cited by 26
Fan, J., Chen, M., Luo, J. C., Yang, S., Shi, J., Yao, Q., Zhang, X., Du, S., Qu, H., Cheng, Y., et al. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01480-3 · Cited by 25
Machine learning models for predicting severe COVID-19 outcomes in hospitals
Wendland, P., Schmitt, V., Zimmermann, J., Häger, L., Göpel, S., Schenkel-Häger, C., & Kschischo, M. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101188 · Cited by 24
Is Generative Artificial Intelligence the Next Step Toward a Personalized Hemodialysis?
Hueso, M., Álvarez, R., Marí, D., Ribas, V. J., Lekadir, K., & Vellido, A. (2023) · Revista de investigaci�n Cl�nica · doi:10.24875/ric.23000162 · Cited by 22
Challenges of Machine Learning and AI (What Is Next?), Responsible and Ethical AI
Gkontra, P., Quaglio, G., Garmendia, A. T., & Lekadir, K. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_17 · Cited by 22
Torous, J. B., Ledley, K. T., Gorban, C., Strudwick, G., Schwarz, J., Choudhary, S., Emerson, M. R., Patriquin, M. A., Dempsey, A. G., Bantjes, J. R., et al. (2025) · JMIR Mental Health · doi:10.2196/84501 · Cited by 22
Emdad, F. B., Tian, S., Nandy, E., Hanna, K., & He, Z. (2023) · PubMed Central · Cited by 22
Martinson, A. K., Chin, A. T., Butte, M. J., & Rider, N. L. (2024) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2024.08.012 · Cited by 22
Applying Large Language Models to Assess Quality of Care: Monitoring ADHD Medication Side Effects
Bannett, Y., Güntürkün, F., Pillai, M., Herrmann, J. E., Luo, I., Huffman, L. C., & Feldman, H. M. (2024) · PEDIATRICS · doi:10.1542/peds.2024-067223 · Cited by 21
OnRAMP for Regulating Artificial Intelligence in Medical Products
Higgins, D. C. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202100042 · Cited by 21
King, H., Wright, J. M., Treanor, D. E., Williams, B. J., & Randell, R. (2023) · Journal of Medical Internet Research · doi:10.2196/38039 · Cited by 21
REPORT-SCS: minimum reporting standards for spinal cord stimulation studies in spinal cord injury
Malik, R. N., Samejima, S., Shackleton, C., Miller, T., Pedrocchi, A., Rabchevsky, A. G., Moritz, C. T., Darrow, D., Field-Fote, E. C., Guanziroli, E., et al. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad2290 · Cited by 20
Salybekov, A. A., Wolfien, M., Hahn, W., Hidaka, S., & Kobayashi, S. (2024) · Biomedicines · doi:10.3390/biomedicines12030606 · Cited by 20
Decisions are not all equal—Introducing a utility metric based on case-wise raters’ perceptions
Campagner, A., Sternini, F., & Cabitza, F. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106930 · Cited by 20
Evaluating dental AI research papers: Key considerations for editors and reviewers
Uribe, S. E., Hamdan, M. H., Valente, N. A., Yamaguchi, S., Umer, F., Tichý, A., Pauwels, R., & Schwendicke, F. (2025) · Journal of Dentistry · doi:10.1016/j.jdent.2025.105867 · Cited by 20
Fanconi, C., de Hond, A., Peterson, D. J., Capodici, A., & Hernandez‐Boussard, T. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104632 · Cited by 20
Self-citationSystematic Review: AI Applications in Liver Imaging with a Focus on Segmentation and Detection
Pomohaci, M. D., Grasu, M. C., Băicoianu-Nițescu, A.-Ş., Enache, R. M., & Lupescu, I. G. (2025) · Life · doi:10.3390/life15020258 · Cited by 19
Albu, E., Gao, S., Stijnen, P., Rademakers, F. E., van Bussel, B. C. T., Collyer, T. A., Hernandez‐Boussard, T., Wynants, L., & CALSTER, B. V. (2025) · Journal of Medical Internet Research · doi:10.2196/73987 · Cited by 19
Self-citationArtificial intelligence reporting guidelines: what the pediatric radiologist needs to know
Meshaka, R., dos Santos, D. P., Arthurs, O. J., Sebire, N. J., & Shelmerdine, S. C. (2021) · Pediatric Radiology · doi:10.1007/s00247-021-05129-1 · Cited by 19
Carmichael, H. L., Coquet, J., Sun, R., Sang, S., Groat, D., Asch, S. M., Bledsoe, J. R., Peltan, I. D., Jacobs, J. R., & Hernandez‐Boussard, T. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103802 · Cited by 19
Self-citationTowards a framework for interoperability and reproducibility of predictive models
Rahrooh, A., Garlid, A. O., Bartlett, K., Coons, W. R., Petousis, P., Hsu, W. W. Y., & Bui, A. A. T. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104551 · Cited by 18
Interpretation of the DOME Recommendations for Machine Learning in Proteomics and Metabolomics
Palmblad, M., Böcker, S., Degroeve, S., Kohlbacher, O., Käll, L., Noble, W. S., & Wilhelm, M. (2022) · Journal of Proteome Research · doi:10.1021/acs.jproteome.1c00900 · Cited by 18
Jalal, M. E., Emam, O. S., Castillo-Olea, C., García-Zapirain, B., & Elmaghraby, A. S. (2025) · Scientific Reports · doi:10.1038/s41598-025-85277-8 · Cited by 18
Lehoux, P., de Oliveira, R. R., Rivard, L., da Silva, H. P., Alami, H., Mörch, C., & Malas, K. (2023) · Journal of Medical Internet Research · doi:10.2196/48496 · Cited by 17
Artificial intelligence methods available for cancer research
Murmu, A., & Győrffy, B. (2024) · Frontiers of Medicine · doi:10.1007/s11684-024-1085-3 · Cited by 17
Editorial: Explainable artificial intelligence for critical healthcare applications
He, Z., Zhang, R., Diallo, G., Huang, Z., & Glicksberg, B. S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1282800 · Cited by 17
Lareyre, F., Wanhainen, A., & Raffort, J. (2023) · Journal of Endovascular Therapy · doi:10.1177/15266028231187599 · Cited by 17
Bias and Oversight in Clinical AI: A Review of Decision Support Tools and Equity Frameworks
Adegunle, F., Chhatwal, K., Arab, S., Alabdaljabar, M. S., Raslan, M. A., Sayed, O., & Goldsweig, A. M. (2026) · Journal of General Internal Medicine · doi:10.1007/s11606-026-10229-5 · Cited by 16
An Intelligent Digital Learning Platform to Enhance Digital Health Literacy
Eumbunnapong, K., Wannapiroon, P., & Pornpongtechavanich, P. (2022) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v17i04.27907 · Cited by 16
The Role of Artificial Intelligence in the Medical Field
Kapa, S. (2023) · Journal of Computer and Communications · doi:10.4236/jcc.2023.1111001 · Cited by 16
Klén, R., Purohit, D., Gómez‐Huelgas, R., Rojo, J. M. C., Santos, J. M. A., Núñez-Cortés, J. M., Lumbreras, C., Ramos, J. M., Barrio, N. G., Pedrera‐Jiménez, M., et al. (2021) · eLife · doi:10.2139/ssrn.3920914 · Cited by 16
Machine learning with asymmetric abstention for biomedical decision-making
Gandouz, M., Holzmann, H., & Heider, D. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01655-y · Cited by 16
Large Language Models Using Clinical Text in Pediatrics: A Scoping Review
Huang, T., Tse, G., Pageler, N. M., & Bannett, Y. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.2443 · Cited by 15
Zhang, X., Ferry, J., Hewson, D. W., Collins, G. S., Wiles, M. D., Zhao, Y., Martindale, A. P. L., Tomaschek, M., Bowness, J. S., & the GRAITE‐USRA Working Group (2025) · Anaesthesia · doi:10.1111/anae.16733 · Cited by 15
Goffart, S., Delingette, H., Chierici, A. P., Guzzi, L., Nasr, B., Lareyre, F., & Raffort, J. (2025) · Angiology · doi:10.1177/00033197241310572 · Cited by 15
Reporting Guidelines for Meta‐Analysis in Economics—Updated for AI
Cook, N., Bartos̆, F., Bom, P. R. D., Gechert, S., Kantová, K., Geyer‐Klingeberg, J., Havránek, T., Iršová, Z., Lušková, M., Opatrný, M., et al. (2026) · Journal of Economic Surveys · doi:10.1111/joes.70116 · Cited by 15
Computer Vision and Videomics in Otolaryngology–Head and Neck Surgery
Paderno, A., Bedi, N., Rau, A., & Holsinger, F. C. (2024) · Otolaryngologic Clinics of North America · doi:10.1016/j.otc.2024.05.005 · Cited by 15
(2024) · doi:10.1093/jamia/ocae001 · Cited by 14
Self-citationCritical Appraisal Tools for Evaluating Artificial Intelligence in Clinical Studies: Scoping Review
Cabello, J. B., García, V. R., Torralba, M., Fernandez, M. M., Ubeda, M., Ansuategi, E., Ramos-Ruperto, L., Emparanza, J. I., Urreta, I., Iglesias, M. T., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/77110 · Cited by 14
Hoebers, F. J. P., Wee, L., Likitlersuang, J., Mak, R. H., Bitterman, D. S., Huang, Y., Dekker, A. L. A. J., Aerts, H. J. W. L., & Kann, B. H. (2023) · BJR|Open · doi:10.1093/bjro/tzae039 · Cited by 14
Effect of Having, but Not Consulting, a Computerized Diagnostic Aid
Pezzo, M. V., Nash, B. E. D., Vieux, P., & Foster-Grammer, H. W. (2021) · Medical Decision Making · doi:10.1177/0272989x211011160 · Cited by 14
On the Horizon: Specific Applications of Automation and Artificial Intelligence in Anesthesiology
Davoud, S. C., & Kovacheva, V. (2023) · Current anesthesiology reports · doi:10.1007/s40140-023-00558-0 · Cited by 14
Droppelmann, G., Rodríguez, C., Jorquera, C., & Feijoo, F. (2024) · EFORT Open Reviews · doi:10.1530/eor-23-0174 · Cited by 14
Zhang, M., Zeng, X., Huang, C., Liu, J., Liu, X., Xie, X., & Wang, R. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104545 · Cited by 14
The Clinical Researcher Journey in the Artificial Intelligence Era: The PAC-MAN’s Challenge
Bignami, E. G., Vittori, A., Lanza, R., Compagnone, C., Cascella, M., & Bellini, V. (2023) · Healthcare · doi:10.3390/healthcare11070975 · Cited by 13
External Validation of a Machine Learning Based Delirium Prediction Software in Clinical Routine
Jauk, S., Veeranki, S. P. K., Kramer, D., Högler, S., Mühlecker, D., Eberhartl, E., Schueler, A., Chvosta, C., Straßer, W., Strasser, R., et al. (2022) · Studies in health technology and informatics · doi:10.3233/shti220353 · Cited by 13
Jean-Quartier, C., Stryeck, S., Thien, A., Vrella, B., Kleinschuster, J., Spreitzer, E., Wali, M., Mueller, H., Holzinger, A., & Jeanquartier, F. (2024) · Digital Health · doi:10.1177/20552076241271769 · Cited by 13
Mottershead, K., & Miller, T. H. (2023) · Environmental Science Advances · doi:10.1039/d3va00005b · Cited by 13
Uncertainty-aware abstention in medical diagnosis based on medical texts
Vazhentsev, A., Sviridov, I., Barseghyan, A., Kuzmin, G., Panchenko, A., Nesterov, A., Shelmanov, A., & Panov, M. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00097-z · Cited by 13
IOT based Machine Learning Algorithms for Data Science on Quality Control Process
Kittusamy, L., Lakshmi, G. P., Khatkale, P. B., William, P., Ghige, O., & Tingare, B. A. (2024) · International Conference on Intelligent & Innovative Practices in Engineering & Management (IIPEM) · doi:10.1109/iipem62726.2024.10925700 · Cited by 13
Consorti, G., Catarzi, L., Frosolini, A., Vaira, L. A., Committeri, U., & Cirignaco, G. (2026) · International Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.ijom.2026.02.020 · Cited by 12
Taber, P. A., Armin, J. S., Orozco, G., Fiol, G. D., Erdrich, J., Kawamoto, K., & Israni, S. T. (2023) · Current Oncology Reports · doi:10.1007/s11912-023-01376-7 · Cited by 12
Verma, N., Garg, P., Valsan, A., Roy, A., Mishra, S., Kaur, P., Rathi, S., De, A., Premkumar, M., Taneja, S., et al. (2024) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.18274 · Cited by 12
Advancing nanomedicine with machine learning: predicting protein corona and nano-bio interactions
Canchola, A., Li, K., Chen, K., Ukbamichael, A., Wang, X., & Chou, W. (2026) · Nanomedicine · doi:10.1080/17435889.2026.2661385 · Cited by 12
Luo, X., Wang, B., Shi, Q., Wang, Z., Lai, H., Liu, H., Qin, Y., Chen, F., Song, X., Ge, L., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111903 · Cited by 12
Improving wearable-based seizure prediction by feature fusion using an explainable growing network
Hasija, T., Kuschel, M., Jackson, M. C., Dailey, S., Menne, H., Reinsberger, C., Vieluf, S., & Loddenkemper, T. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103228 · Cited by 12
The need for a prediction model assessment framework
Islam, S. M. S., & Khosravi, A. (2021) · The Lancet Global Health · doi:10.1016/s2214-109x(21)00022-x · Cited by 12
Bertram, C., Schutten, M. M., Ressel, L., Breininger, K., Webster, J. D., & Aubreville, M. (2025) · Veterinary Pathology · doi:10.1177/03009858251344320 · Cited by 12
Johnson, D. G., Ho, V. T., Hah, J. M., Humphreys, K. N., Carroll, I. R., Curtin, C. M., Asch, S. M., & Hernandez‐Boussard, T. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000075 · Cited by 12
Self-citationPijnacker, T., Bartels, R., van Leeuwen, M., & Teske, E. (2022) · Parasites & Vectors · doi:10.1186/s13071-022-05163-4 · Cited by 12
Standardizing Machine Learning Manuscript Reporting in Otolaryngology‐Head & Neck Surgery
Crowson, M. G., & Rameau, A. (2022) · The Laryngoscope · doi:10.1002/lary.30264 · Cited by 11
Oloruntoba, A. I., Ingvar, Å., Sashindranath, M., Anthony, O., Abbott, L. M., Guitera, P., Caccetta, T. P., Janda, M., Soyer, H. P., & Mar, V. (2024) · Australasian Journal of Dermatology · doi:10.1111/ajd.14269 · Cited by 11
Impact of artificial intelligence on future clinical pharmacy research and scholarship
Chan, A., Baker, W. L., Abazia, D. T., Bauman, J. L., DeVane, C. L., Goodlet, K. J., Hall, N., Hicks, J. K., Jones, E., Lu, C., et al. (2025) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.70003 · Cited by 11
Kolossváry, M., Smith, E. E., Reeves, M. J., Layton, A. T., Mills, N. L., Motwani, M., Goto, S., & Atkins, N. (2025) · Circulation · doi:10.1161/circulationaha.125.074325 · Cited by 11
Mooney, S. D. (2023) · The Journal of Applied Laboratory Medicine · doi:10.1093/jalm/jfac113 · Cited by 11
Coquet, J., Bievre, N., Billaut, V., Seneviratne, M. G., Magnani, C. J., Bozkurt, S., Brooks, J. D., & Hernandez‐Boussard, T. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.31730 · Cited by 11
Self-citationRough, K., Rashidi, E., Tai, C. G.-L., Lucia, R. M., Mack, C. D., & Largent, J. A. (2024) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.70041 · Cited by 11
CLIN-LLM: A safety-constrained hybrid framework for clinical diagnosis and treatment generation
Hasan, M. M., Hossain, M. A., Sayem, F. H., Paul, B. K., Rahman, Z., Uddin, M. S., & Mostafiz, R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0348611 · Cited by 11
Metadata
- Authors
- Hernandez-Boussard, T., Bozkurt, S., Ioannidis, J. P. A., & Shah, N. H.
- Affiliations
- Department of Medicine, Stanford University, Stanford, California, USA
- Stanford Medicine (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-06-28
- Volume
- 27
- Issue
- 12
- Pages
- 2011-2015
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7727333
- OpenAlex
- W3037405958
- Cited by
- 410
- References
- 28
- Citations by year
- 2026: 94 · 2025: 77 · 2024: 80 · 2023: 65 · 2022: 51 · 2021: 38 · 2020: 5
- FWCI
- 11.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (R01CA183962)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- reporting guidelines, artificial intelligence in healthcare, clinical decision support, model transparency, algorithmic bias, generalizability, clinical prediction model
- MeSH terms
- Artificial Intelligence, Delivery of Health Care, Humans, Electronic Health Records, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.