Bias in artificial intelligence algorithms and recommendations for mitigation
Open accessThe DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index; 54 of the 84 sources its claims cite were checked for support.
Abstract
The adoption of artificial intelligence (AI) algorithms is rapidly increasing in healthcare. Such algorithms may be shaped by various factors such as social determinants of health that can influence health outcomes. While AI algorithms have been proposed as a tool to expand the reach of quality healthcare to underserved communities and improve health equity, recent literature has raised concerns about the propagation of biases and healthcare disparities through implementation of these algorithms. Thus, it is critical to understand the sources of bias inherent in AI-based algorithms. This review aims to highlight the potential sources of bias within each step of developing AI algorithms in healthcare, starting from framing the problem, data collection, preprocessing, development, and validation, as well as their full implementation. For each of these steps, we also discuss strategies to mitigate the bias and disparities. A checklist was developed with recommendations for reducing bias during the development and implementation stages. It is important for developers and users of AI-based algorithms to keep these important considerations in mind to advance health equity for all populations.
Overview
CoChat Summary
TL;DR
This review maps sources of bias across the AI algorithm lifecycle in healthcare—problem framing, data collection, preprocessing, development/validation, and implementation—and proposes mitigation strategies and a checklist. It argues that bias can arise at every stage and that diverse teams, representative data, bias identification, preprocessing safeguards, validation, and monitoring are needed to advance health equity.
Key findings
- Bias can enter at each stage: framing (e.g., cystic fibrosis with ~40,000 US patients receives over 3 times more NIH funding per affected individual than sickle cell disease with ~100,000 patients; sex funding favored males in about three-quarters of gender-dominant diseases), data collection (an AKI model used data from over 700,000 patients but was predominantly older non-Black men, average age 62, over 90% male), preprocessing (SOFA score shows suboptimal performance in Black, female, and disabled patients), development/validation (only half of 152 machine-learning prediction studies examined potential overfitting), and implementation (Obermeyer algorithm would reduce Black patients needing additional care by more than half; remediation increased the percentage receiving additional care from 17.7% to 46.5%).
- Mitigation recommendations include inclusive diverse teams, combining datasets, open code sharing, identifying bias sources, preprocessing techniques such as re-weighing, suppression, massaging, and multiple imputation, de-biasing/oversampling, external validation, and monitoring for data and concept drift.
- An AHRQ systematic review identified 6 major strategies to mitigate racial and ethnic bias; the most common was removing race, used in 15 of 33 studies, but no preferred specific strategy could be recommended.
- A proposed checklist covers framing the problem, data sources, data preprocessing, model development, model validation, and model implementation.
Methods
- Narrative review, not a systematic or comprehensive review; it aims to highlight main sources of bias and mitigation strategies within each step of developing AI algorithms in healthcare.
- Draws on published literature and examples; no primary data collection, sample, or empirical analysis is reported.
- Synthesizes mitigation strategies and presents Table 1, a checklist to aid in mitigating bias during development and implementation.
Limitations
- Stated in the paper: the review does not aim to provide a comprehensive description of published sources of bias and mitigation strategies; current understanding of bias in AI reflects “no more than the tip of the iceberg”; most identified bias sources reflect developed countries, mostly North America and Europe, limiting understanding of global healthcare bias; de-biasing techniques need more research; and AHRQ could not recommend a preferred mitigation strategy.
- Evident from the text: no systematic search strategy or formal quality appraisal is described, and the proposed checklist is presented without validation data.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
44 Valid · 1 Not valid · 23 Not checked · 19 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“the authors demonstrated that utilizing the algorithm would reduce the number of Black patients needing additional care by more than half.”
§ Bias in artificial intelligence algorithms and recommendations for mitigation > Introduction
What the sources say
- Disputedcites [17] Z Obermeyer, 2019, Dissecting racial bias in an algorithm used to manage the health of populations, Science sourceExperimental — accuracy not yet measured
The summary on p. 9 says the algorithm’s racial bias reduces the number of Black patients *identified* for extra care by more than half; it does not reduce the number who need care. The paper’s opening summary (p. 2) says remedying that disparity would increase the percentage of Black patients receiving additional help from 17.7% to 46.5%. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Literature has demonstrated how AI can revolutionize healthcare through its ability to perform various clinical tasks with a comparable or arguably even faster and with greater precision performance to that of humans [10–12].”
§ Bias in artificial intelligence algorithms and recommendations for mitigation > Introduction
What the sources say
- Partly supportedcites [10] F Homayounieh, 2021, An artificial intelligence-based chest x-ray model on human nodule detection accuracy from a multicenter study, JAMA Netw Open sourceExperimental — accuracy not yet measured
The Results (Sensitivity, Specificity, and Accuracy; page not provided) report greater detection accuracy when radiologists used AI assistance, and the Discussion reports higher standalone AI sensitivity than the readers for pulmonary-nodule detection. The paper does not establish faster performance or performance across various clinical tasks; it studies nodule detection on chest radiographs. (LLM, conf=0.88)
- Partly supportedcites [11] RM Wehbe, 2021, DeepCOVID-XR: An artificial intelligence algorithm to detect COVID-19 on chest radiographs trained and tested on a large U.S. clinical data set, Radiology sourceExperimental — accuracy not yet measured
The Results (Comparison with Expert Thoracic Radiologists) report similar performance and faster analysis for DeepCOVID-XR on one task: detecting COVID-19 on chest radiographs. They do not establish greater precision than the radiologists or performance across various clinical tasks. (LLM, conf=0.88)
- Supportedcites [12] J Bajwa, 2021, Artificial intelligence in healthcare: transforming the practice of medicine, Future Healthc J source
The “Diagnostic imaging” section reports AI meeting or exceeding human experts’ performance in image-based diagnoses across several specialties. “Improving the precision and reducing waiting timings for radiotherapy planning” reports that AI can cut image-preparation time by up to 90%. These examples support the claim about various clinical tasks, though not every clinical task. (LLM, conf=0.87)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In a study that evaluated the methodological quality of 152 studies on prediction models developed using machine learning techniques, only half of the included studies examined potential overfitting of the models using appropriate strategies [43].”
§ Bias in artificial intelligence algorithms and recommendations for mitigation > Introduction > 4. Development and validation of AI-based algorithms
What the sources say
- Supportedcites [43] CLA Navarro, 2021, Risk of bias in studies on prediction models developed using supervised machine learning techniques: systematic review, BMJ source
The Discussion states that only half of the included studies examined potential overfitting using split data, bootstrapping, or cross validation. The Results identify 152 included studies and report that 76 of 152 developed models accounted for overfitting and optimism. No page numbers are supplied in our copy. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The lack of such data limits the ability of researchers to understand the impact of disability on outcomes”
§ Bias in artificial intelligence algorithms and recommendations for mitigation > Introduction > 2. Data collection
What the sources say
- Not checked — no full text of the sourcecites [24] GL Krahn, 2015, Persons with disabilities as an unrecognized health disparity population, Am J Public Health source
- Partly supportedcites [32] C El Morr, 2021, A Virtual Community for Disability Advocacy: Development of a Searchable Artificial Intelligence-Supported Platform, JMIR Form Res sourceExperimental — accuracy not yet measured
The Introduction says a lack of disability data hampers critical health research and limits knowledge about the experiences of people with disabilities. It does not establish that disability data are absent from most datasets or specifically discuss measuring disability’s impact on outcomes. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Though the dataset used to develop the algorithm was large and diverse, containing data from over 700,000 patients from multiple centers”
§ Bias in artificial intelligence algorithms and recommendations for mitigation > Introduction > 2. Data collection
What the sources say
- Supportedcites [27] N Tomašev, 2019, A clinically applicable approach to continuous prediction of future acute kidney injury, Nature source
The paper states that the model was trained on a multisite dataset of 703,782 adult patients from the US Department of Veterans Affairs. The Methods (Data Description) also describes data aggregated across VA facilities, supporting the reference to multiple centers. (LLM, conf=0.94)
plainn = 700,000- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
45 more claims · 23 with their cited sources checked
Create a free account to see all 87 claims and to verify the 5 references still open.
- It may state two separate claims as one. 20
- Probably not a substantial claim. 23
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current mitigation strategies include debiasing algorithms, prompt engineering, and diverse training data [9].”
From Evaluating and addressing demographic disparities in medical large language models: a systematic review (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such biases can result in inaccurate findings that might influence clinical guidelines or medical interventions, and recent studies have underscored these concerns, suggesting that these biases can lead to significant health disparities.8”
From Balancing innovation and integrity: the role of AI in research and scientific writing (2023) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Obermeyer et al. (2019) [36] and Nazerid et al., (2023) [8] discuss how biases in training data can lead to biased AI systems, which can perpetuate healthcare disparities.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Nazerid et al., (2023) [8]
In the citing paper
“A type of algorithmic bias strongly impacting model generalizability is aggregation bias, which occurs during the data preprocessing phase10.”
From Bias recognition and mitigation strategies in artificial intelligence healthcare applications (2025) · cites this paper as [10]
In the citing paper
“For example, patients who are sicker, have higher comorbidity, or are unable to participate in longitudinal research protocols for geographic or economic reasons may not be represented10.”
From Bias recognition and mitigation strategies in artificial intelligence healthcare applications (2025) · cites this paper as [10]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“A study by Obermeyer and colleagues further emphasized this important point by demonstrating racial bias in an algorithm widely utilized in the United States healthcare system [17].”
BackgroundPROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984
Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock 2021.
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005337 · Cited by 2,935 · cited 1×
“The Surviving Sepsis Campaign guidelines recommend the use of machine learning algorithms that utilize scoring systems for the early screening of patients [36].”
MethodArtificial intelligence in healthcare: transforming the practice of medicine
Bajwa, J., Munir, U., Nori, A., & Williams, B. (2021) · Future Healthcare Journal · doi:10.7861/fhj.2021-0095 · Cited by 1,856
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443 · cited 1×
“A number of comprehensive frameworks and checklists have been developed, such as the Translational Evaluation of Healthcare AI (TEHAI) [46], the DECIDE-AI [47], the Consolidated Standards of Reporting Trials-Artificial Intelligence (CONSORT-AI) [48], the prediction model risk of bias assessment tool (PROBAST) [49], an…”
MethodLiu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 1×
“This can occur when patients receive different care or are incorrectly diagnosed based on sociodemographic factors reflecting practitioner bias [28].”
BackgroundData preprocessing techniques for classification without discrimination
Kamiran, F., & Calders, T. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0463-8 · Cited by 1,305 · cited 1×
“Several techniques have been suggested to mitigate preprocessing bias, including re-weighing (assigning different weights to the training data based on the categories of sensitive attributes and outcomes), suppression (removing sensitive attributes) or massaging the dataset (changing labels to remove bias), and multip…”
MethodDo no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266
A clinically applicable approach to continuous prediction of future acute kidney injury
Tomašev, N., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Mottram, A., Meyer, C., Ravuri, S., Protsyuk, I., et al. (2019) · Nature · doi:10.1038/s41586-019-1390-1 · Cited by 1,086
Persons with disabilities as an unrecognized health disparity population
Krahn, G. L., Walker, D. K., & Correa-De-Araujo, R. (2015) · American Journal of Public Health · doi:10.2105/ajph.2014.302182 · Cited by 1,080 · cited 2×
“Therefore, interest in conducting research and developing clinical tools for patients with disabilities remains suboptimal [24].”
BackgroundPrediction models for cardiovascular disease risk in the general population: systematic review
Damen, J. A. A. G., Hooft, L., Schuit, E., Debray, T. P. A., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C. M., Chiocchia, V., Roberts, C., et al. (2016) · BMJ · doi:10.1136/bmj.i2416 · Cited by 935
Addressing bias in big data and AI for health care: A call for open science
Norori, N., Hu, Q., Aellen, F. M., Faraci, F. D., & Tzovara, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100347 · Cited by 903
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884
Wahl, B., Cossy-Gantner, A., Germann, S., & Schwalbe, N. R. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2018-000798 · Cited by 796
Oliver, D., Britton, M., Seed, P., Martin, F. C., & Hopper, A. H. (1997) · BMJ · doi:10.1136/bmj.315.7115.1049 · Cited by 733
Ethical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
Rajula, H. S. R., Verlato, G., Manchia, M., Antonucci, N., & Fanos, V. (2020) · Medicina · doi:10.3390/medicina56090455 · Cited by 606 · cited 1×
“AI-based algorithms tend to incorporate a variety of conventional statistical methods and intensive computational machine learning methods to help understand patterns and associations within high-dimensional, nonlinear, and multimodal data [8].”
BackgroundSources of bias in artificial intelligence that perpetuate healthcare disparities—A global review
Celi, L. A., Cellini, J., Charpignon, M.-L., Dee, E. C., Dernoncourt, F., Eber, R., Mitchell, W. G., Moukheiber, L., Schirmer, J., Situ, J., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000022 · Cited by 576
Self-citationSex and gender differences and biases in artificial intelligence for biomedicine and healthcare
Cirillo, D., Catuara-Solarz, S., Morey, C., Guney, E., Subirats, L., Mellino, S., Gigante, A., Valencia, A., Rementeria, M. J., Chadha, A. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0288-5 · Cited by 553 · cited 1×
“Though gender, race, and ethnicity are frequently identified as potential sources of bias, other factors may contribute to bias such as age, socioeconomic differences, and geography [58].”
BackgroundDisparities in dermatology AI performance on a diverse, curated clinical image set
Daneshjou, R., Vodrahalli, K., Novoa, R. A., Jenkins, M., Liang, W., Rotemberg, V., Ko, J., Swetter, S. M., Bailey, E. E., Gevaert, O., et al. (2022) · Science Advances · doi:10.1126/sciadv.abq6147 · Cited by 544
Andaur Navarro, C. L., Damen, J. A. A., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., Moons, K. G. M., et al. (2021) · BMJ · doi:10.1136/bmj.n2281 · Cited by 415
The All of Us Research Program: Data quality, utility, and diversity
Ramirez, A. H., Sulieman, L., Schlueter, D. J., Halvorson, A., Qian, J., Ratsimbazafy, F., Loperena, R., Mayo, K., Basford, M., Deflaux, N., et al. (2022) · Patterns · doi:10.1016/j.patter.2022.100570 · Cited by 352
Paulus, J. K., & Kent, D. M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0304-9 · Cited by 274 · cited 2×
“Another bias encountered in data collection is label bias, which is seen when the outcome variable is differentially ascertained or has a different meaning across groups [31].”
BackgroundMitigating bias in machine learning for medicine
Vokinger, K. N., Feuerriegel, S., & Kesselheim, A. S. (2021) · Communications Medicine · doi:10.1038/s43856-021-00028-w · Cited by 269
Gender disparity in the funding of diseases by the U.S National Institutes of Health
Mirin, A. A. (2021) · Journal of Women's Health · doi:10.1089/jwh.2020.8682 · Cited by 269 · cited 1×
“A similar observation was reported when evaluating sex disparity and the allocation of research funding for diseases that are female dominant compared to those that are male dominant [23].”
BackgroundNijman, S., Leeuwenberg, A., Beekers, I., Verkouter, I., Jacobs, J., Bots, M., Asselbergs, F., Moons, K., & Debray, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.023 · Cited by 269 · cited 3×
“The most common approaches used to address this are complete case analysis or mean imputation [35].”
BackgroundMethodBeware explanations from AI in health care
Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2021) · Science · doi:10.1126/science.abg1834 · Cited by 252
Evaluation framework to guide implementation of AI systems into healthcare settings
Reddy, S., Rogers, W., Makinen, V.-P., Coiera, E., Brown, P., Wenzel, M., Weicken, E., Ansari, S., Mathur, P., Casey, A., et al. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100444 · Cited by 230 · cited 1×
“A number of comprehensive frameworks and checklists have been developed, such as the Translational Evaluation of Healthcare AI (TEHAI) [46], the DECIDE-AI [47], the Consolidated Standards of Reporting Trials-Artificial Intelligence (CONSORT-AI) [48], the prediction model risk of bias assessment tool (PROBAST) [49], an…”
MethodSelf-citationDiagnostic and prognostic prediction models
Hendriksen, J. M. T., Geersing, G. J., Moons, K. G. M., & de Groot, J. A. H. (2013) · Journal of Thrombosis and Haemostasis · doi:10.1111/jth.12262 · Cited by 229
Understanding artificial intelligence based radiology studies: What is overfitting?
Mutasa, S., Sun, S., & Ha, R. (2020) · Clinical Imaging · doi:10.1016/j.clinimag.2020.04.025 · Cited by 216
Risk Models to Predict Chronic Kidney Disease and Its Progression: A Systematic Review
Echouffo-Tcheugui, J. B., & Kengne, A. P. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001344 · Cited by 200
Wehbe, R. M., Sheng, J., Dutta, S., Chai, S., Dravid, A., Barutcu, S., Wu, Y., Cantrell, D. R., Xiao, N., Allen, B. D., et al. (2021) · Radiology · doi:10.1148/radiol.2020203511 · Cited by 190
The DECIDE-AI Steering Group (2021) · Nature Medicine · doi:10.1038/s41591-021-01229-5 · Cited by 184
Disparities in A1C Levels Between Hispanic and Non-Hispanic White Adults With Diabetes
Kirk, J. K., Passmore, L. V., Bell, R. A., Narayan, K. M. V., D'Agostino, R. B., Arcury, T. A., & Quandt, S. A. (2008) · Diabetes Care · doi:10.2337/dc07-0382 · Cited by 167 · cited 1×
“Hispanics, for example, tend to have higher rates of diabetes and diabetes-related complications compared to Whites [34].”
Backgroundvan de Sande, D., Van Genderen, M. E., Smit, J. M., Huiskens, J., Visser, J. J., Veen, R. E. R., van Unen, E., BA, O. H., Gommers, D., & Bommel, J. V. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100495 · Cited by 135
Homayounieh, F., Digumarthy, S., Ebrahimian, S., Rueckel, J., Hoppe, B. F., Sabel, B. O., Conjeti, S., Ridder, K., Sistermanns, M., Wang, L., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.41096 · Cited by 113
Dankwa-Mullan, I., Scheufele, E. L., Matheny, M. E., Quintana, Y., Chapman, W. W., Jackson, G., & South, B. R. (2021) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2021.0065 · Cited by 108
Equitably Allocating Resources during Crises: Racial Differences in Mortality Prediction Models
Ashana, D. C., Anesi, G. L., Liu, V. X., Escobar, G. J., Chesley, C., Eneanya, N. D., Weissman, G. E., Miller, W. D., Harhay, M. O., & Halpern, S. D. (2021) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.202012-4383oc · Cited by 98
O’Caoimh, R., Cornally, N., Weathers, E., O'Sullivan, R., Fitzgerald, C., Orfila, F., Clarnette, R., Paúl, C., & Molloy, D. W. (2015) · Maturitas · doi:10.1016/j.maturitas.2015.03.009 · Cited by 89
Li, S., Fonarow, G. C., Mukamal, K. J., Liang, L., Schulte, P. J., Smith, E. E., DeVore, A., Hernandez, A. F., Peterson, E. D., & Bhatt, D. L. (2016) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.115.002621 · Cited by 85
Tackling bias in AI health datasets through the STANDING TOGETHER initiative
Ganapathi, S., Palmer, J., Alderman, J. E., Calvert, M., Espinoza, C., Gath, J., Ghassemi, M., Heller, K., Mckay, F., Karthikesalingam, A., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01987-w · Cited by 82
Lucila Ohno-machado, A., Resnic, F. S., & Matheny, M. E. (2006) · Annual Review of Biomedical Engineering · doi:10.1146/annurev.bioeng.8.061505.095842 · Cited by 71
Bias in algorithms of AI systems developed for COVID-19: A scoping review
Delgado, J., de Manuel, A., Parra, I., Moyano, C., Rueda, J., Guersenzvaig, A., Ausin, T., Cruz, M., Casacuberta, D., & Puyol, A. (2022) · Journal of Bioethical Inquiry · doi:10.1007/s11673-022-10200-z · Cited by 70
Miller, W. D., Han, X., Peek, M. E., Charan Ashana, D., & Parker, W. F. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.13891 · Cited by 59
Gender and the 10/90 gap in health research.
Doyal, L. (2004) · Europe PMC (PubMed Central) · doi:10.1590/s0042-96862004000300003 · Cited by 49
Lessons and tips for designing a machine learning study using EHR data
Arbet, J., Brokamp, C., Meinzen-Derr, J., Trinkley, K. E., & Spratt, H. M. (2021) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.513 · Cited by 46 · cited 2×
“AI-based prediction algorithms are often criticized as being “black-box” models since the model may perform its own interpretation of various features and data to make a given prediction [41].”
BackgroundMethodCritical Bias in Critical Care Devices
Charpignon, M.-L., Byers, J., Cabral, S., Celi, L. A., Fernandes, C., Gallifant, J., Lough, M. E., Mlombwa, D., Moukheiber, L., Ong, B. A., et al. (2023) · Critical Care Clinics · doi:10.1016/j.ccc.2023.02.005 · Cited by 35 · cited 3×
“Certain measurements derived from commonly used medical devices may also be sources of bias among patient subpopulations, such as pulse oximeters, thermometers, and sphygmomanometers [30].”
BackgroundMethodInfluentialSelf-citationImpact of Healthcare Algorithms on Racial and Ethnic Disparities in Health and Healthcare
Tipton, K. N., Leas, B. F., Flores, E. J., Jepson, C., Aysola, J., Cohen, J. B., Harhay, M. O., Schmidt, H., Weissman, G. E., Treadwell, J. R., et al. (2023) · doi:10.23970/ahrqepccer268 · Cited by 35
Global disparity bias in ophthalmology artificial intelligence applications
Nakayama, L. F., Kras, A., Ribeiro, L. Z., Malerbi, F. K., Mendonça, L. S., Celi, L. A., Regatieri, C. V. S., & Waheed, N. K. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100470 · Cited by 23
Zhu, J., Brenna, C. T. A., McCoy, L. G., Atkins, C. G. K., & Das, S. (2022) · BMC Medical Ethics · doi:10.1186/s12910-022-00749-0 · Cited by 21
El Morr, C., Maret, P., Muhlenbach, F., Dharmalingam, D., Tadesse, R., Creighton, A., Kundi, B., Buettgen, A., Mgwigwi, T., Dinca-Panaitescu, S., et al. (2021) · JMIR Formative Research · doi:10.2196/33335 · Cited by 12
Shen, R., Zhang, W., Ming, S., Li, L., Peng, Y., & Gao, X. (2021) · Urolithiasis · doi:10.1007/s00240-020-01190-x · Cited by 8
Lee, H. W., Kang, W., Ahn, S. H., et al. (2014) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.12522 · Cited by 6
More Generalizable Models For Sepsis Detection Under Covariate Shift
Gao, J., Mar, P. L., & Chen, G. (2021) · arXiv · doi:10.48550/arxiv.2105.09385 · Cited by 3
Li, S., Fonarow, G. C., Mukamal, K. J., Liang, L., Schulte, P. J., Smith, E. E., DeVore, A. D., Hernandez, A. F., Peterson, E. D., & Bhatt, D. L. (2015) · Circulation · doi:10.1161/circ.132.suppl_3.17419
Research works printed but not linked: 1
- D Cirillo, 2020, Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare, NPJ Digit Med, 3, 81, 10.1038/s41746-020-0288-5 · DOI · Paper page
Cited by
Enhancing mental health with Artificial Intelligence: Current trends and future prospects
Olawade, D. B., Wada, O. Z., Odetayo, A., David-Olawade, A. C., Asaolu, F., & Eberhardt, J. (2024) · Journal of Medicine, Surgery, and Public Health · doi:10.1016/j.glmedi.2024.100099 · Cited by 514
“Consequently, underrepresented communities may experience misdiagnosis, insufficient treatment recommendations, or even worsening of their mental health conditions [122,123].”
BackgroundBias recognition and mitigation strategies in artificial intelligence healthcare applications
Hasanzadeh, F., Josephson, C. B., Waters, G., Adedinsewo, D., Azizi, Z., & White, J. A. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01503-7 · Cited by 320
“Inthecontextof healthcare AI, biascanbe de fi ned asany systematicand/or unfair difference in how predictions are generated for different patient populations that could lead to disparate care delivery 10 .”
InfluentialA multinational study on the factors influencing university students’ attitudes and usage of ChatGPT
Abdaljaleel, M., Barakat, M., Alsanafi, M., Salim, N. A., Abazid, H., Malaeb, D., Mohammed, A. H., Hassan, B. A. R., Wayyes, A. M., Farhan, S. S., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-52549-8 · Cited by 291
Ethical and legal considerations in healthcare AI: innovation and policy for safe and fair use
Pham, T. (2025) · Royal Society Open Science · doi:10.1098/rsos.241873 · Cited by 261
A Scoping Review of Reporting Gaps in FDA-Approved AI Medical Devices
Muralidharan, V., Adewale, B. A., Huang, C. J., Nta, M. T., Ademiju, P. O., Pathmarajah, P., Hang, M. K., Adesanya, O., Abdullateef, R. O., Babatunde, A. O., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01270-x · Cited by 201
Metadata
- Authors
- Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., & Mathur, P.
- Affiliations
- King Hussein Cancer Center (JO)
- Morehouse School of Medicine (US)
- Dalhousie University (CA)
- Massachusetts Institute of Technology (US)
- Atrium Health Wake Forest Baptist (US)
- The University of Texas MD Anderson Cancer Center (US)
- Beth Israel Deaconess Medical Center (US)
- Cleveland Clinic (US)
- Corresponding author
- Nazer, Lama H.
- ORCID
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-06-22
- Volume
- 2
- Issue
- 6
- Pages
- e0000278
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC10287014
- OpenAlex
- W4381716616
- Cited by
- 621
- References
- 59
- Citations by year
- 2026: 180 · 2025: 285 · 2024: 144 · 2023: 11
- FWCI
- 24.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Greater South Information System
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- algorithmic bias, artificial intelligence in healthcare, health equity, health care disparities, bias mitigation, social determinants of health, underserved populations, data collection bias, data preprocessing, algorithm validation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
