Development and preliminary testing of Health Equity Across the AI Lifecycle (HEAAL): A framework for healthcare delivery organizations to mitigate the risk of AI solutions worsening health inequities
Open accessPublished version of a preprint
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The use of data-driven technologies such as Artificial Intelligence (AI) and Machine Learning (ML) is growing in healthcare. However, the proliferation of healthcare AI tools has outpaced regulatory frameworks, accountability measures, and governance standards to ensure safe, effective, and equitable use. To address these gaps and tackle a common challenge faced by healthcare delivery organizations, a case-based workshop was organized, and a framework was developed to evaluate the potential impact of implementing an AI solution on health equity. The Health Equity Across the AI Lifecycle (HEAAL) is co-designed with extensive engagement of clinical, operational, technical, and regulatory leaders across healthcare delivery organizations and ecosystem partners in the US. It assesses 5 equity assessment domains–accountability, fairness, fitness for purpose, reliability and validity, and transparency–across the span of eight key decision points in the AI adoption lifecycle. It is a process-oriented framework containing 37 step-by-step procedures for evaluating an existing AI solution and 34 procedures for evaluating a new AI solution in total. Within each procedure, it identifies relevant key stakeholders and data sources used to conduct the procedure. HEAAL guides how healthcare delivery organizations may mitigate the potential risk of AI solutions worsening health inequities. It also informs how much resources and support are required to assess the potential impact of AI solutions on health inequities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unchecked bias in health communications can also contribute to widening health disparities (10, 15, 16).”
From The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Kim et al.30, HEAAL framework, is a comprehensive tool that evaluates AI across several domains: accountability, fairness, fitness to purpose, reliability and validity, and transparency throughout the lifecycle.”
From Advancing healthcare AI governance through a comprehensive maturity model based on systematic review (2026) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“…with unprecedented data [22], bias captured in specific data measurements [23,24], bias captured in unstructured text [25,26], bias embedded within outcome labels used to train models [11,12], and models learning shortcuts unrelated to disease process to generate diagnostic predictions [27,28].”
BackgroundRajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
Self-citationRacial bias in pulse oximetry measurement
Sjoding, M. W., Dickson, R. P., Iwashyna, T. J., Gay, S. E., & Valley, T. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmc2029240 · Cited by 1,114 · cited 1×
“…historic data to build an accurate model [21], an outlier event with unprecedented data [22], bias captured in specific data measurements [23,24], bias captured in unstructured text [25,26], bias embedded within outcome labels used to train models [11,12], and models learning shortcuts…”
BackgroundBias in artificial intelligence algorithms and recommendations for mitigation
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000278 · Cited by 621
A Framework of Potential Sources of Harm Throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 576
Self-citationSources of bias in artificial intelligence that perpetuate healthcare disparities—A global review
Celi, L. A., Cellini, J., Charpignon, M.-L., Dee, E. C., Dernoncourt, F., Eber, R., Mitchell, W. G., Moukheiber, L., Schirmer, J., Situ, J., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000022 · Cited by 576
Wu, E., Wu, K., Daneshjou, R., Ouyang, D., Ho, D. E., & Zou, J. (2021) · Nature Medicine · doi:10.1038/s41591-021-01312-x · Cited by 494
Research works printed but not linked: 1
- Tamer YT, Karam A, Roderick T, Miff S. Know thy patient: a novel approach and method for patient segmentation and clustering using machine learning to develop holistic, patient-centered programs and treatment plans. NEJM Catalyst Innovations in Care Delivery. 2022 Aug 23; 3(4).
Cited by
Poon, E. G., Lemak, C. H., Rojas, J. C., Guptill, J., & Classen, D. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf065 · Cited by 143
Algorithmic bias in public health AI: a silent threat to equity in low-resource settings
Joseph, J. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1643180 · Cited by 142
Pal, A., Wangmo, T., Bharadia, T., Ahmed-Richards, M., Bhanderi, M., Kachhadiya, R., Allemann, S. S., & Elger, B. S. (2025) · Patient Preference and Adherence · doi:10.2147/ppa.s527922 · Cited by 63
Advancing healthcare AI governance through a comprehensive maturity model based on systematic review
Hussein, R., Zink, A., Ramadan, B., Howard, F. M., Hightower, M., Shah, S., & Beaulieu-Jones, B. K. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02418-7 · Cited by 96
Generative Artificial Intelligence in Medicine
Shanmugam, D., Agrawal, M., Movva, R., Chen, I. Y., Ghassemi, M., Jacobs, M. L., & Pierson, E. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095332 · Cited by 41
Kumar, R. R., Sporn, K., Waisberg, E., Ong, J., Paladugu, P., Vadhera, A. S., Amiri, D., Ngo, A., Jagadeesan, R., Tavakkoli, A., et al. (2025) · Health Care Analysis · doi:10.1007/s10728-025-00537-y · Cited by 38
Governance for safe and responsible AI in healthcare organisations: a scoping review of frameworks
Wang, A., Freeman, S., & Magrabi, F. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02679-2 · Cited by 35
Bailo, P., Nittari, G., Pesel, G., Basello, E., Spasari, T., & Ricci, G. (2026) · Sci · doi:10.3390/sci8020036 · Cited by 22
“Multi-stakeholder frameworks emphasize equity checks and monitoring plans from the outset, and provincial models show how coordinated intake and risk assessment can scale governance across health systems [130,142,143].”
What Is Fair? Defining Fairness in Machine Learning for Health
Gao, J., Chou, B., McCaw, Z. R., Thurston, H., Varghese, P., Hong, C., & Gronsbell, J. L. (2025) · Statistics in Medicine · doi:10.1002/sim.70234 · Cited by 30
AI in action: a road map from the radiology AI council for effective model evaluation and deployment
Trivedi, H., Khosravi, B., Gichoya, J., Benson, L., Dyckman, D., Galt, J., Howard, B. M., Kikano, E. G., Kunjummen, J., Lall, N., et al. (2025) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2025.05.016 · Cited by 15
Wang, T., Emami, E., Jafarpour, D., Tolentino, R., Gore, G. C., & Rahimi, S. A. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000941 · Cited by 17
Proactive Algorithm Monitoring to Ensure Health Equity
Sendak, M., Balu, S., & Hernandez, A. F. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.45022 · Cited by 16
Self-citationMechael, P. (2025) · Women s Health Nursing · doi:10.4069/whn.2025.06.25 · Cited by 10
Welch, M. L., Grant, B., Deutschman, C., McElcheran, C., Badzynski, A., Bell, J. A. H., Hope, A. J., Grant, R. C., Truong, T., Lane, K., et al. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100957 · Cited by 25
The Need for Continuous Evaluation of Artificial Intelligence Prediction Algorithms.
Shah, N. H., Pfeffer, M., & Ghassemi, M. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.33009 · Cited by 12
Rough, K., Rashidi, E., Tai, C. G.-L., Lucia, R. M., Mack, C. D., & Largent, J. A. (2024) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.70041 · Cited by 11
Scaling equitable artificial intelligence in healthcare with machine learning operations
Ng, M. Y., Youssef, A., Pillai, M., Shah, V. B., & Hernandez‐Boussard, T. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2024-101101 · Cited by 10
Digital health equity: Crafting sustainable pathways
Pierce, R. L. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000703 · Cited by 10
The Emergence of Applied Artificial Intelligence in the Realm of Value Based Musculoskeletal Care
Hunter, J., Dentino, P., & Jayakumar, P. (2025) · Current Reviews in Musculoskeletal Medicine · doi:10.1007/s12178-025-09982-7 · Cited by 9
Lightening the Load: Generative AI to Mitigate the Burden of the New Era of Obesity Medical Therapy
Stevens, E. R., Elmaleh-Sachs, A., Lofton, H. F., & Mann, D. M. (2024) · JMIR Diabetes · doi:10.2196/58680 · Cited by 9
Kiragga, A. N., Iddi, S., Walekhwa, A. W., Barasa, M., Cygu, S. B., Odhiambo, R., Gningue, M., Mboup, A., Onana, A., Adnew, B., et al. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1695907 · Cited by 7
Alipour, P., El-Aghil, M., Foo, A., & Azizi, Z. (2025) · Current Atherosclerosis Reports · doi:10.1007/s11883-024-01272-w · Cited by 10
Soley, N., Rattsev, I., Speed, T. J., Xie, A., Ferryman, K. S., & Taylor, C. O. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf053 · Cited by 8
Hart, S. N., Day, P. L., & Garcia, C. A. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03099-0 · Cited by 9
Grosek, Š., Štivić, S., Borovečki, A., Ćurković, M., Lajovic, J., Marušić, A., Mijatović, A., Miksić, M., Mimica, S., Škrlep, E., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310599 · Cited by 9
Sendak, M., Kim, J. Y., Hasan, A., Ratliff, W., Lifson, M. A., Patel, M. R., Raji, I. D., Sehgal, A., Shaw, K., Tobey, D., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000513 · Cited by 5
Self-citationTransdisciplinary perspectives for health systems science
Bian, J., Liu, N., Overgaard, S., Padman, R., Steel, P. A. D., Tiase, V., Whitcomb, C. A., Zhang, J., & Zhang, Y.-Y. (2024) · npj Health Systems · doi:10.1038/s44401-024-00002-3 · Cited by 6
Ali, S. M., Gambin, A., Chadwick, H., Dixon, W. G., Crawford, A. S., & van der Veer, S. N. (2024) · International Journal for Equity in Health · doi:10.1186/s12939-024-02299-w · Cited by 6
Zhao, Q., Jiang, W., Zhang, C., Ouyang, M., Wu, N., & Guo, Y. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1863050 · Cited by 3
Melo, Z. (2024) · Trayectorias Humanas Trascontinentales · doi:10.25965/trahs.6349 · Cited by 4
Kpodzro, S., Kim, J. Y., Hasan, A., Thomas, C., Draugelis, M. E., Jeffries, S. M., Beecy, A., Stroum, C., Valladares, A., Eigen, Z. J., et al. (2026) · NEJM AI · doi:10.1056/aip2500985 · Cited by 4
Self-citationDonia, J., Oyefeso, L., Embuldeniya, G., Whyne, C. M., Burns, D., Boyer, P., Razmjou, H., & Shaw, J. (2024) · AI and Ethics · doi:10.1007/s43681-024-00594-4 · Cited by 2
Ramezani, M., Mobinizadeh, M., Bakhtiari, A., Rabiee, H. R., Ramezani, M., Mostafavi, H., Olyaeemanesh, A., Fazaeli, A. A., Atashi, A., Sazgarnejad, S., et al. (2025) · BioData Mining · doi:10.1186/s13040-025-00428-x · Cited by 3
Exploring and Mitigating Implicit Bias in Large Language Models: A Cross-Domain Evaluation Framework
Donkor, P. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i28.35329 · Cited by 3
Khalid, F., Abbas, S., Sadeq, A. M., & Aslam, B. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/7342994 · Cited by 2
Mukhopadhyay, A., Zhao, Y., Chunara, R., Kronish, I. M., Lawrence, S., Blecker, S., & Adhikari, S. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag097 · Cited by 2
Babu, C. V. S., Mohideen, A. M., Saikrishna, K., & Kannan, K. A. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-6294-5.ch002 · Cited by 2
Zahraini, D. A. (2025) · Medicor Journal of Health Informatics and Health Policy · doi:10.61978/medicor.v3i3.1085 · Cited by 1
Can We Read AI’s Mind? A Quest for Transparency
Ravindran, S. K., Kot, E., & Nah, F. F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13167-6_6 · Cited by 1
Understanding and Mitigating Unintended Bias in Medical AI Systems
Tyner-Monroe, S., Rakova, B., Kim, J. Y., Sendak, M., Balu, S., Tobey, D., Darling, C., Eigen, Z. J., Kloeppel, K., & Sharma, D. (2026) · Harvard Data Science Review · doi:10.1162/99608f92.59ca6018 · Cited by 1
Self-citationHanna, J. J., Dennis, C. R., Johnson, A. O., Cooper, L. N., Evans, C. S., Lehmann, C. U., & Medford, R. J. (2026) · Applied Clinical Informatics · doi:10.1055/a-2876-1059 · Cited by 1
Adefolalu, A. O. (2026) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2026.103032 · Cited by 1
Healthcare reform: let science, not politics, lead the way
Kim, N., Park, J. E., Koo, H. J., Chay, S., Ham, S., Kim, S. Y., Sul, J.-Y., Hong, S. W., & Baik, H. W. (2024) · Annals of Coloproctology · doi:10.3393/ac.2024.00283.0040 · Cited by 1
The Health Communications Assessment Checklist: a teaching tool for uncovering bias in the age of AI
Ofrane, R. H., Canada, T., & Birnbaum, A. S. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1872506
“Unchecked bias in health communications can also contribute to widening health disparities (10, 15, 16).”
Multi-Omics Approaches for Building Software as Medical Devices
Palaniappan, A., & Vaithilingam, N. (2024) · doi:10.52843/cassyni.09v0nt
Role of governability and generative AI for healthcare
Gaur, L., & Abraham, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-33124-4.00004-7
Dashdorj, T., & Miller, A. D. (2025) · International Journal of Social Science and Education Research · doi:10.33545/26649845.2025.v7.i2f.395
Kamat, M. M., Kamat, M. S., Barreto, N., Kalshetti, P., Das, A., Selvakumar, P., & Manjunath, T. C. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3820-0.ch004
Bushana, P. N., Alshuaib, S., Lu, D., & Shainker-Connelly, S. J. (2025) · Journal of Science Policy & Governance · doi:10.38126/jspg270102
Ethical Considerations in AI-Enabled Healthcare
Aldemir, E., Bloom, C., Honeyman, S. I., & Vardanyan, R. (2026) · Biomedical visualization · doi:10.1007/978-3-032-06520-9_5 · Cited by 1
Embodied Data: Exploring the Impact of Biometric Visualization Techniques on Global Health Equity
Ain, Q. U. (2026) · Biomedical visualization · doi:10.1007/978-3-032-12305-3_7
Donia, J. (2025) · TSpace (University of Toronto)
Updated Policy on the Use of Artificial Intelligence for the Journal of Neurosurgical Anesthesiology
Flexman, A. M., Lele, A. V., & on behalf of the JNA Editorial Board (2026) · Journal of Neurosurgical Anesthesiology · doi:10.1097/ana.0000000000001095
From Big Data to Smart Health: Machine Learning Approaches Shaping the Future of Biomedicine
Manoharan, J., Srinivasan, V., & Plunkett, C. M. (2026) · Journal of Medico Informatics · doi:10.64659/jomi/215258
Ferryman, K. S., & Kane, O. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1797705
Jurisdictional gerrymandering: The Authority of Problems without Solutions
Zilberstein, S. (2026) · Social Problems · doi:10.1093/socpro/spag024
Joshi, U., & Lanzas, C. (2026) · Antimicrobial Stewardship & Healthcare Epidemiology · doi:10.1017/ash.2026.10747
Nayak, K. (2026) · Journal of Public and Clinical Health Research · doi:10.63486/jpchr.26060801
Decoding Algorithmic Inequity: Reversing the Generative AI Racial Divide in Healthcare
Davidson, J., Fowe, I. E., Oderinde, A., & Fadeyi, S. A. (2026) · Clinical Therapeutics · doi:10.1016/j.clinthera.2026.06.015 · Cited by 2
Artificial Intelligence in Anesthesiology Education
Rosenkrans, D. J., Blacker, S. N., Lele, A. V., & Buhl, L. K. (2026) · Anesthesiology Clinics · doi:10.1016/j.anclin.2026.06.005
Purkayastha, S., Kuruvikkattil, A. V., Sammeta, C., Perumbilly, A. N., Kudamala, R., & Gichoya, J. W. (2026) · Research Square · doi:10.21203/rs.3.rs-10808081/v1
Bouraima, M. B. (2026) · International Scientific Spectrum · doi:10.66972/iscis21202614
Bokenfohr, M., Shachak, A., Maslej, M. M., Sockalingam, S., Hilton, M., Dickie, E. W., Quilty, L. C., Makhlouf, L., Lankarany, M., Glatard, T., et al. (2026) · doi:10.2196/preprints.111993
Advancing Patient‐Centred AI With Adaptive Machine Learning
Kalogeropoulos, D., Barach, P. R., Downing, A., Verhulst, S., & Lustberg, M. B. (2026) · Cancer Medicine · doi:10.1002/cam4.72371
Chen, H., Huang, J., & Hou, X. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1940621
Unger, D., Parsons, G., Mobasher, A., Shah, M., Fobin, M., & Gonzales, M. J. (2026) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2026.10.017
Metadata
- Authors
- Kim, J. Y., Hasan, A., Kellogg, K. C., Ratliff, W., Murray, S. G., Suresh, H., Valladares, A., Shaw, K., Tobey, D., Vidal, D. E., Lifson, M. A., Patel, M., Raji, I. D., Gao, M., Knechtle, W., Tang, L., Balu, S., & Sendak, M. P.
- Affiliations
- Duke University (US)
- Massachusetts Institute of Technology (US)
- University of California, San Francisco (US)
- Cornell University (US)
- United States Food and Drug Administration (US)
- Mayo Clinic (US)
- Duke Medical Center (US)
- University of California, Berkeley (US)
- Johns Hopkins University (US)
- Corresponding author
- Kim, Jee Young
- ORCID
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2024-05-09
- Volume
- 3
- Issue
- 5
- Pages
- e0000390
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC11081364
- OpenAlex
- W4396766072
- Cited by
- 61
- References
- 36
- Citations by year
- 2026: 26 · 2025: 21 · 2024: 13
- FWCI
- 5.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Gordon and Betty Moore Foundation (10849)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- health equity, artificial intelligence in healthcare, AI lifecycle, health disparities, equity assessment, accountability, algorithmic fairness, transparency, reliability and validity, AI governance, health care delivery organization, artificial intelligence adoption, risk mitigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.