Addressing health disparities in the Food and Drug Administration’s artificial intelligence and machine learning regulatory framework
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The exponential growth of health data from devices, health applications, and electronic health records coupled with the development of data analysis tools such as machine learning offer opportunities to leverage these data to mitigate health disparities. However, these tools have also been shown to exacerbate inequities faced by marginalized groups. Focusing on health disparities should be part of good machine learning practice and regulatory oversight of software as medical devices. Using the Food and Drug Administration (FDA)'s proposed framework for regulating machine learning tools in medicine, I show that addressing health disparities during the premarket and postmarket stages of review can help anticipate and mitigate group harms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“A recent article by Obermeyer et al 9 provides an instructive example of the missteps that can befall an algorithm that does not consider health disparities and the potential for group harm as part of good ML practices.”
BackgroundMental Health Surveillance Among Children — United States, 2013–2019
Bitsko, R. H., Claussen, A. H., Lichstein, J., Black, L. I., Jones, S. E., Danielson, M. L., Hoenig, J. M., Davis Jack, S. P., Brody, D. J., Gyawali, S., et al. (2022) · MMWR Supplements · doi:10.15585/mmwr.su7102a1 · Cited by 1,723
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341
Assessing risk, automating racism
Benjamin, R. (2019) · Science · doi:10.1126/science.aaz3873 · Cited by 378 · cited 1×
“10 This discovery could have led to adjustments to their input data, and scrutiny of the validity of the association between healthcare expenditure and illness before the model was developed.”
BackgroundFathy, C., Patel, S., Sternberg, P., & Kohanim, S. (2016) · Seminars in Ophthalmology · doi:10.3109/08820538.2016.1154170 · Cited by 106 · cited 1×
“African Americans have a 4 times higher risk of developing this condition than do non-Hispanic whites, and this group is also less likely than whites to have eye examinations, which can detect diseases such as diabetic retinopathy (DR).(12) The IDx-DR tool allows for the screening of DR in primary care settings, as th…”
Background
Cited by
Swanson, K., Wu, E., Zhang, A., Alizadeh, A. A., & Zou, J. (2023) · Cell · doi:10.1016/j.cell.2023.01.035 · Cited by 597
“Continuous performance monitoring of ML algorithms after approval and postmarket surveillance mechanisms are necessary to ensure that the purported clinical benefits of ML hold up under various distribution shifts.(121) As a case study, earlier-generation computeraided detection software for mammography was approved b…”
MethodEthical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
Self-citationWu, E., Wu, K., Daneshjou, R., Ouyang, D., Ho, D. E., & Zou, J. (2021) · Nature Medicine · doi:10.1038/s41591-021-01312-x · Cited by 494
The value of standards for health datasets in artificial intelligence-based applications
Arora, A., Alderman, J. E., Palmer, J., Ganapathi, S., Laws, E., McCradden, M. D., Oakden-Rayner, L., Pfohl, S. R., Ghassemi, M., McKay, F., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02608-w · Cited by 294
Čartolovni, A., Tomičić, A., & Lazić Mosler, E. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104738 · Cited by 267
Metadata
- Authors
- Ferryman, K.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-09-20
- Volume
- 27
- Issue
- 12
- Pages
- 2016-2019
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W3087068758
- Cited by
- 55
- References
- 6
- FWCI
- 11.11
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Addressing health disparities in the Food and Drug Administration’s artificial intelligence and machine learning regulatory framework. https://app.cochat.ai/papers/10.1093/jamia/ocaa133
- The paper
- Ferryman, K. (2020). Addressing health disparities in the Food and Drug Administration’s artificial intelligence and machine learning regulatory framework. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocaa133
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.