Machine Learning, Health Disparities, and Causal Reasoning
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Editorials18 December 2018Machine Learning, Health Disparities, and Causal ReasoningSteven N. Goodman, MD, MHS, PhD, Sharad Goel, MS, PhD, and Mark R. Cullen, MDSteven N. Goodman, MD, MHS, PhDStanford University School of Medicine, Stanford, California (S.N.G., M.R.C.), Sharad Goel, MS, PhDStanford University School of Engineering, Stanford, California (S.G.), and Mark R. Cullen, MDStanford University School of Medicine, Stanford, California (S.N.G., M.R.C.)Author, Article, and Disclosure Informationhttps://doi.org/10.7326/M18-3297 SectionsAboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail In their current Annals article, Rajkomar and colleagues (1) warn us that the introduction of machine-learned predictive algorithms into medicine might inadvertently reinforce or create inequitable treatment of protected groups, for which the computer science community has adopted the terminology of "fairness." Others have noted the need for careful, ethical scrutiny of these models (2), and Rajkomar and colleagues add to those calls an elaborate taxonomy of pitfalls and an oversight structure to minimize the ethical harms.The authors offer some useful constructs, many of which have direct counterparts in clinical research, epidemiology, and implementation science (such as "training–serving skew" ...References1. Rajkomar A, Hardt M, Howell MD, Corrado G, Chin MH. Ensuring fairness in machine learning to advance health equity. Ann Intern Med. 2018;169:866-72. doi:10.7326/M18-1990 LinkGoogle Scholar2. Char DS, Shah NH, Magnus D. Implementing machine learning in health care - addressing ethical challenges. N Engl J Med. 2018;378:981-983. [PMID: 29539284] CrossrefMedlineGoogle Scholar3. Corbett-Davies S, Goel S. The measure and mismeasure of fairness: a critical review of fair machine learning. Accessed at https://arxiv.org/abs/1808.00023 on 16 November 2018. Google Scholar4. Buolamwini J, Gebru T. Gender shades: intersectional accuracy disparities in commercial gender classification. Proceedings of Machine Learning Research: Conference on Fairness, Accountability, and Transparency. 2018;81:1-15. Accessed at http://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a.pdf on 26 November 2018. Google Scholar5. Pearl J, Mackenzie D. The Book of Why: The New Science of Cause and Effect. New York: Basic Books; 2018. Google Scholar Author, Article, and Disclosure InformationAffiliations: Stanford University School of Medicine, Stanford, California (S.N.G., M.R.C.)Stanford University School of Engineering, Stanford, California (S.G.)Disclosures: Authors have disclosed no conflicts of interest. Forms can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M18-3297.Corresponding Author: Steven N. Goodman, MD, MHS, PhD, Stanford University School of Medicine, 150 Governor's Lane, HRP/Redwood Building T265, Stanford, CA 94305; e-mail, Steve.[email protected]edu.Current Author Addresses: Dr. Goodman: Stanford University School of Medicine, 150 Governor's Lane, HRP/Redwood Building T265, Stanford, CA 94305.Dr. Goel: Stanford School of Engineering, 475 Via Ortega, Stanford, CA 94305.Dr. Cullen: Stanford Center for Population Health Sciences, 1070 Arastradero Road, Palo Alto, CA 94304.This article was published at Annals.org on 4 December 2018. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee AlsoEnsuring Fairness in Machine Learning to Advance Health Equity Alvin Rajkomar , Michaela Hardt , Michael D. Howell , Greg Corrado , and Marshall H. Chin Metrics Cited byTime-Series Prediction of Intense Wind Shear Using Machine Learning Algorithms: A Case Study of Hong Kong International AirportPotential reduction in healthcare carbon footprint by autonomous artificial intelligenceA reimbursement framework for artificial intelligence in healthcareGround truth labels challenge the validity of sepsis consensus definitions in critical illnessPrediction and Interpretation of Low-Level Wind Shear Criticality Based on Its Altitude above Runway Level: Application of Bayesian Optimization–Ensemble Learning Classifiers and SHapley Additive exPlanationsAssociation of Disparities in Family History and Family Cancer History in the Electronic Health Record With Sex, Race, Hispanic or Latino Ethnicity, and Language Preference in 2 Large US Health Care SystemsNet benefit, calibration, threshold selection, and training objectives for algorithmic fairness in healthcareLearning Resource Allocation Policies from Observational Data with an Application to Homeless Services DeliveryAdaptive Sampling Strategies to Construct Equitable Training DatasetsShort-Term Mortality in Patients with Heart Failure at the End-of-Life Stages: Hades StudyPreventing Overdose Using Information and Data from the Environment (PROVIDENT): protocol for a randomized, population‐based, community intervention trialBig Data Needs and Challenges to Advance Research on Raci
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, AI systems are increasingly in a position to help improve patient and population health outcomes and drive down cost, increase physician job satisfaction, and address health disparities20,21,3,22,23.”
From Considerations for addressing bias in artificial intelligence for health equity (2023) · cites this paper as [21]
Citations
Cites
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857 · cited 1×
“” Others have noted the need for careful, ethical scrutiny of these models (2), and Rajkomar and colleagues add to those calls an elaborate taxonomy of pitfalls and an oversight structure to minimize the ethical harms.”
BackgroundEnsuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341 · cited 1×
“I their current Annals article, Rajkomar and colleagues (1) warn us that the introduction of machinelearned predictive algorithms into medicine might inadvertently reinforce or create inequitable treatment of protected groups, for which the computer science community has adopted the terminology of “fairness.”
Background
Cited by
Racial disparities in automated speech recognition
Koenecke, A., Nam, A., Lake, E., Nudell, J., Quartey, M., Mengesha, Z., Toups, C., Rickford, J. R., Jurafsky, D., & Goel, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915768117 · Cited by 765
“…a problem that has recently come to light in several other advancing applications of machine learning, such as face recognition (5, 6), natural language processing (7–11), online advertising (12, 13), and risk prediction in criminal justice (14–17), healthcare (18, 19), and child services (20, 21).”
BackgroundSelf-citationIdentifying Ethical Considerations for Machine Learning Healthcare Applications
Char, D. S., Abràmoff, M. D., & Feudtner, C. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1819469 · Cited by 415
Krieger, N. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094017 · Cited by 411
“criminal sentencing, mortgage approval, and medical care (63, 148, 168).”
BackgroundConsiderations for addressing bias in artificial intelligence for health equity
Abràmoff, M. D., Tarver, M. E., Loyo-Berrios, N., Trujillo, S., Char, D., Obermeyer, Z., Eydelman, M. B., Foundational Principles of Ophthalmic Imaging and Algorithmic Interpretation Working Group of the Collaborative Community for Ophthalmic Imaging Foundation, W., & Maisel, W. H. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00913-9 · Cited by 349
“Thus, AI systems are increasingly in a position to help improve patient and population health outcomes and drive down cost, increase physician job satisfaction, and address health disparities 20,21,3,22,23 .”
BackgroundLeisman, D. E., Harhay, M. O., Lederer, D. J., Abramson, M., Adjei, A. A., Bakker, J., Ballas, Z. K., Barreiro, E., Bell, S. C., Bellomo, R., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004246 · Cited by 271
“org May 2020 • Volume 48 • Number 5 real world applications (11).”
Background
Metadata
- Authors
- Goodman, S. N., Goel, S., & Cullen, M. R.
- Affiliations
- Stanford Medicine (US)
- Stanford University (US)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2018-12-18
- Volume
- 169
- Issue
- 12
- Pages
- 883-884
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2902054973
- Cited by
- 57
- References
- 2
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 6 · 2023: 8 · 2022: 10 · 2021: 6 · 2020: 16 · 2019: 5
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- health disparities, algorithmic fairness, health equity, causal reasoning, predictive algorithms, algorithmic bias, protected groups, machine learning ethics, causal inference, causal effect estimation
- MeSH terms
- Machine Learning, Health Equity, Problem Solving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.