Investigating for bias in healthcare algorithms: a sex-stratified analysis of supervised machine learning models in liver disease prediction
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Objectives: The Indian Liver Patient Dataset (ILPD) is used extensively to create algorithms that predict liver disease. Given the existing research describing demographic inequities in liver disease diagnosis and management, these algorithms require scrutiny for potential biases. We address this overlooked issue by investigating ILPD models for sex bias. Methods: Following our literature review of ILPD papers, the models reported in existing studies are recreated and then interrogated for bias. We define four experiments, training on sex-unbalanced/balanced data, with and without feature selection. We build random forests (RFs), support vector machines (SVMs), Gaussian Naïve Bayes and logistic regression (LR) classifiers, running experiments 100 times, reporting average results with SD. Results: We reproduce published models achieving accuracies of >70% (LR 71.31% (2.37 SD) – SVM 79.40% (2.50 SD)) and demonstrate a previously unobserved performance disparity. Across all classifiers females suffer from a higher false negative rate (FNR). Presently, RF and LR classifiers are reported as the most effective models, yet in our experiments they demonstrate the greatest FNR disparity (RF; −21.02%; LR; −24.07%). Discussion: We demonstrate a sex disparity that exists in published ILPD classifiers. In practice, the higher FNR for females would manifest as increased rates of missed diagnosis for female patients and a consequent lack of appropriate care. Our study demonstrates that evaluating biases in the initial stages of machine learning can provide insights into inequalities in current clinical practice, reveal pathophysiological differences between the male and females, and can mitigate the digitisation of inequalities into algorithmic systems. Conclusion: Our findings are important to medical data scientists, clinicians and policy-makers involved in the implementation medical artificial intelligence systems. An awareness of the potential biases of these systems is essential in preventing the digital exacerbation of healthcare inequalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hidden in Plain Sight — Reconsidering the Use of Race Correction in Clinical Algorithms
Vyas, D. A., Eisenstein, L. G., & Jones, D. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmms2004740 · Cited by 1,731
The Girl Who Cried Pain: A Bias against Women in the Treatment of Pain
Hoffmann, D. E., & Tarzian, A. J. (2001) · Journal of Law, Medicine & Ethics · doi:10.1111/j.1748-720x.2001.tb00037.x · Cited by 622
A review of spline function procedures in R
Perperoglou, A., Sauerbrei, W., Abrahamowicz, M., & Schmid, M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0666-3 · Cited by 585
Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare
Cirillo, D., Catuara-Solarz, S., Morey, C., Guney, E., Subirats, L., Mellino, S., Gigante, A., Valencia, A., Rementeria, M. J., Chadha, A. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0288-5 · Cited by 553
Artificial Intelligence in mental health and the biases of language based models
Straw, I., & Callison-Burch, C. (2020) · PLOS ONE · doi:10.1371/journal.pone.0240376 · Cited by 164
Self-citationMan-Made Medicine and Women's Health: The Biopolitics of Sex/Gender and Race/Ethnicity
Krieger, N., & Fee, E. (1994) · International Journal of Health Services · doi:10.2190/lwlh-nmcj-uacl-u80y · Cited by 149
Health inequities and the inappropriate use of race in nephrology
Eneanya, N. D., Boulware, L. E., Tsai, J., Bruce, M. A., Ford, C. L., Harris, C., Morales, L. S., Ryan, M. J., Reese, P. P., Thorpe, R. J., et al. (2022) · Nature Reviews Nephrology · doi:10.1038/s41581-021-00501-8 · Cited by 140 · cited 1×
“29 30 A key limitation of our study is that we cannot perform a race stratified analysis.”
MethodStraw, I. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101965 · Cited by 86
Self-citation
Cited by
Survey on Machine Learning Biases and Mitigation Techniques
Siddique, S., Haque, M. A., George, R., Gupta, K. D., Gupta, D., & Faruk, M. J. H. (2023) · Digital · doi:10.3390/digital4010001 · Cited by 78
The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective
Franklin, G., Stephens, R., Piracha, M., Tiosano, S., Lehouillier, F., Koppel, R., & Elkin, P. (2024) · Life · doi:10.3390/life14060652 · Cited by 76
“For example, the Indian Liver Patient Dataset (ILPD), used to create predictive algorithms for liver disease, classifies women with a high false negative rate (FNR), resulting in a deficiency of appropriate care and, thus, poor health outcomes [21].”
BackgroundMethodBias Mitigation in Primary Health Care Artificial Intelligence Models: Scoping Review
Sasseville, M., Ouellet, S., Rhéaume, C., Sahlia, M., Couture, V., Després, P., Paquette, J.-S., Darmon, D., Bergeron, F., & Gagnon, M.-P. (2025) · Journal of Medical Internet Research · doi:10.2196/60269 · Cited by 38
“The studies collectively address a wide range of protected attributes [1,8], including race or ethnicity [19,26,28-37], sex [19,20,26-31,36, 39] , age [ 19, 26, 27,29-31 These empirical findings reinforce theoretical insights that emphasize the importance of health equity between protected and…”
InfluentialThe Limitations of Artificial Intelligence in Head and Neck Oncology
Rao, K. N., Fernandez-Alvarez, V., Guntinas-Lichius, O., Sreeram, M. P., de Bree, R., Kowalski, L. P., Forastiere, A., Pace-Asciak, P., Rodrigo, J. P., Saba, N. F., et al. (2025) · Advances in Therapy · doi:10.1007/s12325-025-03198-4 · Cited by 33
Ten simple rules to leverage large language models for getting grants
Seckel, E., Stephens, B. Y., & Rodriguez, F. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011863 · Cited by 14
Metadata
- Authors
- Straw, I., & Wu, H.
- Venue
- BMJ Health & Care Informatics
- Publisher
- BMJ
- Published
- 2022-04
- Volume
- 29
- Issue
- 1
- Pages
- e100457
- ISSN
- 2632-1009 (ISSN-L)
- OpenAlex
- W4224947616
- Cited by
- 104
- References
- 8
- FWCI
- 14.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating for bias in healthcare algorithms: a sex-stratified analysis of supervised machine learning models in liver disease prediction. https://app.cochat.ai/papers/10.1136/bmjhci-2021-100457
- The paper
- Straw, I., & Wu, H. (2022). Investigating for bias in healthcare algorithms: a sex-stratified analysis of supervised machine learning models in liver disease prediction. BMJ Health & Care Informatics. https://doi.org/10.1136/bmjhci-2021-100457
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.