Hurtful words: quantifying biases in clinical contextual word embeddings
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
In this work, we examine the extent to which embeddings may encode marginalized populations differently, and how this may lead to a perpetuation of biases and worsened performance on clinical tasks. We pretrain deep embedding models (BERT) on medical notes from the MIMIC-III hospital dataset, and quantify potential disparities using two approaches. First, we identify dangerous latent relationships that are captured by the contextual word embeddings using a fill-in-the-blank method with text from real clinical notes and a log probability bias score quantification. Second, we evaluate performance gaps across different definitions of fairness on over 50 downstream clinical prediction tasks that include detection of acute and chronic conditions. We find that classifiers trained from BERT representations exhibit statistically significant differences in performance, often favoring the majority group with regards to gender, language, ethnicity, and insurance status. Finally, we explore shortcomings of using adversarial debiasing to obfuscate subgroup information in contextual word embeddings, and recommend best practices for such deep embedding models in clinical settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Given that NLP-based techniques have shown biases against under-represented subpopulations in both medical 32 and non-medical 33 domains, the automatic labeler could potentially be a large source of bias.”
From Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations (2021) · cites this paper as [32]
In the citing paper
“Following best practice 16,32 for FPR, FNR and FDR estimation, we select a single threshold for all groups, which maximizes the F1 score.”
From Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations (2021) · cites this paper as [32]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Le Gall, J.-R. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.270.24.2957 · Cited by 7,773
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Research works printed but not linked: 29
- 2020, Artificial Intelligence in Medicine. https://www.ibm.com/watson-health/learn/artificial-intelligence-medicine
- 2020, Drug development gets big data analytics boost. https://www.novartis.com/stories/discovery/drug-development-gets-big-data-analytics-boost
- Alsentzer Emily, 2019, McDermott
- Arnold Emily A, 2014, Triply cursed: racism, homophobia and HIV-related stigma are barriers to regular HIV testing, treatment adherence and disclosure among young Black gay men. Culture, health & sexuality 16, 6
- Basta Christine, 2019, Evaluating the underlying gender bias in contextualized word embeddings. arXiv preprint arXiv:1904.08783 · arXiv
- Beutel Alex, 2017, Chi
- Tolga Bolukbasi Kai-Wei Chang James Y Zou Venkatesh Saligrama and Adam T Kalai. 2016. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In Advances in Neural Information Processing Systems. 4349--4357. Tolga Bolukbasi Kai-Wei Chang James Y Zou Venkatesh Saligrama and Adam T Kalai. 2016. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In Advances in Neural Information Processing Systems . 4349--4357.
- Buolamwini Joy, 2018, Conference on fairness, accountability and transparency. 77--91
- Yiming Cui Wanxiang Che Ting Liu Bing Qin Ziqing Yang Shijin Wang and Guoping Hu. 2019. Pre-Training with Whole Word Masking for Chinese BERT. (2019). [arxiv]1906.08101 http://arxiv.org/abs/1906.08101 Yiming Cui Wanxiang Che Ting Liu Bing Qin Ziqing Yang Shijin Wang and Guoping Hu. 2019. Pre-Training with Whole Word Masking for Chinese BERT. (2019). [arxiv]1906.08101 http://arxiv.org/abs/1906.08101 · arXiv
- DuBard C Annette, 2006, Effect of language on heart attack and stroke awareness among US Hispanics. American journal of preventive medicine 30, 3
- Edwards Harrison, 2015, Censoring representations with an adversary. arXiv preprint arXiv:1511.05897 · arXiv
- Elazar Yanai, 2018, Adversarial removal of demographic attributes from text data. arXiv preprint arXiv:1808.06640 · arXiv
- Glance Laurent G, 2013, Trends in racial disparities for injured patients admitted to trauma centers. Health services research 48, 5
- Moritz Hardt Eric Price Nati Srebro etal 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems. 3315--3323. Moritz Hardt Eric Price Nati Srebro et al. 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems . 3315--3323.
- Hashimoto Tatsunori, 2018, Fairness Without Demographics in Repeated Loss Minimization. In International Conference on Machine Learning. 1934--1943
- Johnson Alistair EW, 2016, Leo Anthony Celi, and Roger G Mark
- Kurita Keita, 2019, Measuring Bias in Contextualized Word Representations. arXiv preprint arXiv:1906.07337 · arXiv
- LeCun Yann, 2015, Deep learning. nature 521, 7553
- Lee Jinhyuk, 2019, Chan Ho So, and Jaewoo Kang
- Liu Yinhan, 2019, RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692 · arXiv
- Milner Kerry A, 2004, Gender and age differences in chief complaints of acute myocardial infarction (Worcester Heart Attack Study). The American journal of cardiology 93, 5
- Nelson Gregory S, 2019, Bias in artificial intelligence. North Carolina medical journal 80, 4
- Radford Alec, 2019, Language models are unsupervised multitask learners. OpenAI Blog 1, 8
- Suresh Harini, 2017, Machine Learning for Healthcare Conference. 322--337
- Topol Eric J, 2019, High-performance medicine: the convergence of human and artificial intelligence. Nature medicine 25, 1
- Vayena Effy, 2018, Machine learning in medicine: Addressing ethical challenges. PLoS medicine 15, 11
- Wang Tianlu, 2018, Adversarial Removal of Gender from Deep Image Representations. arXiv preprint arXiv:1811.08489 · arXiv
- Zemel Rich, 2013, International Conference on Machine Learning. 325--333
- Zhao Jieyu, 2018, Learning gender-neutral word embeddings. arXiv preprint arXiv:1809.01496 · arXiv
Cited by
Items 101–200 of 229
BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
Fries, J. A., Weber, L., Seelam, N., Altay, G., Datta, D., Garda, S., Kang, M., Su, R., Kusa, W., Cahyawijaya, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.15076 · Cited by 17
Opportunities for incorporating intersectionality into biomedical informatics
Walk, O. J. B. D., Paullada, A., Everhart, A. R., Casanova-Pérez, R., Cohen, T., & Veinot, T. C. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104653 · Cited by 17
Imputation Strategies Under Clinical Presence: Impact on Algorithmic FairnessPreprint
Jeanselme, V., De‐Arteaga, M., Zhang, Z., Tom, B. D. M., & Barrett, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4496874 · Cited by 17
RuleBERT: Teaching Soft Rules to Pre-Trained Language ModelsPreprint
Saeed, M., Ahmadi, N., Nakov, P., & Papotti, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13006 · Cited by 17
Echoes of Biases: How Stigmatizing Language Affects AI PerformancePreprint
Liu, Y., Wang, W., Guodong, & Agarwal, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.10201 · Cited by 17
Ahmed, A., Saleem, M., Alzeen, M., Birur, B., Fargason, R. E., Burk, B. G., Alhassan, A., & Al-Garadi, M. A. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag065 · Cited by 16
Two-step adversarial debiasing with partial learning -- medical image case-studiesPreprint
Correa, R., Jeong, J., Patel, B. N., Trivedi, H., Gichoya, J. W., & Banerjee, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08711 · Cited by 16
Pulling Up by the Causal Bootstraps: Causal Data Augmentation for Pre-training Debiasing
Gowda, S. C. M., Joshi, S. D., Zhang, H., & Ghassemi, M. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482380 · Cited by 15
Self-citationUnderstanding the Interplay of Scale, Data, and Bias in Language Models: A Case Study with BERTPreprint
Ali, M. A. M., Panda, S., Shen, Q., Wick, M., & Kobren, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.21058 · Cited by 15
Shaier, S., Bennett, K., Hunter, L., & Kann, K. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.36 · Cited by 15
Evaluating Biases in Context-Dependent Sexual and Reproductive Health Questions
Levy, S., Karver, T. S., Adler, W. D., Kaufman, M. R., & Dredze, M. H. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.332 · Cited by 15
Campbell, E. A., Bose, S., & Masino, A. J. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000642 · Cited by 14
Sikström, S., Valavičiūtė, I., Kuusela, I., & Evors, N. (2024) · Communications Psychology · doi:10.1038/s44271-024-00097-2 · Cited by 14
What Do You See in this Patient? Behavioral Testing of Clinical NLP Models
van Aken, B., Herrmann, S., & Löser, A. (2022) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2022.clinicalnlp-1.7 · Cited by 14
Interdisciplinary expertise to advance human-centered explainable AI
Bennett, C. R., Cole-Lewis, H. J., Farquhar, S. A., Hammel, N., Babenko, B., Lang, O., Fleck, M. S., Traynis, I., Lau, C. T., Liu, Y., et al. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119036 · Cited by 13
Exploring Gender Disparities in Time to DiagnosisPreprint
Sun, T., Walk, O. J. B. D., Chen, J. L., Nieva, H. R., & Elhadad, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06100 · Cited by 13
Fair Machine Learning in Healthcare: A Survey
Feng, Q., Du, M., Zou, N., & Hu, X. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3361836 · Cited by 12
Hassoon, A., Lin, C. F., Woo, H., Irimia, R. M., Marsteller, J. A., Li, A., Banderia, A., Leo, H., Peng, X., Rastall, D. P. W., et al. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.11.004 · Cited by 12
Li, X., Yuan, W., Peng, D., Mei, Q., & Wang, Y. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01829-2 · Cited by 12
Presentation matters for AI-generated clinical advice
Ghassemi, M. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01721-7 · Cited by 11
Self-citationTwelve tips for Natural Language Processing in medical education program evaluation
Costa-Dookhan, K. A., Maslej, M. M., Donner, K., Islam, F., Sockalingam, S., & Thakur, A. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2316223 · Cited by 11
Dataset Debt in Biomedical Language Modeling
Fries, J., Seelam, N., Altay, G., Weber, L., Kang, M., Datta, D., Su, R., Garda, S., Wang, B., Ott, S., et al. (2022) · doi:10.18653/v1/2022.bigscience-1.10 · Cited by 11
Kwako, A., Wan, Y., Zhao, J., Chang, K.-W., Cai, L., & Hansen, M. H. (2022) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2022.bea-1.1 · Cited by 11
A Comparative Study on Word Embeddings and Social NLP Tasks
Elsafoury, F., Wilson, S. R., & Ramzan, N. (2022) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/2022.socialnlp-1.5 · Cited by 11
Agarwal, A., Banerjee, T., Romine, W. L., & Cajita, M. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825827 · Cited by 11
Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Models
Aguirre, C. A., Sasse, K., Cachola, I. A., & Dredze, M. H. (2024) · Workshop on NLP for Positive Impact (NLP4PI) · doi:10.18653/v1/2024.nlp4pi-1.4 · Cited by 11
Addressing Healthcare-related Racial and LGBTQ+ Biases in Pretrained Language Models
Xie, S., Hassanpour, S., & Vosoughi, S. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.278 · Cited by 11
AI Fairness Beyond Complete Demographics: Current Achievements and Future Directions
Wang, Z., Yin, Z., Yap, R. H. C., & Zhang, W. (2025) · Frontiers in artificial intelligence and applications · doi:10.3233/faia250905 · Cited by 11
Mitigating Bias for Question Answering Models by Tracking Bias Influence
Ma, M., Kao, J.-Y., Gupta, A. K., Lin, Y.-H., Zhao, W., Chung, T., Wang, W. W., Chang, K.-W., & Peng, N. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.257 · Cited by 11
Pal, R., Garg, H., Patel, S., & Sethi, T. (2023) · medRxiv · doi:10.1101/2023.03.22.23287585 · Cited by 10
Into the Unknown: Exploration of Search Engines’ Responses to Users with Depression and Anxiety
Milton, A., & Pera, M. S. (2023) · ACM Transactions on the Web · doi:10.1145/3580283 · Cited by 10
The effects of gender bias in word embeddings on patient phenotyping in the mental health domain
Soğancıoğlu, G., Kaya, H., & Salah, A. A. (2023) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii59096.2023.10388203 · Cited by 10
Enhancing risk and crisis communication with computational methods: A systematic literature review
Munro, M. H., Gore, R. J., Lynch, C. J., Hastings, Y. D., & Reinhold, A. M. (2024) · Risk Analysis · doi:10.1111/risa.17690 · Cited by 9
Ethical perspectives on deployment of large language model agents in biomedicine: a survey
Nia, N. G., Amiri, A., Luo, Y., & Kline, A. S. (2025) · AI and Ethics · doi:10.1007/s43681-025-00847-w · Cited by 9
Quellcodekritik. Zur Philologie von Algorithmen
Bajohr, H., & Krajewski, M. (2024) · doi:10.52438/avaa1004 · Cited by 9
Temporal Clustering of Critical Illness Events on Medical Wards
Doshi, S., Shin, S., Lapointe‐Shaw, L., Fowler, R., Fralick, M., Kwan, J. L., Shojania, K. G., Tang, T., Razak, F. A., & Verma, A. A. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.2629 · Cited by 9
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05431 · Cited by 9
Gender bias in (non)-contextual clinical word embeddings for stereotypical medical categoriesPreprint
Soğancıoğlu, G., Mijsters, F., van Uden, A., & Peperzak, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.01341 · Cited by 9
Heming, C. A. M., Abdalla, M., Mohanna, S., Ahluwalia, M., Zhang, L., Trivedi, H., Woo, M., Fine, B., Gichoya, J. W., Celi, L. A., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.12560 · Cited by 9
Self-citationGhosh, A., Jain, R., Jhangra, A., Saha, S., & Jatowt, A. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70045 · Cited by 8
Salutari, F., Ramos, J., Rahmani, H. A., Linguaglossa, L., & Lipani, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_42 · Cited by 8
ID-XCB: Data-Independent Debiasing for Fair and Accurate Transformer-Based Cyberbullying Detection
Yi, P., & Zubiaga, A. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35924 · Cited by 8
Glider: Global and Local Instruction-Driven Expert Router
Li, P., Yadav, P., Yoon, J., Peng, J., Sung, Y.-L., Bansal, M., & Chen, T. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.319 · Cited by 8
Clinical Artificial Intelligence
McDermott, M. B. A., Nestor, B., & Szolovits, P. (2022) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2022.09.004 · Cited by 7
Self-citationRacial Skew in Fine-Tuned Legal AI Language Models
Malic, V. Q., Kumari, A., & Liu, X. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00037 · Cited by 7
(Un)fairness in Post-operative Complication Prediction ModelsPreprint
Tripathi, S., Fritz, B. A., Abdelhack, M., Avidan, M. S., Chen, Y., & King, C. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02036 · Cited by 7
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN
Ovalle, A., Dev, S., Zhao, J., Sarrafzadeh, M., & Chang, K.-W. (2023) · Studies in computational intelligence · doi:10.1007/978-3-031-36938-4_10 · Cited by 7
Gray, M., & Wu, L. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03102-8 · Cited by 7
Multimodal models for skin cancer classification using clinical freetext and dermatoscopic images
Watson, M., Winterbottom, T. M., Hudson, G. T., Jones, B., Shum, H. P. H., Atapour-Abarghouei, A., Breckon, T. P., King, J. H., & Moubayed, N. A. (2026) · Communications Medicine · doi:10.1038/s43856-026-01456-2 · Cited by 6
MSA K-BERT: A Method for Medical Text Intent Classification
Yuan, Y., & Xi, G. (2025) · Applied Sciences · doi:10.3390/app15126834 · Cited by 6
XAI for In-hospital Mortality Prediction via Multimodal ICU DataPreprint
Li, X., Gu, J., Wang, Z., Yuan, Y., Du, B., & He, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.17624 · Cited by 6
Moukheiber, M., Moukheiber, L., Moukheiber, D., & Lee, H. (2024) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/821 · Cited by 6
Agmon, S., Singer, U., & Radinsky, K. (2024) · JMIR AI · doi:10.2196/49546 · Cited by 5
Hidden in Plain Sight: Undetectable Adversarial Bias Attacks on Vulnerable Patient PopulationsPreprint
Kulkarni, P., Chan, A., Navarathna, N., Chan, S., Yi, P. H., & Parekh, V. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.05713 · Cited by 5
EQUITRIAGE: A Fairness Audit of Gender Bias in LLM-Based Emergency Department TriagePreprint
Young, R. J., & Matthews, A. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.03998 · Cited by 5
Stars, Stripes, and Silicon: Unravelling the ChatGPT’s All-American, Monochrome, Cis-centric Bias
Torrielli, F. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_19 · Cited by 4
debiaSAE: Benchmarking and Mitigating Vision-Language Model BiasPreprint
Sasse, K., Chen, S., Pond, J., Bitterman, D. S., & Osborne, J. D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.13146 · Cited by 4
Reliable and Responsible Foundation Models: A Comprehensive Survey
Yang, X., Han, J., Bommasani, R., Luo, J., Qu, W., Zhou, W., Bibi, A., Wang, X., Yoon, J., Stengel-Eskin, E., et al. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2602.08145 · Cited by 4
Self-citationUNSEEN BIAS: HOW AI SHAPES RELIGIOUS NARRATIVES IN DIGITAL SPACES
Nurjaman, H., Siregar, A. F. Y., & Yasinta, J. R. E. (2025) · Jurnal Middle East and Islamic Studies (MEIS) · doi:10.7454/meis.v12i2.200 · Cited by 4
A Relational View of Data Work A case study on nurses’ de-biasing practices.
Milbak, T. W., & Benda, N. C. (2025) · Scandinavian Journal of Information Systems · doi:10.17705/3sjis/037.19 · Cited by 4
Towards Fairness in Classifying Medical Conversations into SOAP SectionsPreprint
Ferracane, E., & Konam, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07749 · Cited by 3
The effects of gender bias in word embeddings on depression predictionPreprint
Soğancıoğlu, G., & Kaya, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.07852 · Cited by 3
Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language
Gnadt, K., Thulke, D., Kopeinik, S., & Schlüter, R. (2025) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2025.gebnlp-1.37 · Cited by 3
Large Language Models for Psychological Assessment: A Comprehensive OverviewPreprint
Brickman, J., Gupta, M., & Oltmanns, J. R. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qm9ae_v1 · Cited by 3
Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection BiasPreprint
Ulichney, A., & Coston, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.14506 · Cited by 3
Imputation Strategies Under Clinical Presence: Impact on Algorithmic FairnessPreprint
Jeanselme, V., De‐Arteaga, M., Zhang, Z., Barrett, J., & Tom, B. D. M. (2022) · arXiv (Cornell University) · doi:10.17863/cam.92891 · Cited by 3
Rodrigues, D. D., & Recamonde‐Mendoza, M. (2025) · doi:10.5753/sbcas.2025.7143 · Cited by 2
Yoo, S., Jeong, M., Seomun, S., Kim, K., & Han, Y. (2024) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3368046 · Cited by 2
Practical Considerations For the Deployment of Clinical NLP Systems
Lehman, E. (2024) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2
Transferring Fairness using Multi-Task Learning with Limited Demographic Information
Aguirre, C. A., & Dredze, M. H. (2024) · Workshop on NLP for Positive Impact (NLP4PI) · doi:10.18653/v1/2024.nlp4pi-1.3 · Cited by 2
Walk, O. J. B. D., Pichon, A., Nieva, H. R., Sun, T., Altosaar, J., Natarajan, K., Perotte, A., Tarczy-Hornoch, P. Z., Demner‐Fushman, D., & Elhadad, N. (2023) · PubMed Central · Cited by 2
Context-Aware Discrimination Detection in Job Vacancies using Computational Language ModelsPreprint
Vethman, S., Adhikari, A., de Boer, M. H. T., van Genabeek, J. A. G. M., & Veenman, C. J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.03907 · Cited by 2
Chistruga, A. (2024) · ANALELE ȘTIINŢIFICE ALE UNIVERSITĂŢII „ALEXANDRU IOAN CUZA” DIN IAȘI (SERIE NOUĂ) ȘTIINŢE JURIDICE · doi:10.47743/jss-2024-70-2-3 · Cited by 2
Transforming Patient Feedback into Action: An AI-Powered Intelligent Hospital System
Esfahani, S. M. P. M. (2024) · TSpace (University of Toronto) · Cited by 2
Li, P., Zhang, X., Hu, X., Lin, Z., & Zhou, D. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag317 · Cited by 1
Towards Responsible Multimodal Modeling for Mental Healthcare
Kaya, H., & Soğancıoğlu, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-07956-5_1 · Cited by 1
Hendrix, N., Parikh, R., Taskier, M., Walter, G., Phillips, R. L., & Rehkopf, D. H. (2025) · American Journal of Epidemiology · doi:10.1093/aje/kwaf162 · Cited by 1
Elucidating mechanisms of demographic bias in LLMs for healthcare
Ahsan, H., Sen Sharma, A., Amir, S., Bau, D., & Wallace, B. C. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.789 · Cited by 1
Trustworthiness in Vision-Language Models
Vu, K., & Lai, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6389-7_7 · Cited by 1
Künstliche Intelligenz in der Medizin: Wo stehen wir heute, und was liegt vor uns?
García-Agúndez, A., & Eickhoff, C. (2024) · Zeitschrift für Herz- Thorax- und Gefäßchirurgie · doi:10.1007/s00398-024-00664-z · Cited by 1
Artificial intelligence and medicine: Mounting risks amid the promise
Nelson, B., & Faquin, W. C. (2023) · Cancer Cytopathology · doi:10.1002/cncy.22739 · Cited by 1
Satisfying Model Validity for Robust Clinical Machine Learning for Time-Series
Nestor, B. (2023) · TSpace (University of Toronto) · Cited by 1
CaTE Data Curation for Trustworthy AIPreprint
Clemens-Sewall, M. V., Cervantes, C. M., Rafkin, E., Otte, J. N., Magelinski, T., Lewis, L., Liu, M., Udwin, D., & Kirkman-Bey, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.14741 · Cited by 1
Investigating Stigmatizing Language in Clinical Documentation with Open-Source Large Language Models
Dahal, R., Hosseinpour, P., Kamishetty, P., Pamulaparthy, S., Tizpaz-Niari, S., & Parde, N. (2026) · doi:10.18653/v1/2026.bionlp-1.39 · Cited by 1
The Point of View of a Sentiment: Towards Clinician Bias Detection in Psychiatric Notes
Valentine, A. A., Lepow, L., Chan, L., Charney, A. W., & Landi, I. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2dxaipemahpd · Cited by 1
Uncovering Bias in Personal InformaticsPreprint
Yfantidou, S., Sermpezis, P., Vakali, A. I., & Baeza-Yates, R. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8113035 · Cited by 1
Automatic Anonymization of Clinical Text: a study on emerging techniques and evaluation methods
Ribeiro, R. A. P. (2023) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 1
Exploring Gender Bias in Large Language Models: An In-depth Dive into the German LanguagePreprint
Gnadt, K., Thulke, D., Kopeinik, S., & Schlüter, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.16557 · Cited by 1
On Harmonizing Implicit Subpopulations
Hong, F., Yao, J., LYU, Y., Zhou, Z., Tsang, I., Zhang, Y., & Wang, Y. (2024) · International Conference on Learning Representations · Cited by 1
Innovation and ethics in software engineering and internet computing
Nigsch, K. (2025) · reposiTUm (TU Wien) · doi:10.34726/hss.2025.77500 · Cited by 1
McInerney, D. J. (2024) · Digital Repository Service (Northeastern University) · doi:10.17760/d20653001
PLeDO: Pain level detection for osteoarthritis from EMR data
Chen, Y., Cai, J., Sadman, N., Zulkernine, F. H., Queenan, J. A., & Barber, D. (2026) · Intelligent Data Analysis · doi:10.1177/1088467x261472133
Grach, S., Badawi, A., Ahmad, F., & Dolatabadi, E. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105077
Fairness in federated medical imaging: a systematic review through the dual fairness lens
Yu, P., Dong, Z., Dhelim, S., Feng, C.-M., & Kechadi, T. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11632-4
Rethinking Software Ethics in the Age of Artificial Intelligence
Nigsch, K. (2026) · Studies in applied philosophy, epistemology and rational ethics · doi:10.1007/978-3-032-31732-2_7
Liu, W., Qu, B., Xiong, J., Ni, C., Malin, B., & Yin, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.26433
Saurav Aryal, Okunji, P. O., Shara, N. M., Libin, A., Jackson, A. D., Laurence, B., Ferguson, E. S., Washington, G. J., & Burge, L. (2024) · American Public Health Association eBooks · doi:10.2105/9780875533476ch12
FairCareNLP: An AI-driven patient review analyzer for healthcare
Esfahani, S. M. P. M., Seeman, D., Dharma, C., Noaeen, M., Guha, S., & Abad, Z. S. H. (2026) · PLoS ONE · doi:10.1371/journal.pone.0337676
Metadata
- Authors
- Zhang, H., Lu, A. X., Abdalla, M., McDermott, M., & Ghassemi, M.
- Affiliations
- University of Toronto (CA)
- Massachusetts Institute of Technology (US)
- Venue
- Proceedings of the ACM Conference on Health, Inference, and Learning
- Publisher
- ACM
- Published
- 2020-04-02
- Pages
- 110-120
- OpenAlex
- W3011762034
- Cited by
- 122
- References
- 38
- Citations by year
- 2026: 8 · 2025: 19 · 2024: 24 · 2023: 22 · 2022: 17 · 2021: 25 · 2020: 7
- FWCI
- 6.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Health, Inference, and Learning (CHIL) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- algorithmic bias, contextual word embeddings, BERT, clinical notes, MIMIC-III, marginalized communities, fairness, clinical prediction, performance gap, gender, language, ethnicity, insurance status, adversarial debiasing, clinical language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.