The DOI matches its DataCite record; 86 of the 88 references it cites were found in a registry or an index, and 1 are not checked yet.
Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Open accessAbstract
As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article investigates the challenges and risks associated with biases in large-scale language models like ChatGPT. We discuss the origins of biases, stemming from, among others, the nature of training data, model specifications, algorithmic constraints, product design, and policy decisions. We explore the ethical concerns arising from the unintended consequences of biased model outputs. We further analyze the potential opportunities to mitigate biases, the inevitability of some biases, and the implications of deploying these models in various applications, such as virtual assistants, content generation, and chatbots. Finally, we review the current approaches to identify, quantify, and mitigate biases in language models, emphasizing the need for a multi-disciplinary, collaborative effort to develop more equitable, transparent, and responsible AI systems. This article aims to stimulate a thoughtful dialogue within the artificial intelligence community, encouraging researchers and developers to reflect on the role of biases in generative language models and the ongoing pursuit of ethical AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, generative conversational AI may also expose users to undesirable consequences, such as biases, misinformation, and manipulation (Brandtzaeg, et al. , 2022; Ferrara, 2023).”
From Why do people use ChatGPT? Exploring user motivations for generative conversational AI (2024) · cites this paper as Ferrara, 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This may be particularly true if generative conversational AI lacks domain-specific knowledge and usable and transparent verification mechanisms, leading to unintended consequences of biased or misinformed model outputs (Ferrara, 2023).”
From Why do people use ChatGPT? Exploring user motivations for generative conversational AI (2024) · cites this paper as Ferrara, 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“It is well-understood that models trained on human data - such as being pre-trained on human-written text or fine-tuned on human feedback - can exhibit human biases.”
From Multi-Agent Risks from Advanced AI (2025) · cites this paper as Ferrara, 2023
The cited source says what the claim attributes to it.
In the citing paper
“These range from parroting harmful stereotypes and misconceptions about certain social groups (Bianchi et al. 2023;Ferrara 2023)”
From Epistemic Injustice in Generative AI (2024) · cites this paper as Ferrara 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Corsaro, W. A., & Bourdieu, P. (1992) · Social Forces · doi:10.2307/2579985 · Cited by 9,968
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Research works printed but not linked: 5
- D.K. Citron and F. Pasquale, 2014. "The scored society: Due process for automated predictions," Washington Law Review, volume 89, number 1, pp. 1-33, and at https://digitalcommons.law.uw.edu/wlr/vol89/iss1/2/, accessed 27 October 2023.
- S. Dev and J.M. Phillips, 2019. "Attenuating bias in word vectors," Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, pp. 879-887, and at https://proceedings.mlr.press/v89/dev19a.html, accessed 27 October 2023.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, and I. Polosukhin, 2017. "Attention is all you need," Advances in Neural Information Processing Systems, volume 30, at https://papers.nips.cc/paper_files/paper/2017, accessed 27 October 2023.
- B.L. Whorf, 1964. Language, thought, and reality: Selected Writings of Benjamin Lee Whorf. Edited by John B. Carroll. Cambridge, Mass.: MIT Press.
- R. Zellers, A. Holtzman, H. Rashkin, Y. Bisk, A. Farhadi, F. Roesner, and Y. Choi, 2019. "Defending against neural fake news," ANIPS'19: Proceedings of the 33rd International Conference on Neural Information Processing Systems, article number 812, pp. 9,054-9,065.
Cited by
Sorted by citations
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
Ferrara, E. (2023) · Sci · doi:10.3390/sci6010003 · Cited by 875
Self-citationChatGPT: Jack of all trades, master of none
Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D., Baran, J., Bielaniewicz, J., Gruza, M., Janz, A., Kanclerz, K., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101861 · Cited by 758
Generative artificial intelligence
Banh, L., & Strobel, G. (2023) · Electronic Markets · doi:10.1007/s12525-023-00680-1 · Cited by 879
Bias and Fairness in Large Language Models: A Survey
Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 1,245
A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical UsagePreprint
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v1 · Cited by 475
Haltaufderheide, J., & Ranisch, R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01157-x · Cited by 396
Cultural bias and cultural alignment of large language models
Tao, Y., Viberg, O., Baker, R. S., & Kizilcec, R. F. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae346 · Cited by 383
Ferrara, E. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00250-1 · Cited by 296
Self-citationGenerative AI in Higher Education: The ChatGPT Effect
Chan, C. K. Y., & Colloton, T. (2024) · Routledge · doi:10.4324/9781003459026 · Cited by 203
Factuality challenges in the era of large language models and opportunities for fact-checking
Augenstein, I., Baldwin, T., Cha, M., Chakraborty, T., Ciampaglia, G. L., Corney, D., DiResta, R., Ferrara, E., Hale, S., Halevy, A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00881-z · Cited by 187
Self-citationSurvey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods
Cao, Y., Zhao, H., Cheng, Y., Shu, T., Chen, Y., Liu, G., Liang, G., Zhao, J., Yan, J., & Li, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3497992 · Cited by 174
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 193
Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
Subramonyam, H., Pea, R. D., Pondoc, C., Agrawala, M., & Seifert, C. M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642754 · Cited by 247
The Butterfly Effect in artificial intelligence systems: Implications for AI bias and fairness
Ferrara, E. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100525 · Cited by 178
Self-citationChatGPT is a Remarkable Tool—For Experts
Azaria, A., Azoulay, R., & Reches, S. (2023) · Data Intelligence · doi:10.1162/dint_a_00235 · Cited by 184
Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond
Nasir, S., Khan, R. A., & Bai, S. (2024) · IEEE Access · doi:10.1109/access.2024.3369912 · Cited by 152
A comprehensive survey of large language models and multimodal large language models in medicine
Xiao, H., Zhou, F., Liu, X., Liu, T., Ли, Ж., Liu, X., & Huang, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102888 · Cited by 154
The limitations and ethical considerations of ChatGPT
Hua, S., Jin, S., & Jiang, S. (2024) · Data Intelligence · doi:10.1162/dint_a_00243 · Cited by 120
Ferrara, E. (2024) · Sensors · doi:10.3390/s24155045 · Cited by 126
Self-citationWhy do people use ChatGPT? Exploring user motivations for generative conversational AI
Skjuve, M., Brandtzaeg, P. B., & Følstad, A. (2024) · First Monday · doi:10.5210/fm.v29i1.13541 · Cited by 95
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741 · Cited by 111
Emergent social conventions and collective bias in LLM populations
Ashery, A. F., Aiello, L. M., & Baronchelli, A. (2025) · Science Advances · doi:10.1126/sciadv.adu9368 · Cited by 81
Abramski, K., Citraro, S., Lombardi, L., Rossetti, G., & Stella, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7030124 · Cited by 81
An Autoethnographic Case Study of Generative Artificial Intelligence's Utility for Accessibility
Glazko, K. S., Yamagami, M., Desai, A., Mack, K. A., Potluri, V., Xu, X., & Mankoff, J. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3614548 · Cited by 80
Shamsuddinova, S., Heryani, P., & Naval, M. A. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102326 · Cited by 80
Madrid-García, A., Rosales, Z., Freites, D., Pérez-Sancristóbal, I., Pato-Cour, E., Plasencia‐Rodríguez, C., Osorio, L. C., Abásolo, L., León, L., Fernández‐Gutiérrez, B., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-49483-6 · Cited by 81
Epistemic Injustice in Generative AI
Kay, J., Kasirzadeh, A., & Mohamed, S. (2024) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v7i1.31671 · Cited by 76
RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs
Chaudhari, S., Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K., Deshpande, A., & Castro da Silva, B. (2026) · ACM Computing Surveys · doi:10.1145/3743127 · Cited by 92
Large language models for life cycle assessments: Opportunities, challenges, and risks
Preuss, N., Alshehri, A. S., & You, F. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.142824 · Cited by 71
Unveiling the Dark Side of ChatGPT: Exploring Cyberattacks and Enhancing User Awareness
Alawida, M., Shawar, B. A., Abiodun, O. I., Mehmood, A., Omolara, A. E., & Hwaitat, A. K. A. (2024) · Information · doi:10.3390/info15010027 · Cited by 82
Florido‐Benítez, L. (2024) · International Journal of Tourism Cities · doi:10.1108/ijtc-05-2024-0111 · Cited by 71
Yang, H., Li, M., Zhou, H., Xiao, Y., Fang, Q., Zhou, S., & Zhang, R. (2025) · Journal of Medical Internet Research · doi:10.2196/70080 · Cited by 82
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63
GIScience in the era of Artificial Intelligence: a research agenda towards Autonomous GIS
Li, Z., Ning, H., Gao, S., Janowicz, K., Li, W., Arundel, S. T., Yang, C. P., Bhaduri, B., Wang, S., Zhu, A.-X., et al. (2025) · Annals of GIS · doi:10.1080/19475683.2025.2552161 · Cited by 78
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v3 · Cited by 71
Evaluating Contextually Personalized Programming Exercises Created with Generative AI
Logacheva, E., Hellas, A., Prather, J. E., Sarsa, S., & Leinonen, J. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671103 · Cited by 85
Large language models in biomedicine and healthcare
Zhou, J., Li, H., Chen, S., Chen, Z., Han, Z., & Gao, X. (2025) · Yearbook of pediatric endocrinology · doi:10.1038/s44387-025-00047-1 · Cited by 74
Generative AI in Education: Mapping the Research Landscape Through Bibliometric Analysis
Ng, S. L., & Ho, C. (2025) · Information · doi:10.3390/info16080657 · Cited by 64
Liu, X., Wu, J., Shao, A., Shen, W., Ye, P., Wang, Y., Ye, J., Jin, K., & Yang, J. (2024) · Journal of Medical Internet Research · doi:10.2196/51926 · Cited by 52
Ethical Aspects of ChatGPT in Software Engineering Research
Akbar, M. A., Khan, A. A., & Liang, P. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3318183 · Cited by 65
Ali, H., & Aysan, A. F. (2024) · International Journal of Ethics and Systems · doi:10.1108/ijoes-04-2024-0112 · Cited by 56
Xiao, Y., Zhang, T., & He, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37238 · Cited by 61
RetractedRole and challenges of ChatGPT and similar generative artificial intelligence in arts and humanities
Rane, N., & Choudhary, S. (2024) · Studies in Humanities and Education · doi:10.48185/she.v5i1.999 · Cited by 56
Yao, D., Zhang, J., Harris, I. G., & Carlsson, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448041 · Cited by 74
Exploring the Feasibility and Efficacy of ChatGPT3 for Personalized Feedback in Teaching
Naz, I., & Robertson, R. (2024) · The Electronic Journal of e-Learning · doi:10.34190/ejel.22.2.3345 · Cited by 49
Federated and edge learning for large language models
Piccialli, F., Chiaro, D., Qi, P., Bellandi, V., & Damiani, E. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102840 · Cited by 56
On opportunities and challenges of large multimodal foundation models in education
Küchemann, S., Avila, K. E., Dinc, Y., Hortmann, C., Revenga, N., Ruf, V., Stausberg, N., Steinert, S., Fischer, F., Fischer, M., et al. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00301-w · Cited by 47
Peer Review in the Age of Generative AI
Kankanhalli, A., & National University of Singapore (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00865 · Cited by 47
Ethical Use of ChatGPT in the Context of Leadership and Strategic Decisions
Basir, A., Puspitasari, E. D., Aristarini, C. C., Sulastri, P. D., & Ausat, A. M. A. (2023) · Jurnal Minfo Polgan · doi:10.33395/jmp.v12i1.12693 · Cited by 51
Large Language Model Supply Chain: A Research Agenda
Wang, S., Zhao, Y., Hou, X., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708531 · Cited by 82
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v2 · Cited by 54
Gupta, N., Khatri, K., Malik, Y., Lakhani, A., Kanwal, A., Aggarwal, S., & Dahuja, A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06592-8 · Cited by 48
Salinas, A., Shah, P., Huang, Y., McCormack, R., & Morstatter, F. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623257 · Cited by 62
Generative AI, learning and new literacies
Chen, S.-Y. (2023) · Journal of Educational Technology Development and Exchange · doi:10.18785/jetde.1602.01 · Cited by 44
The sociolinguistic foundations of language modeling
Grieve, J., Bartl, S., Fuoli, M., Grafmiller, J., Huang, W., Jawerbaum, A., Murakami, A., Perlman, M., Rœmling, D., & Winter, B. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1472411 · Cited by 56
Revisiting the political biases of ChatGPT
Fujimoto, S., & Takemoto, K. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1232003 · Cited by 42
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
Xu, Z., Jiang, F., Niu, L., Jia, J., Lin, B. Y., & Poovendran, R. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.303 · Cited by 40
The impact of artificial intelligence on accounting practices: an academic perspective
Alruwaili, T. F., & Mgammal, M. H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05004-6 · Cited by 40
AI ‐driven circular economy optimization in waste management: A review of current evidence
Olawade, D. B., Yadav, R. N., Ijiwade, J. O., & Wada, O. Z. (2026) · Environmental Progress & Sustainable Energy · doi:10.1002/ep.70322 · Cited by 40
TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties
Kadaoui, K., Magdy, S. M., Waheed, A., Khondaker, M. T. I., El-Shangiti, A. O., Nagoudi, E. M. B., & Abdul-Mageed, M. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.6 · Cited by 46
To use or not to use: exploring the ethical implications of using generative AI in academic writing
Rentier, E. S. (2024) · AI and Ethics · doi:10.1007/s43681-024-00649-6 · Cited by 44
Moon, J., Lee, U., Koh, J., Jeong, Y., Lee, Y., Byun, G., & Lim, J. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09756-z · Cited by 40
Sallam, M., Al-Mahzoum, K., Alshuaib, O., Alhajri, H., Alotaibi, F., Alkhurainej, D., Al-Balwah, M. Y., Barakat, M. M., & Egger, J. (2024) · BMC Infectious Diseases · doi:10.1186/s12879-024-09725-y · Cited by 43
Hadi, M. U., Tashi, Q. A., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2025) · doi:10.36227/techrxiv.23589741.v8 · Cited by 49
KERMIT: Knowledge-EmpoweRed Model In harmful meme deTection
Grasso, B., Gatta, V. L., Moscato, V., & Sperlí, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102269 · Cited by 36
Atreja, S., Ashkinaze, J., Li, L., Mendelsohn, J., & Hemphill, L. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35807 · Cited by 56
Responsible Artificial Intelligence and Journal Publishing
Gregor, S. D. (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00863 · Cited by 33
Evaluating the Artificial Intelligence Performance Growth in Ophthalmic Knowledge
Jiao, C., Edupuganti, N., Patel, P. A., Bui, T., & Sheth, V. S. (2023) · Cureus · doi:10.7759/cureus.45700 · Cited by 33
Rahman, M. A., Alqahtani, L., Albooq, A., & Ainousah, A. (2024) · Learning and Technology Conference (L&T) · doi:10.1109/lt60077.2024.10469434 · Cited by 32
Ghandour, A., Woodford, B. J., & Abusaimeh, H. (2024) · IEEE Access · doi:10.1109/access.2024.3394243 · Cited by 35
The long but necessary road to responsible use of large language models in healthcare research
Kwong, J. C. C., Wang, S., Nickel, G., Cacciamani, G. E., & Kvedar, J. C. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01180-y · Cited by 32
Seger, E., Dreksler, N., Moulange, R., Dardaman, E., Schuett, J., Wei, K., Winter, C., Arnold, M., Ó hÉigeartaigh, S., Korinek, A., et al. (2023) · doi:10.2139/ssrn.4596436 · Cited by 31
The cultural stereotype and cultural bias of ChatGPT
Yuan, H., Che, Z., Zhang, Y., Shao, L. H., Yuan, X., Huang, L., Hu, X., Peng, K., & Luo, S. (2025) · Journal of Pacific Rim Psychology · doi:10.1177/18344909251355673 · Cited by 31
Shen, Y., & Chen, L. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2479141 · Cited by 30
Khorshidi, H., Mohammadi, A., Yousem, D. M., Abolghasemi, J., Ansari, G., Mirza‐Aghazadeh‐Attari, M., Acharya, U. R., & Ardakani, A. A. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101314 · Cited by 31
Giabbanelli, P. J. (2023) · Winter Simulation Conference · doi:10.1109/wsc60868.2023.10408017 · Cited by 39
Konstantis, K., Georgas, A., Faras, A., Georgas, K., & Tympas, A. (2023) · AI and Ethics · doi:10.1007/s43681-023-00312-6 · Cited by 28
Centering health equity in large language model deployment
Singh, N. P., Lawrence, K. S., Richardson, S. I., & Mann, D. M. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000367 · Cited by 29
Aloudat, M. Z., Aboumadi, A., Soliman, A., Al-Mohammed, H. A., Al-Ali, M. S., Mahgoub, A., Barhamgi, M., & Yaacoub, E. E. (2025) · IEEE Access · doi:10.1109/access.2025.3555753 · Cited by 31
Larooij, M., & Törnberg, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11412-6 · Cited by 50
Buldur, M., & Sezer, B. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04358-8 · Cited by 28
Leong, K., & Sung, A. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03660-8 · Cited by 27
Bridging large language model disparities: skill tagging of multilingual educational content
Kwak, Y., & Pardos, Z. A. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13465 · Cited by 25
Salazar, L. R., Peeples, S., & Brooks, M. E. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0831-8.ch010 · Cited by 26
Leveraging foundation and large language models in medical artificial intelligence
Wong, I. N., Monteiro, O., Baptista‐Hon, D. T., Wang, K., Lu, W.-Y., Sun, Z., Nie, S., & Yin, Y. (2024) · Chinese Medical Journal · doi:10.1097/cm9.0000000000003302 · Cited by 27
Timilsina, M., Buosi, S., Razzaq, M. A., Haque, R., Judge, C. S., & Curry, E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109925 · Cited by 27
Surprising gender biases in GPT
Fulgu, R. A., & Capraro, V. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100533 · Cited by 31
AI assistance in enterprise UX design workflows: enhancing design brief creation for designers
Zhu, Z., Lee, H., Pan, Y., & Cai, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1404647 · Cited by 23
The ethical security of large language models: A systematic review
Liu, F., Jiang, J., Lu, Y., Huang, Z., & Jiang, J. (2025) · Frontiers of Engineering Management · doi:10.1007/s42524-025-4082-6 · Cited by 23
Chauhan, A., Khaliq, F., & Nayak, K. R. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00471-z · Cited by 26
An AI-Based Evaluation Framework for Smart Building Integration into Smart City
Shahrabani, M. M. N., & Apanavičienė, R. (2024) · Sustainability · doi:10.3390/su16188032 · Cited by 22
Can GPT-4 learn to analyse moves in research article abstracts?
Yu, D., Bondi, M., & Hyland, K. (2024) · Applied Linguistics · doi:10.1093/applin/amae071 · Cited by 29
Dron, J. (2023) · Digital · doi:10.3390/digital3040020 · Cited by 22
Wikipedia and AI: Access, representation, and advocacy in the age of large language models
McDowell, Z. J. (2024) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565241238924 · Cited by 21
Fairness and social bias quantification in Large Language Models for sentiment analysis
Radaideh, M. I., Kwon, O. H., & Radaideh, M. I. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113569 · Cited by 24
Do-Not-Answer: Evaluating Safeguards in LLMs
Wang, Y., Li, H., Han, X., Nakov, P., & Baldwin, T. (2024) · Findings of the Association for Computational Linguistics: EACL 2024 · doi:10.18653/v1/2024.findings-eacl.61 · Cited by 21
Han, S., & Choi, W. (2025) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2025.51187 · Cited by 27
Metadata
- Authors
- Ferrara, E.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Ferrara, Emilio
- ORCID
- Ferrara, Emilio
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 1396-0458 (ISSN-L)
- arXiv
- 2304.03738
- OpenAlex
- W4388488349
- Cited by
- 282
- References
- 49
- Citations by year
- 2026: 55 · 2025: 77 · 2024: 95 · 2023: 55
- FWCI
- 70.56
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- First Monday (publishedVersion, cc-by-nc-sa)
- SSRN Electronic Journal (acceptedVersion)
- First Monday (acceptedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Viterbi School of Engineering, University of Southern California
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- ChatGPT, large language models, algorithmic bias, bias mitigation, training data bias, ethical AI, generative AI risks, chatbots, virtual assistants, content creation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
