Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Open accessAbstract
As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article investigates the challenges and risks associated with biases in large-scale language models like ChatGPT. We discuss the origins of biases, stemming from, among others, the nature of training data, model specifications, algorithmic constraints, product design, and policy decisions. We explore the ethical concerns arising from the unintended consequences of biased model outputs. We further analyze the potential opportunities to mitigate biases, the inevitability of some biases, and the implications of deploying these models in various applications, such as virtual assistants, content generation, and chatbots. Finally, we review the current approaches to identify, quantify, and mitigate biases in language models, emphasizing the need for a multi-disciplinary, collaborative effort to develop more equitable, transparent, and responsible AI systems. This article aims to stimulate a thoughtful dialogue within the artificial intelligence community, encouraging researchers and developers to reflect on the role of biases in generative language models and the ongoing pursuit of ethical AI.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Generative conversational AI may expose users to undesirable consequences, such as biases, misinformation, and manipulation.
“However, generative conversational AI may also expose users to undesirable consequences, such as biases, misinformation, and manipulation (Brandtzaeg, et al. , 2022; Ferrara, 2023).”
From Why do people use ChatGPT? Exploring user motivations for generative conversational AI (2024) · cites this paper as Ferrara, 2023
Section 5.2 (page unavailable) describes harms from bias in generative language models and says their use in content moderation could amplify harmful content and misinformation. The passages found do not address manipulation of users, so that example is not supported by this source. (LLM, conf=0.85)
Experimental — accuracy not yet measuredModels trained on human data can exhibit human biases.
“It is well-understood that models trained on human data - such as being pre-trained on human-written text or fine-tuned on human feedback - can exhibit human biases.”
From Multi-Agent Risks from Advanced AI (2025) · cites this paper as Ferrara, 2023
Generative AI misuse includes parroting harmful stereotypes and misconceptions about certain social groups.
“These range from parroting harmful stereotypes and misconceptions about certain social groups (Bianchi et al. 2023;Ferrara 2023)”
From Epistemic Injustice in Generative AI (2024) · cites this paper as Ferrara 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Part of this paper’s reference list could not be split into single entries.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · see citing works
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · see citing works
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · see citing works
Corsaro, W. A., & Bourdieu, P. (1992) · Social Forces · doi:10.2307/2579985 · Cited by 9,965 · see citing works
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · see citing works
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611 · see citing works
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · see citing works
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263 · see citing works
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · see citing works
The potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800 · see citing works
A Neural Probabilistic Language Model
Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C., Jaz, K., Hofmann, T., Poggio, T., & Shawe-Taylor, J. S. (2000) · Cited by 3,451 · see citing works
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · see citing works
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · see citing works
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921 · see citing works
Bourdieu, P., & Bourdieu, P. (1991) · Cited by 2,638 · see citing works
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · see citing works
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · see citing works
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · see citing works
(2016) · Cited by 2,334 · see citing works
No Language Left Behind: Scaling Human-Centered Machine TranslationPreprint
Costa-jussà, M., Cross, J., Çelebi, O., Elbayad, M., Heafield, K., Heffernan, K., Kalbassi, E., Lam, J., Licht, D., Maillard, J., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2207.04672 · Cited by 2,176 · see citing works
Individualism and Collectivism
Triandis, H. C. (2018) · Routledge eBooks · doi:10.4324/9780429499845 · Cited by 1,796 · see citing works
(2020) · doi:10.7551/mitpress/12255.001.0001 · Cited by 1,706 · see citing works
Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2020) · Communications of the ACM · doi:10.1145/3381831 · Cited by 1,647 · see citing works
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · see citing works
Review of “Race After Technology: Abolitionist Tools for the New Jim Code”
Jipguep-Akhtar, M. C. (2019) · Social Forces · doi:10.1093/sf/soz162 · Cited by 1,482 · see citing works
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387 · see citing works
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 1,372 · see citing works
How Multilingual is Multilingual BERT?
Pires, T., Schlinger, E., & Garrette, D. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1493 · Cited by 1,351 · see citing works
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264 · see citing works
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177 · see citing works
Word Translation Without Parallel DataPreprint
Conneau, A., Lample, G., Ranzato, M., Denoyer, L., & Jeǵou, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.04087 · Cited by 1,105 · see citing works
Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
Jain, A. (2017) · Business Economics · doi:10.1057/s11369-017-0027-3 · Cited by 1,089 · see citing works
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · see citing works
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890 · see citing works
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884 · see citing works
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · see citing works
Mitigating bias in algorithmic hiring: evaluating claims and practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372828 · Cited by 845 · see citing works
Recommendation of the Council on Artificial Intelligence (OECD)
Yeung, K. (2020) · International Legal Materials · doi:10.1017/ilm.2020.5 · Cited by 824 · see citing works
The Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817 · see citing works
A Network-based End-to-End Trainable Task-oriented Dialogue System
Wen, T.-H., Vandyke, D., Mrkšić, N., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1042 · Cited by 807 · see citing works
Fairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676 · see citing works
Measuring and Mitigating Unintended Bias in Text Classification
Dixon, L., Li, J., Sorensen, J., Thain, N., & Vasserman, L. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278729 · Cited by 674 · see citing works
Learning Deep Transformer Models for Machine Translation
Wang, Q., Li, B., Xiao, T., Zhu, J., Li, C., Wong, D. F., & Chao, L. S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1176 · Cited by 673 · see citing works
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11640 · Cited by 639 · see citing works
Zafar, M. B., Valera, I., Gomez Rodriguez, M., & Gummadi, K. P. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052660 · Cited by 632 · see citing works
Race after technology Abolitionist tools for the new Jim code
Benjamin, R. 1. (2019) · Cited by 578 · see citing works
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569 · see citing works
Expanding Explainability: Towards Social Transparency in AI systems
Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445188 · Cited by 538 · cited 2× · see citing works
“When users and regulators can see that developers are taking steps to ensure the fairness and equity of their models, they may be more likely to trust and adopt these technologies [92, 93].”
BackgroundA Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 512 · see citing works
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501 · see citing works
Mitigating Gender Bias in Natural Language Processing: Literature Review
Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E., Chang, K.-W., & Wang, W. Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1159 · Cited by 492 · see citing works
Ethical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477 · see citing works
The effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448 · see citing works
Should Robots Replace Teachers?: AI and the Future of Education
Selwyn, N. (2019) · Cited by 434 · see citing works
Racial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414 · see citing works
Situating methods in the magic of Big Data and AI
Elish, M. C., & boyd, D. (2017) · Communication Monographs · doi:10.1080/03637751.2017.1375130 · Cited by 414 · see citing works
Fine-Tuning Language Models from Human Preferences
Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., Christiano, P., & Irving, G. (2019) · arXiv · doi:10.48550/arxiv.1909.08593 · Cited by 413 · see citing works
Transparent, explainable, and accountable AI for robotics
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · Science Robotics · doi:10.1126/scirobotics.aan6080 · Cited by 413 · see citing works
Assessing gender bias in machine translation: a case study with Google Translate
Prates, M. O. R., Avelar, P. H., & Lamb, L. C. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04144-6 · Cited by 410 · see citing works
One-step and Two-step Classification for Abusive Language Detection on Twitter
Park, J. H., & Fung, P. (2017) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w17-3006 · Cited by 383 · see citing works
The EU Approach to Ethics Guidelines for Trustworthy Artificial Intelligence
Smuha, N. A. (2019) · Computer Law Review International · doi:10.9785/cri-2019-200402 · Cited by 356 · see citing works
Neural Machine Translation for Low-resource Languages: A Survey
Ranathunga, S., Lee, E.-S. A., Skënduli, M. P., Shekhar, R., Alam, M., & Kaur, R. (2022) · ACM Computing Surveys · doi:10.1145/3567592 · Cited by 348 · see citing works
Bisk, Y., Holtzman, A., Thomason, J., Andreas, J., Bengio, Y., Chai, J. Y., Lapata, M., Lazaridou, A., May, J., Nisnevich, A., et al. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.703 · Cited by 325 · see citing works
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Dettmers, T., Lewis, M., Belkada, Y., & Zettlemoyer, L. (2022) · arXiv · doi:10.48550/arxiv.2208.07339 · Cited by 305 · see citing works
Release Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · see citing works
Paulus, J. K., & Kent, D. M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0304-9 · Cited by 274 · see citing works
Clinical AI: opacity, accountability, responsibility and liability
Smith, H. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01019-6 · Cited by 245 · see citing works
Identifying and Reducing Gender Bias in Word-Level Language Models
Bordia, S., & Bowman, S. R. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop · doi:10.18653/v1/n19-3002 · Cited by 219 · see citing works
Shahriari, K., & Shahriari, M. (2017) · IEEE Canada International Humanitarian Technology Conference · doi:10.1109/ihtc.2017.8058187 · Cited by 209 · see citing works
Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Wu, C., Yin, S., Qi, W., Wang, X., Tang, Z., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2303.04671 · Cited by 197 · see citing works
Factuality challenges in the era of large language models and opportunities for fact-checking
Augenstein, I., Baldwin, T., Cha, M., Chakraborty, T., Ciampaglia, G. L., Corney, D., DiResta, R., Ferrara, E., Hale, S., Halevy, A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00881-z · Cited by 187 · see citing works
Self-citationBotometer 101: social bot practicum for computational social scientists
Yang, K.-C., Ferrara, E., & Menczer, F. (2022) · Journal of Computational Social Science · doi:10.1007/s42001-022-00177-5 · Cited by 159 · see citing works
Self-citationBehind the Screen: Content Moderation in the Shadows of Social Media
Gerrard, Y. (2019) · New Media & Society · doi:10.1177/1461444819878844 · Cited by 157 · see citing works
Machine morality: bottom-up and top-down approaches for modelling human moral faculties
Wallach, W., Allen, C., & Smit, I. (2008) · AI & SOCIETY · doi:10.1007/s00146-007-0099-0 · Cited by 152 · see citing works
Regulate artificial intelligence to avert cyber arms race
Taddeo, M., & Floridi, L. (2018) · Nature · doi:10.1038/d41586-018-04602-6 · Cited by 138 · see citing works
Help wanted: an examination of hiring algorithms, equity, and bias
Bogen, M., & Rieke, A. (2018) · Cited by 138 · see citing works
Behind the Screen: Content Moderation in the Shadows of Social Media
Roberts, S. (2019) · Cited by 133 · see citing works
Fair Class Balancing: Enhancing Model Fairness without Observing Sensitive Attributes
Yan, S., Kao, H.-T., & Ferrara, E. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411980 · Cited by 96 · see citing works
Self-citationIs bigger better? The emergence of big data as a tool for international development policy
Taylor, L., & Schroeder, R. (2014) · GeoJournal · doi:10.1007/s10708-014-9603-5 · Cited by 88 · see citing works
Tackling misinformation: What researchers could do with social media data
Pasquetto, I. V., Swire‐Thompson, B., & Amazeen, M. A. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-49 · Cited by 86 · see citing works
Stoyanovich, J., Howe, B., & Jagadish, H. V. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3415478.3415570 · Cited by 82 · see citing works
Fairness and machine learning limitations and opportunities
Barocas, S., Hardt, M., & Narayanan, A. (n.d.) · Cited by 80 · see citing works
Contextual word representations
Smith, N. A. (2020) · Communications of the ACM · doi:10.1145/3347145 · Cited by 39 · see citing works
Factuality Challenges in the Era of Large Language Models
Augenstein, I., Baldwin, T., Cha, M., Chakraborty, T., Ciampaglia, G. L., Corney, D., DiResta, R., Ferrara, E., Hale, S., Halevy, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.05189 · Cited by 32 · see citing works
Self-citationOverview of the DARPA LORELEI Program
Christianson, C., Duncan, J. D., & Onyshkevych, B. A. (2018) · Machine Translation · doi:10.1007/s10590-017-9212-4 · Cited by 27 · see citing works
Neighbors helping the poor: improving low-resource machine translation using related languages
Pourdamghani, N., & Knight, K. K. (2019) · Machine Translation · doi:10.1007/s10590-019-09236-7 · Cited by 25 · see citing works
Biderman, S., Bicheno, K., & Gao, L. (2022) · arXiv · doi:10.48550/arxiv.2201.07311 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- D.K. Citron and F. Pasquale, 2014. "The scored society: Due process for automated predictions," Washington Law Review, volume 89, number 1, pp. 1-33, and at https://digitalcommons.law.uw.edu/wlr/vol89/iss1/2/, accessed 27 October 2023.
- S. Dev and J.M. Phillips, 2019. "Attenuating bias in word vectors," Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, pp. 879-887, and at https://proceedings.mlr.press/v89/dev19a.html, accessed 27 October 2023.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, and I. Polosukhin, 2017. "Attention is all you need," Advances in Neural Information Processing Systems, volume 30, at https://papers.nips.cc/paper_files/paper/2017, accessed 27 October 2023.
- B.L. Whorf, 1964. Language, thought, and reality: Selected Writings of Benjamin Lee Whorf. Edited by John B. Carroll. Cambridge, Mass.: MIT Press.
- R. Zellers, A. Holtzman, H. Rashkin, Y. Bisk, A. Farhadi, F. Roesner, and Y. Choi, 2019. "Defending against neural fake news," ANIPS'19: Proceedings of the 33rd International Conference on Neural Information Processing Systems, article number 812, pp. 9,054-9,065.
Cited by
Sorted by citations
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 2,842 · see citing works
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 1,409 · see citing works
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970 · see citing works
Ferrara, E. (2023) · Sci · doi:10.3390/sci6010003 · Cited by 875 · see citing works
Self-citationChatGPT: Jack of all trades, master of none
Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D., Baran, J., Bielaniewicz, J., Gruza, M., Janz, A., Kanclerz, K., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101861 · Cited by 758 · see citing works
Generative artificial intelligence
Banh, L., & Strobel, G. (2023) · Electronic Markets · doi:10.1007/s12525-023-00680-1 · Cited by 722 · see citing works
Bias and Fairness in Large Language Models: A Survey
Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 665 · see citing works
A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical UsagePreprint
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v1 · Cited by 429 · see citing works
Haltaufderheide, J., & Ranisch, R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01157-x · Cited by 396 · see citing works
Cultural bias and cultural alignment of large language models
Tao, Y., Viberg, O., Baker, R. S., & Kizilcec, R. F. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae346 · Cited by 383 · see citing works
Ferrara, E. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00250-1 · Cited by 296 · see citing works
Self-citationGenerative AI in Higher Education: The ChatGPT Effect
Chan, C. K. Y., & Colloton, T. (2024) · Routledge · doi:10.4324/9781003459026 · Cited by 203 · see citing works
Factuality challenges in the era of large language models and opportunities for fact-checking
Augenstein, I., Baldwin, T., Cha, M., Chakraborty, T., Ciampaglia, G. L., Corney, D., DiResta, R., Ferrara, E., Hale, S., Halevy, A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00881-z · Cited by 187 · see citing works
Self-citationSurvey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods
Cao, Y., Zhao, H., Cheng, Y., Shu, T., Chen, Y., Liu, G., Liang, G., Zhao, J., Yan, J., & Li, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3497992 · Cited by 174 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 173 · see citing works
Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
Subramonyam, H., Pea, R. D., Pondoc, C., Agrawala, M., & Seifert, C. M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642754 · Cited by 169 · see citing works
The Butterfly Effect in artificial intelligence systems: Implications for AI bias and fairness
Ferrara, E. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100525 · Cited by 160 · see citing works
Self-citationChatGPT is a Remarkable Tool—For Experts
Azaria, A., Azoulay, R., & Reches, S. (2023) · Data Intelligence · doi:10.1162/dint_a_00235 · Cited by 157 · see citing works
Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond
Nasir, S., Khan, R. A., & Bai, S. (2024) · IEEE Access · doi:10.1109/access.2024.3369912 · Cited by 152 · see citing works
A comprehensive survey of large language models and multimodal large language models in medicine
Xiao, H., Zhou, F., Liu, X., Liu, T., Ли, Ж., Liu, X., & Huang, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102888 · Cited by 130 · see citing works
The limitations and ethical considerations of ChatGPT
Hua, S., Jin, S., & Jiang, S. (2024) · Data Intelligence · doi:10.1162/dint_a_00243 · Cited by 120 · see citing works
Ferrara, E. (2024) · Sensors · doi:10.3390/s24155045 · Cited by 116 · see citing works
Self-citationWhy do people use ChatGPT? Exploring user motivations for generative conversational AI
Skjuve, M., Brandtzaeg, P. B., & Følstad, A. (2024) · First Monday · doi:10.5210/fm.v29i1.13541 · Cited by 95 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741 · Cited by 88 · see citing works
Emergent social conventions and collective bias in LLM populations
Ashery, A. F., Aiello, L. M., & Baronchelli, A. (2025) · Science Advances · doi:10.1126/sciadv.adu9368 · Cited by 81 · see citing works
Abramski, K., Citraro, S., Lombardi, L., Rossetti, G., & Stella, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7030124 · Cited by 81 · see citing works
An Autoethnographic Case Study of Generative Artificial Intelligence's Utility for Accessibility
Glazko, K. S., Yamagami, M., Desai, A., Mack, K. A., Potluri, V., Xu, X., & Mankoff, J. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3614548 · Cited by 80 · see citing works
Shamsuddinova, S., Heryani, P., & Naval, M. A. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102326 · Cited by 80 · see citing works
Madrid-García, A., Rosales, Z., Freites, D., Pérez-Sancristóbal, I., Pato-Cour, E., Plasencia‐Rodríguez, C., Osorio, L. C., Abásolo, L., León, L., Fernández‐Gutiérrez, B., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-49483-6 · Cited by 77 · see citing works
Epistemic Injustice in Generative AI
Kay, J., Kasirzadeh, A., & Mohamed, S. (2024) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v7i1.31671 · Cited by 76 · see citing works
RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs
Chaudhari, S., Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K., Deshpande, A., & Castro da Silva, B. (2026) · ACM Computing Surveys · doi:10.1145/3743127 · Cited by 92 · see citing works
Large language models for life cycle assessments: Opportunities, challenges, and risks
Preuss, N., Alshehri, A. S., & You, F. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.142824 · Cited by 71 · see citing works
Unveiling the Dark Side of ChatGPT: Exploring Cyberattacks and Enhancing User Awareness
Alawida, M., Shawar, B. A., Abiodun, O. I., Mehmood, A., Omolara, A. E., & Hwaitat, A. K. A. (2024) · Information · doi:10.3390/info15010027 · Cited by 69 · see citing works
Florido‐Benítez, L. (2024) · International Journal of Tourism Cities · doi:10.1108/ijtc-05-2024-0111 · Cited by 67 · see citing works
Yang, H., Li, M., Zhou, H., Xiao, Y., Fang, Q., Zhou, S., & Zhang, R. (2025) · Journal of Medical Internet Research · doi:10.2196/70080 · Cited by 64 · see citing works
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63 · see citing works
GIScience in the era of Artificial Intelligence: a research agenda towards Autonomous GIS
Li, Z., Ning, H., Gao, S., Janowicz, K., Li, W., Arundel, S. T., Yang, C. P., Bhaduri, B., Wang, S., Zhu, A.-X., et al. (2025) · Annals of GIS · doi:10.1080/19475683.2025.2552161 · Cited by 63 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v3 · Cited by 62 · see citing works
Evaluating Contextually Personalized Programming Exercises Created with Generative AI
Logacheva, E., Hellas, A., Prather, J. E., Sarsa, S., & Leinonen, J. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671103 · Cited by 63 · see citing works
Large language models in biomedicine and healthcare
Zhou, J., Li, H., Chen, S., Chen, Z., Han, Z., & Gao, X. (2025) · npj Artificial Intelligence · doi:10.1038/s44387-025-00047-1 · Cited by 61 · see citing works
Generative AI in Education: Mapping the Research Landscape Through Bibliometric Analysis
Ng, S. L., & Ho, C. (2025) · Information · doi:10.3390/info16080657 · Cited by 56 · see citing works
Liu, X., Wu, J., Shao, A., Shen, W., Ye, P., Wang, Y., Ye, J., Jin, K., & Yang, J. (2024) · Journal of Medical Internet Research · doi:10.2196/51926 · Cited by 52 · see citing works
Ethical Aspects of ChatGPT in Software Engineering Research
Akbar, M. A., Khan, A. A., & Liang, P. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3318183 · Cited by 52 · see citing works
Ali, H., & Aysan, A. F. (2024) · International Journal of Ethics and Systems · doi:10.1108/ijoes-04-2024-0112 · Cited by 52 · see citing works
Xiao, Y., Zhang, T., & He, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37238 · Cited by 52 · see citing works
RetractedRole and challenges of ChatGPT and similar generative artificial intelligence in arts and humanities
Rane, N., & Choudhary, S. (2024) · Studies in Humanities and Education · doi:10.48185/she.v5i1.999 · Cited by 51 · see citing works
Yao, D., Zhang, J., Harris, I. G., & Carlsson, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448041 · Cited by 51 · see citing works
Exploring the Feasibility and Efficacy of ChatGPT3 for Personalized Feedback in Teaching
Naz, I., & Robertson, R. (2024) · The Electronic Journal of e-Learning · doi:10.34190/ejel.22.2.3345 · Cited by 49 · see citing works
Federated and edge learning for large language models
Piccialli, F., Chiaro, D., Qi, P., Bellandi, V., & Damiani, E. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102840 · Cited by 49 · see citing works
On opportunities and challenges of large multimodal foundation models in education
Küchemann, S., Avila, K. E., Dinc, Y., Hortmann, C., Revenga, N., Ruf, V., Stausberg, N., Steinert, S., Fischer, F., Fischer, M., et al. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00301-w · Cited by 47 · see citing works
Peer Review in the Age of Generative AI
Kankanhalli, A., & National University of Singapore (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00865 · Cited by 47 · see citing works
Ethical Use of ChatGPT in the Context of Leadership and Strategic Decisions
Basir, A., Puspitasari, E. D., Aristarini, C. C., Sulastri, P. D., & Ausat, A. M. A. (2023) · Jurnal Minfo Polgan · doi:10.33395/jmp.v12i1.12693 · Cited by 47 · see citing works
Large Language Model Supply Chain: A Research Agenda
Wang, S., Zhao, Y., Hou, X., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708531 · Cited by 47 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v2 · Cited by 47 · see citing works
Gupta, N., Khatri, K., Malik, Y., Lakhani, A., Kanwal, A., Aggarwal, S., & Dahuja, A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06592-8 · Cited by 46 · see citing works
Salinas, A., Shah, P., Huang, Y., McCormack, R., & Morstatter, F. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623257 · Cited by 45 · see citing works
Generative AI, learning and new literacies
Chen, S.-Y. (2023) · Journal of Educational Technology Development and Exchange · doi:10.18785/jetde.1602.01 · Cited by 44 · see citing works
The sociolinguistic foundations of language modeling
Grieve, J., Bartl, S., Fuoli, M., Grafmiller, J., Huang, W., Jawerbaum, A., Murakami, A., Perlman, M., Rœmling, D., & Winter, B. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1472411 · Cited by 45 · see citing works
Revisiting the political biases of ChatGPT
Fujimoto, S., & Takemoto, K. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1232003 · Cited by 42 · see citing works
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
Xu, Z., Jiang, F., Niu, L., Jia, J., Lin, B. Y., & Poovendran, R. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.303 · Cited by 40 · see citing works
The impact of artificial intelligence on accounting practices: an academic perspective
Alruwaili, T. F., & Mgammal, M. H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05004-6 · Cited by 40 · see citing works
AI ‐driven circular economy optimization in waste management: A review of current evidence
Olawade, D. B., Yadav, R. N., Ijiwade, J. O., & Wada, O. Z. (2026) · Environmental Progress & Sustainable Energy · doi:10.1002/ep.70322 · Cited by 40 · see citing works
TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties
Kadaoui, K., Magdy, S. M., Waheed, A., Khondaker, M. T. I., El-Shangiti, A. O., Nagoudi, E. M. B., & Abdul-Mageed, M. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.6 · Cited by 39 · see citing works
To use or not to use: exploring the ethical implications of using generative AI in academic writing
Rentier, E. S. (2024) · AI and Ethics · doi:10.1007/s43681-024-00649-6 · Cited by 21 · see citing works
Moon, J., Lee, U., Koh, J., Jeong, Y., Lee, Y., Byun, G., & Lim, J. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09756-z · Cited by 36 · see citing works
Sallam, M., Al-Mahzoum, K., Alshuaib, O., Alhajri, H., Alotaibi, F., Alkhurainej, D., Al-Balwah, M. Y., Barakat, M. M., & Egger, J. (2024) · BMC Infectious Diseases · doi:10.1186/s12879-024-09725-y · Cited by 36 · see citing works
Hadi, M. U., Tashi, Q. A., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2025) · doi:10.36227/techrxiv.23589741.v8 · Cited by 36 · see citing works
KERMIT: Knowledge-EmpoweRed Model In harmful meme deTection
Grasso, B., Gatta, V. L., Moscato, V., & Sperlí, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102269 · Cited by 34 · see citing works
Atreja, S., Ashkinaze, J., Li, L., Mendelsohn, J., & Hemphill, L. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35807 · Cited by 34 · see citing works
Responsible Artificial Intelligence and Journal Publishing
Gregor, S. D. (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00863 · Cited by 33 · see citing works
Evaluating the Artificial Intelligence Performance Growth in Ophthalmic Knowledge
Jiao, C., Edupuganti, N., Patel, P. A., Bui, T., & Sheth, V. S. (2023) · Cureus · doi:10.7759/cureus.45700 · Cited by 32 · see citing works
Rahman, M. A., Alqahtani, L., Albooq, A., & Ainousah, A. (2024) · Learning and Technology Conference (L&T) · doi:10.1109/lt60077.2024.10469434 · Cited by 32 · see citing works
Ghandour, A., Woodford, B. J., & Abusaimeh, H. (2024) · IEEE Access · doi:10.1109/access.2024.3394243 · Cited by 32 · see citing works
The long but necessary road to responsible use of large language models in healthcare research
Kwong, J. C. C., Wang, S., Nickel, G., Cacciamani, G. E., & Kvedar, J. C. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01180-y · Cited by 32 · see citing works
Seger, E., Dreksler, N., Moulange, R., Dardaman, E., Schuett, J., Wei, K., Winter, C., Arnold, M., Ó hÉigeartaigh, S., Korinek, A., et al. (2023) · doi:10.2139/ssrn.4596436 · Cited by 31 · see citing works
The cultural stereotype and cultural bias of ChatGPT
Yuan, H., Che, Z., Zhang, Y., Shao, L. H., Yuan, X., Huang, L., Hu, X., Peng, K., & Luo, S. (2025) · Journal of Pacific Rim Psychology · doi:10.1177/18344909251355673 · Cited by 31 · see citing works
Shen, Y., & Chen, L. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2479141 · Cited by 30 · see citing works
Khorshidi, H., Mohammadi, A., Yousem, D. M., Abolghasemi, J., Ansari, G., Mirza‐Aghazadeh‐Attari, M., Acharya, U. R., & Ardakani, A. A. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101314 · Cited by 30 · see citing works
Giabbanelli, P. J. (2023) · Winter Simulation Conference · doi:10.1109/wsc60868.2023.10408017 · Cited by 30 · see citing works
Konstantis, K., Georgas, A., Faras, A., Georgas, K., & Tympas, A. (2023) · AI and Ethics · doi:10.1007/s43681-023-00312-6 · Cited by 28 · see citing works
Centering health equity in large language model deployment
Singh, N. P., Lawrence, K. S., Richardson, S. I., & Mann, D. M. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000367 · Cited by 28 · see citing works
Aloudat, M. Z., Aboumadi, A., Soliman, A., Al-Mohammed, H. A., Al-Ali, M. S., Mahgoub, A., Barhamgi, M., & Yaacoub, E. E. (2025) · IEEE Access · doi:10.1109/access.2025.3555753 · Cited by 27 · see citing works
Larooij, M., & Törnberg, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11412-6 · Cited by 27 · see citing works
Buldur, M., & Sezer, B. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04358-8 · Cited by 27 · see citing works
Leong, K., & Sung, A. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03660-8 · Cited by 27 · see citing works
Bridging large language model disparities: skill tagging of multilingual educational content
Kwak, Y., & Pardos, Z. A. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13465 · Cited by 25 · see citing works
Salazar, L. R., Peeples, S., & Brooks, M. E. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0831-8.ch010 · Cited by 25 · see citing works
Leveraging foundation and large language models in medical artificial intelligence
Wong, I. N., Monteiro, O., Baptista‐Hon, D. T., Wang, K., Lu, W.-Y., Sun, Z., Nie, S., & Yin, Y. (2024) · Chinese Medical Journal · doi:10.1097/cm9.0000000000003302 · Cited by 25 · see citing works
Timilsina, M., Buosi, S., Razzaq, M. A., Haque, R., Judge, C. S., & Curry, E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109925 · Cited by 25 · see citing works
Surprising gender biases in GPT
Fulgu, R. A., & Capraro, V. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100533 · Cited by 24 · see citing works
AI assistance in enterprise UX design workflows: enhancing design brief creation for designers
Zhu, Z., Lee, H., Pan, Y., & Cai, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1404647 · Cited by 23 · see citing works
The ethical security of large language models: A systematic review
Liu, F., Jiang, J., Lu, Y., Huang, Z., & Jiang, J. (2025) · Frontiers of Engineering Management · doi:10.1007/s42524-025-4082-6 · Cited by 23 · see citing works
Chauhan, A., Khaliq, F., & Nayak, K. R. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00471-z · Cited by 23 · see citing works
An AI-Based Evaluation Framework for Smart Building Integration into Smart City
Shahrabani, M. M. N., & Apanavičienė, R. (2024) · Sustainability · doi:10.3390/su16188032 · Cited by 22 · see citing works
Can GPT-4 learn to analyse moves in research article abstracts?
Yu, D., Bondi, M., & Hyland, K. (2024) · Applied Linguistics · doi:10.1093/applin/amae071 · Cited by 22 · see citing works
Dron, J. (2023) · Digital · doi:10.3390/digital3040020 · Cited by 22 · see citing works
Wikipedia and AI: Access, representation, and advocacy in the age of large language models
McDowell, Z. J. (2024) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565241238924 · Cited by 21 · see citing works
Fairness and social bias quantification in Large Language Models for sentiment analysis
Radaideh, M. I., Kwon, O. H., & Radaideh, M. I. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113569 · Cited by 21 · see citing works
Do-Not-Answer: Evaluating Safeguards in LLMs
Wang, Y., Li, H., Han, X., Nakov, P., & Baldwin, T. (2024) · Findings of the Association for Computational Linguistics: EACL 2024 · doi:10.18653/v1/2024.findings-eacl.61 · Cited by 21 · see citing works
Han, S., & Choi, W. (2025) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2025.51187 · Cited by 20 · see citing works
- Authors
- Ferrara, E.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Ferrara, Emilio
- ORCID
- Ferrara, Emilio
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 1396-0458 (ISSN-L)
- arXiv
- 2304.03738
- OpenAlex
- W4388488349
- Cited by
- 282
- References
- 49
- Citations by year
- 2026: 55 · 2025: 77 · 2024: 95 · 2023: 55
- FWCI
- 70.56
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- First Monday (publishedVersion, cc-by-nc-sa)
- SSRN Electronic Journal (acceptedVersion)
- First Monday (acceptedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Viterbi School of Engineering, University of Southern California
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- ChatGPT, large language models, algorithmic bias, bias mitigation, training data bias, ethical AI, generative AI risks, chatbots, virtual assistants, content creation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review