Can Generative AI Improve Social Science?
Open accessThe DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Abstract
Artificial intelligence that can produce realistic text,images, and other human-like outputs is currently transforming many different industries. Yet it is not yet known how such tools might transform social science research. In the first section of this article, I assess the potential of Generative AI to improve online experiments, agent-based models, and automated content analyses.I also discuss whether these tools may help social scientists perform literature reviews, identify novel research questions, and develop hypotheses to explain them. Next, I evaluate whether Generative AI can help social scientists with more mundane tasks such as acquiring advancedprogramming skills or writing more effective prose. In the second section of this article I discuss the limitations of Generative AI as well as how these tools might be employed by researchers in an ethical manner. I discuss how bias in the processes and data used to train these tools can negatively impact social science research as well as a rangeof other challenges related to accuracy, reproducibility,interpretability, and efficiency. I conclude by highlighting the need for increased collaboration between social scientists and artificial intelligence researchers--- not only to ensure that such tools are used in a safe and ethical manner, but also because the progress of artificial intelligence may require deeper understanding of theories of human behavior
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research assistant: Beyond their application in specialized domains, LLM-based agents are increasingly adopted as versatile assistants in the broad field of social science research [105,114].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [114]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Agendas and instability in American politics
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0574 · Cited by 5,981
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
(2018) · Cited by 3,510
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Growing Artificial Societies: Social Science from the Bottom Up
Epstein, J. M., & Axtell, R. L. (1996) · doi:10.7551/mitpress/3374.001.0001 · Cited by 2,441
Research works printed but not linked: 3
- [15]15. Daneshjou, Roxana et al. 2021. "Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and Algorithms: A Scoping Review." JAMA Dermatology 157(11): 1362-69.
- [39]39. Princeton, N.J.: Princeton University Press.
- [48]48. Yang, Kai-Cheng, and Filippo Menczer. 2023. "Large Language Models Can Rate News Outlet Credibility." http://arxiv.org/abs/2304.00228 (April 25, 2023). · arXiv
Cited by
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
Multi-Agent Collaboration Mechanisms: A Survey of LLMs
Tran, K.-T., Dao, D., Nguyen, M.-D., Pham, Q.-V., O'Sullivan, B., & Nguyen, H. D. (2025) · arXiv · doi:10.48550/arxiv.2501.06322 · Cited by 680
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
Exploring Large Language Model‐Based Intelligent Agents: Definitions, Methods, and Prospects
Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., et al. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70111 · Cited by 341
GPT is an effective tool for multilingual psychological text analysis
Rathje, S., Mirea, D.-M., Sucholutsky, I., Marjieh, R., Robertson, C. E., & Van Bavel, J. J. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2308950121 · Cited by 297
The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4
Science, M. R. A., & Quantum, M. A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.07361 · Cited by 51
Törnberg, P. (2025) · Social Science Computer Review · doi:10.1177/08944393241286471 · Cited by 249
How large language models can reshape collective intelligence
Burton, J. W., Lopez-Lopez, E., Hechtlinger, S., Rahwan, Z., Aeschbach, S., Bakker, M. A., Becker, J. A., Berditchevskaia, A., Berger, J., Brinkmann, L. U. L., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01959-9 · Cited by 243
AI for social science and social science of AI: A survey
Xu, R. F., Sun, Y., Ren, M., Guo, S., Pan, R., Lin, H., Sun, L., & Han, X. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103665 · Cited by 226
Survey of Cultural Awareness in Language Models: Text and Beyond
Pawar, S., Park, J., Jin, J., Arora, A., Myung, J., Yadav, S., Haznitrama, F. G., Song, I., Oh, A. H., & Augenstein, I. (2025) · Computational Linguistics · doi:10.1162/coli.a.14 · Cited by 219
Obrenovic, B., Gu, X., Wang, G., Godinić, D., & Jakhongirov, I. (2024) · AI & Society · doi:10.1007/s00146-024-01889-0 · Cited by 200
Hayes, A. S. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251322346 · Cited by 186
AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion PredictionPreprint
Kim, J., & Lee, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.09620 · Cited by 190
Human-AI agency in the age of generative AI
Krakowski, S. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100560 · Cited by 162
The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective
Gui, G., & Toubia, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4650172 · Cited by 46
Nicer than Humans: How Do Large Language Models Behave in the Prisoner's Dilemma?
Fontana, N., Pierri, F., & Aiello, L. M. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35829 · Cited by 141
Large Language Models in Qualitative Research: Uses, Tensions, and Intentions
Schroeder, H., Quéré, M. A. L., Randazzo, C., Mimno, D., & Schoenebeck, S. Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713120 · Cited by 142
Cui, Z., Li, N., & Zhou, H. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00840-7 · Cited by 122
Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions
Suh, J., Jahanparast, E., Moon, S., Kang, M., & Chang, S. Y. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1028 · Cited by 120
How to Use Large-Language Models for Text Analysis
Törnberg, P. (2024) · SAGE Publications Ltd eBooks · doi:10.4135/9781529683707 · Cited by 114
Perils and opportunities in using large language models in psychological research
Abdurahman, S., Atari, M., Karimi-Malekabadi, F., Xue, M. J., Trager, J., Park, P. S., Golazizian, P., Omrani, A., & Dehghani, M. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae245 · Cited by 111
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations
Cao, Y., Liu, H., Arora, A., Augenstein, I., Röttger, P., & Hershcovich, D. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.162 · Cited by 109
Veselovsky, V., Ribeiro, M. H., Arora, A., Josifoski, M., Anderson, A., & West, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.15041 · Cited by 109
Generative AI Meets Open-Ended Survey Responses: Research Participant Use of AI and Homogenization
Zhang, S., Xu, J., & Alvero, A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251327130 · Cited by 102
Towards a Definition of Generative Artificial Intelligence
Ronge, R., Maier, M., & Rathgeber, B. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00863-y · Cited by 101
Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning
Chae, Y., & Davidson, T. (2025) · Sociological Methods & Research · doi:10.1177/00491241251325243 · Cited by 102
Do LLM Agents Exhibit Social Behavior?Preprint
Leng, Y., & Yuanyuan (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2312.15198 · Cited by 98
Can Unconfident LLM Annotations Be Used for Confident Conclusions?
Gligorić, K., Zrnic, T., Lee, C., Candès, E. J., & Jurafsky, D. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.179 · Cited by 96
Large language models can predict the results of social science experiments
Ashokkumar, A., Hewitt, L., Ghezae, I., & Willer, R. (2026) · Nature · doi:10.1038/s41586-026-10742-x · Cited by 94
Machine Bias. How Do Generative Language Models Answer Opinion Polls?
Boelaert, J., Coavoux, S., Ollion, É., Petev, I. D., & Präg, P. (2025) · Sociological Methods & Research · doi:10.1177/00491241251330582 · Cited by 88
On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and PerspectivePreprint
Huang, Y., Gao, C., Wu, S., Wang, H., Wang, X., Zhou, Y., Wang, Y., Ye, J., Shi, J., Zhang, Q., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.14296 · Cited by 87
Emergent social conventions and collective bias in LLM populations
Ashery, A. F., Aiello, L. M., & Baronchelli, A. (2025) · Science Advances · doi:10.1126/sciadv.adu9368 · Cited by 81
Quantifying the use and potential benefits of artificial intelligence in scientific research
Gao, J., & Wang, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02020-5 · Cited by 81
'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices
Kapania, S., Wang, R., Li, T. J.-J., Li, T., & Shen, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711000 · Cited by 81
SciSciGPT: advancing human–AI collaboration in the science of science
Shao, E., Wang, Y., Qian, Y., Pan, Z., Liu, H., & Wang, D. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00906-6 · Cited by 77
ChatGPT for Text Annotation? Mind the Hype!
Ollion, E., Shen, R., Macanovic, A., & Chatelain, A. (2023) · doi:10.31235/osf.io/x58kn · Cited by 26
Exploring the scope of generative AI in literature review development
Schryen, G., Marrone, M., & Yang, J. (2025) · Electronic Markets · doi:10.1007/s12525-025-00754-2 · Cited by 72
Kozlowski, A. C., & Evans, J. A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251337316 · Cited by 72
Start Generating: Harnessing Generative Artificial Intelligence for Sociological Research
Davidson, T. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231241259651 · Cited by 76
Generative artificial intelligence in construction: A Delphi approach, framework, and case study
Taiwo, R., Bello, I. T., Abdulai, S. F., Yussif, A., Salami, B. A., Saka, A. B., Seghier, M. E. A. B., & Zayed, T. M. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.12.079 · Cited by 65
Updating “The Future of Coding”: Qualitative Coding with Generative Large Language Models
Than, N., Fan, L., Law, T., Nelson, L. K., & McCall, L. (2025) · Sociological Methods & Research · doi:10.1177/00491241251339188 · Cited by 63
The Mixed Subjects Design: Treating Large Language Models as Potentially Informative Observations
Broska, D., Howes, M., & van Loon, A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251326865 · Cited by 64
The impact of generative AI on social media: an experimental study
Møller, A. G., Romero, D. M., Jurgens, D., & Aiello, L. M. (2026) · Scientific Reports · doi:10.1038/s41598-026-40110-8 · Cited by 63
The dangers of using proprietary LLMs for research
Ollion, É., Shen, R., Macanovic, A., & Chatelain, A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-023-00783-6 · Cited by 62
Social media analytics for business-to-business marketing
Agnihotri, R., Bakeshloo, K. A., & Mani, S. (2023) · Industrial Marketing Management · doi:10.1016/j.indmarman.2023.09.012 · Cited by 60
Generative AI lacks the human creativity to achieve scientific discovery from scratch
Ding, A. W., & Li, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-93794-9 · Cited by 63
An, J., Huang, D., Lin, C., & Tai, M. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf089 · Cited by 58
Quaquebeke, N. V., Tonidandel, S., & Banks, G. C. (2025) · The Leadership Quarterly · doi:10.1016/j.leaqua.2025.101895 · Cited by 59
Davidson, T., & Karell, D. (2025) · Sociological Methods & Research · doi:10.1177/00491241251339184 · Cited by 58
Social Science Meets LLMs: How Reliable Are Large Language Models in Social Simulations?Preprint
Huang, Y., Yuan, Z., Zhou, Y., Guo, K., Wang, X., Zhuang, H., Sun, W., Sun, L., Wang, J., Ye, Y., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.23426 · Cited by 53
Dai, G., Zhang, W., Li, J., Yang, S., lbe, C. O., Rao, S., Caetano, A., & Sra, M. (2026) · Frontiers in Physics · doi:10.3389/fphy.2026.1700712 · Cited by 50
Navigating AI Convergence in Human–Artificial Intelligence Teams: A Signaling Theory Approach
Smith, A., Wagoner, H. P. V., Keplinger, K., & Çelebi, C. (2025) · Journal of Organizational Behavior · doi:10.1002/job.2856 · Cited by 51
Synthetic ethnography: Field devices for the qualitative study of generative models
de Seta, G., Pohjonen, M., & Knuutila, A. (2024) · Big Data & Society · doi:10.1177/20539517241303126 · Cited by 50
A Systematic Review of User Attitudes Toward GenAI: Influencing Factors and Industry Perspectives
Chen, J., Wei, X., Xie, Q., Hu, A., Qiao, Y., Wan, R., & Liu, Y. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13070078 · Cited by 51
Theorizing with Large Language Models
Tranchero, M., Brenninkmeijer, C.-F., Murugan, A., & Nagaraj, A. (2024) · National Bureau of Economic Research · doi:10.3386/w33033 · Cited by 48
The Democratization of Artificial Intelligence: Theoretical Framework
Costa, C. J., Aparicio, M., Aparicio, S., & Aparicio, J. T. (2024) · Applied Sciences · doi:10.3390/app14188236 · Cited by 44
Eacersall, D. C. F., Pretorius, L., Smirnov, I., Spray, E., Illingworth, S., Chugh, R., Strydom, S. C., Stratton-Maher, D., Simmons, J. S., Jennings, I., et al. (2025) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2025.8.2.9 · Cited by 44
Natural language processing for social science research: A comprehensive review
Hou, Y., & Huang, J. (2025) · Chinese Journal of Sociology · doi:10.1177/2057150x241306780 · Cited by 45
Intersectional analysis for science and technology
Nielsen, M. W., Gissi, E., Heidari, S., Horton, R. C., Nadeau, K. C., Ngila, D., Noble, S., Paik, H. Y., Tadesse, G. A., Zeng, E. Y., et al. (2025) · Nature · doi:10.1038/s41586-025-08774-w · Cited by 43
Stuhler, O., Ton, C. D., & Ollion, É. (2025) · Sociological Methods & Research · doi:10.1177/00491241251336794 · Cited by 42
Can We Fix Social Media? Testing Prosocial Interventions using Generative Social SimulationPreprint
Larooij, M., & Törnberg, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.03385 · Cited by 42
Jeon, J., Kim, L., & Park, J. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.102836 · Cited by 41
Prompt Stability Scoring for Text Annotation with Large Language Models
Barrie, C., Palaiologou, E., & Törnberg, P. (2024) · arXiv · doi:10.48550/arxiv.2407.02039 · Cited by 44
Smart Agent-Based Modeling: On the Use of Large Language Models in Computer SimulationsPreprint
Wu, Z., Peng, R., Han, X., Zheng, S., Zhang, Y., & Xiao, C. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2311.06330 · Cited by 40
Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM)
Hauser, J., Kondor, D., Reddish, J., Benam, M., Cioni, E., Villa, F., Bennett, J. S., Hoyer, D., François, P., Turchin, P., et al. (2024) · neural information processing systems · doi:10.52202/079017-1016 · Cited by 40
Evaluating the statistical realism of LLM-generated social science data
Xie, Y., Liang, L., Li, S., Lu, Y., Xiao, Z., Shi, M., Huang, J., Wang, M., & Xie, Y. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2538145123 · Cited by 39
Bojić, L., Cinelli, M., Culibrk, D. R., & Delibašić, B. (2024) · European Journal of Futures Research · doi:10.1186/s40309-024-00238-0 · Cited by 38
Ferrara, E. (2025) · First Monday · doi:10.5210/fm.v30i6.14188 · Cited by 41
Large Language Models in Politics and Democracy: A Comprehensive SurveyPreprint
Aoki, G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.04498 · Cited by 35
The use of synthetic data in tourism
Viglia, G., Adler, S. J., Miltgen, C. L., & Sarstedt, M. (2024) · Annals of Tourism Research · doi:10.1016/j.annals.2024.103819 · Cited by 34
Meaning in Hyperspace: Word Embeddings as Tools for Cultural Measurement
Boutyline, A., & Arseniev‐Koehler, A. (2025) · Annual Review of Sociology · doi:10.1146/annurev-soc-090324-024027 · Cited by 34
Beyond static responses: multi-agent LLM systems as a new paradigm for social science research
Haase, J., & Pokutta, S. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-08832-2 · Cited by 34
Zou, W., Li, J., Yang, Y., & Tang, L. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2295725 · Cited by 34
Cui, Z., Li, N., & Zhou, H. (2024) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2409.00128 · Cited by 36
Krsteski, S., Russo, G., Chang, S. Y., West, R., & Gligorić, K. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.498 · Cited by 36
Lee, J. Y., Ahn, E., Xu, A., Yang, Y., Chang, Y., Cha, H., & Ammari, T. (2024) · Family Relations · doi:10.1111/fare.13090 · Cited by 32
Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas
Giorgi, S., Liu, T., Aich, A., Isman, K., Sherman, G. T., Fried, Z., Sedoc, J., Ungar, L., & Curtis, B. L. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.420 · Cited by 32
Robson, M. J., Xu, S., Wang, Z., Chen, Q., & Francesco Ciucci, A. (2025) · Advanced Materials · doi:10.1002/adma.202502649 · Cited by 32
Wang, Z., Wang, D., Xu, Y., Zhou, L., & Zhou, Y. (2025) · Journal of Chinese Political Science · doi:10.1007/s11366-025-09917-6 · Cited by 31
Balancing Large Language Model Alignment and Algorithmic Fidelity in Social Science Research
Lyman, A., Hepner, B., Argyle, L. P., Busby, E. C., Gubler, J. R., & Wingate, D. (2025) · Sociological Methods & Research · doi:10.1177/00491241251342008 · Cited by 32
Navigating the Risks of Using Large Language Models for Text Annotation in Social Science Research
Lin, H., & Zhang, Y. (2026) · Social Science Computer Review · doi:10.1177/08944393251366243 · Cited by 33
Artificial Intelligence Policymaking: An Agenda for Sociological Research
Law, T. L., & McCall, L. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231241261596 · Cited by 31
Yeykelis, L., Pichai, K., Cummings, J. J., & Reeves, B. B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.16073 · Cited by 31
Validating the use of large language models for psychological text classification
Bunt, H. L., Goddard, A., Reader, T. W., & Gillespie, A. (2025) · Frontiers in Social Psychology · doi:10.3389/frsps.2025.1460277 · Cited by 31
Moral stereotyping in large language models
Zewail, A., Figueroa, A., Graham, J., & Atari, M. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2519941123 · Cited by 29
Best practices for responsibly using AI tools in social sciences research
Feng, G. C. (2024) · Cogent Social Sciences · doi:10.1080/23311886.2024.2420484 · Cited by 29
Behavioral Economics of AI: LLM Biases and CorrectionsPreprint
Bini, P., Cong, L., Huang, X., & Jin, L. J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5213130 · Cited by 29
Large language models in climate and sustainability policy: limits and opportunities
Larosa, F., Hoyas, S., Conejero, J. A., García‐Martínez, J., Nerini, F. F., & Vinuesa, R. (2025) · Environmental Research Letters · doi:10.1088/1748-9326/addd36 · Cited by 27
AI and the advent of the cyborg behavioral scientist
Tomaino, G., Cooke, A. D. J., & Hoover, J. (2025) · Journal of Consumer Psychology · doi:10.1002/jcpy.1452 · Cited by 27
LLM-Based Social Simulations Require a BoundaryPreprint
Wu, Z., Peng, R., Itō, T., Onizuka, M., & Xiao, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.19806 · Cited by 27
Efficient Randomized Experiments Using Foundation Models
Bartolomeis, P. D., Abad, J., Wang, G., Donhauser, K., Duch, R. M., Yang, F., & Dahabreh, I. J. (2025) · neural information processing systems · doi:10.52202/085713-5328 · Cited by 26
Measurement in the Age of LLMs: An Application to Ideological ScalingPreprint
O'Hagan, S., & Schein, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.09203 · Cited by 26
AI-Powered (Finance) Scholarship
Novy‐Marx, R., & Velikov, M. (2025) · National Bureau of Economic Research · doi:10.3386/w33363 · Cited by 26
Artificial Intelligence-Assisted Case Management in Social Work Services: A Systematic Review
Li, L., Wang, M., & Jian, M. (2025) · Research on Social Work Practice · doi:10.1177/10497315251329531 · Cited by 25
A step-by-step method for cultural annotation by LLMs
Dubourg, E., Thouzeau, V., & Baumard, N. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1365508 · Cited by 26
Generative AI: Applications, Models, Challenges, Opportunities, and Future Directions
Madaan, G., Asthana, S. K., & Kaur, J. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-8557-9.ch004 · Cited by 25
Qian, P., & Xie, X.-Z. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2526580 · Cited by 26
Arti-‘fickle’ intelligence: using LLMs as a tool for inference in the political and social sciences
Argyle, L. P., Busby, E. C., Gubler, J. R., Hepner, B., Lyman, A., & Wingate, D. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00843-4 · Cited by 27
Jowsey, T., Stapleton, P., Campbell, S. M., Davidson, A. R., McGillivray, C. J., Maugeri, I., Lee, M. F., & Keogh, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330217 · Cited by 24
AI in science: When and where it makes a difference
Bianchini, S., Girolamo, V. D., Ravet, J., & Arranz, D. (2026) · Research Policy · doi:10.1016/j.respol.2026.105478 · Cited by 27
Metadata
- Authors
- Bail, C. A.
- Affiliations
- Duke University (US)
- Corresponding author
- Bail, Christopher A.
- ORCID
- Bail, Christopher A.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- Center for Open Science
- Published
- 2023-05-12
- Volume
- 121
- Issue
- 21
- Pages
- e2314021121-e2314021121
- ISSN
- 0027-8424 (ISSN-L)
- PMC
- PMC11127003
- OpenAlex
- W4396781199
- Cited by
- 369
- References
- 90
- Citations by year
- 2026: 143 · 2025: 160 · 2024: 55 · 2023: 11
- FWCI
- 148.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- SocArXiv (OSF Preprints) (submittedVersion, cc-by-nd)
- SocArXiv (OSF Preprints) (submittedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD065563)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- generative AI, social science research, survey research, online experiments, computational text analysis, agent-based modeling, training data bias, research ethics, replication, environmental impact of AI, human behavior
- MeSH terms
- Artificial Intelligence, Humans, Social Sciences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.