The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Can Generative AI Improve Social Science?
Open accessAbstract
Artificial intelligence that can produce realistic text,images, and other human-like outputs is currently transforming many different industries. Yet it is not yet known how such tools might transform social science research. In the first section of this article, I assess the potential of Generative AI to improve online experiments, agent-based models, and automated content analyses.I also discuss whether these tools may help social scientists perform literature reviews, identify novel research questions, and develop hypotheses to explain them. Next, I evaluate whether Generative AI can help social scientists with more mundane tasks such as acquiring advancedprogramming skills or writing more effective prose. In the second section of this article I discuss the limitations of Generative AI as well as how these tools might be employed by researchers in an ethical manner. I discuss how bias in the processes and data used to train these tools can negatively impact social science research as well as a rangeof other challenges related to accuracy, reproducibility,interpretability, and efficiency. I conclude by highlighting the need for increased collaboration between social scientists and artificial intelligence researchers--- not only to ensure that such tools are used in a safe and ethical manner, but also because the progress of artificial intelligence may require deeper understanding of theories of human behavior
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research assistant: Beyond their application in specialized domains, LLM-based agents are increasingly adopted as versatile assistants in the broad field of social science research [105,114].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [114]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Agendas and instability in American politics
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0574 · Cited by 5,981
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
(2018) · Cited by 3,510
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Growing Artificial Societies: Social Science from the Bottom Up
Epstein, J. M., & Axtell, R. L. (1996) · doi:10.7551/mitpress/3374.001.0001 · Cited by 2,441
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Micromotives and Macrobehavior.
Connolly, T., & Schelling, T. C. (1979) · Administrative Science Quarterly · doi:10.2307/2989930 · Cited by 2,009
Merz, S. (2020) · Ethnic and Racial Studies · doi:10.1080/01419870.2020.1715454 · Cited by 1,870
The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration
Axelrod, R. (1997) · doi:10.1515/9781400822300 · Cited by 1,759
Atypical Combinations and Scientific Impact
Uzzi, B., Mukherjee, S., Stringer, M., & Jones, B. (2013) · Science · doi:10.1126/science.1240474 · Cited by 1,457
From Factors to Actors: Computational Sociology and Agent-Based Modeling
Macy, M. W., & Willer, R. (2002) · Annual Review of Sociology · doi:10.1146/annurev.soc.28.110601.141117 · Cited by 1,443
ChatGPT outperforms crowd workers for text-annotation tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305016120 · Cited by 1,197
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Large teams develop and small teams disrupt science and technology
Wu, L., Wang, D., & Evans, J. A. (2019) · Nature · doi:10.1038/s41586-019-0941-9 · Cited by 1,034
Tastes, ties, and time: a new social network dataset using Facebook.com
Lewis, K., Kaufman, J., Gonzalez, M., Wimmer, A., & Christakis, N. (2008) · Social Networks · doi:10.1016/j.socnet.2008.07.002 · Cited by 1,024
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023) · arXiv · doi:10.48550/arxiv.2305.03514 · Cited by 839
Out of One, Many: Using Language Models to Simulate Human Samples
Argyle, L. P., Busby, E. C., Fulda, N., Gubler, J. R., Rytting, C., & Wingate, D. (2023) · Political Analysis · doi:10.1017/pan.2023.2 · Cited by 783
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
Systematic inequality and hierarchy in faculty hiring networks
Clauset, A., Arbesman, S., & Larremore, D. B. (2015) · Science Advances · doi:10.1126/sciadv.1400005 · Cited by 624
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Using cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559
“Participant” Perceptions of Twitter Research Ethics
Fiesler, C., & Proferes, N. (2018) · Social Media + Society · doi:10.1177/2056305118763366 · Cited by 528
Aligning simulation models: A case study and results
Axtell, R., Axelrod, R., Epstein, J. M., & Cohen, M. D. (1996) · Computational and Mathematical Organization Theory · doi:10.1007/bf01299065 · Cited by 515
How Is ChatGPT’s Behavior Changing Over Time?
Chen, L., Zaharia, M., & Zou, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.5317da47 · Cited by 507
Complexity Theory and the Social Sciences: The State of the Art
Byrne, D., & Callaghan, G. (2022) · Routledge eBooks · doi:10.4324/9781003213574 · Cited by 454
Computational social science: Obstacles and opportunities
Lazer, D. M. J., Pentland, A., Watts, D. J., Aral, S., Athey, S., Contractor, N., Freelon, D., Gonzalez-Bailon, S., King, G., Margetts, H., et al. (2020) · Science · doi:10.1126/science.aaz8170 · Cited by 453
Bit by Bit: Social Research in the Digital Age
King, T. (2018) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12375 · Cited by 421
Can AI language models replace human participants?
Dillion, D., Tandon, N., Gu, Y., & Gray, K. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.04.008 · Cited by 405
Population growth and collapse in a multiagent model of the Kayenta Anasazi in Long House Valley
Axtell, R. L., Epstein, J. M., Dean, J. S., Gumerman, G. J., Swedlund, A. C., Harburger, J., Chakravarty, S., Hammond, R., Parker, J., & Parker, M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.092080799 · Cited by 391
AI and the transformation of social science research
Grossmann, I., Feinberg, M., Parker, D. C., Christakis, N. A., Tetlock, P. E., & Cunningham, W. A. (2023) · Science · doi:10.1126/science.adi1778 · Cited by 377
All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation
Kreps, S., McCain, R. M., & Brundage, M. (2022) · Journal of Experimental Political Science · doi:10.1017/xps.2020.37 · Cited by 360
Human heuristics for AI-generated language are flawed
Jakesch, M., Hancock, J. T., & Naaman, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2208839120 · Cited by 342
The debate over understanding in AI’s large language models
Mitchell, M., & Krakauer, D. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2215907120 · Cited by 340
Computational Research in the Post-API Age
Freelon, D. (2018) · Political Communication · doi:10.1080/10584609.2018.1477506 · Cited by 336
Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?
Horton, J., Filippas, A., & Manning, B. (2023) · National Bureau of Economic Research · doi:10.3386/w31122 · Cited by 329
Computational Social Science and Sociology
Edelmann, A., Wolff, T., Montagne, D., & Bail, C. A. (2020) · Annual Review of Sociology · doi:10.1146/annurev-soc-121919-054621 · Cited by 305
Self-citationPrompting GPT-3 To Be ReliablePreprint
Si, C., Gan, Z., Yang, Z., Wang, S., Wang, J., Boyd-Graber, J. L., & Wang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.09150 · Cited by 292
Large pre-trained language models contain human-like biases of what is right and wrong to do
Schramowski, P., Turan, C., Andersen, N., Rothkopf, C. A., & Kersting, K. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00458-8 · Cited by 291
Zhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288
Automatic Detection of Generated Text is Easiest when Humans are Fooled
Ippolito, D., Duckworth, D., Callison-Burch, C., & Eck, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.164 · Cited by 264
A Turing Test of Whether AI Chatbots Are Behaviorally Similar to Humans
Mei, Q., Xie, Y., Yuan, W., & Jackson, M. O. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2313925121 · Cited by 254
Human-level play in the game of Diplomacy by combining language models with strategic reasoning
Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., et al. (2022) · Science · doi:10.1126/science.ade9097 · Cited by 241
Synthetic Replacements for Human Survey Data? The Perils of Large Language Models
Bisbee, J., Clinton, J. D., Dorff, C., Kenkel, B., & Larson, J. M. (2024) · Political Analysis · doi:10.1017/pan.2024.5 · Cited by 209
A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges
Liang, J. T., Yang, C., & Myers, B. A. (2023) · arXiv · doi:10.48550/arxiv.2303.17125 · Cited by 206
A Watermark for Large Language Models
Kirchenbauer, J., Geiping, J., Wen, Y., Katz, J., Miers, I., & Goldstein, T. (2023) · arXiv · doi:10.48550/arxiv.2301.10226 · Cited by 194
AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion PredictionPreprint
Kim, J., & Lee, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.09620 · Cited by 183
Becker, J. A., Porter, E. V., & Centola, D. M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1817195116 · Cited by 181
Karinshak, E., Liu, S. X., Park, J. S., & Hancock, J. T. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579592 · Cited by 167
The emergence of economic rationality of GPT
Chen, Y., Liu, T. X., Shan, Y., & Zhong, S. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2316205120 · Cited by 164
Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies
Aher, G., Arriaga, R. I., & Kalai, A. T. (2022) · arXiv · doi:10.48550/arxiv.2208.10264 · Cited by 161
On agent-based modeling and computational social science
Conte, R., & Paolucci, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00668 · Cited by 160
Argyle, L. P., Bail, C. A., Busby, E. C., Gubler, J. R., Howe, T., Rytting, C., Sorensen, T., & Wingate, D. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2311627120 · Cited by 144
Self-citationVulnerable robots positively shape human conversational dynamics in a human–robot team
Traeger, M. L., Strohkorb Sebo, S., Jung, M., Scassellati, B., & Christakis, N. A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910402117 · Cited by 140
Language Models and Cognitive Automation for Economic Research
Korinek, A. (2023) · doi:10.3386/w30957 · Cited by 129
Language Models and Cognitive Automation for Economic ResearchPreprint
Korinek, A. (2023) · Social Science Research Network · doi:10.2139/ssrn.4356243 · Cited by 129
Götz, F. M., Maertens, R., Loomba, S., & van der Linden, S. (2023) · Psychological Methods · doi:10.1037/met0000540 · Cited by 122
On Measuring Gender Bias in Translation of Gender-neutral Pronouns
Cho, W. I., Kim, J. W., Kim, S., & Kim, N. S. (2019) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/w19-3824 · Cited by 120
Whose Opinions Do Language Models Reflect?
Santurkar, S., Durmus, E., Ladhak, F., Lee, C., Liang, P., & Hashimoto, T. (2023) · arXiv · doi:10.48550/arxiv.2303.17548 · Cited by 114
How to Use Large-Language Models for Text Analysis
Törnberg, P. (2024) · SAGE Publications Ltd eBooks · doi:10.4135/9781529683707 · Cited by 114
S3: Social-network Simulation System with Large Language Model-Empowered Agents
Gao, C., Lan, X., Lu, Z., Mao, J., Piao, J., Wang, H., Jin, D., & Li, Y. (2023) · doi:10.2139/ssrn.4607026 · Cited by 113
Large Language Models Can Be Used to Estimate the Latent Positions of Politicians
Wu, P. Y., Nagler, J., Tucker, J. A., & Messing, S. (2023) · arXiv · doi:10.48550/arxiv.2303.12057 · Cited by 106
Why open-source generative AI models are an ethical way forward for science
Spirling, A. (2023) · Nature · doi:10.1038/d41586-023-01295-4 · Cited by 104
On the Societal Impact of Open Foundation Models
Kapoor, S., Bommasani, R., Klyman, K., Longpre, S., Ramaswami, A., Cihon, P., Hopkins, A., Bankston, K., Biderman, S., Bogen, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2403.07918 · Cited by 103
Pellert, M., Lechner, C. M., Wagner, C., Rammstedt, B., & Strohmaier, M. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231214460 · Cited by 97
Accuracy and Political Bias of News Source Credibility Ratings by Large Language Models
Yang, K.-C., & Menczer, F. (2025) · Proceedings of the 17th ACM Web Science Conference 2025 · doi:10.1145/3717867.3717903 · Cited by 81
The carbon emissions of writing and illustrating are lower for AI than for humans
Tomlinson, B., Black, R. W., Patterson, D. J., & Torrance, A. W. (2024) · Scientific Reports · doi:10.1038/s41598-024-54271-x · Cited by 77
Lazar, S., & Nelson, A. (2023) · Science · doi:10.1126/science.adi8982 · Cited by 77
Using the Veil of Ignorance to align AI systems with principles of justice
Weidinger, L., McKee, K. R., Everett, R., Huang, S., Zhu, T., Chadwick, M. J., Summerfield, C., & Gabriel, I. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2213709120 · Cited by 75
Dentella, V., Günther, F., & Leivada, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2309583120 · Cited by 67
All the News that’s Fit to Fabricate: AI-Generated Text as a Tool of Media MisinformationPreprint
Kreps, S. E., McCain, R. M., & Brundage, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3525002 · Cited by 66
Dell’Acqua, F., Kogut, B., & Perkowski, P. (2020) · The Review of Economics and Statistics · doi:10.1162/rest_a_01328 · Cited by 64
Research can help to tackle AI-generated disinformation
Feuerriegel, S., DiResta, R., Goldstein, J. A., Kumar, S., Lorenz-Spreen, P., Tomz, M., & Pröllochs, N. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01726-2 · Cited by 64
Poulain, R., Bin Tarek, M. F., & Beheshti, R. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594102 · Cited by 63
Mellon, J., Bailey, J., Scott, R., Breckwoldt, J., Miori, M., & Schmedeman, P. (2024) · Research & Politics · doi:10.1177/20531680241231468 · Cited by 61
Temporal validity as meta-science
Munger, K. (2023) · Research & Politics · doi:10.1177/20531680231187271 · Cited by 60
Yee, K., Tantipongpipat, U., & Mishra, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479594 · Cited by 59
Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?
Horton, J. J., Filippas, A., & Manning, B. S. (2023) · arXiv · doi:10.48550/arxiv.2301.07543 · Cited by 47
GPT detectors are biased against non-native English writers
Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023) · arXiv · doi:10.48550/arxiv.2304.02819 · Cited by 40
Human-Level Play in the Game of Diplomacy by Combining Language Models with Strategic Reasoning
Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., Jacob, A. P., et al. (2022) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7236699 · Cited by 35
Encore: Lightweight Measurement of Web Censorship with Cross-Origin Requests
Burnett, S., & Feamster, N. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2829988.2787485 · Cited by 34
Mou, X., Wei, Z., & Huang, X. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.285 · Cited by 34
Can Large Language Model Agents Simulate Human Trust Behavior?
Xie, C., Chen, C., Jia, F., Ye, Z., Lai, S., Shu, K., Gu, J., Bibi, A., Hu, Z., Jurgens, D., et al. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-0501 · Cited by 31
Kreps, S., & Kriner, D. L. (2024) · New Media & Society · doi:10.1177/14614448231160526 · Cited by 27
Mellon, J., Bailey, J., Scott, R., Breckwoldt, J., & Miori, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4310154 · Cited by 25
Language Models Trained on Media Diets Can Predict Public Opinion
Chu, E., Andreas, J., Ansolabehere, S., & Roy, D. (2023) · arXiv · doi:10.48550/arxiv.2303.16779 · Cited by 24
Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms
Törnberg, P., Valeeva, D., Uitermark, J., & Bail, C. (2023) · arXiv · doi:10.48550/arxiv.2310.05984 · Cited by 20
Self-citationDisparate foundations of scientists’ policy positions on contentious biomedical research
Edelmann, A., Moody, J. W., & Light, R. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1613580114 · Cited by 19
AI Chat Assistants can Improve Conversations about Divisive TopicsPreprint
Argyle, L. P., Busby, E. C., Gubler, J. R., Bail, C. A., Howe, T., Rytting, C. M., & Wingate, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.07268 · Cited by 13
Self-citationEncore: Lightweight Measurement of Web Censorship with Cross-Origin RequestsPreprint
Burnett, S., & Feamster, N. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.1211 · Cited by 7
Susceptibility to Influence of Large Language Models
Griffin, L. D., Kleinberg, B., Mozes, M., Mai, K. T., Vau, M., Caldwell, M., & Marvor-Parker, A. (2023) · arXiv · doi:10.48550/arxiv.2303.06074 · Cited by 7
Outnumbered Online: The Consequences of Partisan Imbalance in Online Political DiscussionsPreprint
Allamong, M., Trexler, A., Alqabandi, F., LaChapelle, T., Bail, C. A., Hillygus, D. S., & Volfovsky, A. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/tygec · Cited by 6
Self-citation
Research works printed but not linked: 3
- [15]15. Daneshjou, Roxana et al. 2021. "Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and Algorithms: A Scoping Review." JAMA Dermatology 157(11): 1362-69.
- [39]39. Princeton, N.J.: Princeton University Press.
- [48]48. Yang, Kai-Cheng, and Filippo Menczer. 2023. "Large Language Models Can Rate News Outlet Credibility." http://arxiv.org/abs/2304.00228 (April 25, 2023). · arXiv
Cited by
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
Multi-Agent Collaboration Mechanisms: A Survey of LLMs
Tran, K.-T., Dao, D., Nguyen, M.-D., Pham, Q.-V., O'Sullivan, B., & Nguyen, H. D. (2025) · arXiv · doi:10.48550/arxiv.2501.06322 · Cited by 680
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
Exploring Large Language Model‐Based Intelligent Agents: Definitions, Methods, and Prospects
Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., et al. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70111 · Cited by 335
GPT is an effective tool for multilingual psychological text analysis
Rathje, S., Mirea, D.-M., Sucholutsky, I., Marjieh, R., Robertson, C. E., & Van Bavel, J. J. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2308950121 · Cited by 297
Metadata
- Authors
- Bail, C. A.
- Affiliations
- Duke University (US)
- Corresponding author
- Bail, Christopher A.
- ORCID
- Bail, Christopher A.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- Center for Open Science
- Published
- 2023-05-12
- Volume
- 121
- Issue
- 21
- Pages
- e2314021121-e2314021121
- ISSN
- 0027-8424 (ISSN-L)
- PMC
- PMC11127003
- OpenAlex
- W4396781199
- Cited by
- 369
- References
- 90
- Citations by year
- 2026: 143 · 2025: 160 · 2024: 55 · 2023: 11
- FWCI
- 148.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- SocArXiv (OSF Preprints) (submittedVersion, cc-by-nd)
- SocArXiv (OSF Preprints) (submittedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD065563)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- generative AI, social science research, survey research, online experiments, computational text analysis, agent-based modeling, training data bias, research ethics, replication, environmental impact of AI, human behavior
- MeSH terms
- Artificial Intelligence, Humans, Social Sciences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.