Can AI language models replace human participants?

Dillion, Danica, Tandon, Niket, Gu, Yuling, Gray, Kurt·2023·Trends in Cognitive Sciences
DOI 10.1016/j.tics.2023.04.008

Cited by (410)

Items 201–300 of 410

  1. The end of experimental research as we know it? A perspective on generative artificial intelligence in communication science
    Jörg Matthes, Sofie Vranken · 2025 · Communication and Change
  2. Exploring the Human-LLM Synergy in Advancing Theory-driven Qualitative Analysis
    Han Meng, Yitian Yang, Wayne Fu, Jungup Lee, Yunan Li, Yi-Chieh Lee · 2024 · ACM Trans. Comput. Hum. Interact.
  3. Unveiling the Future of Engineering Management: The Role of Artificial Intelligence and Big Data
    Hongye Cui, Chuan Xu, Kangjie Sun · 2024 · International Conference on Science, Engineering and Technology Practices for Sustainable Development (ICSETPSD)
  4. Ideology and Policy Preferences in Synthetic Data: The Potential of LLMs for Public Opinion Analysis
    Keyeun Lee, Jaehyuk Park, Suh‐hee Choi, Changkeun Lee · 2025 · Media and Communication
  5. The ‘Implicit Intelligence’ of artificial intelligence. Investigating the potential of large language models in social science research
    Ottorino Cappelli, Marco Aliberti, Rodrigo Praino · 2024 · Political Research Exchange
  6. Inclusive Counterfactual Generation: Leveraging LLMs in Identifying Online Hate
    M. Atif Qureshi, Arjumand Younus, Simon J. Caton · 2024 · Lecture notes in computer science
  7. Evaluation of moral courage scenarios by large language models: a pilot study
    Uwe Klein, Pantaleon Fassbender · 2025 · Journal of Psychology and AI
  8. Road Rage Against the Machine: Humans and LLMs Share a Blame Bias Against Driverless Cars
    Yueying Chu, Peng Liu, Julian Savulescu, Brian David Earp · 2025 · International Journal of Human-Computer Interaction
  9. Studying and improving reasoning in humans and machines
    Stefano Palminteri, Nicolas Yax, Hernán Anlló · 2023 · Research Square
  10. Simulating Survey Respondents with Large Language Models through Impulse Variables and Persona Conditioning
    Fabio Yoshio Suguri Motoki, Januário José Monteiro, Ricardo Malagueño, Victor Rangel dos Santos Rodrigues · 2023 · SSRN Electronic Journal
  11. A Technological Construction of Society: Comparing GPT-4 and Human Respondents for Occupational Evaluation in the UK
    Paweł Gmyrek, Christoph Lutz, Gemma Newlands · 2024
  12. Folk Economics in the Machine: LLMs and the Emergence of Mental Accounting
    Yan Leng · 2024 · SSRN Electronic Journal
  13. Using Large Language Models to Explore Contextualization Effects in Economics-Based Accounting Experiments
    Fikir Worku Edossa, Joachim Gassen, Victor S. Maas · 2024 · SSRN Electronic Journal
  14. Predicting Field Experiments with Large Language Models
    Yaoyu Chen, Yuheng Hu, Yingda Lu · 2025 · SSRN Electronic Journal
  15. Analysis of Intergenerational Trauma Transmission in Artificial Human Families: A Metaverse-Based Study of Complex Psychological Phenomena
    Seung Hoon Kang, Jae Young Lee, Teressa Talluri, Amarnathvarma Angani, Kyoo Jae Shin · 2024 · IEEE Access
  16. Collaborative Growth: When Large Language Models Meet Sociolinguistics
    Dong Nguyen · 2025 · Language and Linguistics Compass
  17. Artificial Intelligence: Approaches to Safety
    William D’Alessandro, Cameron Domenico Kirk‐Giannini · 2025 · Philosophy Compass
  18. Biases about Chinese People in English Language Use: Stereotypes, Prejudice and Discrimination
    Han‐Wu‐Shuang Bao, PETER HAYS GRIES · 2025 · The China Quarterly
  19. Comparing perceptual judgments in large multimodal models and humans
    Billy Dickson, Sahaj Singh Maini, Craig A. Sanders, Robert M. Nosofsky, Zoran Tiganj · 2025 · Behavior Research Methods
  20. Game-theory behaviour of large language models: The case of Keynesian beauty contests
    Siting Estee Lu · 2025 · Economics and Business Review/The Poznań University of Economics Review
  21. Surfacing citizens’ policy perspectives at scale in the age of large language models
    Ezequiel Lopez-Lopez, Stefan Michael Herzog · 2025 · Behavioral Science & Policy
  22. The Integration of Artificial Intelligence in Marketing Education Within the Context of Education for Sustainable Development (ESD)
    Yao Yao, Ziqing Wang · 2025 · Emerald Group Publishing Limited eBooks
  23. Affective connotations according to LLMs: implications for meaning measurement and cultural bias
    Aidan Combs, Diego Dametto, Christophe Blaison, Renee Leung, Aarti Malhotra, Tobias Schröder, Jesse Hoey, Lynn Smith‐Lovin · 2025 · Cognition & Emotion
  24. Silicus Traveler: An agent to simulate tourist behavior
    Juan Serantes, Jorge E. Araña · 2025 · Annals of Tourism Research
  25. Simulating online political discourse using LLMs: A study on social identity and conflict
    Taehyun Ha · 2025 · Information Processing & Management
  26. Write, Rank, or Rate: Comparing Methods for Studying Visualization Affordances
    Chase Stokes, Kylie Lin, Cindy Xiong · 2025 · IEEE Transactions on Visualization and Computer Graphics
  27. Can large language models exhibit cognitive and affective empathy as humans?
    Tengfei Yu, Siyu Pan, Caoyun Fan, Siyang Luo, Yaohui Jin, Binglei Zhao · 2025 · Computers in Human Behavior Artificial Humans
  28. Towards an LLM-Powered Social Digital Twinning Platform
    Önder Gürcan, Vanja Falck, Markus G. Rousseau, L. L. Lima · 2025 · Lecture notes in computer science
  29. DxHF: Providing High-Quality Human Feedback for LLM Alignment with Interactive Decomposition
    Danqing Shi, Furui Cheng, Tino Weinkauf, Antti Oulasvirta, Mennatallah El‐Assady · 2025 · ACM Symposium on User Interface Software and Technology (UIST)
  30. A large-scale evaluation of commonsense knowledge in humans and large language models
    Tuan Dung Nguyen, Duncan J. Watts, Mark E. Whiting · 2026 · PNAS Nexus
  31. From Text to Insight: Leveraging Large Language Models for Performance Evaluation in Management
    Ning Li, Huaikang Zhou, Mingze Xu · 2026 · Personnel Psychology
  32. Computational Text Analysis for Building and Testing Social Theory
    Miriam Hurtado Bodell, Marc Keuschnigg, Ana Macanovic, Anastasia Menshikova · 2026 · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie
  33. Crocodile tears: Can the ethical-moral intelligence of AI models be trusted?
    Sarah Hubbard, David Kidd, Andrei Gabriel Stupu · 2026 · AI and Ethics
  34. Which LLM performs best in crisis knowledge generation? Automatic evaluation across multiple events and knowledge categories
    Ruilian Han, Lu An, Wei Zhou, Miaomiao Chen, Gang Li · 2026 · Information Processing & Management
  35. On using large language models to support social research for climate action
    Ehsan Nabavi, Holger Robert Maier, Saman Razavi, Adrian Hindes, Mark S. Howden, Will J. Grant, Sujatha Raman · 2026 · npj Climate Action
  36. Generative AI and Discovery of Preferences for Single-Use Plastics Regulations
    Catharina Hollauer, Jorge Garcelán, Nikhita S. Ragam, Tia Vaish, Omar Isaac Asensio · 2024 · Proceedings of the AAAI Symposium Series
  37. Artificial Intelligence in Newborn Medicine
    Thierry A.G.M. Huisman, Thierry A.G.M. Huisman · 2024 · Newborn
  38. Generative Künstliche Intelligenz
    Jürgen Buder, Marlit Annalena Lindner, Uwe Oestermeier, Markus Huff, Peter H. Gerjets, Sonja Utz, Ulrike Creß · 2024 · Psychologische Rundschau
  39. Leveraging Prompt Tuning-Based Cognitive Attention to Enhance Logical Inference in Large Language Models
    Xiaoyan Li, Cuicui Jiang · 2024
  40. ChatGPT and CLT: Investigating differences in multimodal processing
    Michael C. Cahalane, Samuel Nathan Kirshner · 2024 · Journal of Economy and Technology
  41. GALEA – Leveraging Generative Agents in Artifact Evaluation
    Nicolas Prat, John Patrick Lalor, Ahmed Abbasi · 2025 · Lecture notes in computer science
  42. The art of audience engagement: LLM-based thin-slicing of scientific talks
    Ralf Schmälzle, Sue Lim, Yuetong Du, Gary Bente · 2025 · Frontiers in Communication
  43. Can AI replace experts in the evaluation of cultural heritage? Based on the controlled experiments conducted on six architectural heritages
    Yuchuan Wang, Yi Yang, Xueqing Tian, Tao Zhu · 2025 · Digital Scholarship in the Humanities
  44. LLMs replicate metaphor norms based on word co-occurrence but struggle with topic-vehicle mappings
    Laura Pissani, Mayank Jobanputra, Vera Demberg · 2026 · Frontiers in Language Sciences
  45. Studying the Effect of Globalization on Color Perception using Multilingual Online Recruitment and Large Language Models
    Jakob Niedermann, Ilia Sucholutsky, Raja Marjieh, Elif Çelen, Thomas L. Griffiths, Nori Jacoby, Pol van Rijn · 2024
  46. Studying and improving reasoning in humans and machines
    Nicolas Yax, Hernán Anlló, Stefano Palminteri · 2024
  47. Can Large Language Models Exhibit Cognitive and Affective Empathy as Humans?
    Siyu Pan, Caoyun Fan, Binglei Zhao, Siyang Luo, Yaohui Jin · 2024
  48. The Mixed Subjects Design: Treating Large Language Models as Potentially Informative Observations
    David Broska, Michael Howes, Austin van Loon · 2024
  49. GPT-4 accurately predicts human emotions and their neural correlates
    Severi Santavirta, Lauri Suominen, Yuhang Wu, David Sander, Lauri Nummenmaa · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  50. MarxistLLM: Fine-tuning a language model with a Marxist worldview
    Matti Nelimarkka · 2026 · Big Data & Society
  51. Generative AI in psychology
    2025 · Nature Reviews Psychology
  52. SweetBean: A declarative language for behavioral experiments with human and artificial participants
    Younes Strittmatter, Sebastian Musslick · 2025 · The Journal of Open Source Software
  53. Leveraging Human-AI Partnership Approach to Unravel Human Psychological Constructs
    Han Meng · 2025 · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA)
  54. How Well Do Simulated Population Samples with GPT-4 Align with Real Ones? The Case of the Eysenck Personality Questionnaire Revised-Abbreviated Personality Test
    Gregorio Ferreira, Jacopo Amidei, Rubén Nieto, Andreas Kaltenbrunner · 2025 · Health Data Science
  55. Beyond Buzzwords: The Development of Large Language Models and Their Use in Advertising and Strategic Communication Research
    Veranika Paltaratskaya, Alice Ji, Priyam Mazumdar, Kevin R. Wise · 2025 · Journal of Current Issues & Research in Advertising
  56. Finding Middle Ground in Cognitive Media Psychology
    Richard Huskey, Ralf Schmälzle · 2025 · Oxford University Press eBooks
  57. Leveraging Large Reasoning Models for Test Equating Without Anchor Items: A Simulation Study with O1 and DeepSeek-R1
    Junlei Du, Qinhua Zheng, Shuang Li · 2025 · Communications in computer and information science
  58. Language as Data: A Survey of Natural Language Processing for Economics and Finance
    Alexandre Henrique Lucchetti, Daniel O. Cajueiro · 2025 · Journal of Economic Surveys
  59. Compensation or concordance between warmth and competence: Examining social class stereotypes in English and Chinese languages using natural language
    Xingy Luo, Peipei Zhai, Xiao-Jun Sun, Geng-Feng Niu · 2026 · Social Science Research
  60. Assessment of large language models’ performance in simulating students’ self-reports of online self-regulated learning skills
    Junlei Du, Shuang Li, Jingxi Chen, Jing Li · 2025 · Education and Information Technologies
  61. Digital Echoes of Cultural Values: Cross-Cultural Differences in Online Norm-Enforcement
    C. Kenntemich, D. O. I. Brückner-Collet, S. C. Rudert · 2025 · Computers in Human Behavior Reports
  62. Homo-silicus: not (yet) a good imitator of homo sapiens or homo economicus
    SOLOMON WILLIAM POLACHEK, Kenneth Romano, Ozlem Tonguc · 2025 · Journal of the Economic Science Association
  63. Large AI Models Have a Prioritization Problem: Policy Implications and Solutions
    Joshua Conrad Jackson, Yuanze Liu, Zhao Wang, William J. Brady · 2025 · Policy Insights from the Behavioral and Brain Sciences
  64. ChatGPT as a research proxy: simulating human attitudes in social science research
    Рафикова Антонина Семеновна, А. Н. Воронин · 2026 · Journal of Computational Social Science
  65. Market Research in the Age of Generative AI: Opportunities and Challenges
    Billy Sung, Valentina Pitardi, Leonard J. Paas, Trixie Cartwright · 2026 · International Journal of Market Research
  66. Health or taste? Investigating food decision-making patterns in humans and large language models
    Minqi Lyu, Jianping Huang · 2026 · Appetite
  67. Simulated cognitive empathy as an emerging tool for socio-ecological research
    Daniel Rex Richards, Alan Heays, Alexander Herzig, Sandra Lavorel, Clémence Vannier · 2026 · Environmental Research Communications
  68. Reframing the Performance and Ethics of Empathic AI: Wisdom of the Crowd and Placebos
    Mark Allen Thornton · 2026 · Perspectives on Psychological Science
  69. AI UXpert: Comparing the Performance and Perception of AI and Human Experts in B2B Ease of Use Evaluation
    Mengyan Guo, Jianpeng Li, Yao Cheng, Zehui Jin, Luping Wang · 2026 · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA)
  70. AI as a Tool to Support Negotiation Research
    Ray Friedman · 2026 · Negotiation Journal
  71. Evaluating Large Language Models as Substitutes for Human Affective Ratings in Naturalistic Paradigms
    Xuan Yang, Deepa Tilwani, Christian O’Reilly, Svetlana V. Shinkareva · 2026 · IEEE Transactions on Affective Computing
  72. Prompt carefully! ChatGPT displays rule-based insensitivity to contingencies
    Francisco J. Ruiz, Verónica Cardona-Betancourt · 2026 · Journal of Contextual Behavioral Science
  73. The Crowd Without People: Multi-agent Large Language Models as Idea Evaluators
    Fabian Probost, Manfred Schoch, Hannes Voucko-Glockner, Henner Gimpel, Robert Laubacher · 2026 · Group Decision and Negotiation
  74. LLM-Enabled Reconstruction of Farmer Fertilizer-Reduction Responses Under Policy Scenarios: Evidence from Sparse Stated-Preference Data
    Shuaiwen Liu, Yichuan Zhang, Z X Sun, Xiao Huang, Chaoqing Yu · 2026 · Agriculture
  75. Modern approaches to studying human interaction with generative artificial intelligence
    N.I. Skrylnikova, Marina A. Kholodnaya · 2026 · Journal of Modern Foreign Psychology
  76. GenAI as counsellor: how employee evaluations drive engagement and organizational attractiveness
    Tuan Todd Cao, Yunen Zhang, Nhâm Phong Tuân · 2026 · Journal of Enterprise Information Management
  77. Simulating strategic interactions with AI agents
    Matteo Tranchero, Cecil-Francis Brenninkmeijer, Arul Murugan, Abhishek Nagaraj · 2026 · Strategic Management Journal
  78. From collaboration to high-quality evidence for the energy transition: A total experimental field trial error framework
    Celina Kacperski, Mona Bielig, F. Lange, R. Ulloa, F. Kutzner · 2026 · Energy Research & Social Science
  79. AI models of unstable flow exhibit hallucination
    Ramdhan Wibawa, Birendra Jha · 2026 · Scientific Reports
  80. The future of AI-assisted science is both fast and slow
    Yusuke Moriguchi, Yasuhiro Kanakogi · 2026 · Nature Human Behaviour
  81. Large language models as human proxies
    Nikita Karetnikov, Iyad Rahwan, Davor Svetinović · 2026 · Nature Computational Science
  82. AI cannot replace human participants in behavioral research
    Jim Hoover, Alan D. J. Cooke, Geoff Tomaino, Su Hyun Lee · 2026 · Proceedings of the National Academy of Sciences
  83. Davinci the Dualist: The Mind–Body Divide in Large Language Models and in Human Learners
    Iris Berent, Alexzander Sansiveri · 2024 · Open Mind
  84. Literary characters and GPT-4: from William Shakespeare to Elena Ferrante
    Gabriel Abrams · 2024 · Digital Scholarship in the Humanities
  85. On the Cultural Sensitivity of Large Language Models: GPT's Ability to Simulate Human Self-Concept
    Yin Luo, Johnny Shanglin Du, Lin Qiu · 2024 · International Conference on Behavioral, Economic, and Socio-Cultural Computing
  86. LLMs as Mediators: Can They Diagnose Conflicts Accurately?
    Özgecan Koçak, Phanish Puranam, Afşar Yegin · 2025 · ACM Journal on Computing and Sustainable Societies
  87. Matching GPT-simulated Populations with Real Ones in Psychological Studies—The Case of the EPQR-A Personality Test
    Gregorio Ferreira, Jacopo Amidei, Rubén Nieto, Andreas Kaltenbrunner · 2025 · ACM Transactions on Computing for Healthcare
  88. Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future of Edemorcacy
    Rabimba Karanjai, Boris Shor, Amanda Austin, Ryan Kennedy, Yang Lu, Lei Xu, Weidong Larry Shi · 2025 · International Conference on eDemocracy & eGovernment
  89. Leveraging Large Language Models for Early Study Optimization in Educational Research
    Mikayla Friday, Michael Vaccaro, Arash E. Zaghi · 2025 · ASEE Annual Conference & Exposition
  90. The Representation of Moral Intuitions in Stories Created by ChatGPT
    Joshua A. Baldwin · 2025 · Journal of Media Psychology Theories Methods and Applications
  91. Prompt Architecture Can Induce Methodological Artifacts in Large Language Models
    Melanie S. Brucks, Olivier Toubia · 2023 · SSRN Electronic Journal
  92. Exploring The Prospects And Challenges Of Large Language Models For Language Learning And Production
    Anna M. Borghi, Chiara De Livio, Francesco Mannella, Luca Tummolini, Stefano Nolfi · 2023 · IRIS Research product catalog (Sapienza University of Rome)
  93. Large language models in the labyrinth: Possibility spaces and moral constraints
    Victor Møller Poulsen, S. DeDeo · 2023 · Possibility Studies & Society
  94. Experimental Hallucinations, strengths and limits of silicon Participants: How Similar are Silicon and Human Participants?
    olivier kamoun, Udi Sommer · 2024 · SSRN Electronic Journal
  95. Embracing naturalistic paradigms: substituting GPT predictions for human judgments
    Xuan Yang, Christian O’Reilly, Svetlana V. Shinkareva · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  96. A Comparison of Artificial Intelligence and Human Responses in Audit Experiments
    Nikki L. MacKenzie, James Moon, Susan Rykowski, Quinn Thomas Swanquist, Robert Lowell Whited · 2025 · SSRN Electronic Journal
  97. Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questions
    Olivier Toubia, George Gui, Tianyi Peng, Daniel J. Merlau, Ang Li, Haozhe Chen · 2025 · SSRN Electronic Journal
  98. The Task Is to Improve the Ask: An Experiment for Developing Prompts to Generate High Quality Survey Items from Large Language Models
    Trent D. Buskirk, Adam Eck, Jerry Timbrook · 2025 · SSRN Electronic Journal
  99. A MEGA-STUDY OF DIGITAL TWINS REVEALS STRENGTHS, WEAKNESSES AND OPPORTUNITIES FOR FURTHER IMPROVEMENT
    Tianyi Peng, George Gui, Daniel J. Merlau, Grace Jiarui Fan, Malek Ben Sliman, Melanie S. Brucks, Eric Johnson, Vicki G. Morwitz, Abdullah Althenayyan, Silvia Bellezza et al. · 2025 · SSRN Electronic Journal
  100. Moral Concern Is a Response Regime: A Preregistered Cross-Model Test of Persona Framing in Large Language Models
    Emile Boullineau, José Daniel Muñoz Arciniegas · 2026 · SSRN Electronic Journal