Can AI language models replace human participants?

Dillion, Danica, Tandon, Niket, Gu, Yuling, Gray, Kurt·2023·Trends in Cognitive Sciences
DOI 10.1016/j.tics.2023.04.008

Cited by (410)

Items 101–200 of 410

  1. Identification and Description of Emotions by Current Large Language Models
    Suketu Patel, Jin Fan · 2023 · Research Square
  2. AI Surrogates and illusions of generalizability in cognitive science
    Molly J. Crockett, Lisa R. Messeri · 2025 · Trends in Cognitive Sciences
  3. Benchmarking ChatGPT for prototyping theories: Experimental studies using the technology acceptance model
    Tiong‐Thye Goh, Xin Dai, Yanwu Yang · 2023 · BenchCouncil Transactions on Benchmarks Standards and Evaluations
  4. Using large language models to facilitate academic work in the psychological sciences
    Aamir Sohail, Lei Zhang · 2025 · Current Psychology
  5. Dual-process theory and decision-making in large language models
    Oliver Brady, Paul Nulty, Lili Zhang, Tomas Emmanuel Ward, David P. McGovern · 2025 · Nature Reviews Psychology
  6. The promise and pitfalls of generative AI
    Monojit Choudhury, Zohar Elyoseph, Nathanael J. Fast, Desmond C. Ong, Elaine Okanyene Nsoesie, Ellie Pavlick · 2025 · Nature Reviews Psychology
  7. Forewarning Artificial Intelligence about Cognitive Biases
    Jonathan Wang, Donald A. Redelmeier · 2025 · Medical Decision Making
  8. Intersectional race–gender stereotypes in natural language
    Han‐Wu‐Shuang Bao, PETER HAYS GRIES · 2024 · British Journal of Social Psychology
  9. A step-by-step method for cultural annotation by LLMs
    Edgar Dubourg, Valentin Thouzeau, Nicolas Baumard · 2024 · Frontiers in Artificial Intelligence
  10. Language-specific representation of emotion-concept knowledge causally supports emotion inference
    Ming Li, Yu-Sheng Su, Hsiu-Yuan Huang, Jiali Cheng, Xin Hu, Xinmiao Zhang, Huadong Wang, Yujia Qin, Xiaozhi Wang, Kristen A. Lindquist et al. · 2024 · iScience
  11. GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspective
    Ala Nekouvaght Tak, Jonathan S. Gratch · 2024 · International Conference on Affective Computing and Intelligent Interaction and workshops
  12. Balancing Large Language Model Alignment and Algorithmic Fidelity in Social Science Research
    Alex Lyman, Bryce Hepner, Lisa P. Argyle, Ethan Craig Busby, Joshua R. Gubler, David Wingate · 2025 · Sociological Methods & Research
  13. Simulating Human Opinions with Large Language Models
    Carolin Kaiser, Jakob Kaiser, Vladimir Manewitsch, Lea Rau, René Schallner · 2025 · ACM Conference on User Modeling, Adaptation and Personalization (UMAP)
  14. Cognitive Modeling Using Artificial Intelligence
    Michael C. Frank, Noah D. Goodman · 2025 · Annual Review of Psychology
  15. Toward a Novel Methodology in Economic Experiments: Simulation of the Ultimatum Game with Large Language Models
    Ayato Kitadai, Yudai Tsurusaki, Yusuke Fukasawa, Nariaki Nishino · 2023 · IEEE International Conference on Big Data (BigData)
  16. Evaluating the acceptance of CBDCs: experimental research with artificial intelligence (AI) generated synthetic response
    Sergio Luis Náñez Alonso, Peterson K Ozili, Beatriz María Sastre-Hernández, Luís Pacheco, Central Bank of Nigeria, Abuja, Nigeria · 2025 · Quantitative Finance and Economics
  17. A technological construction of society: Comparing GPT‐4 and human respondents for occupational evaluation in the UK
    Paweł Gmyrek, Christoph Lutz, Gemma Newlands · 2024 · British Journal of Industrial Relations
  18. Navigating the Risks of Using Large Language Models for Text Annotation in Social Science Research
    Hao Lin, Yongjun Zhang · 2025 · Social Science Computer Review
  19. Large Language Models as Moral Experts? GPT-4o Outperforms Expert Ethicist in Providing Moral Guidance
    Danica Dillion, Debanjan Mondal, Niket Tandon, Kurt J. Gray · 2024 · PsyArXiv (OSF Preprints)
  20. Large Language Models
    Melanie Mitchell · 2024
  21. Perceptions of artificial intelligence system's aptitude to judge morality and competence amidst the rise of Chatbots
    Manuel Oliveira, Justus Brands, Judith Mashudi, Baptist Liefooghe, Ruud Hortensius · 2024 · Cognitive Research Principles and Implications
  22. Exploring Affective Representations in Emotional Narratives: An Exploratory Study Comparing ChatGPT and Human Responses
    Chaery Park, Jongwan Kim · 2024 · Cyberpsychology Behavior and Social Networking
  23. Human-AI Synergy in Survey Development: Implications from Large Language Models in Business and Research
    Ping-Fan Ke, K. Ng · 2024 · ACM Transactions on Management Information Systems
  24. The machine psychology of cooperation: can GPT models operationalize prompts for altruism, cooperation, competitiveness, and selfishness in economic games?
    Steve Phelps, Yvan I. Russell · 2025 · Journal of Physics Complexity
  25. Generative Agents in Agent-Based Modeling: Overview, Validation, and Emerging Challenges
    Carlo Adornetto, Adrian Mora, Kai Hu, Leticia Izquierdo Garcia, Parfait Atchade-Adelomou, Gianluigi Greco, Luis Alonso, Kent Larson · 2025 · IEEE Transactions on Artificial Intelligence
  26. Do large language models have a legal duty to tell the truth?
    Sandra Wachter, Brent Mittelstadt, Chris Russell · 2024 · SSRN Electronic Journal
  27. On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments
    Jingchao Fang, Nikos Aréchiga, Keiichi Namikoshi, Nayeli Suseth Bravo, Candice Hogan, David A. Shamma · 2024 · ACM International Conference on Intelligent Virtual Agents (IVA)
  28. Do Multimodal Large Language Models and Humans Ground Language Similarly?
    Cameron R. Jones, Benjamin K. Bergen, Sean Trott · 2024 · Computational Linguistics
  29. Data Quality Measures for Computational Research: Ensuring Informed Decisions with Emerging Data Sources
    Edward Carl Malthouse, Ewa Masłowska, Joanna Strycharz, Martin Paul Block, Theo Araujo · 2024 · Journal of Advertising
  30. Large language models can replicate cross-cultural differences in personality
    Paweł Niszczota, Mateusz Janczak, Michał Misiak · 2025 · Journal of Research in Personality
  31. Artificial intelligence and human decision making: Exploring similarities in cognitive bias
    Hanna Campbell, Samantha Goldman, Patrick M. Markey · 2025 · Computers in Human Behavior Artificial Humans
  32. LLM services in the management of social communications
    Yuriy Dyachenko, Олександра Гуменна, Oleg Soloviov, Inna Skarga-Bandurova, Nayden Nenkov · 2025 · Frontiers in Artificial Intelligence
  33. A large-scale investigation of everyday moral dilemmas
    Daniel Alexander Yudkin, Geoffrey P. Goodwin, Andrew Reece, Kurt J. Gray, Sudeep Bhatia · 2025 · PNAS Nexus
  34. Large language models (LLMs) as research Subjects: Status, opportunities and challenges
    Chenguang Zhao, Meirewuti Habule, Wei Zhang · 2025 · New Ideas in Psychology
  35. Estimation of disciplinary similarity with large language models
    Giulio Giacomo Cantone, Er-Te Zheng, Venera Tomaselli, Paul Nightingale · 2025 · Scientometrics
  36. Large language models for spreading dynamics in complex systems
    Shuyu Jiang, Hao Ren, Yichang Gao, Yi‐Cheng Zhang, Qi Li, Dayong Xiao, Jie Fan, Rui Tang, Wei Wang · 2026 · Physics Reports
  37. Promoting interactions between cognitive science and large language models
    Youzhi Qu, Penghui Du, Wenxin Che, Wei Chen, Chi Zhang, Wanli Ouyang, Yatao Bian, Feiyang Xu, Bin Hu, Kai Du et al. · 2024 · The Innovation
  38. Navigating the AI frontier: Should we fear ChatGPT use in higher education and scientific research? Finding a middle ground through guiding principles and practical applications
    Daniele Saccenti, Matilde Buattini, Silvia Grazioli, Dalila Torres · 2024 · Possibility Studies & Society
  39. Comments on “ AI and the advent of the cyborg behavioral scientist”
    Paul Andrew Blythe, Christopher Kulis, A. Peter McGraw, Michael Haenlein, Kelly Hewett, Kiwoong Yoo, Stacy L. Wood, Vicki G. Morwitz, Joel C. Huber · 2025 · Journal of Consumer Psychology
  40. Can Large Language Models Simulate Spoken Human Conversations?
    Eric Mayor, Lucas Manuel Bietti, Adrian Bangerter · 2025 · Cognitive Science
  41. Generative AI for Architectural Façade Design: Measuring Perceptual Alignment Across Geographical, Objective, and Affective Descriptors
    Stephen Law, Cleo Valentine, Yuval Kahlon, Chanuki Illushka Seresinhe, Jason Tang, Michal Gath-Morad, Haruyuki Fujii · 2025 · Buildings
  42. Using large language models for survey research in communication: opportunities and challenges
    Sebastián Valenzuela, Stephan Winter, Sebastián Rivera · 2025 · Communication and Change
  43. Simulating social perception with large language models: perceptions of China’s common prosperity
    Zhuoren Jiang, Biao Huang, Jin Ge, Chenxi Lin, Yueqian Xu, Jianxing Yu · 2025 · Journal of Chinese Governance
  44. Artificial Intelligence Simulation of Adolescents’ Responses to Vaping-Prevention Messages
    Paschal Sheeran, Alexander Kenny, Andrea Bermudez, Kurt J. Gray, E Galper, Marcella H. Boynton, Seth M. Noar · 2024 · Archives of Pediatrics and Adolescent Medicine
  45. Can ChatGPT emulate humans in software engineering surveys?
    Igor Steinmacher, Jacob Penney, Katia Romero Felizardo, Alessandro Garcia, Marco Aurélio Gerosa · 2024 · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement
  46. One fish, two fish, but not the whole sea: Alignment reduces language models' conceptual diversity
    Murthy, Sonia Krishna, Ullman, Tomer, Hu, Jennifer · 2025 · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
  47. Judgments of learning distinguish humans from large language models in predicting memory
    Huff, Markus, Ulakci, Elanur · 2025 · Scientific Reports
  48. Exploring LLMs for Automated Generation and Adaptation of Questionnaires
    Divya Mani Adhikari, Alexander Hartland, Ingmar G. Weber, Vikram Kamath Cannanure · 2025 · ACM Conference on Conversational User Interfaces (CUI)
  49. GPT-4V shows human-like social perceptual capabilities at phenomenological and neural levels
    Severi Santavirta, Yuhang Wu, Lauri Suominen, Lauri Nummenmaa · 2025 · Imaging Neuroscience
  50. How practitioners can leverage GenAI to bridge the research-practice gap
    Wassili Lasarov, Melanie Trabandt, Stefan Hoffmann, Giampaolo Viglia · 2025 · Tourism Management
  51. Who Am I with AI? Occupational identity crafting in human-AI workplaces
    Rui Zhao, Lixia Niu, Shiquan Wang, Zhen Chen · 2025 · International Journal of Information Management
  52. Beyond the Screen
    Musa Malik, Sungbin Youk, René Weber · 2024 · Journal of Media Psychology Theories Methods and Applications
  53. A Large-Scale Investigation of Everyday Moral Dilemmas
    Daniel Alexander Yudkin, Geoffrey P. Goodwin, Andrew Garrett Reece, Kurt J. Gray, Sudeep Bhatia · 2023
  54. Examining the Feasibility of Large Language Models as Survey Respondents
    Ayato Kitadai, Kazuhito Ogawa, Nariaki Nishino · 2024 · IEEE International Conference on Big Data (BigData)
  55. The Impostor is Among Us: Can Large Language Models Capture the Complexity of Human Personas?
    Christopher Klaus Lazik, Christopher Katins, Charlotte Kauter, Jonas Jakob, Caroline Jay, Lars Grunske, Thomas Kosch · 2025 · Mensch und Computer (MuC)
  56. The Good, the Bad, and the Uncanny: Investigating Diversity Aspects of LLM-Generated Personas for Requirements Engineering
    Christopher Klaus Lazik, Charlotte Kauter, Inês Nunes, Aaron Ziglowski, Alina Pryma, Christopher Katins, Lars Grunske, Thomas Kosch · 2025 · IEEE International Requirements Engineering Conference (RE)
  57. Large language models and humans converge in judging public figures’ personalities
    Xubo Cao, Michał Kosiński · 2024 · PNAS Nexus
  58. Quantification of cultural practices and diversity: An empirical experiment with generative artificial intelligence
    Wolfgang Messner · 2025 · Journal of World Business
  59. Testing for completions that simulate altruism in early language models
    Tim Johnson, Nick Obradovich · 2025 · Nature Human Behaviour
  60. How do Generative Language Models Answer Opinion Polls?
    Julien Boelaert, Samuel Coavoux, Étienne Ollion, Ivaylo D. Petev, Patrick Präg · 2024 · SocArXiv (OSF Preprints)
  61. Contradictory attitudes toward academic AI tools: The effect of awe-proneness and corresponding self-regulation
    Jiajin Sophie Tong, Yangmingxi Zhang, Yutong Li · 2025 · Computers in Human Behavior Artificial Humans
  62. Arti-‘fickle’ intelligence: using LLMs as a tool for inference in the political and social sciences
    Lisa P. Argyle, Ethan Craig Busby, Joshua R. Gubler, Bryce Hepner, Alex Lyman, David Wingate · 2025 · Nature Computational Science
  63. Evaluating the ability of large Language models to predict human social decisions
    Feng Xiao, X. T. Wang · 2025 · Scientific Reports
  64. The (in)efficacy of AI personas in deception detection experiments
    David M. Markowitz, Timothy R. Levine · 2025 · Journal of Communication
  65. ChatGPT does not replicate human moral judgments: the importance of examining metrics beyond correlation to assess agreement
    Matthew Grizzard, Rebecca Frazer, Andrew Luttrell, Charles Kevin Monge, Nicholas L. Matthews, C. Joseph Francemone, Michelle Frazer · 2025 · Scientific Reports
  66. Looking Under the Hood: How LLMs Attempt Political Persuasion and Microtargeting
    Alex Lyman, Ethan Craig Busby, Lisa P. Argyle, Joshua R. Gubler, Bryce Hepner, David Wingate · 2026 · Chinese Political Science Review
  67. Persuading large language models to comply with objectionable requests
    Lennart Meincke, Dan Shapiro, Angela Lee Duckworth, Ethan Mollick, Lilach Mollick, Christophe Van den Bulte, Robert B. Cialdini · 2026 · Proceedings of the National Academy of Sciences
  68. Constraint satisfaction in large language models
    Cassandra L. Jacobs, Maryellen C. MacDonald · 2024 · Language Cognition and Neuroscience
  69. The silicon service spectrum: warmth and competence explain people's preferences for AI assistants
    Ivan Alfonso Hernandez, Amal Chekili · 2024 · Frontiers in Social Psychology
  70. Teaching Psychology in Era of Digital Intelligence: The Role of Artificial Intelligence in Knowledge-Oriented and Research-Oriented Education
    Feng Yu, Yijun Zhao, Liying Xu, Kaiping Peng · 2025 · Frontiers of digital education.
  71. The Extended Morality as Cooperation Dictionary (eMACD): A Crowd-Sourced Approach via the Moral Narrative Analyzer Platform
    Musa Malik, Sungbin Youk, Frederic R. Hopp, Oliver Scott Curry, Marc Cheong, Mark Alfano, René Weber · 2025 · Communication Methods and Measures
  72. Assessing Large Language Models’ ability to predict how humans balance self-interest and the interest of others
    Valerio Capraro, Roberto Di Paolo, Veronica Pizziol · 2023
  73. Generative AI in healthcare: challenges to patient agency and ethical implications
    Holmes, Scott A., Faria, Vanda, Moulton, Eric A. · 2025 · Frontiers in Digital Health
  74. Untitled work
    Goli · 2023 · 10.2139/ssrn.4437617
  75. Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models
    Yuxuan Li, Hirokazu Shirado, Sauvik Das · 2025 · ACM Conference on Fairness, Accountability, and Transparency (FAccT)
  76. From Prompts to Constructs: A Dual-Validity Framework for Large Language Model Research in Psychology
    Lin, Zhicheng · 2026 · Annual Review of Psychology
  77. Is more always better? The effect of audience size on sales performance in live streaming commerce: A multimethod study
    Lifeng He, Xiaowei Li, Yuzhuo Li, Yu Liu, Ning Zhang, Xiaohang Zhou · 2025 · Journal of Retailing and Consumer Services
  78. AI‐Enhanced Semantic Feature Norms for 786 Concepts
    Siddharth Suresh, Kushin Mukherjee, Tyler Giallanza, Xizheng Yu, Mia Patil, Jonathan D. Cohen, Timothy Thomas Rogers · 2025 · Topics in Cognitive Science
  79. Startup Evaluations with Generative Artificial Intelligence: An Exploratory Study on Early-Stage Investments and Survival Predictions by Large Language Models
    Simon Kleinert, Diemo Urbig · 2026 · Entrepreneurship Theory and Practice
  80. Digital twins are funhouse mirrors: Five systematic distortions
    Tianyi Peng, Melanie S. Brucks, George Gui, Daniel J. Merlau, Grace Jiarui Fan, Malek Ben Sliman, Eric J. Johnson, Abdullah Althenayyan, Silvia Bellezza, Dante Donati et al. · 2026 · Science Advances
  81. The impact of fine-tuning LLMs on the quality of automated therapy assessed by digital patients
    Stav Yosef, ‪Moreah Zisquit‬‏, Ben Cohen, Anat Brunstein Klomek, Kfir Bar, Doron A. Friedman · 2025 · npj Mental Health Research
  82. A Technological Construction of Society
    Paweł Gmyrek, Christoph Lutz, Gemma Newlands · 2024 · International Labour Office eBooks
  83. Preference-Conditioned Language-Guided Abstraction
    Andi Peng, Andreea Bobu, Belinda Z. Li, Theodore R. Sumers, Ilia Sucholutsky, Nishanth Kumar, Thomas L. Griffiths, Julie Shah · 2024 · ACM/IEEE International Conference on Human-Robot Interaction (HRI)
  84. Intelligent Recognition of Tool Wear with Artificial Intelligence Agent
    Jiaming Gao, Han Qiao, Yilei Zhang · 2024 · Coatings
  85. Innovation Through Conceptual Research: Tips for Stoking Curiosity
    Jun Wen · 2024 · Global Business and Organizational Excellence
  86. Agenda for psychological and behavioural science of transformative behavioural change
    Dario Krpan · 2024 · Behavioural Public Policy
  87. Are Large Language Models Aligned with People’s Social Intuitions for Human–Robot Interactions?
    Lennart Wachowiak, Andrew Coles, Oya Çeliktutan, Gerard Canal · 2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  88. SeSaMe: A Framework to Simulate Self-Reported Ground Truth for Mental Health Sensing Studies
    Akshat Choube, Vedant Das Swain, Varun Mishra · 2024 · International Conference on Affective Computing and Intelligent Interaction and workshops
  89. A publicly available benchmark for assessing large language models’ ability to predict how humans balance self-interest and the interest of others
    Valerio Capraro, Roberto Di Paolo, Veronica Pizziol · 2025 · Scientific Reports
  90. Leveraging LLMs for predictive insights in food policy and behavioral interventions
    Micha Kaiser, Paul Marvin Lohmann, Peter Ochieng, Billy Shi, Cass Robert Sunstein, Lucia A. Reisch · 2025 · Discover Food
  91. Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation
    Cheng Ma, Hyekang Kevin Joo, Alexandria Katarina Vail, Sunreeta Bhattacharya, Álvaro Fernández García, Kailana Baker-Matsuoka, Sheryl Mathew, Lori L. Holt, Fernando De la Torre · 2025 · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion)
  92. Towards a psychology of machines: large language models predict human memory
    Elanur Ulakçı, Jan Pascal Göbel, Markus Huff · 2025 · PeerJ Computer Science
  93. Emotional Intelligence of GPT-4 Large Language Model
    Взорин Глеб Дмитриевич, Alexey M. Bukinich, Anna Sedykh, Ветрова Ирина Игоревна, Elena A. Sergienko · 2023 · Preprints.org
  94. How should the advent of large language models affect the practice of science?
    Marcel Binz, Stephan Alaniz, Adina L. Roskies, Balázs Aczél, Carl T. Bergstrom, Colin Allen, Daniel J. Schad, Dirk U. Wulff, Jevin D. West, Qiong Zhang et al. · 2023 · OSF Preprints (OSF Preprints)
  95. Editorial for the Special Issue on Algorithms in Our Lives
    Sudeep Bhatia, Mirta Galešić, Melanie Mitchell · 2024 · Perspectives on Psychological Science
  96. Replicating Reason: The Advent of Human-like Audit Judgment by Generative AI
    Markus Isack · 2024 · SSRN Electronic Journal
  97. Artificial Agents in Operations Management Experiments
    Samuel Nathan Kirshner · 2024 · SSRN Electronic Journal
  98. Moral Association Graph: A Cognitive Model for Automated Moral Inference
    Aida Ramezani, Yang Xu · 2024 · Topics in Cognitive Science
  99. Using Large Language Models in Behavioral Science Interventions: Promise & Risk
    Cameron A. Hecht, Desmond C. Ong, Margarett Clapper, Michaela Jones, Dorottya Demszky, Diyi Yang, johannes Christopher Eichstaedt, Christopher J. Bryan, David Scott Yeager · 2025 · Behavioral Science & Policy
  100. Conformity towards humans versus AI in different task domains: the type of task matters
    Sebastian Oltedal Thorp, Kjell Solem Slupphaug, Lars M. Rimol, Simon Lervik, Simen Kristoffer Berg Hoel, Simone Grassini · 2025 · Journal of Psychology and AI