Synthetic Replacements for Human Survey Data? The Perils of Large Language Models
Bisbee, James, Clinton, Joshua D., Dorff, Cassy, Kenkel, Brenton, Larson, Jennifer·2023·Political Analysis
Cited by (209)
Items 101–200 of 209
- Be.FM: Open Foundation Models for Human BehaviorYutong Xie, Ziqing Li, Xiyuan Wang, Yijun Pan, Qijia Liu, Xingzhi Cui, Kuang-Yu Lo, Ruoyi Gao, Xingjian Zhang, Jincheng Huang et al. · 2025 · SSRN Electronic Journal
- Assessing Bias in LLM-Generated Synthetic Datasets: The Case of German Voter BehaviorLeah von der Heyde, Anna‐Carolina Haensch, Alexander Wenz · 2023
- Once Upon a Time: Introducing the Historical Values SurveyMahdi Khesali, Stefan Voigt, Nadia von Jacobi · 2025 · SSRN Electronic Journal
- Ranking Business Trade Preferences using GPTRodrigo Fagundes Cézar · 2025 · SSRN Electronic Journal
- Large Language Models(LLMs) in Political Science Research: Analysis of Topical Trends and Usage PatternsInbok Rhee · 2025 · Korean Journal of International Relations
- Exploring the Learning Styles of "Semi-Humans": A Comparative Study of Nine Large Language ModelsYangxiaoyu Yang, Tao Wang, Dayong Shen, Feng Yao, Shan Huang · 2025 · International Conference on Computer Technology Applications (ICCTA)
- Empirical Examination of Large Language Models in Regional Psychological Structures Simulation: Personality and Well-beingXing Zhou, Jiahong Zheng · 2025 · Research Square
- Public pollingArnold Lau, Scott Keeter · 2025 · Elsevier eBooks
- How LLMs Handle Cultural Bias: Reactions to Asian Minority Historical NarrativesShirin Shujaa, Ginel Dorleon, Arthur Tang · 2025 · Lecture notes in computer science
- Moral reasoning and synthetic judgment in large language modelsThierry Poibeau · 2025 · Ubiquity Press eBooks
- LLM Survey Framework: Coverage, Consistency, IdentificationJing Cynthia Wu, Jin Xi, Shihan Xie · 2025 · SSRN Electronic Journal
- AI Simulations of Audience Attitudes and Policy Preferences: “Silicon Sampling” Guidance for Communications PractitionersJohn Wihbey, Samantha D'Alonzo · 2025 · SSRN Electronic Journal
- Psychometric Comparability of LLM-Based Digital TwinsYufei Zhang, Zhihao Ma · 2026 · SSRN Electronic Journal
- Conducting Innovative Thought Experiments and Simulations With Large Language Modelsİbrahim Niftiyev · 2026 · IGI Global eBooks
- The Price of Digital Compassion: Exposing and Managing Latent Risks in AI Survey AugmentationYujie Chi, Dazhou Lei · 2026 · SSRN Electronic Journal
- Living Labs as Innovation Catalysts in the Silver EconomyGöran Roos · 2026 · IGI Global eBooks
- How Many Human Survey Respondents is a Large Language Model Worth? An Uncertainty Quantification PerspectiveChengpiao Huang, Yuhang Wu, Kaizheng Wang · 2026 · SSRN Electronic Journal
- Surveying with AI: Simulating Human Responses Using Personalized LLM Agents and Social Media DataShuxi Liang, Haolin Ren, Tianze Zhang, Xiaofan Liu, Zhimeng Yin, Daning Hu · 2025 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
- Generation of Synthetic Data in Health Surveys Using Large Language ModelsDavid Villarreal‐Zegarra, Luciana Bellido-Boza · 2026 · medRxiv
- How Marketers Can Utilize Generative AI in Qualitative ResearchOmar H. Fares · 2026 · Springer eBooks
- Computational Basis of Large Language Models’ Decision Making in Social SimulationJi Ma · 2026 · Sociological Methodology
- Beyond human proxies: The roles and usefulness of large language models in user research for mobility service developmentEetu Wallius, Esko Lehtonen · 2026 · Transportation Research Interdisciplinary Perspectives
- Approximating Consumer Preferences Before Market Entry: Large Language Models as Decision-Support Tools in Early-Stage New Product DevelopmentHaejun Jung, Jaeyun Lee, Sungwon Lee, Doohee Chung · 2026 · SSRN Electronic Journal
- Polypersona: Persona-Grounded LLM for Synthetic Survey ResponsesTejaswani Dash, Dinesh Karri, Anudeep Vurity, Gautam Varma Datla, Tazeem Ahmad, Saima Rafi, Rohith Tangudu · 2025 · IEEE International Conference on Big Data (BigData)
- LLMs as complementary tools for innovation surveys research: pattern replication and contextual relevanceJae Hyung Park, Jae-Suk Yang · 2026 · Scientometrics
- A Cross-Cultural Comparison of LLM-Based Public Opinion Simulation: Evaluating Chinese and U.S. Models on Diverse SocietiesWeihong Qi, Fan Huang, Jisun An, Haewoon Kwak · 2025 · IEEE ... International Conference on Data Mining workshops
- Stochastic Parrots or Singing in Harmony? Testing Five Leading LLMs for their Ability to Replicate a Human Survey with Synthetic DataJason Miklian, Kristian Hoelscher, John E. Katsos · 2026 · SSRN Electronic Journal
- Experimental comparison of a chatbot-like questionnaire design with a traditional web questionnaire designCeyda Çavusoglu Deveci, Marek Fuchs, Anke Metzler · 2026 · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique
- Survey Research With AI2026 · Advances in computational intelligence and robotics book series
- Generative AI for climate governance and acceptability-constrained policy designAjaykumar Manivannan, Viktoria Spaiser, Tristan J. B. Cann, James Evans, Jordan Everall, Max Falkenberg, David García, Weisi Guo, Rico Herzog, Ilona M. Otto et al. · 2026 · npj Climate Action
- Simulating Lay Health-Seeking Behavior with LLM Personas and Illness Vignettes: Reproducibility, Prompt Sensitivity, and Slice DependenceYuusuke Harada · 2026 · Qeios
- Small is Beautiful : addressing resource scarcity, language variation, and transfer challenges for automatic detection of Harmful languageArij Riabi · 2025 · theses.fr (ABES)
- Establishing Reliability and Validity Evidence for Artificial Intelligence-Based Scores Application to the Organizational SciencesAndrew B. Speer, Frederick Louis Oswald, Dan J. Putka · 2026
- LLMs and Data Management for International Relations Scholars: Moving Beyond EuGene-Style SoftwarePaul Poast · 2026 · SSRN Electronic Journal
- Stochastic Parrots or Singing in Harmony? Testing Five Leading LLMs for their Ability to Replicate a Human Survey with Synthetic DataJason Miklian, Kristian Hoelscher, John Katsos · 2026 · SSRN Electronic Journal
- Can LLMs Mimic Household Surveys?: From Representative Agents to Population DistributionsAmi Dalloul, Moritz Pfeifer · 2026 · SSRN Electronic Journal
- Evolving and Detecting Multi-Turn Deception using Geometric SignaturesSurender Suresh Kumar, Mary L. Cummings · 2026 · SSRN Electronic Journal
- Giving texture to theory: A computational thought experiment on opportunity capital with LLM agentsDimo P. Dimov · 2026 · Journal of Business Venturing Insights
- Simulating Lay Health-Seeking Behavior with LLM Personas and Illness Vignettes: Reproducibility, Prompt Sensitivity, and Slice DependenceYuusuke Harada · 2026 · Qeios
- Assessment of LLMs for Generating Synthetic Health-Related Quality-of-Life Survey Responses Among U.S. AdultsSeungkook Baek, Sunghyun Lee, Hyungjin Kim, Sungchul Park · 2026 · American Journal of Preventive Medicine
- Exploring migration research with large language model: methods and insightsS. Iacus, Hao-Dong Qi, Jiyoung Han · 2026 · Royal Society Open Science
- Value Contamination in Policy Simulation: Measuring How LLM Policy-Value Orientations Shape Predicted Administrative Burden EffectsYichao Jin · 2026 · SSRN Electronic Journal
- Thinking Outside the Black Box: Seven Guidelines for GenAI Use in the Ecological SciencesNina C. Ferrari, Emily E. Conklin, Amelia Fitch, Dustin G. Gannon, Rossana Macedo, Aidan Place, Hannah R. Sachs, Eugene Seo, Matthew J. Weldy, Matthew G. Betts · 2026 · Ecology and Evolution
- Synthetic Personas for Scaling Privacy Research in EducationKimaya Padmashali, Pedrycz Wiktor, Oleksandra Poquet · 2026 · ACM Conference on Learning @ Scale (L@S)
- The Collapse of Heterogeneity in Silicon PhilosophersYuanming Shi, Andreas Alexander Haupt · 2026 · ACM Conference on Fairness, Accountability, and Transparency (FAccT)
- Informing AI Policy Assessment using Large-Scale Simulation of InterventionsJulia Barnett, Kimon Kieslich, Natali Helberger, Nicholas A. Diakopoulos · 2026 · ACM Conference on Fairness, Accountability, and Transparency (FAccT)
- The Context Dependency of Demographic Bias in LLM AnnotationMegan A. Brown, Shubham Atreja, Libby Hemphill, Patrick Y. Wu · 2026 · ACM Conference on Fairness, Accountability, and Transparency (FAccT)
- Evaluation Criteria for Synthetic Respondents in Qualitative Research: Limits of ApplicabilityKirill Zhulikov · 2026 · Inter
- Testing of AI-generated Autobiographies for Studying the Life CourseAnna Vladimirovna Andreenkova · 2026 · Inter
- Synthetic survey data in renewable energy acceptance research: A validity audit using PLS-SEMTanvi Bhatia, Gnana K. Bharathy, Mukesh Prasad · 2026 · Energy Sustainable Development/Energy for sustainable development
- Humanos frente a tres modelos del lenguaje en educación patrimonial: un análisis comparativo mediante la escala Q-HeriLearnVíctor E. Gil-Biraud, Pablo de Castro, Olaia Fontal Merillas · 2026 · Ense�anza de las Ciencias Sociales
- Silicon Sampling via Cross-Survey TransferChan-Tung Ku, Chan Hsu, Pei-Cing Huang, Frank Cheng-Shan Liu, I-Ling Cheng, Yihuang Kang · 2026 · IEEE International Conference on Information Reuse and Integration (IRI)
- Judicious use of LLMs could speed up progress in the social sciencesJames N. Druckman · 2026 · Nature
- Forecasting the Future Through a Partisan Lens: Electoral Outcomes and Household ExpectationsSergii Drobot, Nayeon Kang · 2026 · SSRN Electronic Journal
- Minimal Viable Cognitive Agent (MVCA): Building a glass-box LLM cognitive architecture for testing process theories in Agent psychonomicusJack Chen, WeiHeng Xiao · 2026 · SSRN Electronic Journal
- Chorus: An Agentic Framework for Generating Realistic Deliberation DataAthanasios Koursaris, George Domalis, Alexandra Apostolopoulou, Konstantinos Kanaris, Dimitris Tsakalidis, Ioannis E. Livieris · 2026 · Communications in computer and information science
- Synthetic data and digital twins: The hype, the facts, the promiseOlivier Toubia · 2026 · Current Opinion in Psychology
- AI and citizen participation: a political economy lensNathan Davies, Flynn Devine · 2026 · Data & Policy
- Designing Data Centers for Demand Response Through a Construction-Phase Readiness IndexArezou Shafaghat, Da Hu, Ali Keyvanfar · 2026 · Buildings
- Generation of Synthetic Samples by Large Language Models in the Context of Cross-Country SurveysElizaveta Kuznechenkova, Maria Nesterskaya, Vera Semenova · 2026 · IEEE International Conference on AI and Data Analytics (ICAD)
- The End of Theory in Social Science? AI and Sleepwalking into Epistemic SurrenderA N Smith, Clare Humphries · 2026 · SSRN Electronic Journal
- From institutional trust to AI adoption: a trust transfer and risk perception model of AI-enabled public service acceptance in China's digital government contextHuihui Wang, Shixin Zhu · 2026 · Frontiers in Psychology
- Artificial Consensus: AI and Survey MeasurementThomas Cauthorn · 2026 · SSRN Electronic Journal
- Beyond the Conventional Pipeline: Large Language Models for Social Science MeasurementLê Thái Bảo · 2026 · Chinese Political Science Review
- Enhancing Counselor Education With Artificial Intelligence Chatbots: Attitudes Toward Artificial Intelligence and Counseling Skill Self‐EfficacyEunae Han, Pei‐Ling Hsu, Jihoon Shin · 2026 · Journal of Counseling & Development
- Can silicon citizens replace human respondents? Validating large language models against human choice and valuation dataE.H. Cho, Juyong Lee · 2026 · SSRN Electronic Journal
- Distributional Alignment for Social Simulation with LLMs: A Mixture Modeling ApproachYutong Xie, Ruoyi Gao, Qiao-Zhu Mei · 2026 · Knowledge Discovery and Data Mining
- Drivers of Generative AI Acceptance in Agriculture: An AHP Study with Synthetic Experts *Murat Tahir Çaldağ · 2026 · International Conference on Control, Decision and Information Technologies (CoDIT)
- Not for people like me: How frontier AI models redirect skeptical rural school staffZachary Rossmiller · 2026 · Computers and Education Artificial Intelligence
- Navigating AI disruption: Systems theory framework for the European Social SurveyBrina Malnar · 2026 · Current Sociology
- Generative AI for Surveys on Payment Apps: AI Views on Privacy and TechnologyKoji Takahashi, Joon Park · 2026 · SSRN Electronic Journal
- Auditing LLM-based Synthetic Expert Panels for AHP: A Preregistered Benchmark and Prospective Order-randomization TestHoward Kim, Keuntae Cho · 2026 · SSRN Electronic Journal
- Emergent Health Preferences in Large Language Models: A Time-Trade-Off Analysis Using EQ-5D-3LPatrik P. Süli, György Eigner, Zsombor Zrubka · 2026 · IEEE International Conference on Intelligent Engineering Systems (INES)
- Calibrated synthetic consumer panels for governed strategic market testingOyindamola L. Lawal, Olamide F Orisakahunsi, Ogechi M. Ikeakaonwu, Elizabeth I. Igbodor, Adeyemi A. Adefisan-Williams, Ngozi B. Umoru, Saheed A. Adeniyi, Adeyemi A. Adefisan-Williams, Rukayat A. Olawaled and Elizabeth I. Igbodor, Priscilla Kuyet Ishaku · 2026 · Strategic Business Research
- LLMs Do Not Emulate PopulationsB.S Green, Greg Leo · 2026 · SSRN Electronic Journal
- Between purpose and strategy: How corporations amplify CEO activism on social mediaJia-Cheng Huang, Yi-Hui Ji · 2026 · Public Relations Review
- Global Trends in Research Ethics in the Context of Artificial IntelligenceHakile Resulbegoviq · 2026 · Advances in computational intelligence and robotics book series
- RAD-MRM: A Multi-Source Data-Integrated Methodology for Mining User Requirements in Industrial-Heritage TourismZhi Qiao, Shuai Yuan, Yanmin Xue, Wei Zhou, Shuang Wang, Kai Qi · 2026 · International Journal of Human-Computer Interaction
- Don’t Look up: Evaluating the Tradeoff Between Performance and Sustainability of Text Classification Using Open LLMsSean-Kelly Palicki, Isaac Bravo, Clint Claessen · 2026 · Social Science Computer Review
- Can large language models replace human surveys in geospatial studies? A case of vague cognitive regionsYue Lin, Ningchuan Xiao · 2026 · Spatial Cognition and Computation
- Epistemic Displacement Theory: Understanding the Transformation of Consumer Knowledge in the Age of Synthetic RespondentsHyungjin Lukas Kim · 2026 · Journal of Macromarketing
- LLMRpanel: Benchmarked Silicon Samples for Survey and Experiment DesignAli Sanaei · 2026
- Synthetic data in research: expert perceptions and a protocol for responsible GenAI useTarik Doğru, Makarand Amrish Mody, Anil Bilgihan, A. George Assaf · 2026 · International Journal of Contemporary Hospitality Management
- Mathematical Sociology: Models, Structures, and Open ProblemsDimitri Volchenkov · 2026 · Mathematics
- Moral Inflation in Synthetic Investors: When LLM Personas Replace Heterogeneity with Normative ArchetypesSeungho Jeon, H. Steve Leslie, Hrishikesh Desai · 2026 · SSRN Electronic Journal
- Algorithmic systems, human agency and the future of platform researchHoma Hosseinmardi, Upasana Dutta, David M. Rothschild, Duncan J. Watts · 2026 · Nature Computational Science
- Epistemic Capabilities of Artificial Intelligence for Public Administration and Policy Research: A Framework for Scholarship in the Age of Intelligent MachinesYanto Chandra, Jianxiang Tan · 2026 · Policy Studies Journal
- User engagement behaviours with identity-disclosed social bots on social media: the role of perceived human–machine differencesHao Xu, Shaobo Liang, Jing Dong, Qingxuan Cheng · 2026 · Aslib Journal of Information Management
- Which AI? A Comparative Evaluation of Generative AI and Neuro‐Symbolic AI for Silicon SamplingKamila Zahradníčková, Jan Polišenský, Martin Lukeš, Radek Hranický, Petr Pouč · 2026 · Psychology and Marketing
- Get a learner’s permit before you speed on the highway: farewell and a call for a priori model evaluation metrics and guardrails for computational communication researchLijiang Shen · 2026 · Communication Methods and Measures
- Psychologische Forschung zu Zeiten generativer KI: Eine methodische PositionierungJona Carmon, Martin Rolfs, Melanie Caroline Steffens, Andrea Kiesel, Thorsten Meiser, Gudrun Schwarzer, Simone Kühn · 2026 · Psychologische Rundschau
- KI in der UmfrageforschungMarek Fuchs · 2026 · Springer eBooks
- Simulated responses from large language models are weak proxies for human economic preferences across 74 countriesFadong Chen, Qijun Wang, Lei Wang, Sudeep Bhatia · 2026 · Nature Human Behaviour
- Using Large Language Models to Construct Virtual Top ManagersAntonio Garzón‐Vico, Krithika Komalapati, Arsalan Shahid, Jan Rosier · 2026 · SSRN Electronic Journal
- When Synthetic Consumers Become Consumer Evidence: Evidence-Role Drift in AI-Mediated Market ResearchLenin Heartly · 2026 · Octopus
- Just a Simulation? A Review of Large Language Models as Subjects in Experimental EconomicsAyato Kitadai, Nariaki Nishino · 2026 · SSRN Electronic Journal
- What Is Left for Us? Second Scholarship Against the Degradation of Research by AIClaudio Novelli, Luciano Floridi · 2026 · European Law Journal
- KETRIN: Elicitação Adaptativa de Conhecimento para Diagnóstico de Maturidade em Proteção de DadosKetrin Diovana Alves Rodrigues Vargas, Tuigg R. Barcelos, Camilla Borchhardt Quincozes, Silvio E. Quincozes, Paulo Silas Severo de Souza · 2026 · Simpósio Brasileiro de Cibersegurança (SBSeg)
- On the Impact of Item Order and Questionnaire Popularity for Language Model Construct Validity and Cross-Human AlignmentSimon Münker, Simon Werner, Achim Rettinger · 2026 · Lecture notes in computer science
- Estimating Decision Rules from Large Language Model Agents: An Application to Bank Balance-Sheet ManagementZlatin Sarastov · 2026 · Research Square