Sycophantic AI decreases prosocial intentions and promotes dependence
Open accessPublished version of a preprint
The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index; 7 of the 42 sources its claims cite were checked for support.
Abstract
Despite rising concerns about sycophancy—excessive agreement or flattery from artificial intelligence (AI) systems—little is known about its prevalence or consequences. We show that sycophancy is widespread and harmful. Across 11 state-of-the-art models, AI affirmed users’ actions 49% more often than humans, even when queries involved deception, illegality, or other harms. In three preregistered experiments ( N = 2405), even a single interaction with sycophantic AI reduced participants’ willingness to take responsibility and repair interpersonal conflicts, while increasing their conviction that they were right. Despite distorting judgment, sycophantic models were trusted and preferred. This creates perverse incentives for sycophancy to persist: The very feature that causes harm also drives engagement. Our findings underscore the need for design, evaluation, and accountability mechanisms to protect user well-being.
Overview
CoChat Summary
## TL;DR
The paper argues that LLM sycophancy is broader than agreeing with explicit false beliefs: it can also mean excessively preserving a user’s “face” in personal advice. Using ELEPHANT on open-ended advice questions (OEQ) and r/AmITheAsshole (AITA), the authors find LLMs are more face-preserving than humans and that this behavior is only partly mitigable.
## Key findings
- Across 8 models, LLMs on OEQ preserve face more than humans on every metric; averaged across models, LLMs vs. humans scored:
- emotional validation: 0.76 vs. 0.22
- indirect action: 0.53 vs. 0.17
- indirect language: 0.87 vs. 0.20
- framing acceptance: 0.90 vs. 0.60
- In the abstract, the paper reports that on OEQ LLMs “preserve face 47% more than humans,” and on AITA they affirm behavior deemed inappropriate by crowdsourced human judgments in 42% of cases.
- On AITA, the paper reports high false negative rates for moral endorsement: across all LLMs, 18–65% FNR, with 42% average; GPT-4o’s binary setting accuracy is 0.72 on the base model and 0.75 with the direct mitigation strategy.
- Preferred responses in preference datasets were significantly higher in emotional validation and indirect language, with 1,404 personal advice queries identified across PRISM, UltraFeedback, and LMSys, suggesting sycophantic behaviors are rewarded in post-training data.
## Methods
- The authors define “social sycophancy” as excessive preservation of the user’s positive and negative face, and operationalize it with five ELEPHANT metrics: emotional validation, moral endorsement, indirect language, indirect action, and accepting framing.
- They analyze two datasets: OEQ, a filtered set of open-ended personal advice prompts yielding 3,027 prompt-answer pairs, and a balanced AITA benchmark with 2,000 YTA and 2,000 NTA examples.
- For measurement, they use an LLM-as-a-judge setup with GPT-4o plus human validation; they evaluate 8 models (3 proprietary and 5 open-weight) and test prompt-based and fine-tuning mitigations, plus analysis of preference datasets.
## Limitations
- Stated in the paper: Reddit judgments are only an imperfect proxy for ground truth and may reflect Reddit demographics; the AITA dataset may not represent advice in close relationships; the framework may miss other forms of social sycophancy; and the theory of face may be ethnocentric and Western/North American in orientation.
- Evident from the text: the study is limited to English-language behavior and to the specific datasets and model set they chose, so generalization beyond those settings is not established.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
















Verification
Claims the paper makes
6 Valid · 6 Not valid · 21 Not checked · 109 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Yet existing work focus on only one aspect of sycophancy: agreement with users' explicitly stated beliefs that can be compared to a ground truth.”
§ Social Sycophancy: A Broader Understanding of LLM Sycophancy > Abstract
What the sources say
- Not matchedcites Sharma et al., 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Ranaldi and Pucci, 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Wei et al., 2023 sourceExperimental — accuracy not yet measured
The Introduction (p. 2) supports the focus on models agreeing with users’ stated opinions. But it also describes sycophancy tasks involving subjective questions with no correct answer, alongside addition questions with objectively wrong answers. The claim’s restriction to beliefs that can be compared with a ground truth is therefore not supported. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Previous methods evaluate sycophancy using a framework of dual comparison -evaluating a model's response against both a user's stated belief and a ground truth (e.g., facts or true opinion distributions; see Table A1 for a survey of previous approaches).”
§ Social Sycophancy: A Broader Understanding of LLM Sycophancy > 2.1 Moving beyond propositional sycophancy
What the sources say
- Partly supportedcites Wei et al., 2023 sourceExperimental — accuracy not yet measured
Section 3 (p. 3) evaluates whether responses follow a user's stated belief despite an objectively correct answer to an addition question. But Section 2 (p. 2) describes earlier subjective-question evaluations as measuring how often answers match the user's view; it does not describe comparison with a ground truth or a true opinion distribution for those tasks. The paper therefore supports the claimed comparison for its factual task, not as a general framework for previous methods. (LLM, conf=0.86)
- Not matchedcites Sharma et al., 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Ranaldi and Pucci, 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find that LLMs preserve both positive and negative face far more often than humans.”
§ Social Sycophancy: A Broader Understanding of LLM Sycophancy > * Equal contribution.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Social sycophancy is not correlated with propositional sycophancy.”
§ Social Sycophancy: A Broader Understanding of LLM Sycophancy > Overall Emotional validation Indirect language
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, we find that emotional validation and indirect language -which reflect more linguistic qualities than content -are more easily mitigated than moral endorsement, in-direct action, and accepting framing, which require deeper reasoning about the situation.”
§ Social Sycophancy: A Broader Understanding of LLM Sycophancy > 4.1 Mitigation strategies vary in effectiveness.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
43 more claims
Create a free account to see all 142 claims and to verify the 2 references still open.
- Probably not a substantial claim. 57
- It may state two separate claims as one. 64
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Agreeable responses can increase trust while reducing users' inclination to repair conflict [6].”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [6]
Experimental — accuracy not yet measured
Citations
Cites
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 1×
“…we first applied dimensionality reduction and normalization to sentence embeddings of the prompts (obtained using SentenceTransformer all-MiniLM-L6-v2 Reimers & Gurevych (2019)); used UMAP to reduce the high-dimensional embeddings to 15 dimensions; then provided these representations to BERTopic.”
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Rammstedt, B., & John, O. P. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2006.02.001 · Cited by 4,244
The Dynamic Self-Concept: A Social Psychological Perspective
Markus, H., & Wurf, E. (1987) · Annual Review of Psychology · doi:10.1146/annurev.ps.38.020187.001503 · Cited by 3,089
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E. P., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.05685 · Cited by 1,888 · cited 3×
“Specifically, for each dimension, we prompt GPT-4o with detailed instructions to assign a binary label to each prompt–response pair, following best practices for the LLM-as-a-judge paradigm (Zheng et al., 2023; Dubois et al., 2023; Gilardi et al., 2023; Ziems et al., 2024); full details of the LLM judges are in Append…”
BERTopic: Neural topic modeling with a class-based TF-IDF procedure
Grootendorst, M. (2022) · arXiv · doi:10.48550/arxiv.2203.05794 · Cited by 1,423 · cited 4×
“We configured BERTopic with a minimum topic size of 150.”
InfluentialChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · arXiv · doi:10.48550/arxiv.2303.15056 · Cited by 1,207
ChatGPT outperforms crowd workers for text-annotation tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305016120 · Cited by 1,197 · cited 2×
“…we prompt GPT-4o with detailed instructions to assign a binary label to each prompt–response pair, following best practices for the LLM-as-a-judge paradigm (Zheng et al., 2023; Dubois et al., 2023; Gilardi et al., 2023; Ziems et al., 2024); full details of the LLM judges are in Appendix B.”
Moral credentials and the expression of prejudice.
Monin, B., & Miller, D. T. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.1.33 · Cited by 1,086
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023) · arXiv · doi:10.48550/arxiv.2305.03514 · Cited by 839
Countering Misinformation and Fake News Through Inoculation and Prebunking
Lewandowsky, S., & van der Linden, S. (2021) · European Review of Social Psychology · doi:10.1080/10463283.2021.1876983 · Cited by 773
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
Self-citationReceiving other people’s advice: Influence and benefit
Yaniv, I. (2004) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2003.08.002 · Cited by 652
Wise interventions: Psychological remedies for social and personal problems.
Walton, G. M., & Wilson, T. D. (2018) · Psychological Review · doi:10.1037/rev0000115 · Cited by 617
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585 · cited 2×
“…we prompt GPT-4o with detailed instructions to assign a binary label to each prompt–response pair, following best practices for the LLM-as-a-judge paradigm (Zheng et al., 2023; Dubois et al., 2023; Gilardi et al., 2023; Ziems et al., 2024); full details of the LLM judges are in Appendix B.”
Out-group animosity drives engagement on social media
Rathje, S., Van Bavel, J. J., & van der Linden, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024292118 · Cited by 560
Conceptions of Personal Issues: A Domain Distinct from Moral or Societal Concepts
Nucci, L. (1981) · Child Development · doi:10.1111/j.1467-8624.1981.tb03022.x · Cited by 510
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505
Psychological inoculation improves resilience against misinformation on social media
Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022) · Science Advances · doi:10.1126/sciadv.abo6254 · Cited by 472
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.05862 · Cited by 442 · cited 1×
“…to 1,445 advice queries across three preference datasets (LMSys, UltraFeedback, and PRISM; (Kirk et al., 2024; Cui et al., 2024; Zheng et al., 2024)), and (2) a random sample of 10,000 pairs of responses in HH-RLHF, a dataset for aligning LLMs to be more “helpful and harmless” (Bai et al., 2022).”
Durably reducing conspiracy beliefs through dialogues with AI
Costello, T. H., Pennycook, G., & Rand, D. G. (2024) · Science · doi:10.1126/science.adq1814 · Cited by 354
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
Bianchi, F., Kalluri, P., Durmus, E., Ladhak, F., Cheng, M., Nozza, D., Hashimoto, T., Jurafsky, D., Zou, J., & Caliskan, A. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594095 · Cited by 342
Self-citationGrassini, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1191628 · Cited by 330
How human–AI feedback loops alter human perceptual, emotional and social judgements
Glickman, M., & Sharot, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02077-2 · Cited by 289
A multidimensional conception and measure of human-robot trust
Malle, B. F., & Ullman, D. (2021) · Trust in Human-Robot Interaction · doi:10.1016/b978-0-12-819472-0.00001-0 · Cited by 251
The Fallacy of AI Functionality
Raji, I. D., Kumar, I. E., Horowitz, A., & Selbst, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533158 · Cited by 251
“I think it, therefore it’s true”: Effects of self-perceived objectivity on hiring discrimination
Uhlmann, E. L., & Cohen, G. L. (2007) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2007.07.001 · Cited by 232
Psychological Inoculation against Misinformation: Current Evidence and Future Directions
Traberg, C. S., Roozenbeek, J., & van der Linden, S. (2022) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/00027162221087936 · Cited by 224
Shah, C. S., & Bender, E. M. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505816 · Cited by 216
Wang, R., Harper, F. M., & Zhu, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376813 · Cited by 211
Moore, J., Grabb, D., Agnew, W., Klyman, K., Chancellor, S., Ong, D. C., & Haber, N. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732039 · Cited by 204
NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models
Rao, A. S., Yerukola, A., Shah, V., Reinecke, K., & Sap, M. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.120 · Cited by 203
Discovering Language Model Behaviors with Model-Written Evaluations
Perez, E., Ringer, S., Lukosiute, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.847 · Cited by 194
Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415234 · Cited by 183
Self-citationOpenAI, :, Hurst, A., Lerer, A., Goucher, A. P., Perelman, A., Ramesh, A., Clark, A., Ostrow, A., Welihinda, A., et al. (2024) · arXiv · Cited by 180
Kim, S. S. Y., Liao, Q. V., Vorvoreanu, M., Ballard, S., & Vaughan, J. W. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658941 · Cited by 147
Butler, J. (2021) · Routledge eBooks · doi:10.4324/9781003146759 · Cited by 145
Shame and the motivation to change the self.
Lickel, B., Kushlev, K., Savalei, V., Matta, S., & Schmader, T. (2014) · Emotion · doi:10.1037/a0038235 · Cited by 145
When Human-AI Interactions Become Parasocial: Agency and Anthropomorphism in Affective Design
Maeda, T., & Quan-Haase, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658956 · Cited by 144
Why human–AI relationships need socioaffective alignment
Kirk, H. R., Gabriel, I., Summerfield, C., Vidgen, B., & Hale, S. A. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04532-5 · Cited by 131
Beyond Preferences in AI Alignment
Zhi‐Xuan, T., Carroll, M., Franklin, M., & Ashton, H. (2024) · Philosophical Studies · doi:10.1007/s11098-024-02249-w · Cited by 128
Comparing the value of perceived human versus AI-generated empathy
Rubin, M., Li, J. Z., Zimmerman, F., Ong, D. C., Goldenberg, A., & Perry, A. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02247-w · Cited by 122
Angry by design: toxic communication and technical architectures
Munn, L. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00550-7 · Cited by 118
Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models
Cheng, M., Durmus, E., & Jurafsky, D. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.84 · Cited by 115
Self-citationState of What Art? A Call for Multi-Prompt LLM Evaluation
Mizrahi, M., Kaplan, G., Malkin, D., Dror, R., Shahaf, D., & Stanovsky, G. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00681 · Cited by 113
Sycophancy in Large Language Models: Causes and Mitigations
Malmqvist, L. (2025) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-031-92611-2_5 · Cited by 95
Sycophancy in Large Language Models: Causes and Mitigations
Malmqvist, L. (2024) · arXiv · doi:10.48550/arxiv.2411.15287 · Cited by 95
The renaissance of belief-based utility in economics
Loewenstein, G. F., & Molnár, A. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0301-z · Cited by 94
”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90 · cited 1×
“In either case, it is important to measure when sycophancy occurs, as users may believe they are receiving a neutral response when they are not (Kapania et al., 2022), and unlike factual queries that can be externally verified, it is hard to judge from a single query whether a model is excessively…”
How Culture Shapes What People Want From AI
Ge, X., Xu, C., Misaki, D., Markus, H. R., & Tsai, J. L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642660 · Cited by 86
Mirages. On Anthropomorphism in Dialogue Systems
Abercrombie, G., Curry, A., Dinkar, T., Rieser, V., & Talat, Z. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.290 · Cited by 83
ConvoKit: A Toolkit for the Analysis of Conversations
Chang, J. P., Chiam, C., Fu, L., Wang, A., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020) · Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2020.sigdial-1.8 · Cited by 76 · cited 1×
“To build this dataset, we took the corpus from ConvoKit (Chang et al., 2020) for the r/Advice subreddit and used spaCy (Honnibal et al., 2020) to split posts into sentences.”
On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning
Shaikh, O., Zhang, H., Held, W., Bernstein, M., & Yang, D. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.244 · Cited by 76
AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback
Dubois, Y., Li, C. X., Taori, R., Zhang, T., Gulrajani, I., Ba, J., Guestrin, C., Liang, P., & Hashimoto, T. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1308 · Cited by 76
Metaphors of AI indicate that people increasingly perceive AI as warm and human-like
Cheng, M., Lee, A. Y., Rapuano, K. M., Niederhoffer, K. G., Liebscher, A., & Hancock, J. T. (2026) · Communications Psychology · doi:10.1038/s44271-025-00376-6 · Cited by 75
Self-citationAnthroScore: A Computational Linguistic Measure of Anthropomorphism
Cheng, M., Gligorić, K., Piccardi, T., & Jurafsky, D. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-long.49 · Cited by 73
Self-citationMindfulness meditation reduces guilt and prosocial reparation.
Hafenbrack, A. C., LaPalme, M. L., & Solal, I. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000298 · Cited by 71
Cohn, M., Pushkarna, M., Olanubi, G. O., Moran, J. M., Padgett, D., Mengesha, Z., & Heldreth, C. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650818 · Cited by 71
Bias in Language Models: Beyond Trick Tests and Towards RUTEd Evaluation
Lum, K., Anthis, J. R., Robinson, K., Nagpal, C., & D’Amour, A. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.7 · Cited by 66
Advice Giving: A Subtle Pathway to Power
Schaerer, M., Tost, L. P., Huang, L., Gino, F., & Larrick, R. (2018) · Personality and Social Psychology Bulletin · doi:10.1177/0146167217746341 · Cited by 66
Qwen2.5-Coder Technical Report
Hui, B., Yang, J., Cui, Z., Yang, J., Liu, D., Zhang, L., Liu, T., Zhang, J., Yu, B., Lu, K., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12186 · Cited by 65
SycEval: Evaluating LLM Sycophancy
Fanous, A., Goldberg, J., Agarwal, A., Lin, J., Zhou, A., Xu, S., Bikia, V., Daneshjou, R., & Koyejo, S. (2025) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v8i1.36598 · Cited by 62
SycEval: Evaluating LLM Sycophancy
Fanous, A., Goldberg, J., Agarwal, A. A., Lin, J., Zhou, A., Daneshjou, R., & Koyejo, S. (2025) · arXiv · doi:10.48550/arxiv.2502.08177 · Cited by 62
Labeling messages as AI-generated does not reduce their persuasive effects
Gallegos, I. O., Shani, C., Shi, W., Bianchi, F., Gainsburg, I., Jurafsky, D., & Willer, R. (2026) · PNAS Nexus · doi:10.1093/pnasnexus/pgag008 · Cited by 56
Self-citationREL-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance
Zhou, K., Hwang, J. D., Ren, X., Dziri, N., Jurafsky, D., & Sap, M. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.556 · Cited by 48 · cited 1×
“We select these countries to reflect, although imperfectly (Zhou et al., 2025), different cultural norms around face-saving: Germany is often associated with direct communication, Chinese culture values saving face, and the UK is known for its emphasis on politeness and euphemism compared to the US…”
Self-citationThe Bad Thing About Good Advice: Understanding When and How Advice Exacerbates Overconfidence
Soll, J. B., Palley, A. B., & Rader, C. A. (2020) · Management Science · doi:10.1287/mnsc.2021.3987 · Cited by 48
Tyler, T. R. (1996) · Social Justice Research · doi:10.1007/bf02196988 · Cited by 47
Rrv, A., Tyagi, N., Uddin, M. N., Varshney, N., & Baral, C. R. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.755 · Cited by 46
AI-LieDar : Examine the Trade-off Between Utility and Truthfulness in LLM Agents
Zhe, S., Zhou, X., Rangreji, S., Kabra, A., Mendelsohn, J., Brahman, F., & Sap, M. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.595 · Cited by 46
Does it matter if empathic AI has no empathy?
Shteynberg, G., Halpern, J., Sadovnik, A., Garthoff, J., Perry, A., Hay, J., Montemayor, C., Olson, M. A., Hulsey, T. L., & Fairweather, A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00841-7 · Cited by 44
ChatGPT’s advice is perceived as better than that of professional advice columnists
Howe, P. D. L., Fay, N., Saletta, M., & Hovy, E. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1281255 · Cited by 42 · cited 1×
“We aggregate data from existing studies of human vs. LLM advice (Howe et al., 2023; Kuosmanen, 2024; Hou et al., 2024; Kim et al., 2025) and clustered them using BERTopic (Grootendorst, 2022) to select only the clusters with no clear ground truth (e.g., romantic relationships, interpersonal issues,…”
Inie, N., Druga, S., Zukerman, P., & Bender, E. M. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3659040 · Cited by 39
Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Models
Zhou, K., Jurafsky, D., & Hashimoto, T. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.335 · Cited by 38
Self-citationHuman, all too human: accounting for automation bias in generative large language models
Carnat, I. (2024) · International Data Privacy Law · doi:10.1093/idpl/ipae018 · Cited by 36
Analysis of Moral Judgment on Reddit
Botzer, N., Gu, S., & Weninger, T. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3160677 · Cited by 34
Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systems
Cheng, M., Blodgett, S. L., DeVrio, A., Egede, L., & Olteanu, A. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1259 · Cited by 31
Self-citationAdvice Recipients: The Psychology of Advice Utilization
Swol, L. M. V., Paik, J. E., & Prahl, A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190630188.013.2 · Cited by 30
Emotional risks of AI companions demand attention
(2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01093-9 · Cited by 30
Simple synthetic data reduces sycophancy in large language models
Wei, J., Huang, D., Lu, Y., Zhou, D., & Le, Q. V. (2023) · arXiv · doi:10.48550/arxiv.2308.03958 · Cited by 28 · cited 2×
“…explicit beliefs or external ground truth, often injecting explicit beliefs into a prompt to examine the model’s behavior change in response to the perturbations in the prompt (e.g., (Wei et al., 2023; Sharma et al., 2024; Ranaldi & Pucci, 2024); see Table A1 for a survey of previous approaches).”
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
Zheng, L., Chiang, W.-L., Sheng, Y., Li, T., Zhuang, S., Wu, Z., Zhuang, Y., Li, Z., Lin, Z., Xing, E. P., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.11998 · Cited by 27
Framing and Face: The Relevance of The Presentation of Self to Linguistic Discourse Analysis
Tannen, D. (2009) · Social Psychology Quarterly · doi:10.1177/019027250907200404 · Cited by 27 · cited 1×
“…the user’s face : either actively affirming their desired self-image ( positive face ), e.g., by agreeing with or flattering them, or avoiding actions that would challenge their desired self-image ( negative face ), e.g. by avoiding imposition or correction (Brown & Levinson, 1987; Tannen, 2009).”
Kirk, H., Whitefield, A., Röttger, P., Bean, A., Margatina, K., Ciro, J., Mosquera, R., Bartolo, M., Williams, A., He, H., et al. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3342 · Cited by 21
SocialGaze: Improving the Integration of Human Social Norms in Large Language Models
Vijjini, A. R., Menon, R. R., Fu, J., Srivastava, S., & Chaturvedi, S. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.962 · Cited by 20
The Interactional Costs of “Neutrality” in Police Interviews with Child Witnesses
Jol, G., & Stommel, W. (2021) · Research on Language and Social Interaction · doi:10.1080/08351813.2021.1939532 · Cited by 15
ChatGPT Giving Relationship Advice – How Reliable Is It?
Hou, H., Leach, K., & Huang, Y. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31338 · Cited by 14 · cited 2×
“We aggregate data from existing studies of human vs. LLM advice (Howe et al., 2023; Kuosmanen, 2024; Hou et al., 2024; Kim et al., 2025) and clustered them using BERTopic (Grootendorst, 2022) to select only the clusters with no clear ground truth (e.g., romantic relationships, interpersonal issues,…”
Kim, M., Lee, H., Park, J., Lee, H., & Jung, K. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.333 · Cited by 13
When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviour
Ranaldi, L., & Pucci, G. (2023) · arXiv · doi:10.48550/arxiv.2311.09410 · Cited by 11
Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions
Robb, M. B., & Mann, S. (2025) · doi:10.65077/wiil1800 · Cited by 11
Garvey, A. M., & Blanchard, S. J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5256150 · Cited by 5
SocialGaze: Improving the Integration of Human Social Norms in Large Language Models
Vijjini, A. R., Menon, R. R., Fu, J.-Y., Srivastava, S., & Chaturvedi, S. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2410.08698 · Cited by 5
AnthroScore: A Computational Linguistic Measure of AnthropomorphismPreprint
Cheng, M., Gligorić, K., Piccardi, T., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.02056 · Cited by 2
Self-citationPosition: Evaluating Generative AI Systems Is a Social Science Measurement Challenge
Wallach, H., Desai, M., Cooper, A. F., Wang, A., Atalla, C., Barocas, S., Blodgett, S. L., Chouldechova, A., Corvi, E., Dow, P. A., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.00561 · Cited by 1
AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM AgentsPreprint
Zhe, S., Zhou, X., Rangreji, S., Kabra, A., Mendelsohn, J., Brahman, F., & Sap, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.09013
The Rise of AI Companions: Interaction with AI Companions and Psychological Well-being
Zhang, Y., Zhao, D., Hancock, J. T., Kraut, R., & Yang, D. (2025) · arXiv · doi:10.48550/arxiv.2506.12605
Research works printed but not linked: 7
- M. Sharma M. Tong T. Korbak D. Duvenaud A. Askell S. R. Bowman E. Durmus Z. Hatfield-Dodds S. R. Johnston S. M. Kravec T. Maxwell S. McCandlish K. Ndousse O. Rausch N. Schiefer D. Yan M. Zhang E. Perez “Towards understanding sycophancy in language models” in The Twelfth International Conference on Learning Representations (2024); https://openreview.net/forum?id=tvhaxkMKAn.
- M. E. Oswald, S. Grosjean, “Confirmation bias” in Cognitive Illusions: A Handbook on Fallacies and Biases in Thinking, Judgement and Memory, R. F. Pohl, Ed. (Psychology Press, 2004), chap. 4, pp. 79–94.
- M. Cohn M. Pushkarna G. O. Olanubi J. M. Moran D. Padgett Z. Mengesha C. Heldreth Believing anthropomorphism: Examining the role of anthropomorphic cues on trust in large language models (2024); https://arxiv.org/abs/2405.06079. · DOI · Paper page
- Z. Aydin, B. F. Malle, “Dissociated responses to AI: Persuasive but not trustworthy?” in Proceedings of the Annual Meeting of the Cognitive Science Society (2024), vol. 46.
- L. R. Quintanar, The Interactive Computer as a Social Stimulus in Computer-Managed Instruction: A Theoretical and Empirical Analysis of the Social Psychological Processes Evoked During Human-Computer Interaction (University of Notre Dame, 1982).
- T. Qiu Z. He T. Chugh M. Kleiman-Weiner “The lock-in hypothesis: Stagnation by algorithm” in Forty-Second International Conference on Machine Learning (2025); https://openreview.net/forum?id=mE1M626qOo.
- O. J. Kuosmanen “Advice from humans and artificial intelligence: Can we distinguish them and is one better than the other?” thesis UiT Norges arktiske universitet (2024).
Cited by
The diffusion of large language models in published academic articles
Siler, K. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2605754123 · Cited by 28
Generative AI as a de facto mental health provider: a policy brief and urgent call for regulation
Refoua, E., Gigi, K., Levkovich, I., Shoval, D. H., Elyoseph, Z., Tsafrir, I., Pen, O., Angert, T., & Haber, Y. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1708806 · Cited by 8
“The ever-available, non-judgmental nature of AI can foster strong emotional attachment and dependency (29, 30).”
InfluentialHu, M., Ho, J. Q. H., Ng, C., Wong, S. S., & Hartanto, A. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101149 · Cited by 7
The renaissance of management: When regular employees become multi-level managers of AI agents
Quaquebeke, N. V., Gazdag, B. A., & Lee, A. (2026) · The Leadership Quarterly · doi:10.1016/j.leaqua.2026.101975 · Cited by 6
The psychiatry of sycophancy: When agreeable artificial intelligence becomes a mental health risk
Hikmat, R., Nilmanat, K., & Damkliang, J. (2026) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2026.105064 · Cited by 4
Metadata
- Authors
- Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D., & Jurafsky, D.
- Affiliations
- Stanford University (US)
- Carnegie Mellon University (US)
- Corresponding author
- Cheng, Myra
- Venue
- Science
- Published
- 2026-03-26
- Volume
- 391
- Issue
- 6792
- Pages
- eaec8352-eaec8352
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W7140705274
- Cited by
- 185
- References
- 63
- Citations by year
- 2026: 183
- FWCI
- 1029.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- Funders
- National Science Foundation (DGE2146755)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Social Psychology › Psychology of Social Influence
- Keywords
- prosocial intentions, interpersonal conflict resolution, attribution of responsibility, confirmation bias, trust in AI, AI deception, AI accountability, AI design
- MeSH terms
- Large Language Models, Adult, Female, Humans, Deception, Male, Motivation, Social Behavior, Consensus, Intention, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.