CoChat
Sign Up
PreprintCited by 8Ethics and Social Impacts of AIPsychiatry, Mental Health, NeuroscienceTopic Modeling

The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.

Evaluating Large Language Models with Psychometrics . -

Open access
Li, Yuan, Huang, Yue, Wang, Hongyi, Cheng, Ying, Zhang, Xiangliang, Zou, James, Sun, Lichao·2024·arXiv
DOI 10.48550/arxiv.2406.17675arXiv 2406.17675
Open this paper in CoChat — free accountOpen PDF

Abstract

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they exhibit psychological patterns, and whether these patterns remain consistent across different contexts -- questions that could deepen the understanding of their behaviors. Inspired by psychometrics, this paper presents a {comprehensive benchmark for quantifying psychological constructs of LLMs}, encompassing psychological dimension identification, assessment dataset design, and assessment with results validation. Our work identifies five key psychological constructs -- personality, values, emotional intelligence, theory of mind, and self-efficacy -- assessed through a suite of 13 datasets featuring diverse scenarios and item types. We uncover significant discrepancies between LLMs' self-reported traits and their response patterns in real-world scenarios, revealing complexities in their behaviors. Our findings also show that some preference-based tests, originally designed for humans, could not solicit reliable responses from LLMs. This paper offers a thorough psychometric assessment of LLMs, providing insights into reliable evaluation and potential applications in AI and social sciences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2406.17675

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Self-reported traits of LLMs can diverge sharply from observed behavior in realistic scenarios.

    “self-reported traits can diverge sharply from observed behavior in realistic scenarios [3, 4]”

    From Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence (2026) · cites this paper as [4]

  • Psychological inventories and latent-trait methods can be applied to large language models.

    “Current work in AI psychometrics shows that psychological inventories and latent-trait methods can be applied to large language models”

    From Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence (2026) · cites this paper as [4]

  • Some human-designed assessments fail to produce reliable results when used with LLMs.

    “Some human-designed assessments fail to produce reliable results when used with LLMs”

    From Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence (2026) · cites this paper as [4]

  • Existing work in AI psychometrics has shown that psychometric tools can be adapted to LLMs, but has also demonstrated that self-report and preference-style tests can be unreliable in artificial systems.

    “Existing work in AI psychometrics has shown that psychometric tools can be adapted to LLMs, but has also demonstrated that self-report and preference-style tests can be unreliable in artificial systems [3, 4].”

    From Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence (2026) · cites this paper as [4]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 124

  1. Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258, 2021. · arXiv
  2. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023. · arXiv
  3. Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen, Michihiro Ya- sunaga, and Diyi Yang. Is chatgpt a general-purpose natural language process- ing task solver? arXiv preprint arXiv:2302.06476, 2023. · arXiv
  4. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems, 36, 2024.
  5. Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, and Yueting Zhuang. Hugginggpt: Solving ai tasks with chatgpt and its friends in hugging face. Advances in Neural Information Processing Systems, 36, 2024.
  6. Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, et al. Pre-trained lan- guage models for interactive decision-making. Advances in Neural Information Processing Systems, 35:31199-31212, 2022.
  7. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems, 36, 2024.
  8. Zilin Ma, Yiyang Mei, and Zhaoyuan Su. Understanding the benefits and chal- lenges of using large language model-based conversational agents for mental well-being support. In AMIA Annual Symposium Proceedings, volume 2023, page 1105. American Medical Informatics Association, 2023.
  9. Nikita Mehandru, Brenda Y Miao, Eduardo Rodriguez Almaraz, Madhumita Sushil, Atul J Butte, and Ahmed Alaa. Evaluating large language models as agents in the clinic. npj Digital Medicine, 7(1):84, 2024.
  10. Jen-Tse Huang, Wenxuan Wang, Eric John Li, Man Ho Lam, Shujie Ren, Youliang Yuan, Wenxiang Jiao, Zhaopeng Tu, and Michael R. Lyu. On the humanity of conversational ai: Evaluating the psychological portrayal of llms. In Proceedings of the Twelfth International Conference on Learning Representations (ICLR), 2024.
  11. John Rust and Susan Golombok. Modern psychometrics: The science of psycho- logical assessment. Routledge, 2014.
  12. Xiting Wang, Liming Jiang, Jose Hernandez-Orallo, Luning Sun, David Stillwell, Fang Luo, and Xing Xie. Evaluating general-purpose ai with psychometrics. arXiv preprint arXiv:2310.16379, 2023. · arXiv
  13. Susan E Embretson and Steven P Reise. Item response theory. Psychology Press, 2013.
  14. Kathleen Slaney. Validating psychological constructs: Historical, philosophical, and practical dimensions. Springer, 2017.
  15. Lee J Cronbach and Paul E Meehl. Construct validity in psychological tests. Psychological bulletin, 52(4):281, 1955.
  16. Jason E Strickhouser, Ethan Zell, and Zlatan Krizan. Does personality predict health and well-being? a metasynthesis. Health psychology, 36(8):797, 2017.
  17. Ziang Xiao, Susu Zhang, Vivian Lai, and Q Vera Liao. Evaluating evaluation metrics: A framework for analyzing nlg evaluation metrics using measurement theory. In The 2023 Conference on Empirical Methods in Natural Language Processing, 2023.
  18. Mustafa Safdari, Greg Serapio-García, Clément Crepy, Stephen Fitz, Peter Romero, Luning Sun, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić. Personality traits in large language models. arXiv preprint arXiv:2307.00184, 2023. · arXiv
  19. Jen-tse Huang, Wenxuan Wang, M Lam, E Li, Wenxiang Jiao, and M Lyu. Re- visiting the reliability of psychological scales on large language models. arXiv preprint arXiv, 2305, 2023.
  20. Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, and Yixin Zhu. Evaluating and inducing personality in pre-trained language models. In NeurIPS, 2023.
  21. Xuena Wang, Xueting Li, Zi Yin, Yue Wu, and Jia Liu. Emotional intelligence of large language models. Journal of Pacific Rim Psychology, 17:18344909231213958, 2023.
  22. Michal Kosinski. Evaluating large language models in theory of mind tasks. arXiv e-prints, pages arXiv-2302, 2023.
  23. Max van Duijn, Bram van Dijk, Tom Kouwenhoven, Werner de Valk, Marco Spruit, and Peter van der Putten. Theory of mind in large language mod- els: Examining performance of 11 state-of-the-art models vs. children aged 7-10 on advanced tests. In Jing Jiang, David Reitter, and Shumin Deng, editors, Proceedings of the 27th Conference on Computational Natural Lan- guage Learning (CoNLL), pages 389-402, Singapore, December 2023. Associ- ation for Computational Linguistics. doi: 10.18653/v1/2023.conll-1.25. URL https://aclanthology.org/2023.conll-1.25. · DOI · Paper page
  24. Yufan Wu, Yinghui He, Yilin Jia, Rada Mihalcea, Yulong Chen, and Naihao Deng. Hi-ToM: A benchmark for evaluating higher-order theory of mind reasoning in large language models. In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 10691-10706, Singapore, December 2023. Association for Computational Linguistics. doi: 10.18653/v1/2023.findings-emnlp.717. URL https://aclanthology. org/2023.findings-emnlp.717. · DOI
  25. Bojana Bodroza, Bojana M Dinic, and Ljubisa Bojic. Personality testing of gpt-3: Limited temporal reliability, but highlighted social desirability of gpt-3's personality instruments results. arXiv preprint arXiv:2306.04308, 2023. · arXiv
  26. Marilù Miotto, Nicola Rossberg, and Bennett Kleinberg. Who is GPT-3? an exploration of personality, values and demographics. In David Bamman, Dirk Hovy, David Jurgens, Katherine Keith, Brendan O'Connor, and Svit- lana Volkova, editors, Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS), pages 218-227, Abu Dhabi, UAE, November 2022. Association for Computational Linguistics. doi: 10.18653/v1/2022.nlpcss-1.24. URL https://aclanthology.org/2022.nlpcss-1.24. · DOI
  27. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. Judging LLM-as-a-judge with MT-bench and chatbot arena. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023. URL https://openreview.net/ forum?id=uccHPGDlao.
  28. Abhinav Rao, Aditi Khandelwal, Kumar Tanmay, Utkarsh Agarwal, and Monojit Choudhury. Ethical reasoning over moral alignment: A case and framework for in-context ethical policies in LLMs. In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 13370-13388, Singapore, December 2023. Association for Computational Linguistics. doi: 10.18653/v1/2023.findings-emnlp.892. URL https://aclanthology.org/2023.findings-emnlp.892. · DOI
  29. Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, et al. Trustllm: Trustwor- thiness in large language models. arXiv preprint arXiv:2401.05561, 2024. · arXiv
  30. Rui Yang, Ting Fang Tan, Wei Lu, Arun James Thirunavukarasu, Daniel Shu Wei Ting, and Nan Liu. Large language models in health care: Development, appli- cations, and challenges. Health Care Science, 2(4):255-263, 2023.
  31. Murray Shanahan, Kyle McDonell, and Laria Reynolds. Role play with large language models. Nature, pages 1-6, 2023.
  32. Zhicheng Lin. How to write effective prompts for large language models. Nature Human Behaviour, pages 1-5, 2024.
  33. Melanie Sclar, Yejin Choi, Yulia Tsvetkov, and Alane Suhr. Quantifying language models' sensitivity to spurious features in prompt design or: How i learned to start worrying about prompt formatting. In The Twelfth International Confer- ence on Learning Representations, 2024. URL https://openreview.net/forum?id= RIu5lyNXjT.
  34. Benjamin L Hankin and John RZ Abela. Development of psychopathology: A vulnerability-stress perspective. Sage Publications, 2005.
  35. Tenko Raykov and George A Marcoulides. Introduction to psychometric theory. Routledge, 2011.
  36. Daniel N Jones and Delroy L Paulhus. Introducing the short dark triad (sd3) a brief measure of dark personality traits. Assessment, 21(1):28-41, 2014.
  37. Geert Hofstede, Gert Jan Hofstede, and Michael Minkov. Cultures et organisa- tions: Nos programmations mentales. Pearson Education France, 2010.
  38. Nino Scherrer, Claudia Shi, Amir Feder, and David Blei. Evaluating the moral beliefs encoded in llms. Advances in Neural Information Processing Systems, 36, 2024.
  39. OpenAI. Gpt-4 technical report. ArXiv, abs/2303.08774, 2023. · arXiv
  40. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, and Tianhang Zhu. Qwen technical report. arXiv preprint arXiv:2309.16609, 2023. · arXiv
  41. Albert Q Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, et al. Mixtral of experts. arXiv preprint arXiv:2401.04088, 2024. · arXiv
  42. Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Kirk, Hinrich Schuetze, and Dirk Hovy. Political compass or spinning arrow? towards more meaningful evaluations for values and opinions in large language models. In Lun-Wei Ku, Andre Martins, and Vivek Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15295-15311, Bangkok, Thailand, August 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024.acl-long.816. URL https://aclanthology.org/2024.acl-long.816. · DOI · Paper page
  43. Daphna Oyserman. Values, psychology of. In James D. Wright, editor, In- ternational Encyclopedia of the Social & Behavioral Sciences (Second Edition), pages 36-40. Elsevier, Oxford, second edition edition, 2015. ISBN 978-0- 08-097087-5. doi: https://doi.org/10.1016/B978-0-08-097086-8.24030-0. URL https://www.sciencedirect.com/science/article/pii/B9780080970868240300. · DOI
  44. Gerben A Van Kleef. How emotions regulate social life: The emotions as social information (easi) model. Current directions in psychological science, 18(3): 184-188, 2009.
  45. Peter Salovey and John D. Mayer. Emotional intelligence. Imagination, Cognition and Personality, 9(3):185-211, 1990. doi: 10.2190/DUGG-P24E-52WK-6CDG. URL https://doi.org/10.2190/DUGG-P24E-52WK-6CDG. · DOI · Paper page
  46. David Premack and Guy Woodruff. Does the chimpanzee have a theory of mind? Behavioral and brain sciences, 1(4):515-526, 1978.
  47. Simon Baron-Cohen, Alan M Leslie, and Uta Frith. Does the autistic child have a "theory of mind"? Cognition, 21(1):37-46, 1985.
  48. Sheri Coates Broussard and ME Betsy Garrison. The relationship between classroom motivation and academic achievement in elementary-school-aged children. Family and consumer sciences research journal, 33(2):106-120, 2004.
  49. Albert Bandura. Self-efficacy: toward a unifying theory of behavioral change. Psychological review, 84(2):191, 1977.
  50. Ryan Burnell, Han Hao, Andrew RA Conway, and Jose Hernandez Orallo. Revealing the structure of language model capabilities. arXiv preprint arXiv:2306.10062, 2023. · arXiv
  51. Hongli Zhan, Desmond C Ong, and Junyi Jessy Li. Evaluating subjective cognitive appraisals of emotions from large language models. arXiv preprint arXiv:2310.14389, 2023. · arXiv
  52. Abigail Z Jacobs and Hanna Wallach. Measurement and fairness. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pages 375-385, 2021.
  53. Oskar Van der Wal, Dominik Bachmann, Alina Leidinger, Leendert van Maanen, Willem Zuidema, and Katrin Schulz. Undesirable biases in nlp: Addressing challenges of measurement. Journal of Artificial Intelligence Research, 79:1-40, 2024.
  54. Zaibin Zhang, Yongting Zhang, Lijun Li, Jing Shao, Hongzhi Gao, Yu Qiao, Lijun Wang, Huchuan Lu, and Feng Zhao. PsySafe: A comprehensive framework for psychological-based attack, defense, and evaluation of multi-agent system safety. In Lun-Wei Ku, Andre Martins, and Vivek Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15202-15231, Bangkok, Thailand, August 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024.acl-long.812. URL https://aclanthology.org/2024.acl-long.812. · DOI
  55. Walter Mischel. Personality and Assessment. Psychology Press, 2013.
  56. Xingxuan Li, Yutong Li, Shafiq Joty, Linlin Liu, Fei Huang, Lin Qiu, and Lidong Bing. Does gpt-3 demonstrate psychopathy? evaluating large language models from a psychological perspective. arXiv preprint arXiv:2212.10529, 2022. · arXiv
  57. Robert R McCrae and Oliver P John. An introduction to the five-factor model and its applications. Journal of personality, 60(2):175-215, 1992.
  58. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing systems, 33:1877-1901, 2020.
  59. Tobias Ebert, Jochen E Gebauer, Thomas Brenner, Wiebke Bleidorn, Samuel D Gosling, Jeff Potter, and P Jason Rentfrow. Are regional differences in psycho- logical characteristics and their correlates robust? applying spatial-analysis techniques to examine regional variation in personality. Perspectives on Psycho- logical Science, 17(2):407-441, 2022.
  60. Peter Muris, Harald Merckelbach, Henry Otgaar, and Ewout Meijer. The malev- olent side of human nature: A meta-analysis and critical review of the literature on the dark triad (narcissism, machiavellianism, and psychopathy). Perspectives on psychological science, 12(2):183-204, 2017.
  61. Rhidian Hughes. Considering the vignette technique and its application to a study of drug injecting and hiv risk and safer behaviour. Sociology of health & illness, 20(3):381-400, 1998.
  62. James Horley. Values and beliefs as personal constructs. International Journal of Personal Construct Psychology, 4(1):1-14, 1991.
  63. Shalom H Schwartz. An overview of the schwartz theory of basic values. Online readings in Psychology and Culture, 2(1):11, 2012.
  64. Stacy L. Carter and John J. Wheeler. Chapter 9 -Social validity and cultural competence. In Stacy L. Carter and John J. Wheeler, editors, The Social Valid- ity Manual (Second Edition), pages 217-228. Academic Press, second edition edition, 2019. ISBN 978-0-12-816004-6. doi: https://doi.org/10.1016/B978-0- 12-816004-6.00009-6. URL https://www.sciencedirect.com/science/article/pii/ B9780128160046000096. · DOI
  65. Stephane M Shepherd, Cynthia Willis-Esqueda, Danielle Newton, Diane Siva- subramaniam, and Yin Paradies. The challenge of cultural competence in the workplace: perspectives of healthcare providers. BMC Health Services Research, 19(1):1-11, 2019.
  66. Yang Liu, Yuanshun Yao, Jean-Francois Ton, Xiaoying Zhang, Ruocheng Guo Hao Cheng, Yegor Klochkov, Muhammad Faaiz Taufiq, and Hang Li. Trust- worthy llms: a survey and guideline for evaluating large language models' alignment. arXiv preprint arXiv:2308.05374, 2023. · arXiv
  67. Bernard Gert. Common morality: Deciding what to do. Oxford University Press, 2004.
  68. Myeongjun Jang, Deuk Sin Kwon, and Thomas Lukasiewicz. Becel: Benchmark for consistency evaluation of language models. In Proceedings of the 29th International Conference on Computational Linguistics, pages 3680-3696, 2022.
  69. Chujie Zheng, Hao Zhou, Fandong Meng, Jie Zhou, and Minlie Huang. Large language models are not robust multiple choice selectors. In The Twelfth Inter- national Conference on Learning Representations, 2024. URL https://openreview. net/forum?id=shr9PXz7T0.
  70. Yi Zeng, Enmeng Lu, and Cunqing Huangfu. Linking artificial intelligence principles. arXiv preprint arXiv:1812.04814, 2018. · arXiv
  71. Anna Jobin, Marcello Ienca, and Effy Vayena. The global landscape of ai ethics guidelines. Nature machine intelligence, 1(9):389-399, 2019.
  72. Karen Yeung. Recommendation of the council on artificial intelligence (oecd). International legal materials, 59(1):27-34, 2020.
  73. Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, et al. Decodingtrust: A comprehensive assessment of trustworthiness in gpt models. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023.
  74. Ben Shneiderman. Design lessons from ai's two grand goals: human emulation and useful applications. IEEE Transactions on Technology and Society, 1(2):73-82, 2020.
  75. Taylor Sorensen, Liwei Jiang, Jena D Hwang, Sydney Levine, Valentina Pyatkin, Peter West, Nouha Dziri, Ximing Lu, Kavel Rao, Chandra Bhagavatula, et al. Value kaleidoscope: Engaging ai with pluralistic human values, rights, and duties. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19937-19947, 2024.
  76. Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. Red teaming language models with language models. In Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3419-3448, Abu Dhabi, United Arab Emirates, December 2022. Association for Computational Linguistics. doi: 10.18653/v1/2022.emnlp-main.225. URL https://aclanthology.org/2022.emnlp- main.225. · DOI · Paper page
  77. Margaret Wilson. Six views of embodied cognition. Psychonomic bulletin & review, 9:625-636, 2002.
  78. Natalie Sebanz, Harold Bekkering, and Günther Knoblich. Joint action: bodies and minds moving together. Trends in cognitive sciences, 10(2):70-76, 2006.
  79. Simon Baron-Cohen, Ruth Campbell, Annette Karmiloff-Smith, Julia Grant, and Jane Walker. Are children with autism blind to the mentalistic significance of the eyes? British Journal of Developmental Psychology, 13(4):379-398, 1995.
  80. LMJ De Sonneville, CA Verschoor, C Njiokiktjien, V Op het Veld, N Toorenaar, and M Vranken. Facial identity and facial emotions: speed, accuracy, and processing strategies in children and adults. Journal of Clinical and experimental neuropsychology, 24(2):200-213, 2002.
  81. Herbert H Clark. Using language. Cambridge university press, 1996.
  82. Josef Perner, Susan R Leekam, and Heinz Wimmer. Three-year-olds' difficulty with false belief: The case for a conceptual deficit. British journal of develop- mental psychology, 5(2):125-137, 1987.
  83. Heinz Wimmer and Josef Perner. Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception. Cognition, 13(1):103-128, 1983.
  84. William V Fabricius, Ty W Boyer, Amy A Weimer, and Kathleen Carroll. True or false: Do 5-year-olds understand belief? Developmental Psychology, 46(6): 1402, 2010.
  85. Francesca GE Happé. An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. Journal of autism and Developmental disorders, 24(2):129-154, 1994.
  86. Peter Kinderman, Robin Dunbar, and Richard P Bentall. Theory-of-mind deficits and causal attributions. British journal of Psychology, 89(2):191-204, 1998.
  87. Ruth Kanfer. Motivation theory and industrial and organizational psychology. Handbook of industrial and organizational psychology, 1(2):75-130, 1990.
  88. Frédéric Guay, Julien Chanal, Catherine F Ratelle, Herbert W Marsh, Simon Larose, and Michel Boivin. Intrinsic, identified, and controlled types of motiva- tion for school subjects in young elementary school children. British journal of educational psychology, 80(4):711-735, 2010.
  89. Jack Martin. Self-regulated learning, social cognitive theory, and agency. Edu- cational psychologist, 39(2):135-145, 2004.
  90. Thomas Li-Ping Tang, Toto Sutarso, Adebowale Akande, Michael W Allen, Abdulgawi Salim Alzubaidi, Mahfooz A Ansari, Fernando Arias-Galicia, Mark G Borg, Luigina Canova, Brigitte Charles-Pauvers, et al. The love of money and pay level satisfaction: Measurement and functional equivalence in 29 geopolitical entities around the world. Management and Organization Review, 2(3):423-452, 2006.
  91. Ralf Schwarzer and Matthias Jerusalem. Generalized self-efficacy scale. J. Weinman, S. Wright, & M. Johnston, Measures in health psychology: A user's portfolio. Causal and control beliefs, 35(37):82-003, 1995.
  92. Minzhi Li, Taiwei Shi, Caleb Ziems, Min-Yen Kan, Nancy Chen, Zhengyuan Liu, and Diyi Yang. CoAnnotating: Uncertainty-guided work allocation between human and large language models for data annotation. In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 1487-1505, Singapore, December 2023. Association for Computational Linguistics. doi: 10.18653/v1/2023.emnlp- main.92. URL https://aclanthology.org/2023.emnlp-main.92. · DOI
  93. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. · arXiv
  94. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824-24837, 2022.
  95. Graham Caron and Shashank Srivastava. Manipulating the perceived per- sonality traits of language models. In Houda Bouamor, Juan Pino, and Ka- lika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 2370-2386, Singapore, December 2023. Association for Computational Linguistics. doi: 10.18653/v1/2023.findings-emnlp.156. URL https://aclanthology.org/2023.findings-emnlp.156. · DOI · Paper page
  96. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Jill Burstein, Christy Doran, and Thamar Solorio, editors, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171-4186, Minneapolis, Minnesota, June 2019. As- sociation for Computational Linguistics. doi: 10.18653/v1/N19-1423. URL https://aclanthology.org/N19-1423. · DOI · Paper page
  97. Saketh Reddy Karra, Son The Nguyen, and Theja Tulabandhula. Estimating the personality of white-box language models. arXiv preprint arXiv:2204.12000, 2022. · arXiv
  98. Ivar Frisch and Mario Giulianelli. Llm agents in interaction: Measuring person- ality consistency and linguistic alignment in interacting populations of large language models. arXiv preprint arXiv:2402.02896, 2024. · arXiv
  99. Lucio La Cava, Davide Costa, and Andrea Tagarelli. Open models, closed minds? on agents capabilities in mimicking human personalities through open large language models. arXiv preprint arXiv:2401.07115, 2024. · arXiv
  100. Jiaxi Cui, Liuzhenghao Lv, Jing Wen, Jing Tang, YongHong Tian, and Li Yuan. Machine mindset: An mbti exploration of large language models. arXiv preprint arXiv:2312.12999, 2023. · arXiv
  101. Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tat- sunori Hashimoto. Whose opinions do language models reflect? In International Conference on Machine Learning, pages 29971-30004. PMLR, 2023.
  102. Caleb Ziems, William Held, Omar Shaikh, Jiaao Chen, Zhehao Zhang, and Diyi Yang. Can large language models transform computational social science? Computational Linguistics, pages 1-55, 2024.
  103. Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. Aligning {ai} with shared human values. In Inter- national Conference on Learning Representations, 2021. URL https://openreview. net/forum?id=dNy_RKzJacY.
  104. Esin Durmus, Karina Nyugen, Thomas I Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, et al. Towards measuring the representation of subjective global opin- ions in language models. arXiv preprint arXiv:2306.16388, 2023. · arXiv
  105. Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Han- nah Rose Kirk, Hinrich Schütze, and Dirk Hovy. Political compass or spinning arrow? towards more meaningful evaluations for values and opinions in large language models. arXiv preprint arXiv:2402.16786, 2024. · arXiv
  106. Zaijing Li, Gongwei Chen, Rui Shao, Dongmei Jiang, and Liqiang Nie. Enhancing the emotional generation capability of large language models via emotional chain-of-thought. arXiv preprint arXiv:2401.06836, 2024. · arXiv
  107. Julian Coda-Forno, Kristin Witte, Akshay K Jagadish, Marcel Binz, Zeynep Akata, and Eric Schulz. Inducing anxiety in large language models increases exploration and bias. arXiv preprint arXiv:2304.11111, 2023. · arXiv
  108. Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, and Yulia Tsvetkov. Minding language models'(lack of) theory of mind: A plug-and-play multi-character belief tracker. In The 61st Annual Meeting Of The Association For Computational Linguistics, 2023.
  109. Ziqiao Ma, Jacob Sansom, Run Peng, and Joyce Chai. Towards a holistic landscape of situated theory of mind in large language models. In The 2023 Conference on Empirical Methods in Natural Language Processing, 2023. URL https://openreview.net/forum?id=xlg5jVmPSg.
  110. Mudit Verma, Siddhant Bhambri, and Subbarao Kambhampati. Theory of mind abilities of large language models in human-robot interaction: An illusion? In Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, HRI '24, page 36-45, New York, NY, USA, 2024. Association for Computing Machinery. ISBN 9798400703232. doi: 10.1145/3610978.3640767. URL https://doi.org/10.1145/3610978.3640767. · DOI
  111. Michael F Scheier, Charles S Carver, and Michael W Bridges. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the life orientation test. Journal of personality and social psychology, 67(6):1063, 1994.
  112. Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, et al. Sotopia: Interactive evaluation for social intelligence in language agents. In The Twelfth International Conference on Learning Representations, 2023.
  113. Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, pages 1-22, 2023.
  114. Morris Rosenberg. Society and the adolescent self-image. Princeton university press, 2015.
  115. Michael H Kernis. Toward a conceptualization of optimal self-esteem. Psycho- logical inquiry, 14(1):1-26, 2003.
  116. Lingjiao Chen, Matei Zaharia, and James Zou. How is ChatGPT's behavior changing over time? arXiv preprint arXiv:2307.09009, 2023. · arXiv
  117. Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, and Heng Ji. Unleashing cognitive synergy in large language models: A task-solving agent through multi-persona self-collaboration. arXiv preprint arXiv:2307.05300, 1(2):3, 2023. · arXiv
  118. Jintian Zhang, Xin Xu, and Shumin Deng. Exploring collaboration mechanisms for llm agents: A social psychology view. arXiv preprint arXiv:2310.02124, 2023. · arXiv
  119. Junkai Li, Siyu Wang, Meng Zhang, Weitao Li, Yunghwei Lai, Xinhui Kang, Weizhi Ma, and Yang Liu. Agent hospital: A simulacrum of hospital with evolvable medical agents. arXiv preprint arXiv:2405.02957, 2024. · arXiv
  120. Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, and Xing Xie. Culturellm: Incorporating cultural differences into large language models. arXiv preprint arXiv:2402.10946, 2024. · arXiv
  121. Zhengliang Liu, Yue Huang, Xiaowei Yu, Lu Zhang, Zihao Wu, Chao Cao, Haixing Dai, Lin Zhao, Yiwei Li, Peng Shu, et al. Deid-gpt: Zero-shot medical text de-identification by gpt-4. arXiv preprint arXiv:2303.11032, 2023. · arXiv
  122. Yusheng Liao, Yutong Meng, Yuhao Wang, Hongcheng Liu, Yanfeng Wang, and Yu Wang. Automatic interactive evaluation for large language models with state aware patient simulator. arXiv preprint arXiv:2403.08495, 2024. · arXiv
  123. Yaneng Li, Cheng Zeng, Jialun Zhong, Ruoyu Zhang, Minhao Zhang, and Lei Zou. Leveraging large language model as simulated patients for clinical education. arXiv preprint arXiv:2404.13066, 2024. · arXiv
  124. Faiha Fareez, Tishya Parikh, Christopher Wavell, Saba Shahab, Meghan Cheva- lier, Scott Good, Isabella De Blasi, Rafik Rhouma, Christopher McMahon, Jean- Paul Lam, et al. A dataset of simulated patient-physician medical interviews with a focus on respiratory cases. Scientific Data, 9(1):313, 2022.

Cited by

Sorted by citations

Metadata

Authors
Li, Y., Huang, Y., Wang, H., Cheng, Y., Zhang, X., Zou, J., & Sun, L.
Affiliations
  • University of Cambridge (GB)
  • University of Notre Dame (US)
  • Carnegie Mellon University (US)
  • Stanford University (US)
  • Lehigh University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2406.17675
arXiv
2406.17675
OpenAlex
W4400065236
Cited by
8
References
2
Citations by year
2026: 4 · 2025: 3 · 2024: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, psychometrics, psychological constructs, personality, values, emotional intelligence, theory of mind, self-efficacy, LLM evaluation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review