CoChat

An appraisal-based chain-of-emotion architecture for affective language model game agents

Croissant, Maximilian, Frister, Madeleine, Schofield, Guy, McCall, Cade · 2024 · PLOS ONE
Cited by 15

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Abstract

The development of believable, natural, and interactive digital artificial agents is a field of growing interest. Theoretical uncertainties and technical barriers present considerable challenges to the field, particularly with regards to developing agents that effectively simulate human emotions. Large language models (LLMs) might address these issues by tapping common patterns in situational appraisal. In three empirical experiments, this study tests the capabilities of LLMs to solve emotional intelligence tasks and to simulate emotions. It presents and evaluates a new Chain-of-Emotion architecture for emotion simulation within video games, based on psychological appraisal research. Results show that it outperforms control LLM architectures on a range of user experience and content analysis metrics. This study therefore provides early evidence of how to construct and test affective agents based on cognitive processes represented in language models.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0301033

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 19 references

Research works printed but not linked: 52

  1. E Hudlicka, 2011, Guidelines for designing computational models of emotions, International Journal of Synthetic Emotions (IJSE), 2, 26, 10.4018/jse.2011010103 · DOI · Paper page
  2. R Reisenzein, 2013, Computational modeling of emotion: Toward improving the inter-and intradisciplinary exchange, IEEE Transactions on Affective Computing, 4, 246, 10.1109/T-AFFC.2013.14 · DOI · Paper page
  3. R Beale, 2009, Affective interaction: How emotional agents affect users, International journal of human-computer studies, 67, 755, 10.1016/j.ijhcs.2009.05.001 · DOI · Paper page
  4. Luxton DD, Hudlicka E. Intelligent Virtual Agents in Behavioral and Mental Healthcare Mental healthcare: Ethics Ethics and Application Considerations. In: Artificial Intelligence in Brain and Mental Health: Philosophical, Ethical & Policy Issues. Springer; 2022. p. 41–55. · DOI
  5. KR Scherer, 2022, Theory convergence in emotion science is timely and realistic, Cognition and Emotion, 36, 154, 10.1080/02699931.2021.1973378 · DOI
  6. KR Scherer, 2000, Psychological models of emotion, The neuropsychology of emotion, 137, 137
  7. M Croissant, 2023, Theories, methodologies, and effects of affect-adaptive games: A systematic review, Entertainment Computing, 100591, 10.1016/j.entcom.2023.100591 · DOI
  8. AI Siam, 2022, Deploying machine learning techniques for human emotion detection, Computational intelligence and neuroscience, 2022
  9. Kosinski M. Theory of mind may have spontaneously emerged in large language models. arXiv preprint arXiv:230202083. 2023;.
  10. LF Barrett, 2017, How emotions are made: The secret life of the brain
  11. A Moors, 2013, Appraisal theories of emotion: State of the art and future development, Emotion Review, 5, 119, 10.1177/1754073912468165 · DOI · Paper page
  12. KA Lindquist, 2015, Does language do more than communicate emotion?, Current directions in psychological science, 24, 99, 10.1177/0963721414553440 · DOI · Paper page
  13. JA Brooks, 2017, The role of language in the experience and perception of emotion: A neuroimaging meta-analysis, Social Cognitive and Affective Neuroscience, 12, 169
  14. L Anolli, 2010, Emotions in serious games: From experience to assessment, International Journal of Emerging Technologies in Learning (iJET), 5, 10.3991/ijet.v5s3.1496 · DOI · Paper page
  15. Hudlicka E. Affective computing for game design. In: Proceedings of the 4th Intl. North American Conference on Intelligent Games and Simulation. McGill University Montreal, Canada; 2008. p. 5–12.
  16. GN Yannakakis, 2014, Emotion in games, Handbook on affective computing, 2014, 459
  17. Croissant M, Schofield G, McCall C. Emotion Design for Video Games: A Framework for Affective Interactivity. ACM Games: Research and Practice. 2023;. · DOI
  18. A Ortony, 1990, The cognitive structure of emotions
  19. A Popescu, 2013, Gamygdala: An emotion engine for games, IEEE Transactions on Affective Computing, 5, 32, 10.1109/T-AFFC.2013.24 · DOI · Paper page
  20. Bosse T, Zwanenburg E. There’s always hope: Enhancing agent believability through expectation-based emotions. In: 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. IEEE; 2009. p. 1–8. · DOI
  21. GN Yannakakis, 2011, Experience-driven procedural content generation, IEEE Transactions on Affective Computing, 2, 147, 10.1109/T-AFFC.2011.6 · DOI · Paper page
  22. Shaker N, Yannakakis G, Togelius J. Towards automatic personalized content generation for platform games. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. vol. 5; 2010. · DOI · Paper page
  23. N Shaker, 2013, Fusing visual and behavioral cues for modeling user experience in games, IEEE Transactions on cybernetics, 43, 1519, 10.1109/TCYB.2013.2271738 · DOI · Paper page
  24. JA Russell, 1980, A circumplex model of affect, Journal of personality and social psychology, 39, 1161, 10.1037/h0077714 · DOI · Paper page
  25. RS Lazarus, 1968, Nebraska symposium on motivation
  26. RS Lazarus, 1991, Emotion and adaptation, 10.1093/oso/9780195069945.001.0001 · DOI · Paper page
  27. B Mesquita, 2014, Emotions in context: A sociodynamic model of emotions, Emotion Review, 6, 298, 10.1177/1754073914534480 · DOI · Paper page
  28. Freiknecht J, Effelsberg W. Procedural generation of interactive stories using language models. In: Proceedings of the 15th International Conference on the Foundations of Digital Games; 2020. p. 1–8. · DOI · Paper page
  29. Callison-Burch C, Tomar GS, Martin LJ, Ippolito D, Bailis S, Reitter D. Dungeons and dragons as a dialog challenge for artificial intelligence. arXiv preprint arXiv:221007109. 2022;. · DOI
  30. Ciolino M, Kalin J, Noever D. The go transformer: natural language modeling for game play. In: 2020 Third International Conference on Artificial Intelligence for Industries (AI4I). IEEE; 2020. p. 23–26. · DOI
  31. Sun T, He J, Qiu X, Huang X. BERTScore is unfair: On social bias in language model-based metrics for text generation. arXiv preprint arXiv:221007626. 2022;. · DOI
  32. Singh M, SB V, Malviya N, et al. Mind meets machine: Unravelling GPT-4’s cognitive psychology. arXiv preprint arXiv:230311436. 2023;.
  33. P Salovey, 1990, Emotional intelligence, Imagination, cognition and personality, 9, 185, 10.2190/DUGG-P24E-52WK-6CDG · DOI · Paper page
  34. S Newsome, 2000, Assessing the predictive validity of emotional intelligence, Personality and Individual differences, 29, 1005, 10.1016/S0191-8869(99)00250-0 · DOI · Paper page
  35. PK Papadogiannis, 2009, An ability model of emotional intelligence: A rationale, description, and application of the Mayer Salovey Caruso Emotional Intelligence Test (MSCEIT), Assessing emotional intelligence: Theory, research, and applications, 43, 10.1007/978-0-387-88370-0_3 · DOI
  36. C MacCann, 2008, New paradigms for assessing emotional intelligence: theory and data, Emotion, 8, 540, 10.1037/a0012746 · DOI · Paper page
  37. P Sajjadi, 2019, A personality-based emotional model for embodied conversational agents: Effects on perceived social presence and game experience of users, Entertainment Computing, 32, 100313, 10.1016/j.entcom.2019.100313 · DOI
  38. JW Pennebaker, 2001, Linguistic inquiry and word count: LIWC 2001, Mahway: Lawrence Erlbaum Associates, 71, 2001
  39. JH Kahn, 2007, Measuring emotional expression with the Linguistic Inquiry and Word Count, The American journal of psychology, 120, 263, 10.2307/20445398 · DOI · Paper page
  40. ML Newman, 2003, Lying words: Predicting deception from linguistic styles, Personality and social psychology bulletin, 29, 665, 10.1177/0146167203029005010 · DOI · Paper page
  41. K Krippendorff, 2018, Content analysis: An introduction to its methodology
  42. HA Elfenbein, 2015, The social perception of emotional abilities: expanding what we know about observer ratings of emotional intelligence, Emotion, 15, 17, 10.1037/a0038436 · DOI
  43. KS Law, 2004, The construct and criterion validity of emotional intelligence and its potential utility for management studies, Journal of applied Psychology, 89, 483, 10.1037/0021-9010.89.3.483 · DOI · Paper page
  44. AJ Cuddy, 2007, The BIAS map: behaviors from intergroup affect and stereotypes, Journal of personality and social psychology, 92, 631, 10.1037/0022-3514.92.4.631 · DOI · Paper page
  45. Croissant, M. An Appraisal-Based Chain-of-Emotion Architecture for Affective Language Model Game Agents. OSF Digitial Repository. https://doi.org/10.17605/OSF.IO/QPT6Z. · doi:10.17605/osf.io/qpt6z
  46. Frank MC. Large language models as models of human cognition. PsyArXiv. 2023;. · DOI
  47. Li C, Wang J, Zhu K, Zhang Y, Hou W, Lian J, et al. Emotionprompt: Leveraging psychology for large language models enhancement via emotional stimulus. arXiv preprint arXiv:230711760. 2023;. · DOI
  48. SA Kotz, 2011, Emotion, language, and the brain, Language and Linguistics Compass, 5, 108, 10.1111/j.1749-818X.2010.00267.x · DOI · Paper page
  49. K Isbister, 2022, Better game characters by design: A psychological approach
  50. Wu T, Terry M, Cai CJ. Ai chains: Transparent and controllable human-ai interaction by chaining large language model prompts. In: Proceedings of the 2022 CHI conference on human factors in computing systems; 2022. p. 1–22. · DOI · Paper page
  51. Han Y, Liu C, Wang P. A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challenge. arXiv preprint arXiv:231011703. 2023;.
  52. Liu H, Ning R, Teng Z, Liu J, Zhou Q, Zhang Y. Evaluating the logical reasoning ability of chatgpt and gpt-4. arXiv preprint arXiv:230403439. 2023;.

Metadata

Authors
Croissant, M., Frister, M., Schofield, G., & McCall, C.
Venue
PLOS ONE
Published
2024-05-10
Volume
19
Issue
5
Pages
e0301033
ISSN
1932-6203
Cited by
15
References
19
Language
en
Funders
EPSRC Centre for Doctoral Training in Intelligent Games and Game Intelligence (EP/S022325/1)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An appraisal-based chain-of-emotion architecture for affective language model game agents. https://app.cochat.ai/papers/10.1371/journal.pone.0301033
The paper
Croissant, M., Frister, M., Schofield, G., & McCall, C. (2024). An appraisal-based chain-of-emotion architecture for affective language model game agents. PLOS ONE. https://doi.org/10.1371/journal.pone.0301033

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.