CoChat
Sign Up
PreprintCited by 3Emotion and Mood RecognitionSocial Robot Interaction and HRIAugmented Reality Applications

The DOI matches its DataCite record.

Livia: An Emotion-Aware AR Companion Powered by Modular AI Agents and Progressive Memory Compression

Open access
Xi, Rui, Wang, Xianghan·2025·arXiv
DOI 10.48550/arxiv.2509.05298arXiv 2509.05298
Open this paper in CoChat — free accountOpen PDF

Abstract

Loneliness and social isolation pose significant emotional and health challenges, prompting the development of technology-based solutions for companionship and emotional support. This paper introduces Livia, an emotion-aware augmented reality (AR) companion app designed to provide personalized emotional support by combining modular artificial intelligence (AI) agents, multimodal affective computing, progressive memory compression, and AR driven embodied interaction. Livia employs a modular AI architecture with specialized agents responsible for emotion analysis, dialogue generation, memory management, and behavioral orchestration, ensuring robust and adaptive interactions. Two novel algorithms-Temporal Binary Compression (TBC) and Dynamic Importance Memory Filter (DIMF)-effectively manage and prioritize long-term memory, significantly reducing storage requirements while retaining critical context. Our multimodal emotion detection approach achieves high accuracy, enhancing proactive and empathetic engagement. User evaluations demonstrated increased emotional bonds, improved satisfaction, and statistically significant reductions in loneliness. Users particularly valued Livia's adaptive personality evolution and realistic AR embodiment. Future research directions include expanding gesture and tactile interactions, supporting multi-user experiences, and exploring customized hardware implementations.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2509.05298

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 15

  1. [1]1. Office of the Surgeon General (OSG): Our Epidemic of Loneliness and Isolation: The U.S. Surgeon General's Advisory on the Healing Effects of Social Connection and Community. U.S. Department of Health and Human Services, Washington DC (2023). PMID: 37792968.
  2. [3]3. Maples, B., et al.: Loneliness and suicide mitigation for students using GPT3-enabled chatbots. npj Mental Health Res 3, 4 (2024). https://doi.org/10.1038/s44184-023-00047-6. · DOI · Paper page
  3. [4]4. Zhou, H., et al.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, pp. 733-738. AAAI (2018).
  4. [5]5. Park, J.S., et al.: Generative Agents: Interactive Simulacra of Human Behavior. arXiv preprint arXiv:2304.03442v2 (2023). https://doi.org/10.48550/arXiv.2304.03442. · DOI · Paper page
  5. [6]6. Ahmed, N., Al Aghbari, Z., Girija, S.: A systematic survey on multimodal emotion recognition using learning algorithms. Intelligent Systems with Applications 15, 200171 (2022). https://doi.org/10.1016/j.iswa.2022.200171. · DOI
  6. [7]7. Nijholt, A.: Towards Social Companions in Augmented Reality: Vision and Challenges. In: Distributed, Ambient and Pervasive Interactions. Smart Living, Learning, Well-being and Health, Art and Creativity. 10th International Conference, DAPI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 - July 1, 2022, Proceedings, Part II, pp. 304-319. Springer (2022). https://doi.org/10.1007/978-3-031-05431-0\_21. · DOI
  7. [8]8. Wu, B., et al.: Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational History. arXiv preprint arXiv:2503.05150 (2025). https://doi.org/10.48550/arXiv.2503.05150 · DOI
  8. [9]9. Billinghurst, M., Clark, A., Lee, G.: A Survey of Augmented Reality. Foundations and Trends® in Human-Computer Interaction 8(2-3), 73-272 (2015). https://doi.org/10.1561/1100000049. · DOI
  9. [10]10. Shevlin, H.: All too human? Identifying and mitigating ethical risks of Social AI. Law Ethics Technol. (2024). https://doi.org/10.55092/let20240003. · DOI · Paper page
  10. [11]11. Reddy, P.S., John, A., Kaushik, S.: AI As Romantic Companion-an Ethical Dilemma. SSRN (2024). https://doi.org/10.2139/ssrn.5106936. · DOI
  11. [12]12. Malfacini, K.: The impacts of companion AI on human relationships: risks, benefits, and design considerations. AI & Society (2025). https://doi.org/10.1007/s00146-025-02318-6. · DOI · Paper page
  12. [13]13. Fosch-Villaronga, E., Poulsen, A.: Diversity and Inclusion in Artificial Intelligence. In: Custers, B., Fosch-Villaronga, E. (eds.) Law and Artificial Intelligence. Information Technology and Law Series, vol. 35, T.M.C. Asser Press, The Hague (2022). https://doi.org/10.1007/978-94-6265-523-2\_6. · DOI
  13. [14]14. Yang, L: Technologies as 'AI Companions': a call for more inclusive emotional affordance for people with disabilities. AI & Soc (2025). https://doi.org/10.1007/s00146-025-02358-y. · DOI
  14. [15]15. Chowdhury, M.R.Z., et al.: Privacy Preserving Federated Learning Approach for Speech Emotion Recognition. In: 2023 26th International Conference on Computer and Information Technology (ICCIT). IEEE (2023). https://doi.org/10.1109/ICCIT60459.2023.10441577. · DOI
  15. [16]16. Schirmer, A., Adolphs, R.: Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence. Trends in Cognitive Sciences 21(3), 216-228 (2017). https://doi.org/10.1016/j.tics.2017.01.001. · DOI

Cited by

Sorted by citations

See all 3

Metadata

Authors
Xi, R., & Wang, X.
Affiliations
  • University of California, Berkeley (US)
  • New York University (US)
Corresponding author
Wang, Xianghan
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
Pages
28-42
ISSN
2190-3018 (ISSN-L)
DOI
10.48550/arxiv.2509.05298
arXiv
2509.05298
OpenAlex
W7117973404
Cited by
3
References
0
Citations by year
2026: 2 · 2025: 1
FWCI
41.07
Type
conference paper
Language
en
Open access
Licence
creativecommons.org/licenses/by-nc-nd/4.0/legalcode
Locations
  • Smart innovation, systems and technologies (publishedVersion)
  • arXiv (Cornell University) (acceptedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
Keywords
loneliness, social isolation, affective computing, multimodal emotion recognition, memory compression, embodied interaction, dialogue generation, adaptive personality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Livia: An Emotion-Aware AR Companion Powered by Modular AI Agents and Progressive Memory Compression. https://app.cochat.ai/papers/10.48550/arxiv.2509.05298
The paper
Xi, R., & Wang, X. (2025). Livia: An Emotion-Aware AR Companion Powered by Modular AI Agents and Progressive Memory Compression. arXiv. https://doi.org/10.48550/arxiv.2509.05298