The DOI matches its DataCite record.
Livia: An Emotion-Aware AR Companion Powered by Modular AI Agents and Progressive Memory Compression
Open accessAbstract
Loneliness and social isolation pose significant emotional and health challenges, prompting the development of technology-based solutions for companionship and emotional support. This paper introduces Livia, an emotion-aware augmented reality (AR) companion app designed to provide personalized emotional support by combining modular artificial intelligence (AI) agents, multimodal affective computing, progressive memory compression, and AR driven embodied interaction. Livia employs a modular AI architecture with specialized agents responsible for emotion analysis, dialogue generation, memory management, and behavioral orchestration, ensuring robust and adaptive interactions. Two novel algorithms-Temporal Binary Compression (TBC) and Dynamic Importance Memory Filter (DIMF)-effectively manage and prioritize long-term memory, significantly reducing storage requirements while retaining critical context. Our multimodal emotion detection approach achieves high accuracy, enhancing proactive and empathetic engagement. User evaluations demonstrated increased emotional bonds, improved satisfaction, and statistically significant reductions in loneliness. Users particularly valued Livia's adaptive personality evolution and realistic AR embodiment. Future research directions include expanding gesture and tactile interactions, supporting multi-user experiences, and exploring customized hardware implementations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Rather than retaining all raw logs, systems (Xi and Wang, 2025; Zhong et al., 2024; Park et al., 2023; Lei et al., 2025) maintain structured stores of past interactions, ranking entries by metrics such as relevance , recency , importance , or distinctiveness .”
From Memory in the Age of AI Agents (2025) · cites this paper as Xi and Wang, 2025
The cited source says what the claim attributes to it.
In the citing paper
“Livia (Xi and Wang, 2025) incorporates emotional salience and contextual relevance to model emotion-driven selective forgetting.”
From Memory in the Age of AI Agents (2025) · cites this paper as Xi and Wang, 2025
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 15
- [1]1. Office of the Surgeon General (OSG): Our Epidemic of Loneliness and Isolation: The U.S. Surgeon General's Advisory on the Healing Effects of Social Connection and Community. U.S. Department of Health and Human Services, Washington DC (2023). PMID: 37792968.
- [3]3. Maples, B., et al.: Loneliness and suicide mitigation for students using GPT3-enabled chatbots. npj Mental Health Res 3, 4 (2024). https://doi.org/10.1038/s44184-023-00047-6. · DOI · Paper page
- [4]4. Zhou, H., et al.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, pp. 733-738. AAAI (2018).
- [5]5. Park, J.S., et al.: Generative Agents: Interactive Simulacra of Human Behavior. arXiv preprint arXiv:2304.03442v2 (2023). https://doi.org/10.48550/arXiv.2304.03442. · DOI · Paper page
- [6]6. Ahmed, N., Al Aghbari, Z., Girija, S.: A systematic survey on multimodal emotion recognition using learning algorithms. Intelligent Systems with Applications 15, 200171 (2022). https://doi.org/10.1016/j.iswa.2022.200171. · DOI
- [7]7. Nijholt, A.: Towards Social Companions in Augmented Reality: Vision and Challenges. In: Distributed, Ambient and Pervasive Interactions. Smart Living, Learning, Well-being and Health, Art and Creativity. 10th International Conference, DAPI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 - July 1, 2022, Proceedings, Part II, pp. 304-319. Springer (2022). https://doi.org/10.1007/978-3-031-05431-0\_21. · DOI
- [8]8. Wu, B., et al.: Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational History. arXiv preprint arXiv:2503.05150 (2025). https://doi.org/10.48550/arXiv.2503.05150 · DOI
- [9]9. Billinghurst, M., Clark, A., Lee, G.: A Survey of Augmented Reality. Foundations and Trends® in Human-Computer Interaction 8(2-3), 73-272 (2015). https://doi.org/10.1561/1100000049. · DOI
- [10]10. Shevlin, H.: All too human? Identifying and mitigating ethical risks of Social AI. Law Ethics Technol. (2024). https://doi.org/10.55092/let20240003. · DOI · Paper page
- [11]11. Reddy, P.S., John, A., Kaushik, S.: AI As Romantic Companion-an Ethical Dilemma. SSRN (2024). https://doi.org/10.2139/ssrn.5106936. · DOI
- [12]12. Malfacini, K.: The impacts of companion AI on human relationships: risks, benefits, and design considerations. AI & Society (2025). https://doi.org/10.1007/s00146-025-02318-6. · DOI · Paper page
- [13]13. Fosch-Villaronga, E., Poulsen, A.: Diversity and Inclusion in Artificial Intelligence. In: Custers, B., Fosch-Villaronga, E. (eds.) Law and Artificial Intelligence. Information Technology and Law Series, vol. 35, T.M.C. Asser Press, The Hague (2022). https://doi.org/10.1007/978-94-6265-523-2\_6. · DOI
- [14]14. Yang, L: Technologies as 'AI Companions': a call for more inclusive emotional affordance for people with disabilities. AI & Soc (2025). https://doi.org/10.1007/s00146-025-02358-y. · DOI
- [15]15. Chowdhury, M.R.Z., et al.: Privacy Preserving Federated Learning Approach for Speech Emotion Recognition. In: 2023 26th International Conference on Computer and Information Technology (ICCIT). IEEE (2023). https://doi.org/10.1109/ICCIT60459.2023.10441577. · DOI
- [16]16. Schirmer, A., Adolphs, R.: Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence. Trends in Cognitive Sciences 21(3), 216-228 (2017). https://doi.org/10.1016/j.tics.2017.01.001. · DOI
Cited by
Sorted by citations
Memory in the Age of AI Agents
Hu, Y., Liu, S., Yue, Y., Zhang, G., Liu, B., Zhu, F., Lin, J., Guo, H., Dou, S., Xi, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.13564 · Cited by 389
Metadata
- Authors
- Xi, R., & Wang, X.
- Affiliations
- University of California, Berkeley (US)
- New York University (US)
- Corresponding author
- Wang, Xianghan
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- Pages
- 28-42
- ISSN
- 2190-3018 (ISSN-L)
- arXiv
- 2509.05298
- OpenAlex
- W7117973404
- Cited by
- 3
- References
- 0
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 41.07
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Smart innovation, systems and technologies (publishedVersion)
- arXiv (Cornell University) (acceptedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Keywords
- loneliness, social isolation, affective computing, multimodal emotion recognition, memory compression, embodied interaction, dialogue generation, adaptive personality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
