Understanding the Impact of Long-Term Memory on Self-Disclosure with Large Language Model-Driven Chatbots for Public Health Intervention
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Recent large language models (LLMs) offer the potential to support public health monitoring by facilitating health disclosure through open-ended conversations but rarely preserve the knowledge gained about individuals across repeated interactions. Augmenting LLMs with long-term memory (LTM) presents an opportunity to improve engagement and self-disclosure, but we lack an understanding of how LTM impacts people’s interaction with LLM-driven chatbots in public health interventions. We examine the case of CareCall—an LLM-driven voice chatbot with LTM—through the analysis of 1,252 call logs and interviews with nine users. We found that LTM enhanced health disclosure and fostered positive perceptions of the chatbot by offering familiarity. However, we also observed challenges in promoting self-disclosure through LTM, particularly around addressing chronic health conditions and privacy concerns. We discuss considerations for LTM integration in LLM-driven chatbots for public health monitoring, including carefully deciding what topics need to be remembered in light of public health goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A prior study showed that users appreciated when chatbots remembered past conversations, such as recalling a health complaint mentioned earlier and following up on it [70].”
From Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit Narratives (2026) · cites this paper as [70]
In the citing paper
“This kind of continuity gave users a stronger sense of being valued.”
From Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit Narratives (2026) · cites this paper as [70]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
How stigma interferes with mental health care.
Corrigan, P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.614 · Cited by 3,648 · cited 2×
“People often avoid revealing their vulnerabilities [13, 73], which makes them hesitant to disclose sensitive information, such as their health issues.”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 3×
“” P1 felt CareCall’s LTM-triggered questions were sometimes overly specific, which made him hesitant to share details about his health during the calls: “Sometimes I hesitate to answer some questions.”
BackgroundPaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977 · cited 3×
“Prior work indicated that people might feel more comfortable disclosing sensitive information to a digital system rather than a human because technology is often perceived as anonymous [47, 48, 50] and non-judgemental [32, 47, 49, 70].”
BackgroundChaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572
Lau, J., Zimmerman, B., & Schaub, F. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274371 · Cited by 568
Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot
Liu, B., & Sundar, S. S. (2018) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0110 · Cited by 447
How to evaluate technologies for health behavior change in HCI research
Klasnja, P., Consolvo, S., & Pratt, W. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979396 · Cited by 414
Machine Heuristic: When We Trust Computers More than Humans with Our Personal Information
Sundar, S. S., & Kim, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300768 · Cited by 347
"I Hear You, I Feel You": Encouraging Deep Self-disclosure through a Chatbot
Lee, Y.-C., Yamashita, N., Huang, Y., & Fu, W. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376175 · Cited by 339 · cited 4×
“P6 similarly felt that LTM-triggered questions were repetitive, wishing that those questions were delivered in different forms periodically: “The only health issue that I have now is leg pain, so I can’t complain about the fact that it asks the same question every week.”
BackgroundResultInfluentialReporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308 · cited 3×
“Prior work indicated that people might feel more comfortable disclosing sensitive information to a digital system rather than a human because technology is often perceived as anonymous [47, 48, 50] and non-judgemental [32, 47, 49, 70].”
BackgroundTurn-taking in conversational systems and human-robot interaction: a review
Skantze, G. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101178 · Cited by 298
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.356 · Cited by 188
Jo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174
Self-citationFeedpal: Understanding Opportunities for Chatbots in Breastfeeding Education of Women in India
Yadav, D., Malik, P., Dabas, K., & Singh, P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359272 · Cited by 90
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84 · cited 3×
“With their large-scale ( i.e. , over billions of) parameters trained with a tremendous amount of human-produced text corpus, LLMs tend to generate responses that coherently and organically follow up the conversation and flexibly respond to emergent topics [76].”
BackgroundSelf-citationEngaging Solidarity in Data Collection Practices for Community Health
Ismail, A., & Kumar, N. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274345 · Cited by 78
Convey: Exploring the Use of a Context View for Chatbots
Jain, M., Kota, R., Kumar, P., & Patel, S. N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174042 · Cited by 74 · cited 1×
“However, studies indicated that users might have feelings of privacy violations around chatbots’ memory [14, 52].”
BackgroundAugmenting Language Models with Long-Term Memory
Wang, W., Dong, L., Cheng, H., Liu, X., Yan, X., Gao, J., & Wei, F. (2023) · arXiv · doi:10.48550/arxiv.2306.07174 · Cited by 72
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S. (2022) · arXiv · doi:10.48550/arxiv.2203.05797 · Cited by 65
Park, H., & Lee, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445133 · Cited by 44
Ma, Z., Mei, Y., & Su, Z. (2023) · arXiv · doi:10.48550/arxiv.2307.15810 · Cited by 40
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation
Lee, G., Hartmann, V., Park, J., Papailiopoulos, D., & Lee, K. (2023) · arXiv · doi:10.48550/arxiv.2305.04533 · Cited by 34
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation
Lee, G., Hartmann, V., Park, J., Papailiopoulos, D., & Lee, K. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.277 · Cited by 34 · cited 2×
“One common approach is to include summarized information of the conversation history instead of a raw knowledge base ( e.g. , [2, 41, 75]).”
BackgroundAn Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers
Wang, L., Mujib, M. I., Williams, J., Demiris, G., & Huh-Yoo, J. (2021) · arXiv · doi:10.48550/arxiv.2107.13115 · Cited by 21 · cited 1×
“””
FireAct: Toward Language Agent Fine-tuning
Chen, B., Shu, C., Shareghi, E., Collier, N., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2310.05915 · Cited by 9
Research works printed but not linked: 50
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems (NeurIPS ’20), H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.). Vol. 33. Curran Associates, Inc., 1877–1901. https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
- Hye-jin Byun. 2022. NAVER launches AI call service aimed at seniors - The Korea Herald. Retrieved Sep 14, 2023 from https://www.koreaherald.com/view.php?ud=20220530000643
- Character AI. 2023. Character AI. Retrieved Sep 14, 2023 from https://character.ai/
- 10.13140/RG.2.2.35753.70240 · DOI
- Samuel Rhys Cox Yi-Chieh Lee and Wei Tsang Ooi. 2023. Comparing How a Chatbot References User Utterances from Previous Chatting Sessions: An Investigation of Users’ Privacy Concerns and Perceptions. http://arxiv.org/abs/2308.04879 arXiv:2308.04879 [cs]. · arXiv
- 10.1145/3543829.3543831 · DOI · Paper page
- 10.1177/160940691301200137 · DOI · Paper page
- 10.13140/RG.2.2.36112.92165 · DOI
- Google, Inc. 2023. Bard - Chat Based AI Tool from Google, Powered by PaLM 2. Retrieved Sep 14, 2023 from https://bard.google.com/
- 10.1145/3308558.3313432 · DOI
- Robert B Hays. 1985. A Longitudinal Study of Friendship Development. (April 1985).
- 10.1093/joc · doi:10.1093/joc
- Inflection AI. 2023. Pi, your personal AI. Retrieved Sep 14, 2023 from https://pi.ai/talk
- 10.1145/3274344 · DOI · Paper page
- 10.1145/3411764.3445130 · DOI · Paper page
- 10.1145/3610203 · DOI
- 10.3115/1620754.1620847 · DOI · Paper page
- 10.1002/cav.345 · DOI · Paper page
- Evangelos Karapanos Jens Gerken Jesper Kjeldskov and Mikael B. Skov (Eds.). 2021. Advances in Longitudinal HCI Research. Springer International Publishing Cham. https://doi.org/10.1007/978-3-030-67322-2 · doi:10.1007/978-3-030-67322-2
- 10.18653/v1 · doi:10.18653/v1
- 10.1145/3491102.3502116 · DOI · Paper page
- Korean Statistical Information Service. 2023. Resident Population in Five-Year Age Groups. Retrieved Nov 14, 2023 from https://kosis.kr/statHtml/statHtml.do?orgId=101%26tblId=DT_1B04005N%26vw_cd=MT_ETITLE%26list_id=A_7%26scrId=%26language=en%26seqNo=%26lang_mode=en%26obj_var_id=%26itm_id=%26conn_path=MT_ETITLE%26path=%2Feng%2FstatisticsList%2FstatisticsListIndex.do
- 10.3389/fpsyg.2019.00558 · DOI · Paper page
- 10.18653/v1 · doi:10.18653/v1
- 10.1145/3290605.3300932 · DOI · Paper page
- 10.1145/3392836 · DOI · Paper page
- 10.1177/10944281221134096 · DOI
- 10.1145/3555569 · DOI
- 10.1145/3411764.3445669 · DOI
- 10.1007/978-3-319-67744-6_28 · DOI · Paper page
- 10.1145/3411764.3445420 · DOI · Paper page
- OpenAI, Inc. 2022. ChatGPT. Retrieved Sep 14, 2023 from https://chat.openai.com
- OpenAI, Inc. 2023. Replika. Retrieved Nov 14, 2023 from https://replika.com/
- 10.2196/12231 · DOI · Paper page
- 10.1145/3461778.3462143 · DOI · Paper page
- 10.1145/3544548.3581346 · DOI
- 10.1016/j.chb.2016.08.004 · DOI
- Manuel Portela and Carlos Granell-Canut. 2017. A new friend in our Smartphone? Observing Interactions with Chatbots in the search of emotional engagement. (2017). · DOI · Paper page
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.1145/3041021.3054172 · DOI · Paper page
- 10.2105/AJPH.2015.302696 · DOI · Paper page
- 10.1109/TVCG.2015.2467831 · DOI
- 10.1037/0022-0167.50.3.351 · DOI · Paper page
- 10.18653/v1 · doi:10.18653/v1
- Yonhap. 2017. Lonely deaths of middle-aged, youth brackets stand out amid single-person households - The Korea Herald. Retrieved Sep 14, 2023 from https://www.koreaherald.com/view.php?ud=20171207000623
- Zhonghua Zheng Lizi Liao Yang Deng and Liqiang Nie. 2023. Building Emotional Support Chatbots in the Era of LLMs. arxiv:2308.11584 [cs.CL] · arXiv
- Wanjun Zhong, Lianghong Guo, Qiqi Gao, and Yanlin Wang. 2023. MemoryBank: Enhancing Large Language Models with Long-Term Memory. arXiv preprint arXiv:2305.10250 (2023). · arXiv
Cited by
Zhang, R., Li, H., Meng, H., Zhan, J., Gan, H., & Lee, Y.-C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713429 · Cited by 123
The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support
Song, I., Pendse, S. R., Kumar, N., & De Choudhury, M. (2024) · arXiv · doi:10.48550/arxiv.2401.14362 · Cited by 64
Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit Narratives
Namvarpour, M. (., Brofsky, B., Medina, J. Y., Akter, M., & Razi, A. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790597 · Cited by 24
Zhang, R., Li, H., Chen, A., Liu, Z., & Lee, Y.-C. (2024) · Social Media + Society · doi:10.1177/20563051241290845 · Cited by 23
Private Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recovery
Choi, R., Kim, T., Park, S., Kim, J. G., & Lee, S.-J. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713485 · Cited by 19
Self-citation
Metadata
- Authors
- Jo, E., Jeong, Y., Park, S., Epstein, D. A., & Kim, Y.-H.
- Affiliations
- University of California, United States
- NAVER Cloud, Korea, Republic of
- Informatics, University of California, United States
- NAVER AI Lab, Korea, Republic of
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-21
- Cited by
- 84
- References
- 30
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.