Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index; 9 of the 22 sources its claims cite were checked for support.

Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory

Open access
Zhang, Shuning, Ma, Rongjun, Ma, Ying, Li, Shixuan, Xu, Yiqun, Yi, Xin, Li, Hewu · 2025 · Proceedings of the 2025 Workshop on Human-Centered AI Privacy and Security

Abstract

Large Language Models (LLMs) are increasingly integrating memory functionalities to provide personalized and context-aware interactions. However, user understanding, practices and expectations regarding these memory systems are not yet well understood. This paper presents a thematic analysis of semi-structured interviews with 18 users to explore their mental models of LLM’s Retrieval Augmented Generation (RAG)-based memory, current usage practices, perceived benefits and drawbacks, privacy concerns and expectations for future memory systems. Our findings reveal diverse and often incomplete mental models of how memory operates. While users appreciate the potential for enhanced personalization and efficiency, significant concerns exist regarding privacy, control and the accuracy of remembered information. Users express a desire for granular control over memory generation, management, usage and updating, including clear mechanisms for reviewing, editing, deleting and categorizing memories, as well as transparent insight into how memories and inferred information are used. We discuss design implications for creating more user-centric, transparent, and trustworthy LLM memory systems.

Overview

CoChat Summary

TL;DR

This paper reports a qualitative interview study with 18 Chinese users on their perceptions of LLM RAG-based memory, using ChatGPT as a case study. It finds varied and often incomplete mental models, a privacy calculus of benefits versus risks, and a strong user demand for granular control and transparency across memory generation, management, usage, and updating.

Key findings

  • Users held four dominant mental models of LLM memory: (1) a transient, dialogue-specific buffer; (2) an extension of core training data; (3) an active information processing mechanism; and (4) an acknowledged lack of understanding.
  • Participants described benefits including enhanced personalization and efficiency, improved continuity and reduced redundancy, and the LLM as a better companion/assistant; concerns included confidentiality and data leakage, profiling and unwanted persuasion, aggregation and re-identification, unauthorized secondary use, and lack of epistemological certainty.
  • Protective strategies included strategic privacy disclosure, proactive input obfuscation, and refusal to use or workarounds.
  • Challenges spanned inaccurate memories, lack of meaningful control and transparency, and opaque/uncontrolled inferences; design implications called for context-aware modular memory workspaces, transparent interfaces showing memory origin/use, and co-curation through review-and-commit workflows.

Methods

  • Semi-structured interviews with 18 participants recruited online, representing academic and professional backgrounds including engineering, life sciences, social sciences, IT, and design; the study was IRB-approved and participants were compensated 100 RMB. Interviews were conducted in Chinese via Tencent Meeting, lasted approximately 30–60 minutes, and were recorded and transcribed; the interview centered on ChatGPT’s memory feature as a case study.
  • Thematic analysis was used: two researchers familiarized themselves with the data, inductively generated initial codes, developed a unified codebook, independently coded 20% of the data with Cohen’s Kappa of 0.90, then independently coded the rest; codes were collated into themes and refined through discussion.

Limitations

  • Stated: the study centers on Chinese users under Chinese regulations, so regulatory nuances may differ in GDPR- or CCPA-related regions; participants are biased toward young students with higher education and literacy than average; the work primarily targets ChatGPT, with other products and open-source agent frameworks left for future work; cultural nuances are also left for future work.
  • Evident: the small qualitative sample and self-report nature limit generalizability, and the single-product focus may not capture other memory implementations.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3733816.3760750

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 2 Not valid · 8 Not checked · 56 Own results and interpretations

30 more claims

Create a free account to see all 72 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 28
  • It may state two separate claims as one. 19
  • The quote only partly states this claim. 1
  • Borderline: one of the tests for a substantial claim is unclear. 1

Create a free account to see these claims.

Citations

Cites

Show all 33 references

Research works printed but not linked: 3

  1. Natã M Barbosa, Zhuohao Zhang, and Yang Wang. 2020. Do Privacy and Security Matter to Everyone? Quantifying and Clustering { User-Centric} Considerations About Smart Home Device Adoption. In Sixteenth Symposium on Usable Privacy and Security (SOUPS 2020). 417–435.
  2. Google PAIR. 2019. People + AI Guidebook. Technical Report. Google Research. https://design.google/aiguidebook/
  3. Yijia Shao, Tianshi Li, Weiyan Shi, Yanchen Liu, and Diyi Yang. [n. d.]. PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action. In The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track.

Cited by

See all 8

Metadata

Authors
Zhang, S., Ma, R., Ma, Y., Li, S., Xu, Y., Yi, X., & Li, H.
Affiliations
  • Tsinghua University (CN)
  • Aalto University (FI)
  • The University of Melbourne (AU)
Venue
Proceedings of the 2025 Workshop on Human-Centered AI Privacy and Security
Publisher
ACM
Published
2025-10-13
Pages
10-19
OpenAlex
W4416273051
Cited by
6
References
33
Citations by year
2026: 6
FWCI
20.15
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Aaltodoc (Aalto University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Natural Science Foundation of China (62132010)
Topics
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
large language models, retrieval-augmented generation, LLM memory, mental models, memory accuracy, personalization, user expectations, trustworthy AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory. https://app.cochat.ai/papers/10.1145/3733816.3760750
The paper
Zhang, S., Ma, R., Ma, Y., Li, S., Xu, Y., Yi, X., & Li, H. (2025). Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory. Proceedings of the 2025 Workshop on Human-Centered AI Privacy and Security. https://doi.org/10.1145/3733816.3760750

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.