PreprintCited by 347Speech and dialogue systemsTopic ModelingNatural Language Processing Techniques

The DOI matches its DataCite record; 21 of the 21 references it cites were found in a registry or an index; 2 of the 11 sources its claims cite were checked for support.

MemoryBank: Enhancing Large Language Models with Long-Term Memory

Open access

Abstract

We propose MemoryBank, a novel memory mechanism tailored for LLMs. MemoryBank enables the models to summon relevant memories, continually evolve through continuous memory updates, comprehend, and adapt to a user personality by synthesizing information from past interactions. To mimic anthropomorphic behaviors and selectively preserve memory, MemoryBank incorporates a memory updating mechanism, inspired by the Ebbinghaus Forgetting Curve theory.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

MemoryBank is proposed as a long-term memory layer for LLMs, combining memory storage, retrieval, and a forgetting-curve-inspired updating mechanism, and SiliconFriend is an AI companion built on it. In simulated and real-user evaluations, the ChatGPT-backed variant performed best overall, while open-source variants showed strong retrieval accuracy.

Key findings

  • MemoryBank stores detailed conversation records, hierarchical event summaries, and evolving user portraits; retrieval uses dense dual-tower indexing, and updating increases memory strength when a memory is recalled and resets elapsed time.
  • SiliconFriend was tuned on 38k psychological dialogues and integrated with MemoryBank across ChatGPT, ChatGLM, and BELLE.
  • In the quantitative test with 10 days of conversations, 15 virtual users, and 194 probing questions (97 English, 97 Chinese), SiliconFriend ChatGPT was the best overall variant: English retrieval 0.763, correctness 0.716, coherence 0.912, ranking 0.818; Chinese retrieval 0.711, correctness 0.655, coherence 0.675, ranking 0.758.
  • Open-source variants had high retrieval accuracy—English ChatGLM 0.809 and BELLE 0.814; Chinese ChatGLM 0.84 and BELLE 0.856—but lower scores on other metrics; ChatGLM and ChatGPT did better in English, while BELLE did better in Chinese.

Methods

  • Design: MemoryBank consists of memory storage, dual-tower dense retrieval with FAISS indexing, and an Ebbinghaus-inspired memory updater; SiliconFriend uses LoRA tuning (rank 16, 3 epochs, A100) on 38k psychological dialogues for open-source models, then integrates memory.
  • Data and evaluation: qualitative analysis used real-user dialogs, while quantitative analysis used a simulated memory storage of 10 days, 15 virtual users, and 194 probing questions; human annotators scored retrieval accuracy, response correctness, contextual coherence, and model ranking.
  • Models and retrieval: ChatGPT, ChatGLM (6.2B), and BELLE (7B LLaMA) were used; embeddings were MiniLM for English and Text2vec for Chinese via LangChain.

Limitations

  • The paper states that its memory updating model is exploratory and highly simplified, that real memory is more complex and influenced by many factors, and that forgetting curves differ across people and information types; it also notes that Ebbinghaus theory includes additional phenomena such as overlearning and material meaningfulness, but this work simulates only three listed rules.
  • Evident from the text: the quantitative evaluation relies on ChatGPT-simulated users and manually written probing questions rather than a long-term real deployment, and no statistical tests or comparisons against alternative memory mechanisms are reported.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2305.10250

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

29 Own interpretation · 14 Own result · 8 No basis given · 5 Sources not found · 2 Couldn’t confirm · 1 Own method · accuracy not yet measured

Show all 33 claims

  • It may state two separate claims as one. 17
  • Probably not a substantial claim. 14
26 of 26
  • The paper relies on this without support.

    The Ebbinghaus Forgetting Curve theory is applicable to artificial memory updating in LLMs.

    “inspired by the Ebbinghaus Forgetting Curve theory”
    “Our memory forgetting mechanism is inspired from Ebbinghaus Forgetting Curve theory”
  • The paper relies on this without support.

    ChatGPT can validly simulate multiple users with diverse characteristics for evaluating MemoryBank.

    “for which ChatGPT plays the role of users and generates dialog contexts according to their personalities.”
  • The paper relies on this without support.

    The 38k psychological conversations collected from online sources are suitable for tuning an LLM to provide empathetic support.

    “The initial stage of Silicon-Friend's development involves tuning the LLMs using a dataset of 38k psychological dialogues.This data, parsed from online sources, comprises a range of conversations that cover an array of emotional states and responses.”
  • The paper relies on this without support.

    LLMs lack a robust long-term memory function, which hinders their ability to maintain context over long periods and retrieve pertinent information from past interactions.

    “A noticeable gap lies in their deficiency in a robust long-term memory function.”
    “This limitation hinders their ability to maintain context over a long period and retrieve pertinent information from past interactions.”
  • The paper relies on this without support.

    There is a need for a long-term memory mechanism to empower LLMs in scenarios requiring personalized and persistent interactions.

    “In summary, while significant progress has been made in the field of LLMs, there is still a need for long-term memory mechanism to empower LLMs in the scenarios requiring personalized and persistent interactions.”
  • The paper relies on this without support.

    The ability to exhibit empathy in a conversation is a key attribute of an effective AI companion.

    “The ability to exhibit empathy in a conversation is a key attribute of an effective AI companion.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 19 references

Cited by

Sorted by citations

Items 301–347 of 347

Metadata

Authors
Zhong, W., Guo, L., Gao, Q., Ye, H., & Wang, Y.
Affiliations
  • Sun Yat-sen University (CN)
  • Harbin Institute of Technology (CN)
  • KTH Royal Institute of Technology (SE)
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
38
Issue
17
Pages
19724-19731
ISSN
2159-5399 (ISSN-L)
OpenAlex
W4393147158
Cited by
253
References
19
Citations by year
2026: 133 · 2025: 83 · 2024: 36 · 2023: 1
FWCI
74.02
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
long-term memory, large language models, Ebbinghaus forgetting curve, AI companions, chatbots, empathy, psychological counseling, memory retrieval

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review