MemoryBank: Enhancing Large Language Models with Long-Term Memory

Memory systems largely treat memory as a passive information store.

“However, these approaches largely treat memory as a passive information store.”

Such methods ignore the dynamic changes in human psychological states.

“However, such methods ignore the dynamic changes in human psychological states.”

MemoryBank, while solving the long-term memory problem well, still has shortcomings in structured memory storage and efficient systematic memory retrieval, and further optimization and improvement are needed.

“While this method solves the long-term memory problem of LLM Agents well, there are still shortcomings in structured memory storage and efficient systematic memory retrieval, and further optimization and improvement are needed.”

Text-based memory offers good interpretability and implementation convenience for long-term memory in LLMs.

“Memory in textual form (Li et al., 2023; Huang et al., 2023; Zhong et al., 2024) offers good interpretability and implementation convenience for long-term memory in LLMs.”

Retrieval-based external memory systems incur low online overhead but suffer from unstable accuracy due to limited query construction and candidate filtering.

“These methods are efficient, but limited query construction and candidate filtering often introduce retrieval noise, resulting in unstable answer accuracy.”

Existing research has effectively simulated the forgetting process of human memory with the Ebbinghaus Forgetting Curve, taking into account enhanced strength after recall.

“Existing research has effectively simulated the forgetting process of human memory with the help of the Ebbinghaus Forgetting Curve, taking into account the characteristics of the enhanced strength of memory after it is called upon (Zhong et al., 2024).”

Among all baseline methods, only MemoryBank and H-MEM adopt a memory mechanism that encodes memory into vector representations and retrieves it via similarity-based matching.

“Among all the baseline methods, only MemoryBank and H-MEM adopt a memory mechanism that encodes memory into vector representations and retrieves it via similarity-based matching.”

Such methods ignore the dynamic changes in human psychological states.

“However, such methods ignore the dynamic changes in human psychological states.”

The first class of benchmarks focuses on evaluating memorization through recall or retrieval over static long-context inputs in question answering or summarization settings.

“The first class of benchmarks focuses on evaluating memorization through recall or retrieval over static long-context inputs in question answering or summarization settings”

Timestamp-aware retrieval down-weights older memories as new ones accumulate.

“Timestampaware retrieval down-weights older memories as new ones accumulate [31, 52].”

Existing memory systems use vector stores, knowledge graphs, or persistent files to retain information across sessions.

“Existing memory systems use vector stores, knowledge graphs, or persistent files to retain information across sessions”

MemGPT and MemoryBank use buffer-based systems to store conversational or episodic traces and retrieve them with embedding search and simple heuristics.

“Along the first direction, some methods such as MemGPT [11] and MemoryBank [32], use buffer-based systems to store conversational or episodic traces and retrieve them with embedding search and simple heuristics.”

Many systems retain free-form text snippets such as notes, summaries, or dialogue chunks.

“Many systems retain free-form text snippets such as notes, summaries, or dialogue chunks; these are easy to write but suffer from retrieval drift and weak compositionality as repositories scale [11, 32].”

Free-form text snippets are easy to write but suffer from retrieval drift and weak compositionality as repositories scale.

“Many systems retain free-form text snippets such as notes, summaries, or dialogue chunks; these are easy to write but suffer from retrieval drift and weak compositionality as repositories scale [11, 32].”

Many existing LLM agent memory systems decompose histories into isolated turns or fixed-size chunks and compensate through enrichment, consolidation, or retrieval mechanisms tied to semantic proximity or fragment-level records.

“Yet many LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then compensate through enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records.”

Existing long-term memory methods for LLM agents operate over turns, chunks, summaries, or mutable records and rely on update or retrieval to compensate for fragmentation.

“These methods improve capacity and flexibility, but still operate over turns, chunks, summaries, or mutable records and rely on update or retrieval to compensate for fragmentation.”

Most methods employ fixed Top-k retrieval strategies (e.g., Memorybank Top-5, Mem0 Top-30), which may introduce both redundancy and noise.

“Moreover, most methods employ fixed Topk retrieval strategies ( e.g. Memorybank [56] Top5, Mem0 [7] Top-30), which may introduce both redundancy and noise.”

Most existing work on memory mechanisms focuses on analyzing and explaining memory from the temporal (time) dimension, specifically short-term and long-term memory.

“Although previous studies and reviews have provided detailed explanations of memory mechanisms, most of the existing work focuses on analyzing and explaining memory from the temporal (time) dimension, specifically in terms of short-term and long-term memory [8, 7, 17].”

Long-horizon deployments lack a unified maintenance-and-recovery interface, with updates often performed via in-place replacement or ad-hoc archiving without explicit lineage and budgeted recovery to immutable evidence.

“However, long-horizon deployments still lack a unified maintenance-and-recovery interface: updates are often performed via in-place replacement or ad-hoc archiving, without explicit lineage and budgeted recovery to immutable evidence, so redundancy, entanglement, and superseded states increasingly crowd a fixed window (Zhong et al., 2024; Chhikara et al., 2025; Rasmussen et al., 2025).”

Existing datasets like personalized chats sourced through crowdsourcing or psychological dialogues lack the property of containing valuable personal memories.

“especially considering that existing datasets like personalized chats sourced through crowdsourcing (Zhang et al., 2018) or psychological dialogues (Zhong et al., 2024) lack this property.”

Existing approaches employ unstructured formats such as summarization or compression, but struggle with temporal modeling and content overlap, leading to information loss and fragmented representations.

“Existing approaches employ unstructured formats such as summarization (Zhong et al., 2024; Wang et al., 2025) or compression (Pan et al., 2025; Chen et al., 2025), but struggle with temporal modeling and content overlap, leading to information loss and fragmented representations.”

User-centric benchmarks, such as MSC and MemoryBank, primarily evaluate conversational consistency, measuring an agent's ability to retain persona information, recall user preferences, and sustain coherent interactions across multi-session or multi-turn dialogue.

“Usercentric benchmarks, such as MSC (Xu et al., 2022a) and MemoryBank (Zhong et al., 2024), primarily evaluate conversational consistency, measuring an agent's ability to retain persona information, recall user preferences, and sustain coherent interactions across multi-session or multi-turn dialogue.”

Most existing agent memory designs remain text-centric, treating memory as an ever-growing collection of past interactions, summaries, or episodic logs that are retrieved and injected into the prompt.

“Most existing agent memory designs remain text-centric, treating memory as an ever-growing collection of past interactions, summaries, or episodic logs that are retrieved and injected into the prompt (Xu et al., 2025e; Zhong et al., 2024).”

Retrieval-based external memory systems incur low online overhead but suffer from unstable accuracy due to limited query construction and candidate filtering.

“However, retrieval-based external memory systems incur low online overhead but suffer from unstable accuracy due to limited query construction and candidate filtering.”

Several commercial and open-source assistant systems with memory have been introduced.

“Recently, several commercial (OpenAI, 2024; Coze, 2024) and open-source assistant systems with memory (Zhong et al., 2024; Zhang et al., 2024) have been introduced.”

Compressing sessions into summaries or user-specific facts can lead to information loss, harming the performance of the system to answer detailed questions.

“Conversely, compressing sessions into summaries or user-specific facts, as seen in prior work such as Zhong et al. (2024) and Du et al. (2024), can lead to information loss, harming the performance of the system to answer detailed questions.”

Existing memory systems encode conversation history as embedding vectors and retrieve information through semantic similarity, and this paradigm fails to capture the associative structure of human memory.

“Existing memory systems encode conversation history as embedding vectors and retrieve information through semantic similarity. This paradigm fails to capture the associative structure of human memory, wherein related experiences progressively strengthen interconnections through repeated co-activation.”

Recent approaches to long-term dialogue retrieve historical context and reason over retrieved segments in temporal order and/or use events to scaffold dialogues to enable consistency.

“Recent approaches involve retrieving historical context from a range of previous dialogues and reasoning over retrieved segments in a temporal order (Lee et al., 2023b; Lu et al., 2023; Zhong et al., 2023; Liang et al., 2023) and/or using events to scaffold the dialogues (Jang et al., 2023; Zhang et al., 2023) to enable consistency in long-term conversations.”

Recent studies turn to equip LLM agents with memory to support long-turn conversations because LLMs struggle in retaining information from long input text.

“To address the limit of LLMs struggling in retaining information from long input text, recent studies turn to equip LLM agents with memory to support long-turn conversations (Lu et al., 2023;Packer et al., 2023;Zhong et al., 2024).”

Existing memory systems rely on fixed retrievers, which struggle to adapt to the diverse retrieval demands of varying dialogue domains and individual user interaction patterns.

“Secondly, these systems rely on fixed retrievers (Li et al., 2025; Zhong et al., 2024), which struggle to adapt to the diverse retrieval demands of varying dialogue domains and individual user interaction patterns.”

MemoryBank retrieves historical context by maintaining a structured memory where both conversational summaries and round-level utterances are stored as key-value pairs.

“MemoryBank (Zhong et al., 2024) retrieves historical context by maintaining a structured memory where both conversational summaries and round-level utterances are stored as keyvalue pairs.”

Existing memory systems rely on fixed retrievers, which struggle to adapt to the diverse retrieval demands of varying dialogue domains and individual user interaction patterns.

“Secondly, these systems rely on fixed retrievers (Li et al., 2025; Zhong et al., 2024), which struggle to adapt to the diverse retrieval demands of varying dialogue domains and individual user interaction patterns.”

MemoryBank retrieves historical context by maintaining a structured memory where both conversational summaries and round-level utterances are stored as key-value pairs.

“MemoryBank (Zhong et al., 2024) retrieves historical context by maintaining a structured memory where both conversational summaries and round-level utterances are stored as keyvalue pairs.”

For both MemoryBank and LD-Agent, retrieval operates in a non-hierarchical manner, meaning all stored data is accessed through a uniform search mechanism without additional interaction-based refinement.

“For both methods, retrieval operates in a non-hierarchical manner, meaning that all stored data is accessed through a uniform search mechanism without additional interaction-based refinement.”

Memory storage in existing LLM-centric agents is often inefficient, hindering quick access and selective retrieval, which results in slower and less accurate decisions.

“Memory storage is often inefficient, hindering quick access and selective retrieval, which results in slower and less accurate decisions (Zhong et al., 2024).”

Prior research demonstrates that granting agents access to a persistent memory of past interactions can significantly enhance task performance; however, most existing designs assume a single-user setting, overlooking benefits of cross-user knowledge transfer.

“Prior research [25, 10, 20] demonstrates that granting agents access to a persistent memory of past interactions can significantly enhance task performance; however, most existing designs assume a single-user setting, thus overlooking the benefits of cross-user knowledge transfer.”

The scoring weights were fixed a priori and were not tuned; they encode a prior, drawn from the memorystream and forgetting-curve literature, that access-driven signals (recency, frequency) should dominate structural and age-based ones.

“The weights were fixed a priori and were not tuned: they encode a prior, drawn from the memorystream and forgetting-curve literature [Park et al., 2023, Zhong et al., 2024], that access-driven signals (recency, frequency) should dominate structural and age-based ones.”

Previous studies have proposed many promising memory mechanisms, but they are scattered across different papers.

“While previous studies have proposed many promising memory mechanisms, they are scattered in different papers, and there lacks a systematical review to summarize and compare these works from a holistic perspective, failing to abstract common and effective designing patterns for inspiring future studies.”

Zhong et al. [6] store memory information in natural languages, which is explainable and friendly to users.

“Zhong et al. [6] store memory information in the form of natural languages, which is explainable and friendly to the users.”

To enable meaningful long-term interactions, it is crucial to remember past information beyond the limitations of the context window and to correctly reference it in ongoing conversations.

“However, to enable such skills and to ensure meaningful long-term interactions, it is crucial to remember past information beyond the limitations of the context window and to correctly reference it in ongoing conversations [4, 64].”

Existing memory-augmented approaches lack effective retrieval and prioritization mechanisms, often resulting in inclusion of irrelevant data and decreasing response correctness.

“Existing memory-augmented approaches lack effective retrieval and prioritization mechanisms, often resulting in the inclusion of irrelevant data, decreasing the correctness of responses, which negatively impacts user experience and interaction continuity [35, 64].”

Selective retrieval is important for interactive systems, where irrelevant information can negatively influence interaction quality.

“This selective retrieval is important for interactive systems, where irrelevant information can negatively influence interaction quality [58, 64].”

Most existing agent memory systems do not provide a topic-level access path.

“Most existing agent memory systems (Zhong et al., 2024; Xu et al., 2025; Chhikara et al., 2025) do not provide this topic-level access path.”

MemoryBank enhances long-term interaction capabilities by encoding memories into vector representations and retrieving them through similarity-based search.

“MemoryBank enhances long-term interaction capabilities by encoding memories into vector representations and retrieving them through similarity-based search (Zhong et al., 2024).”

Existing memory systems for LLM agents provide basic memory storage functionality.

“Existing memory systems [25, 39, 28, 21] for LLM agents provide basic memory storage functionality.”

Using the value itself as the key may be suboptimal.

“Therefore, using the value itself as the key, a common practice in prior works (Zhong et al., 2024; Maharana et al., 2024), may be suboptimal.”

MemoryBank and PerLTQA insufficiently evaluate the ability to synthesize information across numerous sessions or to reason with temporal metadata or time references.

“For instance, MemoryBank (Zhong et al., 2024) and PerLTQA (Du et al., 2024) insufficiently evaluate the ability to synthesize information across numerous sessions or to reason with temporal metadata or time references.”

In applications such as dialogue systems, personalized recommendations, and personal assistants, LLMs need to retain and utilize historical information over the long term to provide more accurate and consistent responses.

“In many practical applications, such as personal assistants (Lu et al., 2023), personalized recommendations (Wang et al., 2023c), and dialogue systems (Zhong et al., 2024), models need to retain and utilize past information over the long term to provide more accurate and consistent responses.”

We follow the original papers in terms of experimental data and configuration settings for baselines.

“Regarding the baselines, we follow the original papers in terms of experimental data and configuration settings (Packer et al., 2023; Zhong et al., 2024; Xu et al., 2025).”

The fragmentation-compensation paradigm breaks dialogue continuity into separately stored fragments and later attempts to compensate by adding back related context through enrichment, consolidation, or retrieval.

“This example reflects a broader fragmentation-compensation paradigm : dialogue continuity is first broken into separately stored fragments, and later mechanisms such as enrichment, consolidation, or retrieval attempt to compensate by adding back related context.”

MemoryBank provides temporal-aware memory architecture.

“MemoryBank [31] provides temporal-aware memory architecture.”

MemoryBank and ReadAgent rely primarily on embedding-based retrieval.

“This contrasts with systems like MemoryBank [Zhong et al., 2023] and ReadAgent [Lee et al., 2024] that rely primarily on embedding-based retrieval.”

MemoryBank applies Ebbinghaus-curve decay to chatbot memory and was published at AAAI 2024.

“Ebbinghaus-curve decay applied to chatbot memory; published at AAAI 2024.”

LLMs face limitations on tasks relying heavily on personal knowledge accumulated through long-term user-AI interactions.

“Nevertheless, LLMs face limitations on tasks relying heavily on personal knowledge accumulated through long-term user-AI interactions, such as psychological counseling or secretarial duties (Zhong et al., 2024).”

The necessity of temporal validity propels the evolution of memory mechanisms from static storage toward active management, integrating temporal awareness, decay policies, and flexible retrieval.

“This necessity propels the evolution of memory mechanisms from the paradigm of static storage toward that of active management, integrating awareness of temporal factors, policies for decay, and methods for retrieval with enhanced flexibility (Zhong et al., 2023; Siyue et al., 2024; Salama et al., 2025; Du et al., 2025a; Houichime et al., 2025).”

Zhong et al. (2023) models temporal decay via the Ebbinghaus Forgetting Curve.

“Zhong et al. (2023) models temporal decay via the Ebbinghaus Forgetting Curve”

Existing memory systems typically emphasize storing, updating, and retrieving relevant records, which is crucial for personalization, persistent user state, and cross-session recall.

“Existing memory systems typically emphasize storing, updating, and retrieving relevant records (Packer et al., 2023;Zhong et al., 2024;Park et al., 2023;Mem0 Team, 2026), which is crucial for personalization, persistent user state, and cross-session recall.”

MBMemory (MemoryBank) is a multi-layered memory model with dynamic summarization and a forgetting mechanism.

“• MBMemory (MemoryBank [14]): A multi-layered memory model with dynamic summarization and forgetting mechanism.”

MemoryBank's retrieval process involves directly matching user queries to the most relevant stored information, ensuring efficient context retrieval for response generation.

“The retrieval process involves directly matching user queries to the most relevant stored information, ensuring efficient context retrieval for response generation.”

Existing systems often optimize only one side of memory: STM-oriented methods organize or compress the current reasoning state, whereas LTM-oriented methods build external stores for persistent recall.

“Existing systems often optimize only one side of this process. STM-oriented methods organize or compress the current reasoning state (Qian et al., 2026; Li et al., 2025), whereas LTM-oriented methods build external stores for persistent recall (Zhong et al., 2024; Xu et al., 2025).”

Standard retrieval methods like RAG and MemoryBank rely fundamentally on vector similarity, representing memories as isolated points in embedding space, and consequently struggle with queries requiring causal bridging between semantically dissimilar or distant events.

“Standard retrieval methods like RAG and MemoryBank (Zhong et al., 2024) rely fundamentally on vector similarity (Karpukhin et al., 2020; Khattab and Zaharia, 2020), representing memories as isolated points in embedding space (Hu et al., 2025). Consequently, they struggle with queries requiring causal bridging between semantically dissimilar or distant events (Yang et al., 2018; Qi et al., 2019; Tr”

Effective memory management is crucial for agent performance.

“Many works stress that effective memory management is crucial for agent performance(Zhong et al., 2024; Zhang et al., 2025e; Yan et al., 2024).”

MemoryBank employs a dual-tower dense retrieval model to find related information from past conversations; each memory entry is encoded into an embedding and subsequently indexed by FAISS to improve the efficiency of retrieval; when reading memories, the current context will be encoded as representations to obtain the most relevant memory.

“MemoryBank [6] employs a dual-tower dense retrieval model to find related information from past conversations. Each memory entry is encoded into an embedding and subsequently indexed by FAISS [124] to improve the efficiency of retrieval. When reading memories, the current context will be encoded as representations to obtain the most relevant memory.”

As the number of memory entries increases, the computational complexity of vector retrieval also rises sharply, posing challenges to system performance.

“Nevertheless, as the number of memory entries increases, the computational complexity of vector retrieval also rises sharply, posing challenges to system performance.”

Existing memory systems require agent developers to predefine memory storage structures, specify storage points within the workflow, and establish retrieval timing.

“These systems require agent developers to predefine memory storage structures, specify storage points within the workflow, and establish retrieval timing.”

Previous studies often utilize external models to expand the range of possible actions; external models typically handle more complex tasks than APIs, and each external model may correspond to multiple APIs.

“Previous studies often utilize external models to expand the range of possible actions.In comparison to APIs, external models typically handle more complex tasks.Each external model may correspond to multiple APIs.”

As the number of memory entries increases, the computational complexity of vector retrieval rises sharply, posing challenges to system performance.

“Nevertheless, as the number of memory entries increases, the computational complexity of vector retrieval also rises sharply, posing challenges to system performance.”

Existing evaluations of agents with memory typically assess memorization and action in isolation.

“Existing evaluations of agents with memory typically assess memorization and action in isolation.”

Existing memory systems assume stored experiences are trustworthy and rarely track provenance.

“Existing memory systems assume stored experiences are trustworthy and rarely track provenance.”