The DOI matches its Crossref record; 67 of the 69 references it cites were found in a registry or an index; 10 of the 12 sources its claims cite were checked for support.
Enhancing memory retrieval in generative agents through LLM-trained cross attention networks
Open accessAbstract
Introduction The surge in the capabilities of large language models (LLMs) has propelled the development of Artificial General Intelligence (AGI), highlighting generative agents as pivotal components for emulating complex AI behaviors. Given the high costs associated with individually training LLMs for each AI agent, there is a critical need for advanced memory retrieval mechanisms to maintain the unique characteristics and memories of individual AI agents. Methods In this research, we developed a text-based simulation of a generative agent world, constructing a community with multiple agents…
Overview
CoChat Summary
## TL;DR
The paper proposes ACAN, a cross-attention-based memory retrieval network for generative agents, trained with LLM feedback against a weighted memory retrieval baseline. In simulations with eight agents, ACAN improved memory quality and event attendance compared with the baseline.
## Key findings
- In a 16-hour/day simulation, the authors generated 1,280 unique training entries from 8 agents over 3 consecutive days; test simulations produced 435 data entries from 8 agents over 1 day.
- In the memory-quality evaluation, ACAN scored 5.94 ± 1.66 versus 5.05 ± 1.88 for the WMR baseline; the difference was significant (T = 7.44, P = 2.42 × 10−13).
- In the invitation/attendance experiment over 10 days with 100 invitation and attendance records, ACAN agents attended 32.6% of invitations on average versus 24.6% for WMR; the paired t-test gave T = 11.31, P = 0.00035.
- The model’s training loss reportedly fell from 1.5 to 0.12.
## Methods
- The authors built a text-based generative agent simulation world with 8 predefined agents (Farmer, Grocer, Doctor, Mayor, Chef, Hunter, Blacksmith, Carpenter) and multiple locations; interactions were simulated using ChatGPT (GPT-3.5-turbo).
- For each decision step, they stored the agent’s current state, memory bank, and retrieved memories, embedded with text-embedding-ada-002; the training set included current state q, memory bank M_q, and WMR-retrieved memories m_r′ ranked by Recency, Importance, and Relevance.
- They trained an Auxiliary Cross Attention Network (ACAN) with Adam (lr = 0.001, batch size = 16), using LLM-based scoring of ACAN-retrieved memories versus baseline-retrieved memories to define the loss; retrieval output was the top five memories ranked by attention weights.
## Limitations
- The paper states that reliance on LLMs for training and evaluation increases computational demands and cost, and that LLM feedback can slow training and limit scalability.
- The paper states that the LLM-based evaluation may not generalize across different configurations or domains, and that using LLMs instead of human assessment may affect rigor and objectivity.
- Evident from the text: the empirical validation is based on a small simulated setup with 8 agents in a text-only environment, so broader real-world generalization is not established.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
7 Valid · 2 Not valid · 2 Not checked · 39 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recent studies have demonstrated that large language models (LLMs) can serve as reliable evaluators for natural language generation (NLG) tasks, exhibiting strong correlation with human judgments.”
§ Enhancing memory retrieval in generative agents through LLM-trained cross attention networks > 3 Methods > 3.2 Auxiliary cross attention network for memory retrieval
What the sources say
- Supportedcites Wang et al. (2023) source
The Introduction reports that ChatGPT had high correlation with human judgment in most cases across the NLG datasets tested, supporting its potential as an evaluator. The Limitations section qualifies this result: performance depends on prompts and datasets, and the experiments covered English-language tasks only. (LLM, conf=0.89)
- Partly supportedcites Chiang and Lee (2023) sourceExperimental — accuracy not yet measured
The source does support LLMs evaluating NLG output consistently with human experts: the Abstract (p. 1) states 'the result of LLM evaluation is consistent with the results obtained by expert human evaluation', and the Contributions (p. 1) and Discussion (p. 8) claim LLM evaluation 'produces results similar to expert human evaluation' and 'has the potential to be used to evaluate NLP systems'. However, the specific assertion of 'strong correlation with human judgments' overstates the reported figures: §3.3.1 (pp. 5-6, Table 2) gives Kendall's tau between English teachers and text-davinci-003 of 0.12-0.43, which the paper itself describes as 'weak to strong positive correlations' under its own benchmark where only |tau| >= 0.3 counts as strong — i.e. only relevance, not grammaticality, cohesiveness or likability. The paper also hedges reliability, noting LLMs 'are not always suitable to be used for LLM evaluation' (§5, p. 8) and recommending LLM evaluation be used alongside, not instead of, human evaluation (p. 10). (LLM, conf=0.78)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“To achieve this goal, the ideal approach would be to train a dedicated LLM for each agent. However, considering the complexity of LLM training (Yang et al., 2024) and the practical demands of a large variety and number of agents, this approach is impractical.”
§ Enhancing memory retrieval in generative agents through LLM-trained cross attention networks > 1 Introduction
What the sources say
- Supportedcites Yang et al., 2024 source
The citation is attached to the complexity of LLM training, not to the citing authors’ conclusion about training one model per agent. The paper’s Cost section describes substantial training costs, energy consumption, data volumes, computing requirements, and hardware needs, supporting that attributed point. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Existing memory retrieval methods for agents primarily focus on relevance and temporal validity.”
§ Enhancing memory retrieval in generative agents through LLM-trained cross attention networks > 3 Methods > 3.2 Auxiliary cross attention network for memory retrieval
What the sources say
- Partly supportedcites Hou et al. (2024) sourceExperimental — accuracy not yet measured
Section 2.2 describes MemoryBank retrieving memories by relevance and accounting for elapsed time in forgetting. Section 2.4 describes Generative Agents using recency and relevance, but also importance. These examples support the role of relevance and time-related factors, but the paper does not establish that existing methods primarily focus on those two factors. (LLM, conf=0.83)
- Partly supportedcites Alonso et al. (2024) sourceExperimental — accuracy not yet measured
The Introduction (p. 2) says existing conversational-agent retrieval models primarily use semantic vector-database search, supporting the relevance part of the claim. But the Related Works section (p. 4) says these systems do not directly test retrieval based on temporal metadata, so the paper does not support saying they primarily focus on temporal validity. (LLM, conf=0.87)
- Partly supportedcites Park et al. (2023) sourceExperimental — accuracy not yet measured
The Introduction and §4.1 (page numbers unavailable) show that this paper’s retrieval model uses relevance and recency, which supports part of the claim. But it also uses importance, and the cited passages do not establish that existing agent-retrieval methods primarily focus on the first two factors. (LLM, conf=0.79)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“recent work such as Edge et al. (2024) demonstrates that LLMs can reliably evaluate relevance and faithfulness in RAG systems, supporting their use as cost-effective alternatives to human assessments.”
§ Enhancing memory retrieval in generative agents through LLM-trained cross attention networks > 5 Discussion
What the sources say
- Partly supportedcites Edge et al. (2024) sourceExperimental — accuracy not yet measured
Section 3.3 describes using an LLM to compare RAG answers, but its criteria are comprehensiveness, diversity, and empowerment—not relevance or faithfulness. The RAG evaluation criteria discussion explicitly calls context relevance, faithfulness, and answer relevance unsuitable for this paper’s global-sensemaking task. Section 2.4 cites prior work on LLM evaluations competitive with human evaluations; this paper does not demonstrate reliable relevance and faithfulness judgments or establish a cost-effective alternative to human assessment. The indexed passages provide no page numbers. (LLM, conf=0.88)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our empirical evaluations demonstrate that this approach substantially enhances the quality of memory retrieval, thereby increasing the adaptability and behavioral consistency of agents in fluctuating environments.”
- Also stated in: § 1 Introduction · boosted
“Our experiments demonstrate that ACAN substantially outperforms traditional methods in memory retrieval, resulting in enhanced adaptability of agents and more effective interactions with their environment and other agents.”
- Also stated in: § 1 Introduction · plain
“By calculating attention weights between the agent's current state and all memories in the memory bank, ACAN ranks and retrieves the most relevant memories, leading to Enhanced Memory Retrieval compared to base methods.”
§ Enhancing memory retrieval in generative agents through LLM-trained cross attention networks > Abstract > Results
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Introduction · boosted
13 more claims
Create a free account to see all 50 claims and every source verdict.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 18
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Online memory handling typically consists of structured subtasks (such as intent routing (Zhang et al., 2024), query construction (Hong and He, 2025) and semantic filtering (Hatalis et al., 2023)).”
From Lightweight LLM Agent Memory with Small Language Models (2026) · cites this paper as Hong and He, 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Online memory handling typically consists of structured subtasks (such as intent routing (Zhang et al., 2024), query construction (Hong and He, 2025) and semantic filtering (Hatalis et al., 2023)).”
From Lightweight LLM Agent Memory with Small Language Models (2026) · cites this paper as Hong and He, 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“reflection focused on trajectories may lead to a linear expansion of the memory bank, which imposes a burden for inference and may potentially result in a characteristic of following trajectories (Hong and He, 2025; Zhu et al., 2025; Fu et al., 2025).”
From From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026) · cites this paper as Hong and He, 2025
Experimental — accuracy not yet measured
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Stanford Encyclopedia of Philosophy 2009: Building an Endowment with Community Support
Loy, M. (2015) · doi:10.18665/sr.22353 · Cited by 2,465
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941 · cited 1×
“Consequently, an increasing number of researchers are exploring the use of LLMs to develop Generative Agents with robust content generation capabilities ( Park et al., 2023; Liu et al., 2023; Wang et al., 2024).”
A Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925
Expel: LLM agents are experiential learners
Zhao, A., Huang, D., Xu, Q., Lin, M., Liu, Y.-J., & Huang, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29936 · Cited by 1,451
Squire, L. R. (1986) · Science · doi:10.1126/science.3086978 · Cited by 1,278 · cited 1×
“Just as the human brain utilizes prior experiences for adaptive behavior (Squire, 1986; Schwabe et al., 2014), agents require specialized memory mechanisms to effectively manage sequential tasks.”
Research works printed but not linked: 2
- Musacchio, 2024, Adapting large language models to narrative content, Complexity, 6, 8
- Zalta, 1995, Stanford Encyclopedia of Philosophy
Cited by
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.2069 · Cited by 3
Zhang, M., Yang, Y., Yu, C., & Diao, Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1615342 · Cited by 4
Lightweight LLM Agent Memory with Small Language Models
Zhang, J., Zhang, C., Chen, S., Huang, Z., Zheng, P., Wang, Z., Guo, P., Mo, F., Bae, S.-H., Zou, J., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.588 · Cited by 35
Memory in LLM-Based Multi-agent Systems: Mechanisms, Challenges, and Collective Intelligence
Wu, S., & Shu, K. (2026) · Lecture Notes in Computer Science · doi:10.1007/978-981-92-1468-6_10 · Cited by 2
Dishop, C. R. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108994 · Cited by 2
Metadata
- Authors
- Hong, C., & He, Q.
- Affiliations
- Southwestern University of Finance and Economics (CN)
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2025-05-07
- Volume
- 16
- Pages
- 1591618-1591618
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC12092450
- OpenAlex
- W4410182127
- Cited by
- 7
- References
- 61
- Citations by year
- 2026: 4 · 2025: 3
- FWCI
- 2.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- generative AI agents, memory retrieval, cross-attention network, large language models, artificial general intelligence, loss function design, agent-based modeling, behavioral consistency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhancing memory retrieval in generative agents through LLM-trained cross attention networks. https://app.cochat.ai/papers/10.3389/fpsyg.2025.1591618
- The paper
- Hong, C., & He, Q. (2025). Enhancing memory retrieval in generative agents through LLM-trained cross attention networks. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2025.1591618
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.