Agentic Memory Management Is the Next Frontier of Information Retrieval

Probably not a substantial claim: may not pass S3 (load-bearing).

Extracting signal from noisy implicit evidence is the problem that click models and unbiased learning to rank were built for.

“Extracting signal from noisy implicit evidence is the problem that click models and unbiased learning to rank were built for [17, 31].”

• cites [17] [17] Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke. 2015. Click Models for Web Search . Morgan & Claypool. - sourceNot checked — no full text of the source
• cites [31] [31] Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining . 781-789. - sourceSupported

May combine two claims.

Reflexion stores verbal reflections on failed attempts and conditions later attempts on them.

“Reflexion stores verbal reflections on failed attempts and conditions later attempts on them [56].”

• cites [56] [56] Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023. Reflexion: Language Agents with Verbal Reinforcement Learning. In Advances in Neural Information Processing Systems . - sourceSupported

May combine two claims.

In Generative Agents, each character starts from a set of seed memories, and the reflections synthesized from its memory stream inform how it plans and responds.

“in Generative Agents, each character starts from a set of seed memories, and the reflections synthesized from its memory stream inform how it plans and responds [44].”

• cites [44] [44] Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative Agents: Interactive Simulacra of Human Behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . - sourceSupported

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

In AI, memory is usually described in terms of persisting state, retaining conversational context, or learning continually without catastrophic forgetting.

“In AI, memory is usually described in terms of persisting state, retaining conversational context, or learning continually without catastrophic forgetting [32, 67].”

• cites [32] [32] James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, et al. 2017. Overcoming Catastrophic Forgetting in Neural Networks. Proceedings of the National Academy of Sciences 114, 13 (2017), 3521-3526. - sourcePartly supported

  The Introduction (p. 1) describes continual learning as learning consecutive tasks without forgetting previously trained tasks, supporting that part of the sentence. The cited passages do not address memory as persisting state or retaining conversational context, so the paper does not support the full statement attributed to the two citations. (LLM, conf=0.86)

  Experimental — accuracy not yet measured
• cites [67] [67] Liyuan Wang, Xingxing Zhang, Hang Su, and Jun Zhu. 2024. A Comprehensive Survey of Continual Learning: Theory, Method and Application. IEEE Transactions on Pattern Analysis and Machine Intelligence 46, 8 (2024), 5362-5383. - sourcePartly supported

  Section 7.1 describes continual learning as addressing catastrophic forgetting by maintaining the stability of old knowledge. Section 4.2 also discusses memory buffers used to recover past information. The paper does not establish that AI memory is usually described in the three ways listed, particularly persisting state or retaining conversational context. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

May combine two claims.

The shift toward generative information access is instructive: a vision articulated in IR was realized mainly through LLMs developed outside the IR community.

“The shift toward generative information access is instructive: a vision articulated in IR [39] was realized mainly through LLMs developed outside the IR community (Section 1).”

• cites [39] [39] Donald Metzler, Yi Tay, Dara Bahri, and Marc Najork. 2021. Rethinking Search: Making Domain Experts out of Dilettantes. SIGIR Forum 55, 1 (2021). - sourceSupported

Probably not a substantial claim: may not pass S2 (checkable).

Attributing a delayed, sparse task outcome to decisions along a trajectory of writing, retention, retrieval, and use is a counterfactual estimation problem.

“attributing a delayed, sparse task outcome to decisions along a trajectory of writing, retention, retrieval, and use is a counterfactual estimation problem, for which IR's work on counterfactual and online learning to rank [31] provides a relevant toolkit.”

• cites [31] [31] Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining . 781-789. - sourcePartly supported

  The Introduction and Section 4 describe a counterfactual learning-to-rank toolkit for estimating performance from biased, partially observed feedback. But the Introduction and Related Work distinguish the paper’s method from online learning algorithms; it does not offer an online learning-to-rank method. The writing-to-use trajectory is the citing authors’ application of the toolkit, not a setting studied by this source. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Current systems commonly store episodes and extracted facts; some also build skills or consolidate preferences.

“Current systems commonly store episodes and extracted facts; some also build skills or consolidate preferences.”

May combine two claims.

Our classification suggests that existing systems emphasize constants and utilization; support for reusable functions, scoped operators, principled forgetting, and learned optimization is less consistent.

“Our classification suggests that these systems emphasize constants and utilization; support for reusable functions, scoped operators, principled forgetting, and learned optimization is less consistent.”

Probably not a substantial claim: may not pass S4 (based).

The four dimensions of the problem differ substantially in the degree to which they depart from established IR.

“The four dimensions of the problem differ substantially in the degree to which they depart from established IR (Table 4).”

Classified as probably not a substantial claim.

Retrieval happens at three levels with three different matching criteria.

“retrieval happens at three levels with three different matching criteria”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

If people and agents are both viewed as managing information through external resources and internal memory, IR can act only on the external side for people but on both sides for agents.

“If people and agents are both viewed as managing information through external resources and internal memory, IR can act only on the external side for people but on both sides for agents.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The difference is emphasis: Zhai's taxonomy is organized by the purpose of retrieval; ours is organized by the algebraic structure of the content itself, which determines how an item must be matched, composed, and updated.

“The difference is emphasis: that taxonomy is organized by the purpose of retrieval; ours is organized by the algebraic structure of the content itself, which determines how an item must be matched, composed, and updated.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

AMM can bring completely new challenges and ideas that significantly broaden the scope of IR research.

“On the other hand, AMMcan bring completely new challenges and ideas that significantly boarden the scope of IR research.”

• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.

Probably not a substantial claim: may not pass S4 (based).

The IR community has a long history and rich experience in user analysis and evaluation methodology.

“In contrast, IR community has long history and rish experience on user analysis and evaluation methodology.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A common answer from psychology is declarative memory (subdivided into semantic and episodic) versus procedural memory.

“A common answer comes from psychology: declarative memory (subdivided into semantic and episodic) versus procedural memory [60, 62].”

• cites [60] [60] Larry R. Squire. 2004. Memory Systems of the Brain: A Brief History and Current Perspective. Neurobiology of Learning and Memory 82, 3 (2004), 171-177. - sourceNot checked — no full text of the source
• cites [62] [62] Endel Tulving. 1972. Episodic and Semantic Memory. In Organization of Memory , Endel Tulving and Wayne Donaldson (Eds.). Academic Press, 381-403. -Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The shift from serving users to serving AI agents in AMM could reshape the way we think about IR.

“The shifting from serving users to serving AI agents in AMM could reshape the way we think about IR.”

• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.

Probably not a substantial claim: may not pass S4 (based).

The second half of utilization (use) has usually occurred outside the retrieval system because a human reader performed it.

“The second half use - has usually occurred outside the retrieval system because a human reader performed it.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

A principled deletion policy requires estimating an item's future value, which current systems generally approximate with recency, frequency, importance, or model-based judgments.

“A principled deletion policy requires estimating an item's future value, which current systems generally approximate with recency, frequency, importance, or model-based judgments.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The consumer is now a model with its own regularities.

“However, the consumer is now a model with its own regularities.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Task completion is the final goal, but conventional IR systems observe only part of the task, so the field built its methodology around measurable proxies.

“First, task completion is the final goal, but conventional IR systems observe only part of the task, so the field built its methodology around measurable proxies; Section 5.3 argues that this constraint weakens when the user is an agent.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

AMM is the combination in which both changes apply: the consumer is an agent, and IR operates inside it.

“AMM is the combination in which both changes apply: the consumer is an agent, and IR operates inside it.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Zhai categorizes what an intelligent agent needs to retrieve from a complementary angle, distinguishing external information the agent has not seen, the provenance of information, training data for continual learning, rules for reasoning, and past scenarios for problem solving.

“Zhai [75] categorizes what an intelligent agent needs to retrieve from a complementary angle, distinguishing external information the agent has not seen, the provenance of information, training data for continual learning, rules for reasoning, and past scenarios for problem solving.”

• cites [75] [75] ChengXiang Zhai. 2025. Information Retrieval for Artificial General Intelligence: A New Perspective of Information Retrieval Research. In Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval . 3876-3886. doi:10.1145/3726302.3730349 - sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

In psychology, memory is the faculty that lets an organism retain and recall experiences, knowledge, and skills.

“In psychology, memory is the faculty that lets an organism retain and recall experiences, knowledge, and skills [2].”

• cites [2] [2] Richard C. Atkinson and Richard M. Shiffrin. 1968. Human Memory: A Proposed System and Its Control Processes. In The Psychology of Learning and Motivation , Kenneth W. Spence and Janet T. Spence (Eds.). Vol. 2. Academic Press, 89-195. - sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Feedback arrives as task outcomes, user corrections, tool errors, and abandoned interactions, and must be interpreted before it can be used.

“Feedback arrives as task outcomes, user corrections, tool errors, and abandoned interactions, and must be interpreted before it can be used.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The two views of IR (user and system) are not separate research areas; they often address the same problem from opposite directions.

“The two views are not separate research areas; they often address the same problem from opposite directions.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

This taxonomy is useful for describing human cognition, and it has shaped both systems and benchmarks.

“This taxonomy is useful for describing human cognition, and it has shaped both systems and benchmarks.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

When the consumer becomes an agent, IR knowledge about users must be re-examined rather than assumed to transfer.

“When the consumer becomes an agent, this knowledge must be re-examined rather than assumed to transfer.”

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Classified as probably not a substantial claim.

A result page shows about ten results in a vertical list ordered by estimated relevance, each with a title and a snippet that helps a person decide whether to click.

“A result page shows about ten results in a vertical list ordered by estimated relevance, each with a title and a snippet that helps a person decide whether to click [25].”

• cites [25] [25] Marti A. Hearst. 2009. Search User Interfaces . Cambridge University Press. - sourceNot checked — no full text of the source

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The shape of IR research remained relatively stable for nearly three decades.

“Ever since then, the shape of IR research remained relatively stable for nearly three decades.”

May combine two claims.

The design of search result pages assumes that people scan from the top and that attention declines with rank, and discounted cumulative gain encodes the same assumption in evaluation.

“The design assumes that people scan from the top and that attention declines with rank, and discounted cumulative gain encodes the same assumption in evaluation [27].”

• cites [27] [27] Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated Gain-Based Evaluation of IR Techniques. ACMTransactions on Information Systems 20, 4 (2002), 422-446. - sourceNot checked — no full text of the source

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S4 (based).

From the memex onward, both views assumed that the consumer of retrieved information is a person.

“Third, from the memex onward, both views assumed that the consumer of retrieved information is a person; Section 3 examines what changes when the consumer is an agent.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The way Broder developed the taxonomy of Web search could be used in the analysis of agent's information needs; the Cranfield paradigms widely used in TREC and NTCIR could serve as a starting point to inspire new ideas for AMM benchmark construction.

“For example, the way how Broder [8] developed the taxonomy of Web search could be used in the analysis of agent's information needs; the Crandfield paradigms widely used in TREC [65] and NTCIR [13] could serve as a starting point to inspire new ideas for AMM benchmark construction.”

• cites [8] [8] Andrei Broder. 2002. A taxonomy of web search. In ACM Sigir forum , Vol. 36. ACM New York, NY, USA, 3-10. - sourceNot checked — no full text of the source
• cites [65] [65] Ellen M Voorhees, Donna K Harman, et al. 2005. TREC: Experiment and evaluation in information retrieval . Vol. 63. MIT press Cambridge. -Not checked yet

  Not checked in the free run.

• cites [13] [13] Chung-Chi Chen, Qingyao Ai, and Shoko Wakamiya. 2025. Overview of ntcir-18. Transfer 2, 9 (2025), U4. -Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable).

Without rigid theoretical or systematic grounding, most AMM studies look more like ad-hoc engineering efforts rather than scientific works.

“Without rigid theoretical or systematic grounding, these make most AMM studies look more like ah-hoc engineering efforts rather than scientific works.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

These objects are often expressed in natural language, can be noisy or inconsistent, and must be matched by applicability or scope inferred from the current task.

“These objects are often expressed in natural language, can be noisy or inconsistent, and must be matched by applicability or scope inferred from the current task.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The consumer change applies even when IR stays external: a search tool that serves an agent must still account for how the agent processes results and in what form they should be delivered.

“The consumer change applies even when IR stays external: a search tool that serves an agent must still account for how the agent processes results and in what form they should be delivered.”

Probably not a substantial claim: may not pass S4 (based).

For people, IR has always been external.

“For people, IR has always been external.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

Memory supports a wide range of human activities and can likewise support many agent behaviors.

“Memory supports a wide range of human activities and can likewise support many agent behaviors.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Forgetting serves more than storage management. It can reduce interference between similar memories, bound retrieval cost as the store grows, and help a system honor deletion requests.

“Forgetting (delete, decay, merge, compress) serves more than storage management. It can reduce interference between similar memories, bound retrieval cost as the store grows, and help a system honor deletion requests.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

AMM brings new opportunities to move IR systems from tools that supply information to modules that directly support the development of continual learning agents and solve an important part of the puzzle to AGI.

“It brings new opportunities to move IR systems from tools that supply information to modules that directly support the development of continue learning agents and solve an important part of the puzzle to AGI.”

• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.

Classified as probably not a substantial claim.

The application determines what counts as a good memory: a benchmark that measures only fact recall in conversation will systematically favor systems designed for one of these families and neglect the rest.

“Second, the application determines what counts as a good memory: a benchmark that measures only fact recall in conversation will systematically favor systems designed for one of these families and neglect the rest.”

Classified as probably not a substantial claim.

Errors compose (supplying a correct fact to an incorrectly selected skill still leads to failure).

“errors compose (supplying a correct fact to an incorrectly selected skill still leads to failure)”

Probably not a substantial claim: may not pass S2 (checkable).

AMM can be viewed as a new form of IR problems in the era of generative AI agents.

“Our position is that AMM could be viewed as a new form of IR problems in the era of generative AI agents.”

• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.
• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Agentic memory management (AMM) is a natural extension of IR research and an area in which the IR community can make distinctive contributions.

“we argue that agentic memory management (AMM), which studies the structure, analysis, organization, storage, searching, retrieval, and use of information in an intelligent agent's memory, is a natural extension of IR research and an area in which the IR community can make distinctive contributions.”

• AssumptionRests on an assumption: People are increasingly asking AI assistants to read, filter, summarize, and act on information on their behalf.
• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.
• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable).

Neither definition alone structures the questions of system design.

“Neither definition alone structures the questions of system design.”

Probably not a substantial claim: may not pass S2 (checkable).

The methodology and research experience from decades of studies on information users and retrieval systems could give IR researchers unique advantages in tackling problems in AMM, particularly at its early stage.

“The methodology and research experience from decades of studies on information users and retrieval systems could give IR researchers unique advantages in tackling problems in AMM, particularly at its early stage.”

• AssumptionRests on an assumption: A second wave of shifts, the rise of AI agents, is already under way.

May combine two claims.

A language model processes its entire context at once, but it uses that context unevenly: accuracy tends to be highest when relevant information appears near the beginning or the end of the input and lowest when it appears in the middle.

“A language model processes its entire context at once, but it uses that context unevenly: accuracy tends to be highest when relevant information appears near the beginning or the end of the input and lowest when it appears in the middle [35].”

• cites [35] [35] Nelson F. Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2024. Lost in the Middle: How Language Models Use Long Contexts. Transactions of the Association for Computational Linguistics 12 (2024), 157-173. -Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Both views ultimately serve the same end: helping people satisfy an information need or complete a task.

“Both views ultimately serve the same end. Search, recommendation, advertising, question answering, and personal assistants differ in their interfaces and signals, but each is valuable to the extent that it helps people satisfy an information need or complete a task.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The overlap between Zhai's taxonomy and ours is substantial: rules correspond roughly to our operators and past scenarios to our functions.

“The overlap is substantial: rules correspond roughly to our operators and past scenarios to our functions.”

Classified as probably not a substantial claim. May combine two claims.

It classifies what is stored, but does not directly specify how a system should match, update, or evaluate each item.

“It classifies what is stored , but does not directly specify how a system should match, update, or evaluate each item.”

Probably not a substantial claim: may not pass S3 (load-bearing).

One of IR's founding visions was building an external memory system for a person.

“Therefore, one of IR's founding visions was building an external memory system for a person .”

• cites [10] [10] Vannevar Bush. 1945. As We May Think. The Atlantic Monthly 176, 1 (1945), 101-108. -Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

A search engine or recommender supplies information, but what a person does with it is up to that person; the system can rank, highlight, and suggest, but it cannot write into the person's memory or determine the next action.

“A search engine or recommender supplies information, but what a person does with it is up to that person; the system can rank, highlight, and suggest, but it cannot write into the person's memory or determine the next action.”

May combine two claims.

Some human constraints disappear for agents: an agent can read all hundred results of a query or issue dozens of reformulations, at a cost measured in tokens rather than in attention or patience.

“Some human constraints also disappear: an agent can read all hundred results of a query or issue dozens of reformulations, at a cost measured in tokens rather than in attention or patience.”

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

May combine two claims.

Under a U-shaped profile, placing the best item first is not necessarily the best arrangement, and a rank-discounted metric may misstate how useful a ranking is to an agent.

“Under such a U-shaped profile, placing the best item first is not necessarily the best arrangement, and a rank-discounted metric may misstate how useful a ranking is to an agent.”

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Interactive IR already studies how people read, judge, and act on results.

“Interactive IR already studies how people read, judge, and act on results.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Because people cannot be redesigned, IR systems adapted to them: to their vocabulary, their biases, and their interfaces.

“Because people cannot be redesigned, IR systems adapted to them: to their vocabulary, their biases, and their interfaces.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Experience and methodology used in IR studies could provide important guidelines to help better craft the structure of AMM research.

“Experience and methodology used in IR studies could provide important guidelines to help us better craft the structure of AMM research.”

Classified as probably not a substantial claim.

The position change adds a possibility rather than replacing one.

“The position change adds a possibility rather than replacing one.”

May combine two claims.

Retrieval has not disappeared, since retrieval-augmented generation made it a standard component of LLM systems, but the retrieved text is now often read by a model before, or instead of, a person.

“Retrieval has not disappeared, since retrieval-augmented generation [34] made it a standard component of LLM systems, but the retrieved text is now often read by a model before, or instead of, a person.”

• cites [34] [34] Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al. 2020. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. In Advances in Neural Information Processing Systems . -Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Many applications are information tasks in the conventional IR sense, but not all of them are: memory supports actions as well as answers, extending beyond the scope of traditional IR.

“First, many of these are information tasks in the conventional IR sense, but not all of them are: memory supports actions as well as answers, extending beyond the scope of traditional IR.”

May combine two claims.

These limitations reduce the reusability of AMM benchmarks and prevent the field from reaching a broader audience.

“These limit the reusibility of AMM benchmarks and prevent the field to reach boarder audience.”

May combine two claims.

The interface for an agent need not be visual; an agent receives results as text or structured data through a tool call, so presentation becomes a question of selection, format, granularity, and length rather than layout.

“The interface need not be visual either. An agent receives results as text or structured data through a tool call, so presentation becomes a question of selection, format, granularity, and length rather than layout.”

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

May combine two claims.

In a study of retrieval-augmented question answering, high-scoring retrieved passages that did not contain the answer reduced accuracy, whereas adding random passages improved it by up to 35% in some configurations.

“In a study of retrieval-augmented question answering, high-scoring retrieved passages that did not contain the answer reduced accuracy, whereas adding random passages improved it by up to 35% in some configurations [22]; a human reader would be unlikely to be misled by the former or helped by the latter.”

• cites [22] [22] Florin Cuconasu, Giovanni Trappolini, Federico Siciliano, Simone Filice, Cesare Campagnano, Yoelle Maarek, Nicola Tonellotto, and Fabrizio Silvestri. 2024. The Power of Noise: Redefining Retrieval for RAG Systems. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval . 719-729. doi:10.1145/3626772.3657834 -Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

IR remains relevant to unstructured constants and becomes especially central for functions and operators.

“IR remains relevant to unstructured constants and becomes especially central for functions and operators.”

May combine two claims.

A person who finds the sentence 'ignore your previous instructions' on a web page does not treat it as a command addressed to them, whereas an LLM-integrated application may follow instructions injected into the content it retrieves.

“A person who finds the sentence 'ignore your previous instructions' on a web page does not treat it as a command addressed to them, whereas an LLMintegrated application may follow instructions injected into the content it retrieves [24].”

• cites [24] [24] Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023. Not What You've Signed Up For: Compromising RealWorld LLM-Integrated Applications with Indirect Prompt Injection. In Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security . 79-90. doi:10. 1145/3605764.3623985 -Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Much of what IR knows about its users describes people rather than information.

“Much of what IR knows about its users describes people rather than information (Section 2).”

• AssumptionRests on an assumption: The consumer of retrieved information is increasingly an agent rather than a person.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

IR advanced through a combination of system building and foundational work, including shared decision principles, reusable models, and test collections that made results comparable; agent-memory research would benefit from the same combination.

“Second, IR advanced through a combination of system building and foundational work, including shared decision principles, reusable models, and test collections that made results comparable; agent-memory research would benefit from the same combination.”

Classified as probably not a substantial claim. May combine two claims.

The levels have different update dynamics, since a single corrected preference should change many future executions while a corrected fact should change only the executions that use it.

“the levels have different update dynamics, since a single corrected preference should change many future executions while a corrected fact should change only the executions that use it”

Classified as probably not a substantial claim.

The two changes are parallel rather than competing.

“The two changes are parallel rather than competing.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The importance of memory systems became even more significant with the rise of the Internet in the 1990s.

“When it came to the 1990s, with the rise of Internet, the importance of such 'memory systems' has become even more significant.”

May combine two claims.

In AMM, this constraint weakens. The consumer of the information is a system that we can instrument.

“In AMM, this constraint weakens. The consumer of the information is a system that we can instrument.”

Probably not a substantial claim: may not pass S2 (checkable).

IR offers additional concepts and methods that should inform this work more systematically.

“Our claim is that IR offers additional concepts and methods that should inform this work more systematically.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

The boundary between parametric and non-parametric knowledge is currently determined by convenience, and a principled account of consolidation is missing.

“The boundary is currently determined by convenience, and a principled account of consolidation - what to compile into parameters, when, and how to reverse it - is missing.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Both fields manage many forms of information, and both must handle scale, redundancy, staleness, and noise.

“Both fields manage many forms of information, and both must handle scale, redundancy, staleness, and noise.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Current accounts provide limited guidance about when repeated textual revision improves task performance, whether the process converges, or how to distinguish a useful update from mere rephrasing.

“current accounts provide limited guidance about when repeated revision improves task performance, whether the process converges, or how to distinguish a useful update from mere rephrasing.”

• AssumptionRests on an assumption: Asking a language model to revise its own notes is often effective in practice.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Recalling a stated fact and acquiring a workflow that transfers to a new site are different capabilities, and a single aggregate score obscures which capabilities a system has acquired.

“Recalling a stated fact and acquiring a workflow that transfers to a new site are different capabilities, and a single aggregate score obscures which capabilities a system has acquired.”

May combine two claims.

Evaluation can therefore connect component behavior to downstream outcomes more directly. We call this shift the observability inversion: downstream use becomes more measurable, while topical relevance becomes less informative on its own.

“Evaluation can therefore connect component behavior to downstream outcomes more directly. We call this shift the observability inversion : downstream use becomes more measurable, while topical relevance becomes less informative on its own.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

AMM is currently studied mostly in the NLP, ML, and agent communities, and much of that work already draws on retrieval.

“AMMis currently studied mostly in the NLP, ML, and agent communities, and much of that work already draws on retrieval.”

May combine two claims.

As data and model capacity grew, learned systems increasingly absorbed factors that IR theories had enumerated explicitly, which accelerated progress but provided less conceptual scaffolding.

“As data and model capacity grew, learned systems increasingly absorbed factors that these theories had enumerated explicitly [40], which accelerated progress but provided less conceptual scaffolding.”

• cites [40] [40] Bhaskar Mitra and Nick Craswell. 2018. An Introduction to Neural Information Retrieval. Foundations and Trends in Information Retrieval 13, 1 (2018), 1-126. - sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

For non-parametric updates, something must play the role that gradient descent plays for parametric models.

“For non-parametric updates, something must play the role that gradient descent plays for parametric models.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The field built foundations for library collections and later for the web, starting from the vision of the memex as an external memory for a person.

“The field built such foundations for library collections and later for the web, starting from the vision of the memex as an external memory for a person [10].”

• cites [10] [10] Vannevar Bush. 1945. As We May Think. The Atlantic Monthly 176, 1 (1945), 101-108. -Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

IR aims to help people satisfy information needs and complete tasks. AMM aims to provide an agent with the information it needs to complete a task on a user's behalf. AMM adds an intermediary while preserving the same objective.

“IR aims to help people satisfy information needs and complete tasks (Section 2). AMM aims to provide an agent with the information it needs to complete a task on a user's behalf. AMMadds an intermediary while preserving the same objective.”

May combine two claims.

In AMM, more of the objective is observable, so component measurements can become diagnostics that explain an outcome.

“In AMM, more of the objective is observable, so component measurements can become diagnostics that explain an outcome.”

May combine two claims.

IR's ultimate goal is to help someone finish a task, but conventional IR systems often see only part of it.

“IR's ultimate goal is to help someone finish a task, but conventional IR systems often see only part of it.”

May combine two claims.

We can observe which items were retrieved, whether they entered the context, whether the agent's action changed as a result, and whether the task succeeded.

“We can observe which items were retrieved, whether they entered the context, whether the agent's action changed as a result, and whether the task succeeded.”

May combine two claims.

Existing benchmarks concentrate on outcome for a narrow slice of state quality; few isolate utilization quality, and the validity of the automated metrics used for outcome is itself contested.

“Existing benchmarks concentrate on (iii) for a narrow slice of (i); few isolate (ii), and the validity of the automated metrics used for (iii) is itself contested [28].”

• cites [28] [28] Dongming Jiang, Yi Li, Songtao Wei, Jinxin Yang, Ayushi Kishore, Alysa Zhao, Dingyi Kang, Xu Hu, Feng Chen, Qiannan Li, and Bingzhe Li. 2026. Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations. arXiv preprint arXiv:2602.19320 (2026). -Not checked yet

  Not checked in the free run.

May combine two claims.

Most AMM benchmarks concentrate on conversational fact recall, although some have begun to include streams of user feedback; recent analysis raises concerns about saturation, the validity of automated judges, backbone sensitivity, and incomplete cost reporting.

“Most concentrate on conversational fact recall, although some have begun to include streams of user feedback [1]; recent analysis also raises concerns about saturation, the validity of automated judges, backbone sensitivity, and incomplete cost reporting [28].”

• cites [1] [1] Qingyao Ai, Yichen Tang, Changyue Wang, Jianming Long, Weihang Su, and Yiqun Liu. 2025. MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems. arXiv preprint arXiv:2510.17281 (2025). -Not checked yet

  Not checked in the free run.

• cites [28] [28] Dongming Jiang, Yi Li, Songtao Wei, Jinxin Yang, Ayushi Kishore, Alysa Zhao, Dingyi Kang, Xu Hu, Feng Chen, Qiannan Li, and Bingzhe Li. 2026. Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations. arXiv preprint arXiv:2602.19320 (2026). -Not checked yet

  Not checked in the free run.

May combine two claims.

IR has shown how a proxy that diverges from the objective can distort a system and how implicit feedback can mislead when position and selection biases are ignored.

“IR has shown how a proxy that diverges from the objective can distort a system and how implicit feedback can mislead when position and selection biases are ignored [31].”

• cites [31] [31] Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining . 781-789. - sourceNot checked yet

  Checked before — its earlier verdict is held back until a new check runs.

May combine two claims.

End-to-end task success confounds memory quality with the agent's competence: a strong backbone can compensate for a bad memory, and a weak one can waste a good one.

“First, end-to-end task success confounds memory quality with the agent's competence: a strong backbone can compensate for a bad memory, and a weak one can waste a good one.”

Probably not a substantial claim: may not pass S3 (load-bearing).

IR advanced through a combination of system building and foundational work.

“As Section 2 notes, IR advanced through a combination of system building and foundational work.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

When an agent acts on a person's behalf, the information that matters is increasingly the information the agent keeps for itself, and managing it well is what allows an assistant to improve with use rather than start afresh in every session.

“When an agent acts on a person's behalf, the information that matters is increasingly the information the agent keeps for itself, and managing it well is what allows an assistant to improve with use rather than start afresh in every session.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

IR made competing claims comparable through shared evaluation protocols, from the Cranfield experiments to TREC and NTCIR, and progress in neural IR accelerated when large shared collections became available.

“IR made competing claims comparable through shared evaluation protocols, from the Cranfield experiments [19] to TREC [65] and NTCIR [13], and progress in neural IR accelerated when large shared collections became available [42].”

• cites [19] [19] Cyril Cleverdon. 1967. The Cranfield Tests on Index Language Devices. Aslib Proceedings 19, 6 (1967), 173-194. -Not checked yet

  Not checked in the free run.

• cites [65] [65] Ellen M Voorhees, Donna K Harman, et al. 2005. TREC: Experiment and evaluation in information retrieval . Vol. 63. MIT press Cambridge. -Not checked yet

  Not checked in the free run.

• cites [13] [13] Chung-Chi Chen, Qingyao Ai, and Shoko Wakamiya. 2025. Overview of ntcir-18. Transfer 2, 9 (2025), U4. -Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

AMM can be viewed as a new form of IR problem, although it is currently approached mainly through system building and analogies to human memory.

“AMM can therefore be viewed as a new form of IR problem, although it is currently approached mainly through system building and analogies to human memory.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Credit assignment asks which memory decisions contributed to an outcome. A task succeeds or fails after a long sequence of decisions about what to write, retain, retrieve, and use.

“Credit assignment asks which memory decisions contributed to an outcome. A task succeeds or fails after a long sequence of decisions about what to write, retain, retrieve, and use.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Some knowledge belongs in model weights, whereas other knowledge belongs in text.

“some knowledge belongs in weights, whereas other knowledge belongs in text.”

Classified as probably not a substantial claim. May combine two claims.

The activities named in Salton's definition of IR remain the same, but the consumer for which they are performed has changed, and AMM adds the use of information by the agent itself.

“The activities it names - structuring, analyzing, organizing, storing, searching, and retrieving - remain the same, but the consumer for which they are performed has changed, and AMM adds one more: the use of information by the agent itself.”

May combine two claims.

IR's user models describe people: their needs, their cognitive limits, their behavior under uncertainty. AMM's consumer is a model.

“IR's user models describe people: their needs, their cognitive limits, their behavior under uncertainty. AMM's consumer is a model.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

A memory system can improve from experience through parametric updates to model weights and through non-parametric updates to the content and structure of its store.

“Amemorysystem can improve from experience through parametric updates to model weights and through non-parametric updates to the content and structure of its store.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

It may over-rely on retrieved content that contradicts its parametric knowledge, or under-use content that is correct but unconventionally formatted.

“It may over-rely on retrieved content that contradicts its parametric knowledge, or under-use content that is correct but unconventionally formatted.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The organization of the memory store is itself a decision variable, and changing it changes what can be retrieved.

“the organization of the store is itself a decision variable, and changing it changes what can be retrieved.”

May combine two claims.

A search engine observes a query, a ranking, and some clicks; it does not observe whether the report was written, the trip was booked, or the bug was fixed.

“A search engine observes a query, a ranking, and some clicks; it does not observe whether the report was written, the trip was booked, or the bug was fixed.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Improving the system requires attributing the outcome to points in that chain and then updating the content of an item, the structure of the store, or the policy that determines when to retrieve.

“Improving the system requires attributing the outcome to points in that chain and then updating the content of an item, the structure of the store, or the policy that determines when to retrieve.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Some of these updates can be parametric, but most are not: they modify text and organization.

“Some of these updates can be parametric, but most are not: they modify text and organization.”

May combine two claims.

IR has spent decades building reproducible ways to study users and to evaluate systems that serve them, including simulation as a first-class methodology.

“IR has spent decades building reproducible ways to study users and to evaluate systems that serve them, including simulation as a first-class methodology [4].”

• cites [4] [4] Krisztian Balog and ChengXiang Zhai. 2024. User Simulation for Evaluating Information Access Systems. Foundations and Trends in Information Retrieval 18, 1-2 (2024), 1-261. -Not checked yet

  Not checked in the free run.

May combine two claims.

Neither end-to-end learning nor system-design routes currently serves AMM well.

“Neither route currently serves AMM well.”

• AssumptionRests on an assumption: System designs often rely on analogies to human memory without stating the conditions under which that design should help.

Probably not a substantial claim: may not pass S4 (based).

Violating the minimal-scope principle offers one plausible explanation for personalization failures in which an agent overgeneralizes a local correction.

“Violating this principle offers one plausible explanation for personalization failures in which an agent overgeneralizes a local correction.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Salton's definition of IR has outlived the technology for which it was written and remains applicable to the transition to agentic memory management.

“Salton's definition of IR has outlived the technology for which it was written and remains applicable to this transition.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Structurally, a memory system can be viewed as a small, personal, write-heavy, feedback-rich retrieval system.

“Structurally, a memory system can be viewed as a small, personal, write-heavy, feedback-rich retrieval system.”

May combine two claims.

Poisoning of memory stores and membership inference against them are emerging concerns.

“poisoning of memory stores [15] and membership inference against them [14] are emerging concerns.”

• cites [15] [15] Zhaorun Chen, Zhen Xiang, Chaowei Xiao, Dawn Song, and Bo Li. 2024. AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases. In Advances in Neural Information Processing Systems . -Not checked yet

  Not checked in the free run.

• cites [14] [14] Kai Chen, Yan Pang, and Tianhao Wang. 2026. MRMMIA: Membership Inference Attacks on Memory in Chat Agents. arXiv preprint arXiv:2605.27825 (2026). -Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The main differences are that memory content is often produced through interaction rather than authored independently, and is frequently user-specific.

“The main differences are that memory content is often produced through interaction rather than authored independently, and is frequently user-specific.”

Probably not a substantial claim: may not pass S4 (based).

Marginal contribution of memory items is not additive across items.

“marginal contribution is not additive across items.”