CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agents
Open accessAbstract
Personalized language agents use persistent memory to adapt to users over time, but the same mechanism creates an attack surface. When new information conflicts with stored preferences, an agent must distinguish genuine preference drift from temporary context shifts, ambiguity, or adversarial memory poisoning. We formulate this problem as a continuous-time partially observable decision process over a latent user state and show why rules based only on recency and provenance are insufficient. CAPTURE addresses this ambiguity with a neural differential-equation belief tracker, a multi-timescale memory ledger, uncertainty-triggered clarification, and counterfactual auditing of cited memories. On 480 held-out episodes from 96 users, CAPTURE achieves a 71.5% win rate, compared with 69.3% for an identically supervised baseline and 66.1% for the strongest heuristic baseline. It limits fixed-policy poisoning success to 11.5% while accepting 83.5% of genuine preference updates. Under an adaptive attacker with access to the released weights, attack success rises to 24.7%, exposing a real adaptation-security tradeoff. We further evaluate the frozen system zero-shot on an independently constructed benchmark and replay longitudinal interaction histories from 40 users collected over two to three weeks. These results suggest that modeling preference authenticity explicitly can improve both personalization and robustness in memory-augmented LLM agents.
AI snapshot
Written from the paper’s full text.
TL;DR
CAPTURE formalizes preference-authenticity ambiguity in personalized LLM agents as a continuous-time partially observable decision process and implements a neural-ODE belief, multi-timescale ledger, clarification, and causal audit. On 480 held-out episodes from 96 users, it reaches a 71.5% win rate, 11.5% fixed-policy poisoning, and 83.5% genuine-update adherence, but an adaptive attacker raises poisoning to 24.7%, where a provenance filter is marginally more secure.
Key findings
- CAPTURE reaches 71.5% win rate against 69.3% for a supervision-matched Transformer and 66.1% for StateMem; it holds fixed-policy poisoning to 11.5% versus 20.0% for Provenance-only and 15.9% for the supervised Transformer, while adhering to 83.5% of genuine updates versus Provenance-only’s 74.1% and admitting 8.9% benign non-updates versus 19.6%.
- The paper proves a lower bound for any rule reading only recency and provenance: FUR(d) + RRL(d) ≥ 1 − δφ against a worst-case feasible adversary; conditioning on the full history is never worse and is strictly better under a stated nondegenerate-likelihood-ratio condition; a bounded-cost clarifying question enlarges the achievable error region under a stated condition.
- Under adaptive attack, CAPTURE’s poisoning rises from 11.5% to 24.7%, while Provenance-only reaches 22.1%; the paired difference is 2.6 points with interval [−1.9, 7.2] at p = 0.29, so the two are not reliably separated on adaptive security. Independently authored attacks give CAPTURE 18.3%, the lowest of the tested methods.
- Zero-shot on HorizonBench, CAPTURE reaches 0.72 contradiction resolution versus StateMem’s 0.65 and Recency RAG’s 0.58, though Recency RAG leads belief revision accuracy at 0.79 versus CAPTURE’s 0.78; on replayed histories from 40 users, CAPTURE wins 67.5% versus StateMem’s 63.0% and shows 12% replay poisoning versus StateMem’s 28%.
Methods
- Design: a continuous-time POMDP over a latent user state, with CAPTURE combining a 3B LoRA preference-hypothesis extractor, a neural-ODE authenticity gate over six memory actions, a graph-structured ledger with stable/contextual/transient layers and quarantine, entropy-triggered clarification, a safety-bounded selector, and counterfactual-removal citation audit.
- Data: D-PREFGUARD contains 2,400 longitudinal episodes across five tracks, with 480 held-out test episodes from 96 users; response backbones are Qwen3-8B-Instruct and Llama-3.1-8B-Instruct, with three seeds. Additional evaluations use HorizonBench zero-shot and a 40-participant, two-to-three-week replay study.
- Analysis: win rate is a blinded pairwise LLM-judge comparison against the unpersonalized backbone; regret is common-pool dynamic regret over a frozen 32-candidate oracle-generated pool; poisoning, adherence, and false-admission rates are reported with user-level paired bootstrap intervals and paired randomization tests with Holm correction.
Limitations
- Stated in the paper: Theorem 2 constrains only σ(φ)-measurable rules, depends on Assumption 4, and does not cover a heuristic reading a third fixed feature; CAPTURE is text-only and does not address weight-level poisoning; the clarification budget is tuned on the authors’ data; D-PREFGUARD is synthetic and validated on a 300-episode subset, so absolute numbers are relative comparisons rather than deployment estimates; HorizonBench trajectories are simulated even where annotations are human; 40 participants supports an effect estimate but no subgroup claim; adaptive attack remains open and the advantage over a provenance filter is not reliably separated.
- Evident from the text: the main benchmark and attack paraphrases are LLM-generated, though test uses a held-out generator family; the external-validity check passes only narrowly; same-origin contamination accounts for 50.7% of CAPTURE’s successful poisoning attempts, and a further 21% are slow attacks the paper says it does not claim to solve; the LLM judge agrees with human raters 87.4% of the time, against 91.2% agreement among the human raters themselves.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
5 of 13 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured
- Findingown data
On D-PREFGUARD, CAPTURE achieves precision 0.79, recall 0.70, and F1 0.74 at a realized query rate of 7.8%, within the 8.33% budget.
“On D-PREFGUARD, where such labels exist, CAPTURE reaches precision 0.79, recall 0.70, and F1 0.74 at a realized query rate of 7.8% inside the 8.33% budget.”
Quote in the paperSubstantial claim - Findingreasoning
A clarifying question with bounded cost and symmetric channel error improves the achievable error region when its cost plus error is below the no-query Bayes error.
“that a bounded-cost clarifying question enlarges the achievable error region under a stated condition”
- Also stated in: § 2 Problem Formulation · plain
“If a clarifying question returns a label through a symmetric channel of error ε at cost κ, then asking beats every no-query rule whenever κ + ε falls below the no-query Bayes error.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Also stated in: § 2 Problem Formulation · plain
- Findingown data
An adaptive attacker with access to the released weights raises CAPTURE's poisoning rate to 24.7%.
“An adaptive attacker with the released weights raises that to 24.7%”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Findingown data
On Qwen3-8B, the continuous gate achieves a win rate 2.4 points higher than the discrete gate.
“the continuous gate leads the discrete one by 2.4 points of win rate on Qwen3”
Quote in the paperSubstantial claim - Findingown data
CAPTURE adheres to 83.5% of genuine updates.
“adheres to 83.5% of genuine updates”
Quote in the paperSubstantial claim
- Findingown data
CAPTURE limits fixed-policy poisoning to 11.5%.
“holds fixed-policy poisoning to 11.5%”
- Also stated in: § Splits and leakage. · plain
“CAPTURE reaches 11.5% poisoning at 83.5% adherence and 8.9% false admission, beating Provenance-only on all three at once”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Also stated in: § Splits and leakage. · plain
- Findingreasoning
The audit contributes 0.4 points of genuine-update adherence rate.
“removing the audit costs 0.4 points of genuine-update adherence rate rather than nothing”
Quote in the paperSubstantial claim - Findingown data
On HorizonBench, the separation appears on contradiction resolution, where CAPTURE reaches 0.72 versus StateMem's 0.65 and Recency RAG's 0.58.
“the separation appears on contradiction resolution, where CAPTURE reaches 0.72 against StateMem's 0.65 and Recency RAG's 0.58.”
Quote in the paperSubstantial claim - Findingreasoning
Any decision rule that uses only recency and provenance has error bounded below by how well a feasible adversary can mimic the statistics of a genuine preference revision.
“we prove that the error of any rule reading only recency and provenance is bounded below by how closely a feasible adversary can imitate the statistics of a legitimate revision”
- Also stated in: § 2 Problem Formulation · plain
“Then every decision rule reading only φ satisfies”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Also stated in: § 2 Problem Formulation · plain
- Findingown data
Satisfaction ratings were 4.1 (95% CI [3.9, 4.3]) for CAPTURE versus 3.8 (95% CI [3.6, 4.0]) for StateMem.
“giving 4.1 at [3.9, 4.3] against StateMem's 3.8 at [3.6, 4.0]”
Quote in the paperNot a substantial claim - Findingown data
Removing the audit lowers evidence F1 from 0.79 to 0.58.
“Removing the audit drops evidence F1 from 0.79 to 0.58.”
Quote in the paperSubstantial claim - Findingown data
The normalized utility cost of delaying an answer by one turn is κ = 0.094 with interval [0.081, 0.109].
“the normalized utility cost of delaying an answer by one turn is κ = 0.094 with interval [0.081, 0.109].”
Quote in the paperNot a substantial claim - Findingown data
The paired difference in macro-F1 between CAPTURE and the supervised Transformer was +0.03 with interval [-0.01, 0.07] at p = 0.13.
“The paired difference is +0.03 with interval [-0.01, 0.07] at p = 0.13”
Quote in the paperSubstantial claim - Findingnone given
Most legitimate updates that CAPTURE fails to capture involve weak evidence, in which the user indicates a change indirectly instead of stating it.
“The legitimate updates CAPTURE misses are dominated by weak evidence, where the user signals a change indirectly rather than stating it.”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
Removing provenance increases poison ASR by 14.0 pp.
“w/o provenance +0.06 +14.0 pp -4.0 pp 9.0% 8.4% 0.68 2300 ms”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
The adaptation-lag difference versus Recency RAG is not significant (p = 0.07).
“The adaptation lag difference against Recency RAG is not, at p = 0.07.”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
In the Appendix A.6 matched split, Provenance-only achieves FUR + RRL above 1 - TV φ, satisfying Equation 11.
“On the matched split of Appendix A.6, Provenance-only attains FUR + RRL above 1 -TV φ as Equation 11 requires.”
Quote in the paperNot a substantial claim - Findingown data
The gate's most common success on contamination is quarantine followed by non-corroboration, which resolves 58% of blocked poisoning attempts.
“On contamination, the gate's most common success is not outright rejection but quarantine followed by non-corroboration, which is how 58% of blocked poisoning attempts resolve.”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
Slow attacks that repeatedly assert a small shift across many turns account for another 21% of successful poisoning attempts.
“and a further 21% are slow attacks that assert a small shift repeatedly across many turns”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
Removing the causal audit reduces evidence F1 to 0.58.
“w/o causal audit +0.01 +0.6 pp -0.4 pp 8.2% 8.9% 0.58 1450 ms”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
With real users, the win-rate advantage over StateMem shrinks from 5.4 points to 4.5 points.
“The win-rate margin over StateMem falls from 5.4 points to 4.5 points with real users”
Quote in the paperSubstantial claim- Rests on an assumption: The user study participants' labels (genuine, temporary, context-specific, incorrect) accurately capture the ground truth of preference validity.
- Findingown data
Same-origin writes make up 50.7% of the poisoning attempts that succeed.
“Of the poisoning attempts that succeed, same-origin writes account for 50.7%, consistent with the 17.5% same-origin rate in Appendix I against 7.0% and 10.0% on the other two families”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
The win-rate and poison-ASR differences from StateMem are significant at p < 0.01 using a paired randomization test with Holm correction.
“Differences against StateMem on win rate and poison ASR are significant at p < 0.01 under a paired randomization test with Holm correction.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
Across 4,800 node-response pairs, 1,472 of them positive, |Inf(n)| yields an AUC of 0.718 (user-bootstrap interval [0.684, 0.751]) for predicting membership in the independently annotated evidence set.
“Over 4,800 node-response pairs of which 1,472 are positive, the AUC of |Inf(n)| against membership in the independently annotated evidence set is 0.718 with a user-bootstrap interval of [0.684, 0.751].”
Quote in the paperSubstantial claim - Findingown data
On the context-switch track, CAPTURE chooses the scope action in 71% of context-switch changepoints, while StateMem chooses it in 4%.
“On the context-switch track, the modal correct action is scope rather than revise, and CAPTURE selects it in 71% of context-switch changepoints against 4% for StateMem, which has no representation for a narrowed belief and must overwrite instead.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Findingown data
After Holm correction, the binned degeneracy null is rejected in 12 of the 32 occupied cells.
“We reject the specified binned degeneracy null in 12 of 32 occupied cells after Holm correction”
Quote in the paperSubstantial claim - Findingown data
In the matched split, 12 of 32 occupied cells (37.5%) in the restricted view show both signs of the estimated conditional likelihood ratio with bootstrap-significant probability, versus the 5% expected under degeneracy.
“On the matched split, 12 of the 32 occupied cells of the restricted view, or 37.5%, contain both signs of the estimated conditional likelihood ratio with bootstrap-significant probability, against the 5% rate expected under degeneracy at our test level.”
Quote in the paperSubstantial claim - Findingown data
The full system's evidence F1 is 0.79.
“CAPTURE full 0.00 0.0 pp 0.0 pp 8.0% 9.0% 0.79 2480 ms”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- Interpretationreasoning
Because the safety selector is independent of the ledger, memory-layer poisoning still fails to yield harmful output in most contamination episodes.
“This asymmetry is why poisoning that succeeds at the memory layer still fails to produce harmful output in most of our contamination episodes.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Interpretationown data
The adaptation-security tradeoff is not fixed.
“The tradeoff is not fixed.”
Quote in the paperSubstantial claim - Study design and conductown data
Three annotators validated a 300-episode subset at Krippendorff's alpha of at least 0.70.
“Three annotators validated a 300-episode subset at Krippendorff's α ≥ 0.70.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The metric used to score a method differs from the one it optimizes, since regret is scored against a reward model trained on disjoint data.
“so the metric a method is scored on is not the one it optimizes”
Quote in the paperNot a substantial claim - Interpretationreasoning
The empirical accuracy of the discriminator cannot replace A, because it exceeds the population value with probability near one half.
“The empirical accuracy cannot be substituted for A, because it exceeds the population value with probability near one half, which is exactly what a one-sided bound may not do.”
Quote in the paperSubstantial claim - Interpretationreasoning
Binning coarsens the σ-algebra, so by Theorem 3 the population quantity being estimated is at most TV_φ(α_0).
“Binning coarsens the σ-algebra, so by Theorem 3 the population quantity being estimated is at most TV φ (α 0 ).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
- Interpretationown data
The preservation of the method ordering under independently authored attacks is the strongest available evidence that the security result is not an artifact of the paper's attack taxonomy.
“The ordering of methods is preserved, which is the strongest available evidence that the security result is not an artifact of our attack taxonomy.”
Quote in the paperSubstantial claim - Interpretationreasoning
Always asking beats every no-query rule when κ+ε < 1/2(1 - TV(P_g|G, P_α|G)).
“always asking beats every no-query rule when κ + ε < 1 2 1 -TV(P g | G , P α | G ) ,(23)”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The agent may take a third action, ask, which incurs a fixed cost κ > 0 and returns a label through a binary symmetric channel with error ε ∈ [0, 1/2), conditionally independent of H given Z.
- Interpretationreasoning
The displayed inequality at α is strict exactly when Equation 18 holds.
“The displayed inequality at α is therefore strict exactly when λ Pr λ E λ [p -q | G ′ ] > 0 G > 0 and Pr λ E λ [p -q | G ′ ] < 0 G > 0 > 0.(18)”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
- Interpretationreasoning
The quantity 2A-1 is a lower bound on the total variation distance, not an estimate of it.
“This is a lower bound and not an estimate.”
Quote in the paperSubstantial claim - Interpretationreasoning
Equality at α holds if and only if E_λ[p-q|G] = E_λ[E_λ[p-q|G']|G] λ-almost everywhere.
“Equality at α holds if and only if E λ [ p -q | G ] = E λ E λ [p -q | G ′ ] G λ-a.e.,(17)”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
- Interpretationreasoning
The population total variation distance between the two laws is at least 2A-1, where A is the one-sided lower bound on the diagnostic discriminator's balanced accuracy.
“gives TV H (α 0 ) ≥ 2A -1. (25”
Quote in the paperSubstantial claim - Interpretationreasoning
Theorem 2: For every G-measurable rule d and every adversary policy α, FUR(d;α) + RRL(d) ≥ 1 - TV(P_g|G, P_α|G), with equality for the likelihood-ratio rule.
“For every G-measurable rule d and every α ∈ A, FUR(d; α) + RRL(d) ≥ 1 -TV P g | G , P α | G ,(11) with equality for the likelihood-ratio rule”
Quote in the paperSubstantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
- The authors state this as an assumption: The latent label Z = g holds exactly when the user's intended preference has genuinely changed, the change affects the component that node n encodes, the user expresses or confirms the change, and an oracle ledger would add, revise, or rescope n.
- The authors state this as an assumption: The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
- Interpretationreasoning
Consequently, for every G-measurable d, the supremum over α of FUR(d;α) + RRL(d) is at least 1 - δ_G.
“Consequently, for every G-measurable d, sup α∈A FUR(d; α) + RRL(d) ≥ 1 -δ G .(12)”
Quote in the paperSubstantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
- The authors state this as an assumption: The latent label Z = g holds exactly when the user's intended preference has genuinely changed, the change affects the component that node n encodes, the user expresses or confirms the change, and an oracle ledger would add, revise, or rescope n.
- The authors state this as an assumption: The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
- Interpretationreasoning
The difference between 2A-1 and the binned plug-in estimate TV_φ is not a lower bound on TV_H - TV_φ, because a valid lower bound on that difference would require an upper bound on TV_φ, which the binned plug-in does not provide.
“Their difference is not a lower bound on TV H -TV φ , because a valid lower bound on that difference requires an upper bound on TV φ and the binned plug-in supplies none.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The test cannot establish the population condition, since it depends on a learned cross-fitted discriminator, estimated likelihood-ratio signs, binning, and finite samples.
“Because the test rests on a learned cross-fitted discriminator, estimated likelihood-ratio signs, binning, and finite samples, it does not establish the population condition.”
Quote in the paperSubstantial claim - Study design and conductown data
Red-teamers did not see CAPTURE's architecture, weights, threshold, outputs, benchmark templates, or any existing attack.
“They did not see CAPTURE's architecture, weights, threshold, outputs, benchmark templates, or any existing attack.”
Quote in the paperSubstantial claim - Interpretationreasoning
Because they repeatedly assert a small shift across many turns, such slow attacks are inherently difficult to distinguish from gradual drift.
“which is by construction hard to separate from gradual drift and which we do not claim to solve.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
- May combine two claims. 144
- Classified as probably not a substantial claim. 65
- The quote only partly states this claim. 1
May combine two claims.
PremisecitationInjection defenses reject content with untrusted provenance, which is sound for external threats but blind to a legitimate user revising a legitimate belief through a legitimate channel.
“Injection defenses refuse content whose provenance is not trusted (Chen et al., 2025;Hines et al., 2024;Debenedetti et al., 2025), which is sound when the threat is external but blind to the case that matters here, where a legitimate user revises a legitimate belief through a legitimate channel.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Chen et al., 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Hines et al., 2024 source
The Overview (§3.1; page unavailable) says spotlighting helps the model distinguish valid system instructions from untrustworthy external input. The Delimiting example (§3.2; page unavailable) tells the model not to obey instructions in an input document, but still to summarize it. Thus the source supports refusing instructions from untrusted input, not refusing the content itself; the legitimate-user scenario is the citing authors’ own framing. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites Debenedetti et al., 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationPersonalization pipelines prioritize adaptation speed and treat the history as ground truth, making them steerable by whoever writes into it.
“Personalization pipelines optimize for adaptation speed and treat the history as ground truth, which makes them steerable by whoever writes into it (Gao et al., 2024;Zollo et al., 2025).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Gao et al., 2024 source
The Abstract and “Minimize cumulative cost” section describe a personalization method that learns from historical user edits and efficiently uses inferred preferences to shape future responses. They do not say that personalization pipelines optimize for adaptation speed, treat history as ground truth, or can be steered by whoever writes into it; the paper describes preferences as latent and edits as potentially inconsistent with them. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites Zollo et al., 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationcitationThe gate is a learned substitute for Bayesian changepoint detection, differing in that it must decide both whether the process changed and whether the user authored the evidence.
“The gate is a learned alternative to Bayesian changepoint detection (Adams and MacKay, 2007), differing in that it must decide not only whether the process changed but whether the evidence was authored by the user.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Adams and MacKay, 2007 source
May combine two claims.
PremisecitationDynamic regret, not static regret, is the appropriate notion because the comparator moves.
“Dynamic rather than static regret is the right notion because the comparator moves (Zinkevich, 2003;Besbes et al., 2015)”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Zinkevich, 2003
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Besbes et al., 2015 source
Classified as probably not a substantial claim. May combine two claims.
PremisecitationSafety alignment is shallow in the token dimension, breakable by optimized suffixes, and fragile under fine-tuning.
“Safety alignment is shallow in the token dimension (Qi et al., 2025), breakable by optimized suffixes (Zou et al., 2023), and fragile under fine-tuning (Qi et al., 2024)”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Qi et al., 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Zou et al., 2023 source
- cites Qi et al., 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataThe D-PREFGUARD benchmark has 2,400 longitudinal episodes spanning five tracks covering stationary behavior, four shapes of genuine drift, benign noise, three contamination families, and utility-safety conflicts, with 480 held out for test.
“D-PREFGUARD contains 2,400 longitudinal episodes across five tracks isolating stationary behavior, four shapes of genuine drift, benign noise, three families of contamination, and conflicts between personal utility and safety, of which 480 are held out for test.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn HorizonBench, Recency RAG leads on belief revision accuracy at 0.79 versus 0.78, the expected ordering when no adversary is present.
“On HorizonBench, Recency RAG leads on belief revision accuracy at 0.79 against 0.78, the expected ordering where no adversary exists”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataJointly learning the decay rates collapsed them toward one value and reduced genuine-update adherence by 3.1 points.
“Learning the rates jointly collapsed them toward a single value and cost 3.1 points of genuine-update adherence rate”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataUnder adaptive attack, Provenance-only reaches 22.1% versus CAPTURE's 24.7%, a paired difference of 2.6 points with interval [-1.9, 7.2] at p = 0.29, so the two are not reliably separated.
“Provenance-only reaches 22.1% against our 24.7%, a paired difference of 2.6 points with interval [-1.9, 7.2] at p = 0.29, so the two are not reliably separated on this axis”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataAcross 480 held-out episodes from 96 users, CAPTURE achieves a 71.5% win rate, compared with 69.3% for a baseline given identical supervision and 66.1% for the strongest heuristic.
“On 480 held-out episodes from 96 users, CAPTURE reaches a 71.5% win rate against 69.3% for a baseline given identical supervision and 66.1% for the strongest heuristic”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataProvenance-only beats CAPTURE on indirect injection (4.8% vs 7.0%) but collapses on same-origin contamination (43.6% vs 17.5%), the regime identified by Theorem 1.
“Provenance-only beats CAPTURE on indirect injection, 4.8% against 7.0%, and collapses on same-origin contamination, 43.6% against 17.5%, the regime Theorem 1 identifies.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataUnder adaptive attack, a provenance filter is marginally more secure than CAPTURE but considerably less adaptive.
“at which point a provenance filter is marginally more secure and considerably less adaptive”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataRemoving the gate costs 22.0 points of poisoning resistance and 0.15 regret, and removing provenance costs a further 14.0 points.
“The gate carries the security result almost entirely, costing 22.0 points of poisoning resistance and 0.15 regret, and provenance a further 14.0”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataAgainst 240 attacks from twelve external red-teamers without access to the authors' templates, CAPTURE reaches 18.3%, above the authors' own generator's 11.5% but still the lowest of any method tested.
“On 240 attacks from twelve external red-teamers with no access to our templates, CAPTURE reaches 18.3%, above our own generator's 11.5% and still the lowest of any method tested”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingnone givenProvenance-only, a memory-layer proxy for that class of defenses, beats CAPTURE on untrusted channels but not where user and attacker write the same kind of sentence.
“Provenance-only is a memory-layer proxy for that class rather than a reimplementation of any one defense, which beats CAPTURE on untrusted channels but not where user and attacker write the same kind of sentence.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRemoving the safety bound raises adherence by 4.0 points while leaving ledger promotion unchanged, and triples safety attack success.
“Removing the safety bound raises adherence by 4.0 while leaving ledger promotion unchanged, confirming adherence is output-level, and triples safety attack success.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataAbout 70% of events carry no preference content, so an extractor unable to decline builds a noisy ledger.
“Roughly seven in ten events carry no preference content, so an extractor that cannot decline builds a ledger of noise.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataTimescale separation contributes 5.4 points of adherence and probing 3.6 points.
“Timescale separation is worth 5.4 points of adherence and probing 3.6.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOn context switches the modal correct action is scoping rather than revision, and CAPTURE selects it in 71% of changepoints versus 4% for StateMem.
“On context switches the modal correct action is scope rather than revise, and CAPTURE selects it in 71% of changepoints against 4% for StateMem.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataWithout the gate, poisoning reaches 33.5%, within 1.3 points of StateMem's 34.8%.
“removing the gate lands at 33.5% poisoning, within 1.3 points of StateMem's 34.8%.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataA baseline given the same supervision closes most of the gap to the heuristics; 2.2 points of win rate and 4.4 points of poisoning remain attributable to the architecture rather than the labels.
“A baseline trained on identical supervision closes most of the gap to the heuristics, leaving 2.2 points of win rate and 4.4 of poisoning attributable to the architecture rather than the labels.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe adaptive attacker more than doubles CAPTURE's attack success, from 11.5% to 24.7%, with same-origin rising to 38.1%; it transfers to the other learned gate almost as well and barely moves the heuristic baselines.
“It more than doubles attack success against CAPTURE, from 11.5% to 24.7%, with same-origin rising to 38.1%, transfers to the other learned gate almost as well, and barely moves the heuristic baselines, which expose no gradient.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataProviding the discrete gate with an explicit elapsed-time input closes about 55% of the gap to the continuous gate, but not the entire gap.
“giving the discrete gate an explicit elapsed-time input recovers about 55% of that gap but not all of it”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningConditioning on the full interaction history rather than only recency and provenance never increases the achievable error, and strictly decreases it under a stated nondegeneracy condition.
“that conditioning on the interaction history is never worse and is strictly better under a stated condition”
- Also stated in: § 2 Problem Formulation · plain
“Against any fixed adversary, conditioning on the full history in place of φ never increases the achievable error, and strictly decreases it whenever the sign of the conditional likelihood ratio given φ is nondegenerate on a set of views of positive measure.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
- Also stated in: § 2 Problem Formulation · plain
May combine two claims.
FindingreasoningAgainst a known adversary, the likelihood-ratio test attains the bound, so the bound is tight.
“Against a known adversary the bound is attained by the likelihood-ratio test, so it is tight rather than loose”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataRun zero-shot, the supervised Transformer scores 0.04 lower than CAPTURE on HorizonBench contradiction resolution (p = 0.008) and 1.7 points lower on replay win (p = 0.031), while the belief-revision and replay-poisoning gaps are not significant, so the architectural gain transfers beyond the authors' generator but only modestly.
“Frozen and run zero-shot, the Transformer trails CAPTURE on HorizonBench contradiction resolution by 0.04 at p = 0.008 and on replay win by 1.7 points at p = 0.031, while the belief-revision and replay-poisoning gaps do not reach significance, so the architectural gain transfers beyond our generator but modestly.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn D-PREFGUARD, CAPTURE leads StateMem by 5.4 points of win rate, and on replayed histories by 4.5 points.
“On D-PREFGUARD CAPTURE leads StateMem by 5.4 points of win rate, and on replayed histories by 4.5.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe advantage of CAPTURE survives both the HorizonBench and user-study evaluations, though it attenuates in each.
“The advantage survives both moves and attenuates each time.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataRecency RAG has the highest adherence at 85.7%, the worst poisoning at 51.6%, and the worst false admission at 41.2%.
“Recency RAG adheres most at 85.7% and has the worst poisoning at 51.6% and worst false admission at 41.2%.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataCAPTURE holds fixed-policy poisoning to 11.5% versus 20.0% for Provenance-only, adheres to 83.5% of genuine updates versus 74.1%, and admits 8.9% of benign non-updates versus 19.6%.
“CAPTURE holds fixed-policy poisoning to 11.5% against 20.0% for Provenance-only while adhering to 83.5% of genuine updates against that baseline's 74.1%, and admits 8.9% of benign non-updates against its 19.6%.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Findingown dataTop-label expected calibration error was 0.047 [0.035, 0.060] for CAPTURE and 0.062 [0.048, 0.078] for the Transformer.
“Top-label expected calibration error on the same events, using 15 equal-mass bins with temperature fitted on development data only, is 0.047 at [0.035, 0.060] for CAPTURE and 0.062 at [0.048, 0.078] for the Transformer.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe win advantage over StateMem was +4.5 points with interval [1.0, 8.0] at p = 0.014, and the satisfaction advantage was +0.30 points at [0.10, 0.50] and p = 0.004.
“the win advantage over StateMem is +4.5 points with interval [1.0, 8.0] at p = 0.014, and the satisfaction advantage is +0.30 points at [0.10, 0.50] and p = 0.004.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingnone givenNo refuting condition currently holds, and the external-validity check passes only narrowly.
“No refuting condition currently holds, and the external-validity check passes only narrowly.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn HorizonBench zero-shot, CAPTURE achieved belief revision accuracy 0.78, contradiction resolution rate 0.72, retrieval-attributable error 0.21, replay win 67.5% [62.0, 73.0], and replay poisoning 12% [7, 18].
“CAPTURE 0.78 0.72 0.21 67.5 [62.0, 73.0] 12 [7, 18]”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe judge's agreement with the human majority was 87.4%, compared with 91.2% pairwise agreement among the humans.
“the judge matches the human majority 87.4% of the time against 91.2% pairwise agreement among the humans.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataRetrievable-memory attack success was higher than response-level success throughout: 55.2% for Static Summary, 69.0% for Recency RAG, 48.1% for StateMem, 27.5% for Provenance-only, 59.8% for MemGPT, and 18.8% [15.7, 22.2] for CAPTURE, against CAPTURE's 11.5% [9.7, 13.4] response-level.
“Retrievable-memory success is higher throughout, at 55.2% Static Summary, 69.0%Recency RAG, 48.1% StateMem, 27.5% Provenance-only, 59.8% MemGPT, and 18.8% with interval [15.7, 22.2] for CAPTURE, against its 11.5% at [9.7, 13.4] response-level.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCAPTURE costs 17% more tokens per turn than StateMem and 43% fewer than Full History.
“CAPTURE therefore costs 17% more tokens per turn than StateMem and 43% fewer than Full History.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataRemark 3: Away from the atom at r_t = ∞, the r_t marginal is non-atomic in the authors' data, so every individual fibre is λ-null.
“Away from the atom at r t = ∞ that Definition 1 introduces for never-corroborated nodes, the r tmarginal is non-atomic in our data, so every individual fibre is λ-null and no such pair of sets exists.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
May combine two claims.
Findingown dataOn the same-origin track, Provenance-only achieves 43.6% attack success while CAPTURE achieves 17.5%, a significant difference at p < 0.001.
“Provenance-only reaches 43.6% attack success on the same-origin track against 17.5% for CAPTURE, and the gap is significant at p < 0.001.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor the headline comparisons in Table 1, CAPTURE's win rate 95% interval was [69.1, 73.8] against StateMem's [63.6, 68.5], and CAPTURE's poison ASR interval was [9.7, 13.4] against Provenance-only's [18.1, 22.0].
“For the headline comparisons in Table 1, the 95% intervals are [69.1,73.8] for CAPTURE's win rate against [63.6, 68.5] for StateMem, and [9.7, 13.4] for CAPTURE's poison ASR against [18.1, 22.0] for Provenance-only.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe rate at which genuine evidence becomes available to response generation was 100.0% for Full History, 93.8% for Recency RAG, 87.4% for StateMem, 86.1% for MemGPT, 79.6% for Static Summary, 78.9% for Provenance-only, and 88.2% for CAPTURE.
“The comparable quantity is the rate at which genuine evidence becomes available to response generation, which is 100.0%for Full History, 93.8% Recency RAG, 87.4% StateMem, 86.1% MemGPT, 79.6% Static Summary, 78.9% Provenance-only, and 88.2% for CAPTURE.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe supervised Transformer, evaluated zero-shot, reached belief revision accuracy 0.77 versus CAPTURE's 0.78, contradiction resolution 0.68 versus 0.72, retrieval-attributable error 0.23 versus 0.21, replay win 65.8% [60.2, 71.0] versus 67.5%, and replay poisoning 17% [11, 24] versus 12%.
“It reaches HorizonBench belief revision accuracy 0.77 against CAPTURE's 0.78, contradiction resolution 0.68 against 0.72, retrieval-attributable error 0.23 against 0.21, replay win 65.8% [60.2, 71.0] against 67.5%, and replay poisoning 17% [11,24] against 12%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFour of five methods showed higher attack success under independently authored attacks than under the fixed generator, while Recency RAG changed only slightly from 51.6% to 50.4%.
“Four of five methods show higher attack success under independently authored attacks than under our fixed generator, while Recency RAG changes slightly from 51.6% to 50.4%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIndependent annotators showed agreement of α = 0.78 on authenticity, 0.74 on scope, 0.71 on timescale, and 0.67 on the six-way action.
“Agreement was α = 0.78 on authenticity, 0.74 on scope, 0.71 on timescale, and 0.67 on the six-way action.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCAPTURE's adaptive attack success of 24.7% exceeds Provenance-only's 22.1% by 2.6 points with a paired interval of [-1.9, 7.2] at p = 0.29.
“CAPTURE's 24.7% exceeds Provenance-only's 22.1% by 2.6 points with a paired interval of [-1.9, 7.2] at p = 0.29.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAgainst CAPTURE, the adaptive attacker raised retrievable-memory attack success to 34.4% and response-level success to 24.7%, and transferred to the supervised Transformer at 27.9%.
“Against CAPTURE it raises retrievable-memory attack success to 34.4% and response-level success to 24.7%, and it transfers to the supervised Transformer at 27.9% while barely moving the heuristic baselines, which expose no gradient.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataTwelve of the 32 recency-origin cells survived the strictness test.
“Twelve cells survive.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataQuery-budget-matched StateMem reached 67.6% win rate, 0.30 regret, 3.7 lag, 30.5% poisoning, 82.4% adherence, and clarification F1 0.51 at precision 0.56 and recall 0.47, on a realized query rate of 8.1%.
“It reaches 67.6% win rate, 0.30 regret, 3.7 lag, 30.5% poisoning, 82.4% adherence, and clarification F1 0.51 at precision 0.56 and recall 0.47, on a realized query rate of 8.1%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPaired comparisons showed the architectural gain was +0.01 on belief revision (p = 0.27), +0.04 on contradiction resolution (p = 0.008), -0.02 retrieval error [-0.040, -0.001] (p = 0.046), +1.7 points replay win (p = 0.031), and -5.0 points replay poisoning (p = 0.064).
“Paired, the architectural gain is +0.01 on belief revision at p = 0.27, +0.04 on contradiction resolution at p = 0.008, -0.02 retrieval error with interval [-0.040, -0.001] at p = 0.046, +1.7 points of replay win at p = 0.031, and -5.0 points of replay poisoning at p = 0.064.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor CAPTURE, ledger promotion was 88.2% [85.4, 90.8] and output adherence was 83.5% [80.6, 86.2]; removing the safety bound left promotion unchanged at 88.2% but raised adherence to 87.5%.
“For CAPTURE specifically, ledger promotion is 88.2% with interval [85.4,90.8] while output adherence is 83.5% at [80.6, 86.2], and removing the safety bound leaves promotion unchanged at 88.2% while raising adherence to 87.5%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataJointly learning the three decay rates with the gate collapsed them toward 0.08 and reduced acceptance by 3.1 points and win rate by 1.9 points.
“Learning them jointly with f θ collapsed the three toward 0.08 and cost 3.1 points of acceptance and 1.9 of win rate.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCAPTURE scored 4.1 on satisfaction with a participant-clustered 95% interval of [3.9, 4.3], while StateMem scored 3.8 with [3.6, 4.0].
“CAPTURE scored 4.1 with a participant-clustered 95% interval of [3.9, 4.3] and StateMem 3.8 at [3.6, 4.0].”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe generation program's labels agree with adjudicated human action 83.6% of the time, and CAPTURE's action macro-F1 against human labels is 0.71 with interval [0.67, 0.75].
“The program labels agree with the adjudicated human action 83.6% of the time, and CAPTURE's action macro-F1 against the human labels is 0.71 with interval [0.67, 0.75].”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataWith ε = 0.08, κ + ε = 0.174, against 1/2(1 - TV_φ) = 0.3323.
“With ε = 0.08 from Appendix D, κ + ε = 0.174, against 1 2 (1 -TV φ ) = 0.3323.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The clarification answer accuracy of 92% against the latent label corresponds to an error ε = 0.08 in the sense of Assumption 5.
May combine two claims.
Findingown dataOn the 720 independently annotated test events, CAPTURE reached six-action macro-F1 of 0.71 [0.67, 0.75] and the supervised Transformer 0.68 [0.64, 0.72].
“On the 720 independently annotated test events, CAPTURE reaches six-action macro-F1 of 0.71 with interval [0.67, 0.75] and the supervised Transformer 0.68 at [0.64, 0.72].”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUnder independently authored attacks, attack success was 50.4% for Recency RAG, 37.1% for StateMem, 26.3% for Provenance-only, 22.5% for the supervised Transformer, and 18.3% [14.0, 23.1] for CAPTURE.
“Attack success is 50.4% for Recency RAG, 37.1% StateMem, 26.3% Provenanceonly, 22.5% for the supervised Transformer, and 18.3% with interval [14.0, 23.1] for CAPTURE.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMean pairwise evidence-set F1 was 0.82 and node-level Krippendorff's α was 0.76.
“Mean pairwise evidence-set F1 is 0.82 and node-level Krippendorff's α is 0.76.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIn the matched sample, Provenance-only's error matches the binned plug-in bound to four decimal places.
“On the matched sample Provenance-only's error equals the binned plug-in bound to four decimals.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAgainst the supervised Transformer, the win advantage was +2.2 points at [0.6, 3.9] and p = 0.011, and the poisoning advantage was -4.4 points at [-7.0, -1.9] and p = 0.003.
“Against the supervised Transformer the win advantage is +2.2 points at [0.6, 3.9] and p = 0.011, and the poisoning advantage -4.4 points at [-7.0, -1.9] and p = 0.003.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStrongREJECT attack success rates are: unpersonalized 10.6%, Full History 13.2%, Static Summary 12.5%, Recency RAG 14.6%, StateMem 12.7%, Provenance-only 11.5%, MemGPT 13.7%, CAPTURE 8.9%, Oracle-memory 4.4%.
“Attack success under StrongREJECT is 10.6% for the unpersonalized model, 13.2% Full History, 12.5% Static Summary, 14.6% Recency RAG, 12.7% StateMem, 11.5% Provenance-only, 13.7% MemGPT, 8.9% CAPTURE, and 4.4% Oracle-memory.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
Findingnone givenA quarantined claim is held, never corroborated, and decays out of the ledger.
“The claim is held, never corroborated, and decays out of the ledger.”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
Findingown dataOver paired replicates, the estimated excess is non-negative, and its one-sided 95% interval [0.0000, 0.0372] has zero at the lower endpoint.
“Across paired replicates the estimated excess is non-negative and its one-sided 95% interval [0.0000, 0.0372] includes zero at its lower endpoint.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataStatic summary attains 0.41 recurring regret, compared with 0.27 for the full system, while the ablation lacking timescale separation attains 0.32.
“Static summary reaches 0.41 recurring regret against 0.27, and the ablation without timescale separation reaches 0.32.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
Findingown dataThe full system's absolute common-pool dynamic regret is 0.27, and it rises to 0.42 when the gate is removed.
“whose absolute values are 0.27 for the full system rising to 0.42 without the gate.”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
Findingown dataThe matched split is more difficult than the aggregate, explaining why Provenance-only rejects 45.6% of genuine updates there versus the 25.9% implied by Table 1.
“The matched split is also harder than the aggregate, which is why Provenance-only rejects 45.6% of genuine updates here against the 25.9% implied by Table 1”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOn HorizonBench, CAPTURE leads only on contradiction resolution and does not lead on belief revision accuracy.
“on HorizonBench CAPTURE does not lead on belief revision accuracy at all, leading only on contradiction resolution.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRemoving the safety bound increases benign safety to 23.0% and reduces refusal to 4.8%.
“w/o safety bound -0.01 +1.0 pp +4.0 pp 23.0% 4.8% 0.77 2050 ms”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningThe quantity D_b = FUR_b + RRL_b - (1 - TV_φ,b) is non-negative across all 10,000 replicates.
“so the difference D b = FUR b + RRL b -(1 -TV φ,b ) is non-negative in all 10,000 replicates”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingnone givenAll StrongREJECT values fall within 1.4 points of their HarmBench counterparts in Table 1, with identical ordering.
“Every value lies within 1.4 points of the corresponding HarmBench figure in Table 1, and the ordering is identical.”
Quote in the paperNot a substantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
Findingown dataRemoving the authenticity gate increases common-pool dynamic regret by 0.15 and poison ASR by 22.0 pp.
“w/o authenticity gate +0.15 +22.0 pp -2.5 pp 9.5% 8.3% 0.64 1850 ms”
Quote in the paperSubstantial claim- Rests on an assumption: The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
May combine two claims.
InterpretationreasoningAn adversary can shape an injected claim's surface form to match the recency profile of a genuine revision, and a user can revise through a summarized document to match the provenance profile of an attack, so each heuristic family fails on the case the other handles.
“An adversary choosing the surface form of an injected claim can match the recency profile of a genuine revision, and a user revising through a summarized document can match the provenance profile of an attack, so each family of heuristic fails on the case the other handles.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
- The authors state this as an assumption: The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
- The authors state this as an assumption: The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
May combine two claims.
Study design and conductreasoningBecause HorizonBench is non-interactive, the clarify action resolves to quarantine without update, so that row represents CAPTURE without interactive clarification and contains no attacks.
“because it is non-interactive, clarify resolves to quarantine without update, so that row is CAPTURE without interactive clarification, and it holds no attacks.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataParticipant histories were frozen and replayed identically for every system, with six controlled attacks injected per participant that no participant saw; when the gate asks, the stored annotation answers, making the replay oracle-assisted with zero answer error.
“Their histories were then frozen and replayed identically to every system with six controlled attacks injected per participant, none of which a participant saw, and when the gate asks the stored annotation answers, making this an oracle-assisted replay with zero answer error.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe results in Table 1 were obtained on Qwen3-8B and Llama-3.1-8B with three random seeds per model, so each reported cell averages six runs.
“in Table 1 was run on Qwen3-8B and Llama-3.1-8B with three seeds each, so those cells average six runs.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataSatisfaction was measured in a separate blinded within-participant rating task using four matched output pairs per session, with identity, order, and side randomized.
“Satisfaction came from a separate blinded withinparticipant rating task, four matched output pairs per session with identity, order, and side randomized”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationHorizonBench tracks 360 simulated users whose preferences evolve over about six months and separates retrieval failures from belief-update failures by design.
“HorizonBench (Li et al., 2026) tracks 360 simulated users whose preferences evolve across roughly six months and separates retrieval from belief-update failures by construction.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Li et al., 2026
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataThe user study uses naturally generated histories, with contamination introduced only during offline replay, so it tests transfer to natural histories rather than to independently generated attacks.
“The user study supplies naturally generated histories, into which we introduce contamination only during offline replay, so it tests transfer to natural histories and not to independently generated attacks.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataOn a 600-comparison subset, the LLM judge matches three human raters 87.4% of the time, versus 91.2% agreement among the raters themselves.
“on a 600-comparison subset the judge agrees with three human raters 87.4% of the time, against 91.2% among the raters themselves.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataMuch of the improvement comes from supervision, and the architecture accounts for the remainder.
“Supervision therefore explains much of the improvement and the architecture the rest.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningA stable node can only be overwritten by repeated high-confidence evidence, not a single assertion, which prevents one sentence from redefining a user.
“Overwriting a stable node requires repeated high-confidence evidence rather than a single assertion, which is what stops one sentence from redefining a user.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationHorizonBench is an independently constructed benchmark that contains evolving preferences but no contamination.
“HorizonBench is independently constructed and holds evolving preferences but no contamination.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Li et al., 2026
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningThese results support transfer of preference tracking beyond the authors' generator, but not transfer of poisoning robustness, because the replayed contamination is author-constructed.
“These panels support transfer of preference tracking beyond our generator, though not of poisoning robustness, since the replayed contamination is author-constructed.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Premisenone givenPrior work on personalization and agent memory assumes the record is trustworthy and manages capacity rather than asking whether a memory should have been written.
“All of it assumes the record is trustworthy and manages capacity rather than asking whether a memory should have been written.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductnone givenThe development and test splits use disjoint synthetic users, topics, surface templates, and attack realizations, and one generator family is held out from training and development for test.
“Development and test partitions use disjoint synthetic users, topics, surface templates, and attack realizations, and one generator model family is excluded from training and development and reserved for test.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningWith the continuous-time dynamics, a nine-day gap substantially decays the transient layer while the stable layer barely moves, so a later contradiction meets a belief that has already discarded session-specific noise.
“Under Equation 4the transient layer decays substantially across the nine days while the stable layer barely moves, so a contradiction arriving afterwards is read against a belief that has already discarded the session-specific noise.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe authors had no role in constructing HorizonBench, and evaluation on it is strictly zero-shot.
“We had no part in building it and evaluation is strictly zero-shot”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningNo clarification F1 is defined on the replay because the four participant labels describe scope and extraction correctness and none indicates whether the assistant should have asked.
“No clarification F1 is defined on the replay, because the four participant labels describe scope and extraction correctness and none expresses whether the assistant should have asked.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe architectural gain transfers beyond the paper's generator, significantly on contradiction resolution and replay win but not on belief revision accuracy or replay poisoning.
“The gain therefore transfers beyond our generator, significantly on contradiction resolution and replay win and not on belief revision accuracy or replay poisoning, which is a modest result and the one we would most want strengthened.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataCAPTURE's action classification against human labels is numerically better than the Transformer's but not significantly so, which locates its larger downstream advantage in the ledger and temporal update rather than in per-event classification accuracy.
“so CAPTURE's action classification against human labels is numerically better and not significantly so, which locates its larger downstream advantage in the ledger and the temporal update rather than in per-event classification accuracy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningRemark 2: The rule d*_α does not depend on which dominating measure is chosen.
“The rule d ⋆ α does not depend on which one is chosen, because for any dominating ν the set {dP g /dν > dP α /dν} agrees with {p > q} up to a λ-null set”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataGenerated episodes were human-validated on a 300-episode subset, with agreement reported in Appendix D.
“Generated episodes were human-validated on a 300-episode subset with the agreement reported in Appendix D”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningRemark 5: Assumption 5 fixes a single ε for all histories and all α, which grants the ask channel an accuracy that no function of H need achieve.
“Assumption 5 fixes a single ε for all histories and all α, which grants the ask channel an accuracy that no function of H need achieve.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The agent may take a third action, ask, which incurs a fixed cost κ > 0 and returns a label through a binary symmetric channel with error ε ∈ [0, 1/2), conditionally independent of H given Z.
May combine two claims.
Interpretationown dataCAPTURE and Provenance-only are not reliably separated on adaptive attack success, and what distinguishes them is adherence at 83.5% versus 74.1%.
“The two are therefore not reliably separated on adaptive attack success, and what distinguishes them is adherence at 83.5% against 74.1%.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningA discriminator that fails to separate the two laws provides no certification, because the failure could be the discriminator's own.
“A discriminator that fails to separate the two laws certifies nothing, since the failure may be its own.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenAdaptive attack remains open, and there the advantage over a provenance filter is not reliably separated.
“Adaptive attack remains open, and there our advantage over a provenance filter is not reliably separated.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningRemark 4: An unrestricted policy may act on (G, Z) jointly rather than on Z alone, and its conditional error after asking is at most min{e, ε}, which can be strictly smaller.
“An unrestricted policy may act on (G, Z) jointly rather than on Z alone, and its conditional error after asking is E Z [min{Pr(Z = a | G, Z), 1 -Pr(Z = a | G, Z)}] ≤ min{e, ε}, which can be strictly smaller.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The agent may take a third action, ask, which incurs a fixed cost κ > 0 and returns a label through a binary symmetric channel with error ε ∈ [0, 1/2), conditionally independent of H given Z.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe safety constraint in Section 3.4 is architecturally separate from the preference model and cannot be lowered by anything a user or an attacker writes.
“the safety constraint in Section 3.4 is architecturally separate from the preference model and cannot be lowered by anything a user or an attacker writes”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe comparison of κ + ε with 1/2(1 - TV_φ) is illustrative and not a checked instantiation of Equation 23, because the theorem's cost is in zero-one loss units while κ is a normalized utility difference and the two scales are not established to coincide.
“We present this as an illustrative comparison and explicitly not as a checked instantiation of Equation 23, for two reasons.The theorem's cost is in the units of zero-one loss while κ is a normalized utility difference, and we have not established that the two scales coincide, so the sum κ + ε is not the quantity the theorem constrains.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The clarification answer accuracy of 92% against the latent label corresponds to an error ε = 0.08 in the sense of Assumption 5.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenCAPTURE is text-only and does not address weight-level poisoning, and the clarification budget is tuned on the authors' data.
“CAPTURE is text-only and does not address weight-level poisoning, and the clarification budget is tuned on our data.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningCorollary 1: The Bayes risk over G-measurable rules is R*_π = (1-π) - ν+(H), and at π = 1/2 it reduces to R* = 1/2(1 - TV(P_g|G, P_α|G)).
“The Bayes risk over G-measurable rules is R ⋆ π = (1 -π) -ν + (H), ν = (1 -π)P g -πP α G ,(15) and at π = 1 2 this reduces to R ⋆ = 1 2 (1 -TV(P g | G , P α | G )).”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
Classified as probably not a substantial claim.
Study design and conductnone givenThe authors construct a dedicated matched split pairing each adversarial episode with a genuine episode agreeing on topic, contradicted node type, and turn index.
“We construct a dedicated matched split pairing each adversarial episode with a genuine episode agreeing on topic, contradicted node type, and turn index.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataD-PREFGUARD is synthetic and validated on a 300-episode subset, so its absolute numbers are relative comparisons rather than deployment estimates.
“D-PREFGUARD is synthetic and validated on a 300-episode subset, so absolute numbers are relative comparisons rather than deployment estimates.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationown dataThe gap between ledger promotion and output adherence, and its sensitivity to a downstream component, is why adherence is named as an output-level quantity.
“The gap between the two, and its sensitivity to a downstream component, is exactly why adherence is named as an output-level quantity.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningMatching changes the estimand to a conditional distance averaged over strata, and because turn index partly determines r_t, the matched distance is expected to be smaller than the deployment distance.
“Matching changes the estimand to a conditional distance averaged over strata, and because turn index partly determines r t the matched distance is expected to be smaller than the deployment distance.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe reference implementation is configured not to persist hypotheses concerning protected attributes, enforced by a schema constraint on the extractor rather than by a learned behavior.
“the reference implementation is configured not to persist hypotheses concerning protected attributes, enforced by a schema constraint on the extractor rather than by a learned behavior”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenAll numerical claims in Section 5 were computed by scripts written by the authors and verified independently by two authors.
“all numerical claims in Section 5 were computed by scripts the authors wrote and verified independently by two authors”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenAn agent that trusts its memory can be rewritten by anyone who reaches it, and one that distrusts it stops learning.
“An agent that trusts its memory can be rewritten by anyone who reaches it, and one that distrusts it stops learning.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe first is a property of the estimand and the second of the estimator, and neither effect is hidden by the reported quantities.
“The first is a property of the estimand and the second of the estimator, and neither effect is hidden by the reported quantities.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThese are one problem, no fixed rule on recency or provenance resolves it, and inferring authenticity as a latent variable improves both axes at once.
“These are one problem, no fixed rule on recency or provenance resolves it, and inferring authenticity as a latent variable improves both axes at once.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningEstimates at α_0 bound TV(P_g|G, P_α0|G) and say nothing directly about δ_G.
“estimates at α 0 bound TV(P g | G , P α0 | G ) and say nothing directly about δ G .”
Quote in the paperSubstantial claim- The authors state this as an assumption: The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenTheorem 2 constrains only σ(φ)-measurable rules, says nothing about a heuristic reading a third fixed feature, and depends on Assumption 4 granting the adversary the visible transcript.
“Theorem 2 constrains only σ(φ)-measurable rules, says nothing about a heuristic reading a third fixed feature, and depends on Assumption 4 granting the adversary the visible transcript.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe binned plug-in estimate of the distance is neither an upper nor a lower bound on the population value, because binning and finite-sample bias act in opposite directions, so it cannot certify the inequality.
“Separately, the binned plug-in estimate of the distance is neither an upper nor a lower bound on the population value, since binning and finite-sample bias act in opposite directions, so it cannot certify that the inequality holds.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenThe plug-in estimator of a total variation distance is upward biased in finite samples by Jensen's inequality.
“the plug-in estimator of a total variation distance is upward biased in finite samples by Jensen's inequality.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataQuery access is worth roughly 1.5 points of win rate and 4.3 points of poisoning resistance to StateMem, a real gain that does not account for CAPTURE's remaining margin.
“Query access is therefore worth roughly 1.5 points of win rate and 4.3 points of poisoning resistance to StateMem, which is a real gain and does not account for CAPTURE's remaining margin.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningTwo distinct effects act here and they do not cancel.
“Two distinct effects act here and they do not cancel.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningRemark 1: The worst-case bound is a maximin value, not a value; equality is attained by d*_α, which depends on α and is therefore unavailable to a defender who does not know the adversary's policy.
“Equality in Equation 11 is attained by d ⋆ α , which depends on α and is therefore unavailable to a defender who does not know the adversary's policy.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
May combine two claims.
Study design and conductreasoningThe aggregate Poison ASR and genuine-update adherence rate columns of Table 1 are not a matched pair, since they are computed over different tracks with different claim distributions, and must not be substituted into Equation 11.
“The aggregate Poison ASR and genuine-update adherence rate columns of Table 1 are not such a pair, since they are computed over different tracks with different claim distributions, and must not be substituted into Equation 11.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningHorizonBench reduces but does not remove this concern, since its trajectories are simulated even where annotations are human, and 40 participants supports an effect estimate but no subgroup claim.
“Horizon-Bench reduces that without removing it, since its trajectories are simulated even where annotations are human, and 40 participants supports an effect estimate but no subgroup claim.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataMost of the gain comes from supervised temporal tracking, which a matched Transformer also reaches; the ledger and continuous-time update add a smaller increment that survives on independently built data.
“Most of that gain comes from supervised temporal tracking, which a matched Transformer also reaches; the ledger and continuous-time update add a smaller increment that survives on independently built data.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenEvery quantity in Appendix A.6 is computed against the single adversary policy realized in D-PREFGUARD, denoted α_0.
“Every quantity below is computed against the single adversary policy realized in D-PREFGUARD, which we write α 0 .”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningTheorem 3: For every α and every pair of sub-σ-algebras G ⊆ G', TV(P_g|G, P_α|G) ≤ TV(P_g|G', P_α|G'), and consequently δ_G ≤ δ_G'.
“For every α ∈ A and every pair of sub -σ-algebras G ⊆ G ′ ⊆ Σ H , TV P g | G , P α | G ≤ TV P g | G ′ , P α | G ′ ,(16) and consequently δ G ≤ δ G ′ .”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
- The authors state this as an assumption: The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningSynthetic and external results use user-level paired bootstrap with 10,000 resamples for 95% intervals, resampling users rather than episodes so that repeated episodes from one simulated user do not count as independent evidence.
“Synthetic and external results use user-level paired bootstrap with 10,000 resamples for 95% intervals, resampling users rather than episodes so that repeated episodes from one simulated user do not count as independent evidence.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataNo evaluation user appears in the preference reward model's training data, its test portion uses the held-out generator family, and it never receives the latent state as input.
“No evaluation user appears in its training data, its test portion uses the held-out generator family, held-out pair accuracy is 79%, and it never receives the latent state as input.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe data leave a positive empirical gap unresolved, which does not constitute evidence of population equality or optimality.
“The data therefore do not resolve a positive empirical gap, which is not evidence of population equality or optimality.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenAll sessions used the same fixed neutral assistant, Qwen3-8B-Instruct without persistent personalization, held constant across participants and sessions, so no later-compared system shaped the histories it would be evaluated on.
“Every session ran against one fixed neutral assistant, Qwen3-8B-Instruct with no persistent personalization, held constant across all participants and sessions, so that no system under later comparison shaped the histories it would be evaluated on.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe diagnostic discriminator shares no parameters with CAPTURE.
“It shares no parameters with CAPTURE.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenElsewhere the paper uses paired randomization tests with 10,000 permutations, corrected across comparisons within each table by the Holm procedure.
“Elsewhere we use paired randomization tests with 10,000 permutations, corrected across the comparisons within each table by the Holm procedure.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe distance is estimated after binning; the plug-in estimator is biased; non-negativity is imposed by the inequality rather than observed; and equality would also require Provenance-only to match the empirical likelihood-ratio decision in every cell, which has not been demonstrated.
“The distance is estimated after binning, the plug-in estimator is biased, non-negativity is imposed by the inequality itself rather than observed, and equality would additionally require Provenance-only to match the empirical likelihoodratio decision in every cell, which we have not shown.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenHuman-study results use participant-clustered bootstrap, resampling participants rather than sessions, and within-participant comparisons throughout.
“Human-study results use participant-clustered bootstrap, resampling participants rather than sessions, and within-participant comparisons throughout.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationown dataThe 720 annotated events are stratified to 144 per track and 120 per action, which is appropriate for macro-F1 but deliberately does not reproduce the natural prevalence of the six actions, so the agreement figures should not be read as prevalence-weighted accuracy.
“They are stratified to 144 per track and 120 per action, which is appropriate for macro-F1 but deliberately does not reproduce the natural prevalence of the six actions, so the agreement figures should not be read as a prevalence-weighted accuracy.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe test partition uses Llama-3.1-70B-Instruct, a family held out from training and development, so it measures generalization across generator families rather than within one.
“Test uses Llama-3.1-70B-Instruct, a family excluded from training and development and reserved for test, so the test partition measures generalization across generator families rather than within one.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThree annotators labeled a 300-episode subset for track membership and changepoint position, achieving Krippendorff's α of 0.73 for track and 0.70 for changepoint, with a fourth rater adjudicating disagreements.
“Three annotators labeled a 300-episode subset for track membership and changepoint position, reaching Krippendorff's α = 0.73 on track and 0.70 on changepoint, with disagreements adjudicated by a fourth rater.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataTwelve external red-teamers with no access to D-PREFGUARD templates authored 240 attacks, 80 per family.
“Twelve external red-teamers with no access to D-PREFGUARD templates authored 240 attacks, 80 per family.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Study design and conductnone givenDuring replay, preference evidence comes only from user-originated content; assistant utterances never become evidence.
“Only user-originated content creates preference evidence during replay; assistant utterances never become evidence.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe evaluation reward model was trained on disjoint users, responses, and generator families, and no system reads it at inference, which separates the metric from the objective.
“A second model of the same architecture trained on disjoint users, responses, and generator families.No system reads it at inference, which is what separates the metric from the objective.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenData splits are disjoint by user, topic, attack template, and generator family.
“Splits are disjoint by user, topic, attack template, and generator family.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThe judge used GPT-4.1 at a pinned dated version, temperature 0, one judgment in each response order, with method names hidden, refusals visible as response text, and safety labels hidden.
“GPT-4.1 at a pinned dated version, temperature 0, one judgment in each response order, method names hidden, refusals visible as response text, and safety labels hidden.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe adaptive attacker's probabilities are surrogate estimates from a local copy of the released weights rather than readings from the deployed system, which keeps the experiment within Assumption 4 and makes it a released-weight hidden-state-surrogate attack rather than full state-aware white-box optimization.
“The probabilities are therefore surrogate estimates rather than readings from the deployed system, which keeps the experiment inside Assumption 4, and the correct description is a released-weight hidden-state-surrogate attack rather than full state-aware white-box optimization.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The adaptive attacker's surrogate probabilities, computed from a local copy of the released weights, are adequate for evaluating attack success against the deployed system (Assumption 4).
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThese four labels capture the scope of a valid preference and extraction correctness; none indicates whether the assistant should have asked before updating, so they do not define an ambiguity target, and no clarification F1 is computed on the replay.
“These four labels describe the scope of a valid preference and the correctness of extraction, and none of them expresses whether the assistant should have asked before updating, so they do not define an ambiguity target and no clarification F1 is computed on the replay.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenAll 720 annotated events come from the frozen test partition and cover all 96 test users, with none drawn from training or development.
“All 720 come from the frozen test partition and cover all 96 test users, with none drawn from training or development.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe independently authored attack analysis uses a crossed two-way resample over red-teamer and target user, with method outputs for a given attack kept paired within each replicate.
“its intervals require a crossed two-way resample over red-teamer and target user, with method outputs for a given attack kept paired within each replicate.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe unpersonalized model never writes injected preferences, so its zero poisoning rate is a trivial control.
“The unpersonalized model never writes injected preferences, so its zero is a trivial control.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningOracle-memory's poisoning rate is zero by construction because it observes the attack label, making it a diagnostic ceiling rather than an estimated defense result.
“Oracle-memory's poisoning rate is zero by construction, since it observes the attack label, so it is a diagnostic ceiling rather than an estimated defense result”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThe safety threshold τ_safe = 0.35 was chosen to reach at least 95% harmful-response recall while maximizing benign acceptance, and was frozen before any D-PREFGUARD test evaluation.
“The threshold τ safe = 0.35 was chosen to reach at least 95% harmful-response recall while maximizing benign acceptance, and frozen before any D-PREFGUARD test evaluation.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenAt the end of each session, participants labeled each extracted preference as genuine, temporary, context-specific, or incorrect, providing ground truth for the genuine-update adherence rate and the false-update rate.
“At each session's end participants labeled every extracted preference as genuine, temporary, context-specific, or incorrect, which supplies the ground truth for the genuine-update adherence rate and the false-update rate.”
Quote in the paperSubstantial claim- Rests on an assumption: The user study participants' labels (genuine, temporary, context-specific, incorrect) accurately capture the ground truth of preference validity.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningBecause the comparator is the best member of a finite oracle-conditioned pool rather than the best possible response, the regret metric is a finite-pool approximation to the comparator in Equation 1.
“Because the comparator is the best member of a finite oracle-conditioned pool rather than the best possible response, this is a finite-pool approximation to the comparator in Equation 1 and we name it accordingly.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The finite oracle-conditioned pool of 32 candidates is an adequate approximation to the comparator in Equation 1.
May combine two claims.
Study design and conductreasoningThe test relies on the fixed-adversary inequality rather than the worst-case form, because the split realizes a single adversary policy.
“The test uses the fixed-adversary inequality and not the worst-case form, since the split realizes one adversary policy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationown dataThe measured cost of asking is well inside the range where the theorem's mechanism would operate, which is weaker than a verification.
“What the comparison does show is that the measured cost of asking is well inside the range where the theorem's mechanism would operate, which is weaker than a verification and is all we claim.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningSince binning can only lower the population distance and the plug-in estimator is upward biased, a violation indicates a mis-paired split or a rule reading outside φ only once both effects are accounted for.
“And because binning can only reduce the population distance while the plug-in estimator is upward biased, a violation is evidence of a mis-paired split or of a rule reading outside φ only after both effects are accounted for.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataSatisfaction was collected in a separate blinded within-participant task rather than during interaction, with method identity hidden and left-right placement and presentation order independently randomized.
“Satisfaction was collected in a separate blinded within-participant task rather than during interaction.All 40 participants rated four matched output pairs sampled from each completed session, with method identity hidden and left-right placement and presentation order independently randomized.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe adaptive attacker never queries the deployed gate and never reads its logits or realized hidden state.
“The attacker never queries the deployed gate and never reads its logits or realized hidden state.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataDuring replay, histories were frozen and identical evidence was replayed to every system, and no participant was exposed to any of the six controlled attacks injected per participant.
“Histories were frozen and identical evidence replayed to every system.Six controlled attacks were injected per participant during replay, two from each family, for 240 in total, and no participant was exposed to any of them.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningWhen the gate asks during replay, the stored participant annotation answers, so the replay is oracle-assisted with ε = 0 relative to those annotations, and the realized query rate is 7.1%.
“When the gate asks during replay the stored participant annotation answers, so the replay is oracle-assisted with ε = 0 relative to those annotations, and the realized query rate is 7.1%.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningClarification labels are constructed only from the ambiguity at the current event and the current oracle state, with no future event text entering label construction or training.
“Clarification labels are constructed from the ambiguity present at the current event and the current oracle state only; no future event text enters either label construction or training”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenIn each bootstrap replicate, users are resampled with genuine and adversarial episodes kept paired, and FUR, RRL, and TV φ are recomputed from that replicate.
“Each bootstrap replicate resamples users while keeping genuine and adversarial episodes paired, then recomputes FUR, RRL, and TV φ from that same replicate”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenAnnotators saw the raw history, target prompt, response, and anonymized candidate nodes in randomized order, and did not see method names, model citations, influence scores, counterfactual results, or retrieval rank.
“Annotators saw the raw history, the target prompt, the response, and anonymized candidate nodes in randomized order, and did not see method names, model citations, influence scores, counterfactual results, or retrieval rank.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataAction labels for gate supervision came from structured track metadata and the generation program's oracle update rules, and were not validated by humans at the event level during construction, since the 300-episode validation covered only track membership and changepoint position.
“Action labels come from the structured track metadata and the oracle update rules of the generation program.They were not validated by humans at the event level during construction, since the 300-episode validation covers track membership and changepoint position only.”
Quote in the paperNot a substantial claim- Rests on an assumption: The generation program's oracle update rules provide valid action labels for gate supervision.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataAppendix I does not include StateMem among the baselines for that track, so the scope statistic and the regret figures are two separate measurements, not one decomposition.
“StateMem is not among the baselines Appendix I reports on that track, so the scope statistic and the regret figures are two measurements rather than one decomposition.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe paper reports three training seeds and gives intervals rather than isolated significance claims wherever the sample is small enough that a p-value would mislead.
“We report three training seeds and give intervals rather than isolated significance claims wherever the sample is small enough that a p-value would mislead.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe two calibration error figures for CAPTURE and the Transformer are directly comparable because both predict the same six actions against the same labels, which is not true of the heuristic baselines.
“These two are directly comparable because both predict the same six actions against the same labels, which is not true of the heuristic baselines and is why no calibration column appears in Table 1.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningBecause 240 attacks are evaluated against 96 test users, each user is targeted about 2.5 times and dependence exists on both the authoring and target axis, so red-teamer clustering alone would understate it.
“Because 240 attacks are evaluated against 96 test users, each user is targeted about 2.5 times and dependence exists on both the authoring and the target axis, so red-teamer clustering alone would understate it.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductown dataThree annotators uninvolved in benchmark construction labeled 720 candidate events without access to generator metadata.
“Three annotators uninvolved in benchmark construction labeled 720 candidate events without access to generator metadata.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenAll methods receive the event text, a coarse origin label, and a timestamp, but none receives the track label, changepoint position, or ground-truth user state.
“Every method sees the event text, its coarse origin label, and its timestamp.No method sees the track label, the changepoint position, or the ground-truth user state.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe AUC target is derived from the annotation, not from the score, which prevents circularity.
“The target comes from the annotation rather than from the score, since defining it by thresholding |Inf(n)| would make the measure circular.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenHarmBench and StrongREJECT were used for evaluation only and never for selection.
“HarmBench and StrongREJECT are used for evaluation only and never for selection.”
Quote in the paperSubstantial claim
The authors state this as an assumption.
The attacker controls at least one channel the agent reads and can see the visible transcript with its timestamps and source labels.
“The adversary controls at least one channel the agent reads, in practice a retrieved document, a shared file, or a tool response, and observes the visible transcript with its timestamps and source labels.”
The authors state this as an assumption.
The attacker knows the defense, including the released weights, and writes grammatical, plausible claims.
“It knows the defense, including the released weights, and writes grammatical, plausible claims, which excludes surface anomaly detection.”
The authors state this as an assumption.
The attacker cannot alter weights, read the private ledger, or see the gate's current belief.
“It cannot modify weights, read the private ledger, or observe the gate's current belief.”
The authors state this as an assumption.
Safety is not a preference the user may revise, so the safety constraint sits outside the objective.
“the constraint sits outside the objective because safety is not a preference the user may revise.”
The authors state this as an assumption.
The restricted view φ is measurable with respect to the σ-algebras on H and Φ.
“Assumption 1 (Measurability of the view).φ is Σ H /Σ Φ -measurable.”
The authors state this as an assumption.
The rule under analysis is measurable with respect to σ(φ) and may not condition on any other function of the history H.
“Assumption 2 (Restricted access).The rule under analysis is σ(φ)-measurable and may not condition on any other function of H.”
The authors state this as an assumption.
The latent label Z = g holds exactly when the user's intended preference has genuinely changed, the change affects the component that node n encodes, the user expresses or confirms the change, and an oracle ledger would add, revise, or rescope n.
“Assumption 3 (Legitimate update).Z = g holds exactly when the user's intended preference has genuinely changed, the change affects the stable, contextual, or transient component that n encodes, the user expresses the change at turn t or confirms it subsequently, and an oracle ledger would add, revise, or rescope n in consequence.”
The authors state this as an assumption.
The adversary observes the visible transcript, its timestamps, and visible source labels; knows the architecture, algorithm, hyperparameters, and released adapter weights; does not observe the private ledger, latent user state, gate confidence, or random seeds; may choose injection timing and content; cannot impersonate an authenticated user and cannot corrupt the answer to a clarifying question.
“Assumption 4 (Adversary).The adversary observes the visible transcript, its timestamps, and the visible source labels.”
The authors state this as an assumption.
The distribution P_g does not depend on the adversary policy α.
“We further assume that P g does not depend on α.”
The authors state this as an assumption.
The feasible set of adversary policies A is non-empty.
“Write A for the feasible set, assumed non-empty”
The authors state this as an assumption.
The agent may take a third action, ask, which incurs a fixed cost κ > 0 and returns a label through a binary symmetric channel with error ε ∈ [0, 1/2), conditionally independent of H given Z.
“Assumption 5 (Clarification channel).The agent may take a third action ask, which incurs a fixed cost κ > 0 in the units of the zero-one loss and returns a label Z through a binary symmetric channel, meaning Pr( Z ̸ = Z | Z = g) = Pr( Z ̸ = Z | Z = a) = ε ∈ [0, 1 2 ),(20) with Z conditionally independent of H given Z.”
The authors state this as an assumption.
The adaptive attacker's surrogate probabilities, computed from a local copy of the released weights, are adequate for evaluating attack success against the deployed system (Assumption 4).
“which keeps the experiment inside Assumption 4”
The authors state this as an assumption.
The clarification answer accuracy of 92% against the latent label corresponds to an error ε = 0.08 in the sense of Assumption 5.
“giving ε = 0.08 in the sense of Assumption 5”
The paper relies on this without support.
The generation program's oracle update rules provide valid action labels for gate supervision.
“Action labels come from the structured track metadata and the oracle update rules of the generation program.”
The authors state this as an assumption.
The finite oracle-conditioned pool of 32 candidates is an adequate approximation to the comparator in Equation 1.
“this is a finite-pool approximation to the comparator in Equation 1”
The paper relies on this without support.
The three attack families (indirect injection, poisoned summary, same-origin) are representative of real memory poisoning attacks.
“T3 episodes carry one to three attempts each, and the track holds 160 indirect-injection, 160 poisoned-summary, and 160 same-origin episodes”
“Same-origin episodes are built by user-mediated laundering as described in Section 4, never by impersonation.”
The paper relies on this without support.
The user study participants' labels (genuine, temporary, context-specific, incorrect) accurately capture the ground truth of preference validity.
“At each session's end participants labeled every extracted preference as genuine, temporary, context-specific, or incorrect, which supplies the ground truth for the genuine-update adherence rate and the false-update rate.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Reported per-turn cost conflicts with the latency table
MinorThe paper calls roughly 630 ms the method's per-turn cost, but Appendix B reports CAPTURE's per-turn latency as 2,480 ms. The 630 ms figure equals the difference between CAPTURE and the version without its gate, not the reported full-system latency.
“We also report what the method costs, roughly 630 ms per turn,”
“Tokens and latency per turn.CAPTURE 2,480 ms and 3,850 tokens; without the gate 1,850 and 3,200;”
StateMem does not degrade by 6.3-6.8 points on independent attacks
MinorThe claim covers four of the five methods other than Recency RAG. Table 2 puts StateMem at 34.8% fixed-policy and 37.1% independent attack success, an increase of only 2.3 points.
“four of the five methods degrade by 6.3 to 6.8 points while Recency RAG, which mounts no defense, moves slightly the other way.”
“StateMem 34.8% 37.2% [32.6, 42.0] 37.1%”
Independent-attack interval is both pending and reported
MinorTable 2 says independent-attack intervals were omitted pending a crossed two-way resample. Appendix E nevertheless reports an interval for CAPTURE's independently authored attack result and describes the crossed two-way bootstrap used for those intervals.
“independent-attack intervals are omitted pending the crossed two-way resample rather than reported under a clustering that understates the dependence.”
“18.3% with interval [14.0, 23.1] for CAPTURE.”
Cites
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228 · cited 1× · see citing works
“Hypotheses live as nodes in a directed graph over a vector store (Johnson et al., 2021), with edges recording support and contradiction.”
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149 · see citing works
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435 · cited 1× · see citing works
“We report no calibration column, since C APTURE ’s confidence is a distribution over six memory actions while the baselines expose a response likelihood, and a calibration error spanning both would not be comparable (Naeini et al., 2015; Guo et al., 2017).”
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · cited 1× · see citing works
“Alignment from human feedback fits a single population preference (Ouyang et al., 2022; Rafailov et al., 2023), and a growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et…”
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 1× · see citing works
“We report three training seeds, user-level paired bootstrap 95% intervals, and paired randomization tests with Holm correction, with full hyperparameters in Appendix B. Baselines span the two families of Section 1 plus a retrieval-augmented middle (Lewis et al., 2020; Packer et al., 2023).”
Jain, S., & Wallace, B. C. (2019) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n19-1357 · Cited by 2,287 · cited 1× · see citing works
“For interpretability we do not report attention or retrieval rank, both of which are known to be unreliable as explanations (Jain and Wallace, 2019; Wiegreffe and Pinter, 2019; Turpin et al., 2023).”
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187 · cited 2× · see citing works
“Persistent memory lets an assistant learn that a reviewer wants terse feedback, that an engineer writes Rust and not Go, and that a clinician wants citations attached to every claim (Park et al., 2023; Packer et al., 2023; Zhong et al., 2024).”
Neural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097 · cited 2× · see citing works
“It holds a latent belief h t evolving in continuous time between events, in which neither the event embedding nor absolute time appears, so the between-event flow is autonomous and time enters only through the integration interval ∆ t (Chen et al., 2018; Kidger et al., 2020).”
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061 · cited 1× · see citing works
“Instead, for each ledger node n i the agent cites, we re-decode with that node removed and measure the shift in utility, following the counterfactual tradition in explanation (Wachter et al., 2018; Verma et al., 2024).”
Obtaining well calibrated probabilities using Bayesian binning
Pakdaman Naeini, M., Cooper, G., & Hauskrecht, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9602 · Cited by 991 · cited 1× · see citing works
“We report no calibration column, since C APTURE ’s confidence is a distribution over six memory actions while the baselines expose a response likelihood, and a calibration error spanning both would not be comparable (Naeini et al., 2015; Guo et al., 2017).”
Attention is not not Explanation
Wiegreffe, S., & Pinter, Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1002 · Cited by 966 · cited 1× · see citing works
“For interpretability we do not report attention or retrieval rank, both of which are known to be unreliable as explanations (Jain and Wallace, 2019; Wiegreffe and Pinter, 2019; Turpin et al., 2023).”
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Rafailov, R., Sharma, A., Mitchell, E., Manning, C. D., Ermon, S., & Finn, C. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2338 · Cited by 686 · cited 1× · see citing works
“Alignment from human feedback fits a single population preference (Ouyang et al., 2022; Rafailov et al., 2023), and a growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et…”
Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., & Fritz, M. (2023) · Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3605764.3623985 · Cited by 667 · cited 4× · see citing works
“Indirect prompt injection turns retrieved content into instructions (Greshake et al., 2023), and the agent setting has produced benchmarks (Zhan et al., 2024; Debenedetti et al., 2024) and attacks targeting retrieval and memory (Zou et al., 2025; Chen et al., 2024; Dong et al., 2025; Wang et al.,…”
InfluentialBayesian Online Changepoint Detection
Adams, R. P., & MacKay, D. J. C. (2007) · arXiv · doi:10.48550/arxiv.0710.3742 · Cited by 601 · cited 1× · see citing works
“The gate is a learned alternative to Bayesian changepoint detection (Adams and MacKay, 2007), differing in that it must decide not only whether the process changed but whether the evidence was authored by the user.”
Safety Alignment Should Be Made More Than Just a Few Tokens Deep
Qi, X., Panda, A., Lyu, K., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2406.05946 · Cited by 535 · cited 1×
“Safety alignment is shallow in the token dimension (Qi et al., 2025), breakable by optimized suffixes (Zou et al., 2023), and fragile under fine-tuning (Qi et al., 2024), which argues for keeping the constraint outside anything a user can revise (Bai et al., 2022), and our selector is a…”
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505 · cited 1× · see citing works
“1-8B-Instruct (Yang et al., 2025; Grattafiori et al., 2024), with the extractor and gate built on Qwen2.”
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K., Dickerson, J. P., & Shah, C. S. (2024) · ACM Computing Surveys · doi:10.1145/3677119 · Cited by 456 · cited 1× · see citing works
“Instead, for each ledger node n i the agent cites, we re-decode with that node removed and measure the shift in utility, following the counterfactual tradition in explanation (Wachter et al., 2018; Verma et al., 2024).”
A StrongREJECT for Empty Jailbreaks
Souly, A., Lu, Q.-Y., Bowen, D., et al. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2402.10260 · Cited by 455 · cited 5×
“…a separate classifier that never sees the ledger, and the Safety column is attack success on track T4 under HarmBench (Mazeika et al., 2024), with StrongREJECT (Souly et al., 2024) within 1.4 points on every method in Appendix C and XSTest (R¨ottger et al., 2024) supplying the false refusal column.”
InfluentialNon-stationary stochastic optimization
Besbes, O., Gur, Y., & Zeevi, A. (2015) · Operations Research · doi:10.1287/opre.2015.1408 · Cited by 337 · see citing works
Bai, Y., Kadavath, S., Kundu, S., Askell, A., Kernion, J., Jones, A., Chen, A., Goldie, A., Mirhoseini, A., & Kaplan, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.08073 · Cited by 326 · cited 1× · see citing works
“…is shallow in the token dimension (Qi et al., 2025), breakable by optimized suffixes (Zou et al., 2023), and fragile under fine-tuning (Qi et al., 2024), which argues for keeping the constraint outside anything a user can revise (Bai et al., 2022), and our selector is a memory-layer analogue.”
Turpin, M., Michael, J., Perez, E., & Bowman, S. R. (2023) · arXiv · doi:10.48550/arxiv.2305.04388 · Cited by 262 · cited 1× · see citing works
“For interpretability we do not report attention or retrieval rank, both of which are known to be unreliable as explanations (Jain and Wallace, 2019; Wiegreffe and Pinter, 2019; Turpin et al., 2023).”
MemoryBank: Enhancing Large Language Models with Long-Term Memory
Zhong, W., Guo, L., Gao, Q., Ye, H., & Wang, Y. (2023) · arXiv · doi:10.48550/arxiv.2305.10250 · Cited by 253 · cited 2× · see citing works
“Persistent memory lets an assistant learn that a reviewer wants terse feedback, that an engineer writes Rust and not Go, and that a clinician wants citations attached to every claim (Park et al., 2023; Packer et al., 2023; Zhong et al., 2024).”
Neural Controlled Differential Equations for Irregular Time SeriesPreprint
Kidger, P., Morrill, J., Foster, J., & Lyons, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08926 · Cited by 199 · cited 1× · see citing works
“It holds a latent belief h t evolving in continuous time between events, in which neither the event embedding nor absolute time appears, so the between-event flow is autonomous and time enters only through the integration interval ∆ t (Chen et al., 2018; Kidger et al., 2020).”
Universal and Transferable Adversarial Attacks on Aligned Language Models
Zou, A., Wang, Z., Carlini, N., Nasr, M., Kolter, J. Z., & Fredrikson, M. (2023) · arXiv · doi:10.48550/arxiv.2307.15043 · Cited by 197 · cited 1× · see citing works
“Safety alignment is shallow in the token dimension (Qi et al., 2025), breakable by optimized suffixes (Zou et al., 2023), and fragile under fine-tuning (Qi et al., 2024), which argues for keeping the constraint outside anything a user can revise (Bai et al., 2022), and our selector is a…”
InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents
Zhan, Q., Liang, Z., Ying, Z., & Kang, D. (2024) · Findings of the Association for Computational Linguistics: ACL 2024 · doi:10.18653/v1/2024.findings-acl.624 · Cited by 147 · see citing works
InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents
Zhan, Q., Liang, Z., Ying, Z., & Kang, D. (2024) · arXiv · doi:10.48550/arxiv.2403.02691 · Cited by 143 · cited 2×
“Personalization benchmarks hold preference signal but no attacks (Salemi et al., 2024; Zollo et al., 2025; Guo et al., 2026), and injection benchmarks hold attacks but a static user (Zhan et al., 2024; Debenedetti et al., 2024).”
Latent ODEs for Irregularly-Sampled Time SeriesPreprint
Rubanova, Y., Chen, R. T. Q., & Duvenaud, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03907 · Cited by 135 · cited 1× · see citing works
“Latent dimension 256. f θ is a three-layer MLP with tanh activations integrated by a Dormand-Prince solver at relative tolerance 10 − 3 and absolute tolerance 10 − 4 (Chen et al., 2018; Rubanova et al., 2019), with a GRU cell for the discrete update on event arrival.”
Qwen, :, Yang, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Li, C., Liu, D., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.15115 · Cited by 128 · cited 1× · see citing works
“5-3B (Yang et al., 2024) using LoRA adapters on four A100 80GB GPUs.”
Yang, A., Li, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Gao, C., Huang, C., Lv, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.09388 · Cited by 111 · cited 1× · see citing works
“1-8B-Instruct (Yang et al., 2025; Grattafiori et al., 2024), with the extractor and gate built on Qwen2.”
LaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2023) · arXiv · doi:10.48550/arxiv.2304.11406 · Cited by 109 · cited 5× · see citing works
“…fits a single population preference (Ouyang et al., 2022; Rafailov et al., 2023), and a growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et al., 2024), and datasets…”
InfluentialLaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.399 · Cited by 109 · see citing works
Aligning to Thousands of Preferences via System Message Generalization
Lee, S., Park, S. H., Kim, S., & Seo, M. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.17977 · Cited by 105 · cited 1×
“…growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et al., 2024), and datasets recording who disagreed with whom (Kirk et al., 2024; Zollo et al., 2025; Zhang et al., 2025).”
Personalization of Large Language Models: A SurveyPreprint
Zhang, Z., Rossi, R. A., Kveton, B., Shao, Y., Yang, D., Zamani, H., Dernoncourt, F., Barrow, J., Yu, T., Kim, S., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.00027 · Cited by 99 · see citing works
Evaluating Very Long-Term Conversational Memory of LLM Agents
Maharana, A., Lee, D.-H., Tulyakov, S., Bansal, M., Barbieri, F., & Fang, Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.747 · Cited by 96 · see citing works
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
Röttger, P., Kirk, H., Vidgen, B., Attanasio, G., Bianchi, F., & Hovy, D. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.301 · Cited by 77 · see citing works
Jatmo: Prompt Injection Defense by Task-Specific Finetuning
Piet, J., Al-Rashed, M., Sitawarin, C., Chen, S., Wei, Z., Sun, E., Alomair, B., & Wagner, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70879-4_6 · Cited by 70 · see citing works
MemGPT: Towards LLMs as Operating Systems
Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2310.08560 · Cited by 64 · cited 3× · see citing works
“Persistent memory lets an assistant learn that a reviewer wants terse feedback, that an engineer writes Rust and not Go, and that a clinician wants citations attached to every claim (Park et al., 2023; Packer et al., 2023; Zhong et al., 2024).”
Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!Preprint
Qi, X., Zeng, Y., Xie, T., Chen, P., Jia, R., Mittal, P., & Henderson, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.03693 · Cited by 57 · cited 1× · see citing works
“…alignment is shallow in the token dimension (Qi et al., 2025), breakable by optimized suffixes (Zou et al., 2023), and fragile under fine-tuning (Qi et al., 2024), which argues for keeping the constraint outside anything a user can revise (Bai et al., 2022), and our selector is a memory-layer…”
Jatmo: Prompt Injection Defense by Task-Specific Finetuning
Piet, J., Alrashed, M., Sitawarin, C., Chen, S., Wei, Z., Sun, E., Alomair, B., & Wagner, D. (2023) · arXiv · doi:10.48550/arxiv.2312.17673 · Cited by 54 · cited 1×
“Defenses separate instructions from data (Chen et al., 2025; Piet et al., 2024; Hines et al., 2024) or enforce capability boundaries (Debenedetti et al., 2025), and all treat the user as static.”
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
Mazeika, M., Phan, L., Yin, X., Zou, A., Wang, Z., Mu, N., Sakhaee, E., Li, N., Basart, S., Li, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.04249 · Cited by 28 · cited 4×
“The safety risk r s is a separate classifier that never sees the ledger, and the Safety column is attack success on track T4 under HarmBench (Mazeika et al., 2024), with StrongREJECT (Souly et al., 2024) within 1.4 points on every method in Appendix C and XSTest (R¨ottger et al., 2024) supplying…”
InfluentialUnveiling Privacy Risks in LLM Agent Memory
Wang, B., He, W., Zeng, S., Xiang, Z., Xing, Y., Tang, J., & He, P. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1227 · Cited by 24 · see citing works
Unveiling Privacy Risks in LLM Agent Memory
Wang, B., He, W., Zeng, S., Xiang, Z., Xing, Y., Tang, J., & He, P. (2025) · arXiv · doi:10.48550/arxiv.2502.13172 · Cited by 23 · cited 2×
“…prompt injection turns retrieved content into instructions (Greshake et al., 2023), and the agent setting has produced benchmarks (Zhan et al., 2024; Debenedetti et al., 2024) and attacks targeting retrieval and memory (Zou et al., 2025; Chen et al., 2024; Dong et al., 2025; Wang et al., 2025).”
Kirk, H., Whitefield, A., Röttger, P., Bean, A., Margatina, K., Ciro, J., Mosquera, R., Bartolo, M., Williams, A., He, H., et al. (2024) · neural information processing systems · doi:10.52202/079017-3342 · Cited by 21 · cited 4× · see citing works
“The benchmark holds 2,400 episodes of 12 to 20 turns, seeded from PRISM, PersonalLLM, and LaMP (Kirk et al., 2024; Zollo et al., 2025; Salemi et al., 2024), across five tracks.”
InfluentialAligning LLM Agents by Learning Latent Preference from User Edits
Gao, G., Taymanov, A., Salinas, E., Mineiro, P., & Misra, D. (2024) · arXiv · doi:10.48550/arxiv.2404.15269 · Cited by 18 · cited 2×
“…et al., 2023), and a growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et al., 2024), and datasets recording who disagreed with whom (Kirk et al., 2024; Zollo et al.,…”
Aligning LLM Agents by Learning Latent Preference from User Edits
Gao, G., Taymanov, A., Salinas, E., et al. (2024) · neural information processing systems · doi:10.52202/079017-4349 · Cited by 18
HorizonBench: Long-Horizon Personalization with Evolving Preferences
Li, S., Paranjape, B., Oktar, K., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.17283 · Cited by 16
Defeating Prompt Injections by Design
Debenedetti, E., Shumailov, I., Fan, T., Hayes, J., Carlini, N., Fabian, D., Kern, C., Shi, C., Terzis, A., & Tramèr, F. (2026) · 2026 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00040 · Cited by 15 · cited 2× · see citing works
“Injection defenses refuse content whose provenance is not trusted (Chen et al., 2025; Hines et al., 2024; Debenedetti et al., 2025), which is sound when the threat is external but blind to the case that matters here, where a legitimate user revises a legitimate belief through a legitimate channel.”
AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases
Chen, Z., Xiang, Z., Xiao, C., Song, D., & Li, B. (2024) · arXiv · doi:10.48550/arxiv.2407.12784 · Cited by 10 · cited 3× · see citing works
“…prompt injection turns retrieved content into instructions (Greshake et al., 2023), and the agent setting has produced benchmarks (Zhan et al., 2024; Debenedetti et al., 2024) and attacks targeting retrieval and memory (Zou et al., 2025; Chen et al., 2024; Dong et al., 2025; Wang et al., 2025).”
StruQ: defending against prompt injection with structured queries
Chen, S., Piet, J., Sitawarin, C., & Wagner, D. (2024) · arXiv · doi:10.48550/arxiv.2402.06363 · Cited by 10 · cited 3× · see citing works
“Injection defenses refuse content whose provenance is not trusted (Chen et al., 2025; Hines et al., 2024; Debenedetti et al., 2025), which is sound when the threat is external but blind to the case that matters here, where a legitimate user revises a legitimate belief through a legitimate channel.”
Defending Against Indirect Prompt Injection Attacks With Spotlighting
Hines, K., Lopez, G., Hall, M., Zarfati, F., Zunger, Y., & Kiciman, E. (2024) · arXiv · doi:10.48550/arxiv.2403.14720 · Cited by 8 · cited 3× · see citing works
“Injection defenses refuse content whose provenance is not trusted (Chen et al., 2025; Hines et al., 2024; Debenedetti et al., 2025), which is sound when the threat is external but blind to the case that matters here, where a legitimate user revises a legitimate belief through a legitimate channel.”
Guo, Q.-Y., Li, Y.-B., Liu, Y., et al. (2026) · doi:10.48550/arxiv.2603.04191 · Cited by 8 · cited 3×
“Personalization benchmarks hold preference signal but no attacks (Salemi et al., 2024; Zollo et al., 2025; Guo et al., 2026), and injection benchmarks hold attacks but a static user (Zhan et al., 2024; Debenedetti et al., 2024).”
AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
Debenedetti, E., Zhang, J., Balunović, M., Beurer-Kellner, L., Fischer, M., & Tramèr, F. (2024) · arXiv · doi:10.48550/arxiv.2406.13352 · Cited by 7 · see citing works
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
Röttger, P., Kirk, H. R., Vidgen, B., Attanasio, G., Bianchi, F., & Hovy, D. (2023) · arXiv · doi:10.48550/arxiv.2308.01263 · Cited by 6 · cited 2×
“…a separate classifier that never sees the ledger, and the Safety column is attack success on track T4 under HarmBench (Mazeika et al., 2024), with StrongREJECT (Souly et al., 2024) within 1.4 points on every method in Appendix C and XSTest (R¨ottger et al., 2024) supplying the false refusal column.”
InfluentialEvaluating Very Long-Term Conversational Memory of LLM Agents
Maharana, A., Lee, D.-H., Tulyakov, S., Bansal, M., Barbieri, F., & Fang, Y. (2024) · arXiv · doi:10.48550/arxiv.2402.17753 · Cited by 3 · cited 2× · see citing works
“Benchmarks now measure how well assistants hold such facts across hundreds of turns (Maharana et al., 2024; Wu et al., 2025), and personalization has become a research program in its own right (Salemi et al., 2024; Zhang et al., 2025).”
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
Wu, D., Wang, H., Yu, W., Zhang, Y., Chang, K.-W., & Yu, D. (2024) · arXiv · doi:10.48550/arxiv.2410.10813 · Cited by 3 · cited 3× · see citing works
“Benchmarks now measure how well assistants hold such facts across hundreds of turns (Maharana et al., 2024; Wu et al., 2025), and personalization has become a research program in its own right (Salemi et al., 2024; Zhang et al., 2025).”
Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMs
Zhao, S., Hong, M., Liu, Y., Hazarika, D., & Lin, K. (2025) · arXiv · doi:10.48550/arxiv.2502.09597 · Cited by 3 · cited 1× · see citing works
“…practical by paging information in and out of context (Packer et al., 2023), decaying it (Zhong et al., 2024), or reflecting on it (Park et al., 2023), and benchmarks now stress them at length (Maharana et al., 2024; Wu et al., 2025; Guo et al., 2026; Zhao et al., 2025; Jiang et al., 2025).”
Memory Injection Attacks on LLM Agents via Query-Only Interaction
Dong, S., Xu, S., He, P., Li, Y., Tang, J., Liu, T., Liu, H., & Xiang, Z. (2025) · Advances in Neural Information Processing Systems 38 · doi:10.52202/085713-1554 · Cited by 3 · cited 2×
“…prompt injection turns retrieved content into instructions (Greshake et al., 2023), and the agent setting has produced benchmarks (Zhan et al., 2024; Debenedetti et al., 2024) and attacks targeting retrieval and memory (Zou et al., 2025; Chen et al., 2024; Dong et al., 2025; Wang et al., 2025).”
Jiang, B., Hao, Z., Cho, Y.-M., Li, B., Yuan, Y., Chen, S., Ungar, L., Taylor, C. J., & Roth, D. (2025) · arXiv · doi:10.48550/arxiv.2504.14225 · Cited by 1 · cited 1×
“…practical by paging information in and out of context (Packer et al., 2023), decaying it (Zhong et al., 2024), or reflecting on it (Park et al., 2023), and benchmarks now stress them at length (Maharana et al., 2024; Wu et al., 2025; Guo et al., 2026; Zhao et al., 2025; Jiang et al., 2025).”
PersonalLLM: Tailoring LLMs to Individual Preferences
Zollo, T. P., Siah, A. W. T., Ye, N., Li, A., & Namkoong, H. (2024) · arXiv · doi:10.48550/arxiv.2409.20296 · Cited by 1 · cited 5× · see citing works
“Personalization pipelines optimize for adaptation speed and treat the history as ground truth, which makes them steerable by whoever writes into it (Gao et al., 2024; Zollo et al., 2025).”
InfluentialMemory Injection Attacks on LLM Agents via Query-Only Interaction
Dong, S., Xu, S., He, P., Li, Y., Tang, J., Liu, T., Liu, H., & Xiang, Z. (2025) · arXiv · doi:10.48550/arxiv.2503.03704 · Cited by 1 · see citing works
Aligning to Thousands of Preferences via System Message Generalization
Lee, S., Park, S. H., Kim, S., et al. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2347
Flagged first, then by citations
Research works printed but not linked: 1
- Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. LoRA: Low-rank adaptation of large language models. In International Conference on Learning Representations (ICLR 2022), 2022. URL https://openreview.net/forum?id=nZeVKeeFYf9.
- Authors
- Hossain, S. M. A., Shayoni, R. K., & Morol, M. K.
- ORCID
- Morol, Md Kishor
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2609.02265
- OpenAlex
- W7207681694
- Semantic Scholar
- 6c2ef186b5091367d9c2667d2f3013a2b6f79ab7
- Cited by
- 0
- References
- 51
- Type
- posted content
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Security and Verification in Computing
- Keywords
- preference drift, memory poisoning, persistent memory, adversarial attacks, belief tracking, differential equations, partially observable Markov decision processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review