The Attribution-Compression Frontier in Retrieval-Augmented Generation

Classified as probably not a substantial claim.

Citation-grade attribution requires locatable evidence: a reader must be able to retrieve and check the cited source.

“Citation-grade attribution requires locatable evidence: a reader must be able to retrieve and check the cited source (Rashkin et al., 2023;Bohnet et al., 2022).”

• cites Rashkin et al., 2023 sourcePartly supported

  The Discussion describes verification against a known source as a necessary step, and §4.1.2 asks annotators to check a generated statement against its source document. These passages support the need for identifiable, checkable evidence, but they do not state that a reader must be able to retrieve a cited source or define a separate “citation-grade” requirement. No page numbers are available in our copy. (LLM, conf=0.84)

  Experimental — accuracy not yet measured
• cites Bohnet et al., 2022 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

ALCE's summary-context ablation illustrates a correctness-citation trade-off.

“ALCE's summary-context ablation also illustrates a correctness-citation trade-off (Gao et al., 2023); information-preservation studies examine grounding under compression (Łajewska et al., 2025), and human evaluations examine verifiability as output abstractiveness changes (Worledge et al., 2024).”

• cites Gao et al., 2023 sourceSupported

Classified as probably not a substantial claim. May combine two claims.

The QASPER context contains the supplied paper's abstract and all full-text paragraphs, sentence-segmented for compression; no top-k retrieval truncation is applied.

“The context contains the supplied paper's abstract and all full-text paragraphs, sentence-segmented for compression; no top-k retrieval truncation is applied.”

• cites Dasigi et al., 2021 sourcePartly supported

  Section 4.1 defines QASPER as answering questions from a paper’s full text, and Section 4.2 says the LED model reads the question and document without a pipelined retrieval system. But Section 4.2 says only 99% of paper full texts fit without truncation; it does not describe sentence segmentation for compression or establish that the abstract is included in the stated context. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

The AIS framework evaluates whether statements are supported by identified sources.

“The AIS framework evaluates whether statements are supported by identified sources (Rashkin et al., 2023).”

• cites Rashkin et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Attention-based explanations remain contested.

“Attention-based explanations remain contested (Jain and Wallace, 2019;Wiegreffe and Pinter, 2019).”

• cites Jain and Wallace, 2019Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wiegreffe and Pinter, 2019 sourceSupported

Classified as probably not a substantial claim. May combine two claims.

QASPER is the 1,005-question dev split over 281 NLP papers, using each supplied paper's abstract and full text.

“QASPER (Dasigi et al., 2021) is the 1,005-question dev split over 281 NLP papers, using each supplied paper's abstract and full text.”

• cites Dasigi et al., 2021 sourcePartly supported

  The Data splits section reports 1,005 questions in the validation (dev) set, and the Abstract explains that questions were written from titles and abstracts and answered using the papers’ full text. Our copy does not substantiate the claim that this split covers 281 papers; the paper gives 1,585 papers for QASPER as a whole. (LLM, conf=0.85)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim. May combine two claims.

Gold evidence on QASPER is paragraph-level, so identity presents paragraphs as citable units while compressors operate on sentence snippets; declared sids map to paragraphs for set-F1 against gold evidence, taking the maximum over annotators.

“Gold evidence is paragraphlevel, so identity presents paragraphs as citable units while compressors operate on sentence snippets; declared sids map to paragraphs for set-F1 against gold evidence, max over annotators.”

• cites Dasigi et al., 2021 sourcePartly supported

  Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

Automatic attribution and entailment evaluation inform the citation precision and recall metrics of ALCE, which the paper adapts.

“Automatic attribution and entailment evaluation (Bohnet et al., 2022;Honovich et al., 2022) inform the citation precision and recall metrics of ALCE (Gao et al., 2023), which we adapt.”

• cites Bohnet et al., 2022 sourceSupported
• cites Honovich et al., 2022Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Gao et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

QASPER provides questions over research papers with annotator-marked evidence.

“QASPER provides questions over research papers with annotator-marked evidence (Dasigi et al., 2021).”

• cites Dasigi et al., 2021 sourceSupported

Classified as probably not a substantial claim. May combine two claims.

ASQA comprises 948 ambiguous factoid questions from the ALCE release, each paired with the top-5 GTR-retrieved passages, sentence-segmented into citable snippets; answer quality is string exact match (str-EM).

“ASQA comprises 948 ambiguous factoid questions from the ALCE release (Gao et al., 2023), each paired with the top-5 GTR-retrieved passages, sentencesegmented into citable snippets; answer quality is string exact match (str-EM).”

• cites Gao et al., 2023 sourcePartly supported

  Section 2 describes ASQA as ambiguous factoid questions and says ALCE randomly selects 1,000 development-set examples, not 948. Sections 4.1 and 5.3 support GTR retrieval and a top-five-passage baseline, while §3.2 supports exact-match recall for answer quality. Section 2 says the model’s output is segmented by sentence boundaries; it does not say the retrieved passages are sentence-segmented into citable snippets. (LLM, conf=0.88)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim. May combine two claims.

Pointwise 95% percentile bootstrap intervals are used for each paired mean difference, resampling 944 questions on ASQA and 271 papers on QASPER with replacement.

“We use pointwise 95% percentile bootstrap intervals for each paired mean difference (Dror et al., 2018), resampling 944 questions on ASQA and 271 papers on QASPER with replacement.”

• cites Dror et al., 2018 sourcePartly supported

  Section 3.2.2 (page unavailable) describes paired bootstrap sampling with replacement to approximate a statistic’s sampling distribution. It discusses p-values, not pointwise 95% percentile intervals for paired mean differences. The ASQA and QASPER sample sizes describe the citing authors’ procedure, rather than a finding attributed to Dror et al. (LLM, conf=0.85)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

This released mixture uses SNLI, MNLI, FEVER, SciTail, PAWS, and VitaminC rather than the original TRUE paper's ANLI recipe.

“This released mixture uses SNLI, MNLI, FEVER, SciTail, PAWS, and VitaminC (Bowman et al., 2015;Williams et al., 2018;Thorne et al., 2018;Khot et al., 2018;Zhang et al., 2019;Schuster et al., 2021), rather than the original TRUE paper's ANLI recipe.”

• cites Bowman et al., 2015Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Williams et al., 2018 sourceSupported
• cites Thorne et al., 2018 sourceSupported

Classified as probably not a substantial claim. May combine two claims.

We use an AutoAIS-style exact-one decision: generate at most ten tokens deterministically, strip surrounding whitespace, and count only 1 as entailment.

“We use an AutoAIS-style exact-one decision (Bohnet et al., 2022;Gao et al., 2023): generate at most ten tokens deterministically, strip surrounding whitespace, and count only 1 as entailment.”

• cites Bohnet et al., 2022 sourcePartly supported

  Section 3.2 (p. 4) describes AutoAIS as a binary attributable-versus-non-attributable decision. But Section 5.2 (p. 7) specifies force-decoding a positive label, scoring its probability, and treating scores of at least 0.5 as entailment; it does not support the ten-token generation, whitespace-stripping, or exact-one procedure attributed to an AutoAIS-style decision. (LLM, conf=0.88)

  Experimental — accuracy not yet measured
• cites Gao et al., 2023 sourcePartly supported

  In §3.3 (Citation Quality), the paper describes a binary NLI decision: its model outputs 1 when cited passages entail a statement and 0 otherwise. Appendix C (Implementation Details, NLI model) says the TRUE model outputs “1” for entailment. Our copy does not specify a ten-token limit, deterministic generation, stripping whitespace, or an exact-string acceptance rule. (LLM, conf=0.88)

  Experimental — accuracy not yet measured

May combine two claims.

On ASQA at a nominal 0.25 budget (achieved compression 0.08), a RECOMP-style compressor's citations score 0.86 precision against its summaries but 0.12 against source spans under the paper's re-attributability protocol.

“On ASQA at a nominal 0.25 budget (achieved compression 0.08), a RECOMP-style compressor's citations score 0.86 precision against its summaries but 0.12 against source spans under our re-attributability protocol.”

• Also stated in: § 1 Introduction · plain

  “On ASQA at nominal budget 0.25 (achieved ratio 0.08), a RECOMP-style compressor's citations score 0.86 precision against its summaries and 0.12 against source spans under our recovery protocol.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.

May combine two claims. The quote only partly states this claim.

The paired differences from summary checking for RE-COMP recovered-source unsupported rates are 0.712 (CI [0.683, 0.739]) on ASQA and 0.450 [0.417, 0.483] on QASPER, both p H = 0.0148.

“Their paired differences from summary checking are 0.712 (CI [0.683, 0.739]) and 0.450 [0.417, 0.483], both p H = 0.0148.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

For RE-COMP, recovered-source unsupported rates are 0.88 on ASQA and 0.95 on QASPER.

“for RE-COMP, unsupported rates are 0.88 on ASQA and 0.95 on QASPER.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

Extractive families track their budgets closely, but abstractive compressors emit what their decoder emits: RECOMP realizes achieved ratios of 0.05-0.08 on ASQA and approximately 0.015 on QASPER across all four nominal budgets.

“Extractive families track their budgets closely, but abstractive compressors emit what their decoder emits: RECOMP realizes achieved ratios of 0.05-0.08 on ASQA and ≈ 0.015 on QASPER across all four nominal budgets-distinct nominal operating points collapse together.”

Probably not a substantial claim: may not pass S4 (based).

Declared provenance determines verification coverage (H4).

“Declared provenance determines verification coverage (H4).”

May combine two claims. The quote only partly states this claim.

LLMLingua-2's recovered-source unsupported rates are 0.90 on ASQA and 0.91 on QASPER.

“LLMLingua-2's recovered-source rates are 0.90 and 0.91,”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

At nominal 0.25, RECOMP's mean compressed context is 60.3 tokens and its mean complete generator input is 125.4 tokens.

“At nominal 0.25, RECOMP's mean compressed context is 60.3 tokens and its mean complete generator input is 125.4 tokens.”

Classified as probably not a substantial claim. May combine two claims.

A saved ASQA answer reproduced this discrepancy, and a regression test now checks the required gate through the evaluation pipeline.

“A saved ASQA answer reproduced this discrepancy, and a regression test now checks the required gate through the evaluation pipeline.”

May combine two claims.

On the 976 common QASPER questions, full-source token counts have mean 4,672, median 4,557, and range 897-11,418.

“On the 976 common questions, full-source token counts have mean 4,672, median 4,557, and range 897-11,418.”

May combine two claims.

ECR's other QASPER precision differences and all four ASQA differences lack adjusted statistical support.

“Its other QASPER precision differences and all four ASQA differences lack adjusted statistical support.”

May combine two claims.

All no-provenance settings score below their dataset's identity reference (0.51 on ASQA, 0.48 on QASPER), with p H = 0.0148 for each comparison.

“All no-provenance settings score below their dataset's identity reference (0.51 on ASQA, 0.48 on QASPER), with p H = 0.0148 for each comparison.”

May combine two claims.

For RECOMP on ASQA, unsupported rates under declared-span and summary checking are 1.00 and 0.17, respectively.

“For RECOMP on ASQA the unsupported rates are 1.00 and 0.17, respectively;”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Classified as probably not a substantial claim.

Emitted and grounded scores diverge (H1).

“Emitted and grounded scores diverge (H1).”

May combine two claims.

On QASPER the gate reduces identity precision from 0.4992 to 0.4826, affecting 61 of 976 questions.

“On QASPER it reduces identity precision from 0.4992 to 0.4826, affecting 61 of 976 questions.”

Classified as probably not a substantial claim.

Verification adds input tokens.

“Verification adds input tokens.”

May combine two claims. The quote only partly states this claim.

On ASQA at nominal budget 0.25 (achieved ratio 0.08), RECOMP receives emitted citation precision of 0.86 against its summaries and grounded precision of 0.12 against source spans; its mean per-question recovery rate is 0.41.

“On ASQA at nominal budget 0.25 (achieved ratio 0.08), RECOMP receives emitted citation precision of 0.86 against its summaries and grounded preci-”

May combine two claims.

For RECOMP on QASPER, unsupported rates under declared-span and summary checking are 1.00 and 0.50, respectively.

“the corresponding QASPER values are 1.00 and 0.50.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

On QASPER the corresponding RECOMP scores are 0.55 and 0.06 (achieved ratio 0.015), with gap 0.491 [0.457, 0.525] and p H = 0.0148.

“On QASPER the corresponding scores are 0.55 and 0.06 (achieved ratio 0.015), with gap 0.491 [0.457, 0.525] and p H = 0.0148.”

May combine two claims.

ASQA extraction str-EM decreases from identity's 0.34 through 0.32, 0.26, and 0.19 to 0.15, with every adjacent decrease supported (p H = 0.0148).

“Its str-EM decreases from identity's 0.34 through 0.32, 0.26, and 0.19 to 0.15, with every adjacent decrease supported (p H = 0.0148).”

The quote only partly states this claim.

The paired precision gap for RECOMP on ASQA is 0.740 (95% CI [0.711, 0.767], p H = 0.0148).

“The paired precision gap is 0.740 (95% CI [0.711, 0.767], p H = 0.0148).”

May combine two claims.

LLMLingua-2's ASQA re-attribution rate means decrease from 0.56 to 0.40, 0.25, and 0.20 as budgets tighten; the first two adjacent decreases have p H = 0.0148, while the final decrease is unresolved (p H = 0.242).

“LLMLingua-2's ASQA rate means decrease from 0.56 to 0.40, 0.25, and 0.20 as budgets tighten; the first two adjacent decreases have p H = 0.0148, while the final decrease is unresolved (p H = 0.242).”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

Reranking's declared-evidence F1 means decrease from 0.07 to 0.06, 0.04, and 0.03; the first two decreases have p H = 0.0148, but the final difference is unresolved (p H = 1).

“Reranking's F1 means decrease from 0.07 to 0.06, 0.04, and 0.03; the first two decreases have p H = 0.0148, but the final difference is unresolved (p H = 1).”

May combine two claims.

On the common ASQA cohort, the gate reduces identity precision from 0.5622 to 0.5086, affecting 98 of 944 questions.

“On the common ASQA cohort, the gate reduces identity precision from 0.5622 to 0.5086, affecting 98 of 944 questions.”

May combine two claims.

LLMLingua-2's paired differences from summary checking are 0.394 [0.362, 0.426] on ASQA and 0.253 [0.225, 0.282] on QASPER (both p H = 0.0148).

“with differences 0.394 [0.362, 0.426] and 0.253 [0.225, 0.282] (both p H = 0.0148).”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

RECOMP emits identical per-question contexts at nominal budgets 0.50 and 0.25 on ASQA, and at 0.50, 0.25, and 0.10 on QASPER.

“RECOMP emits identical per-question contexts at nominal budgets 0.50 and 0.25 on ASQA, and at 0.50, 0.25, and 0.10 on QASPER.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Four inputs required truncation, with maximum pre-truncation length 47,440 tokens.

“Four inputs required truncation, with maximum pre-truncation length 47,440 tokens.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

No-provenance declared-span rates are structural.

“Notation follows Section 3; no-provenance declared-span rates are structural.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The 122 nonbinary pairs are pair counts, not fractions of questions affected.

“These are pair counts, not fractions of questions affected; the full histogram accompanies the cache.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The run scored 6,015 unique pairs in 419 seconds of model inference (430 seconds including bookkeeping).

“The run scored 6,015 unique pairs in 419 seconds of model inference (430 seconds including bookkeeping; setup and excluded attempts are additional).”

May combine two claims.

Mean recovery rates for QASPER LLMLingua-2 are 0.84 for DeBERTa versus 0.38 for TRUE.

“Recovery can disagree substantially: QASPER LLMLingua-2 has 50.3% agreement over 1,000 candidate decisions and mean recovery rates of 0.84 for DeBERTa versus 0.38 for TRUE.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Full-context identity and nominal-0.25 extraction, RECOMP, and LLMLingua-2 contribute 800 unchanged saved answers, with 1,627 claims and 1,890 citation markers.

“Full-context identity and nominal-0.25extraction, RECOMP, and LLMLingua-2 contribute 800 unchanged saved answers, with 1,627 claims and 1,890 citation markers.”

May combine two claims.

Abstractive compressors do not reliably hit nominal token budgets; RECOMP often produces much less context than requested.

“Abstractive compressors do not reliably hit nominal token budgets; RECOMP often produces much less context than requested.”

• AssumptionRests on an assumption: Nominal token budgets are a meaningful basis for comparing compression methods despite achieved ratios differing.

May combine two claims.

After normalization, 122 pairs (2.03%) produced nonbinary strings, including 103 empty strings.

“After normalization, 122 pairs (2.03%) produced nonbinary strings, including 103 empty strings; assigning zero does not establish reliable nonentailment.”

Classified as probably not a substantial claim.

Citation support does not establish causal reliance on evidence.

“Related work already identifies a divergence between answer quality and citation grounding under compression (Li et al., 2026a), while citation support does not establish causal reliance on evidence (Wallat et al., 2025).”

• cites Wallat et al., 2025 sourceNot checked — no full text of the source

May combine two claims.

The automatic citation scores depend on a shared NLI model for span recovery and citation scoring and have not been independently calibrated.

“These estimates depend on a shared NLI model for span recovery and citation scoring and lack independent human calibration.”

• Also stated in: § 1 Introduction · plain

  “These automatic scores depend on a shared NLI evaluator and bounded candidate search; they have not been independently calibrated.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.

Classified as probably not a substantial claim.

Entailment decisions are the NLI model's predictions, not independently validated judgments of source support.

“Entailment decisions below are this model's predictions, not independently validated judgments of source support.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.

May combine two claims.

Lexical retrieval can miss paraphrases, and the single-snippet test can reject units supported only by combined evidence.

“Lexical retrieval can miss paraphrases, and the single-snippet test can reject units supported only by combined evidence.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Appendix C reports a second-evaluator sensitivity check; human calibration remains absent.

“Appendix C reports a second-evaluator sensitivity check; human calibration remains absent.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.

May combine two claims.

Failed recovery does not establish that support is absent from the source, and the direction of overall scoring bias is unknown.

“Thus failed recovery does not establish that support is absent from the source, and the direction of overall scoring bias is unknown.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.
• AssumptionRests on an assumption: The circularity risk from using the same NLI model for span recovery and citation scoring does not invalidate cross-compressor comparisons.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Per-example harness failures occur only in identity (4 of 948 on ASQA, 29 of 1,005 on QASPER); every primary setting excludes those same question IDs, with failure counts retained.

“Per-example harness failures occur only in identity (4 of 948 on ASQA, 29 of 1,005 on QASPER); every primary setting excludes those same question IDs, with failure counts retained.”

Classified as probably not a substantial claim.

Related work already identifies a divergence between answer quality and citation grounding under compression.

“Related work already identifies a divergence between answer quality and citation grounding under compression (Li et al., 2026a), while citation support does not establish causal reliance on evidence (Wallat et al., 2025).”

• cites Li et al., 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

The paper's measurements concern source support under an automatic evaluation protocol and do not test causal citation faithfulness.

“Our measurements concern source support under an automatic evaluation protocol; they do not test causal citation faithfulness.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The paper's NLI-based support scores do not establish whether the generator causally relied on the cited evidence.

“Our NLI-based support scores do not establish whether the generator causally relied on the cited evidence.”

• AssumptionRests on an assumption: The NLI model's entailment predictions are a valid proxy for source support.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Both procedures use 10,000 replicates and seed 13, with independent random-number streams for bootstrap sampling and randomization.

“Both procedures use 10,000 replicates and seed 13, with independent random-number streams for bootstrap sampling and randomization.”

• AssumptionThe authors state this as an assumption: The randomization tests assume label exchangeability within a resampling unit under the null.

Classified as probably not a substantial claim. May combine two claims.

The extension plan was recorded before running these four tests, and Holm adjustment was recomputed over all 148 raw p-values.

“The extension plan was recorded before running these four tests, and Holm adjustment was recomputed over all 148 raw p-values.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Li et al. (2026a) study Self-RAG on ASQA with LLMLingua-2 and prefix truncation, finding sharper degradation in citation grounding than answer quality, and investigate hierarchical evidence retention.

“Li et al. (2026a) study Self-RAG on ASQA with LLMLingua-2 and prefix truncation, finding sharper degradation in citation grounding than answer quality, and investigate hierarchical evidence retention.”

• cites Li et al., 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Each question has equal weight in citation precision, citation recall, answer quality, and evidence F1; claims and citations are not pooled across questions.

“Each question has equal weight in citation precision, citation recall, answer quality, and evidence F1; claims and citations are not pooled across questions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

This is a post hoc camera-ready analysis, not a preregistration.

“This is a post hoc camera-ready analysis, not a preregistration.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These are evidence-F1 results, not evidence-precision estimates or a controlled test of selection granularity.

“These are evidence-F1 results, not evidence-precision estimates or a controlled test of selection granularity.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The initial plan specified 134 core contrasts and 10 recovery-threshold contrasts before inspecting the revised inferential results.

“The initial plan specified 134 core contrasts and 10 recoverythreshold contrasts before inspecting the revised inferential results.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The declared-span column is zero for no-provenance compressors because this policy rejects their claims without an NLI call.

“The declared-span column is zero for no-provenance compressors because this policy rejects their claims without an NLI call.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Classified as probably not a substantial claim.

The audit also computes legacy precision from the same new NLI scores to isolate the gate's effect from numerical inference differences and cohort selection.

“The audit also computes legacy precision from the same new NLI scores to isolate the gate's effect from numerical inference differences and cohort selection.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Only identity has failures: 4 budget-check failures on ASQA, and 15 budget-check plus 14 prompt-overflow failures on QASPER; their question IDs are excluded from every primary setting.

“Only identity has failures: 4 budget-check failures on ASQA, and 15 budget-check plus 14 promptoverflow failures on QASPER; their question IDs are excluded from every primary setting.”

Classified as probably not a substantial claim. May combine two claims.

These are deterministic scorer-rule comparisons using fixed NLI scores, not new model-performance tests.

“These are deterministic scorer-rule comparisons using fixed NLI scores, not new model-performance tests.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Verification-rate means exclude answers with zero claims; paired verification comparisons exclude a question if either member has zero claims.

“Verification-rate means exclude answers with zero claims; paired verification comparisons exclude a question if ei-ther member has zero claims.”

May combine two claims.

Recovery coverage depends on method, budget, and dataset as well as the search and evaluator; these observations provide no universal ceiling on recoverable support.

“Recovery coverage depends on method, budget, and dataset as well as the search and evaluator; these observations provide no universal ceiling on recoverable support.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Classified as probably not a substantial claim.

Primary entailment judgments use the development-grade DeBERTa NLI evaluator of §3.1 at τ = 0.5.

“Primary entailment judgments use the development-grade DeBERTa NLI evaluator of §3.1 at τ = 0.5.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These primary scores remain dependent on this single evaluator; the correction does not constitute independent validation.

“These primary scores remain dependent on this single evaluator; the correction does not constitute independent validation.”

May combine two claims.

The gap combines effects of compression, bounded recovery, and NLI judgments; these measurements do not separate their contributions.

“The gap combines effects of compression, bounded recovery, and NLI judgments; these measurements do not separate their contributions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every QASPER contrast retains all 271 papers after metric-specific exclusions.

“Every QASPER contrast retains all 271 papers after metric-specific exclusions.”

Classified as probably not a substantial claim. May combine two claims.

Intervals are pointwise, not simultaneous; statistical-support statements use p H < 0.05.

“Intervals are pointwise, not simultaneous; statistical-support statements use p H < 0.05.”

Classified as probably not a substantial claim. May combine two claims.

LLMLingua-2's output is a token stream with no unit-level sid mapping in the pipeline, so it declares no provenance and is scored with the no-provenance family alongside RECOMP.

“Although LLMLingua-2 prunes tokens verbatim, its output is a token stream with no unit-level sid mapping in our pipeline, so it declares no provenance and is scored with the no-provenance family alongside RECOMP.”

May combine two claims.

The results support a setting-specific precision gain, not general superiority or lossless redundancy removal.

“Thus the results support a settingspecific precision gain, not general superiority or lossless redundancy removal.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Input, source-code, checkpoint, and tokenizer hashes accompany persistent per-question records and resumable score caches.

“Input, source-code, checkpoint, and tokenizer hashes accompany persistent per-question records and resumable score caches.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The 512-token NLI input limit can truncate concatenated evidence, so the joint gate is also conditional on that bounded input.

“The 512-token NLI input limit can truncate concatenated evidence, so the joint gate is also conditional on that bounded input.”

Classified as probably not a substantial claim.

Primary summaries and comparisons use the intersection of successful question IDs across identity and all twenty compressed settings.

“Primary summaries and comparisons use the intersection of successful question IDs across identity and all twenty compressed settings.”

Classified as probably not a substantial claim. May combine two claims.

All retained questions from a sampled QASPER paper travel together, and each replicate divides its total difference by the number of sampled questions, preserving the question-weighted estimand.

“All retained questions from a sampled QASPER paper travel together, and each replicate divides its total difference by the number of sampled questions, preserving the questionweighted estimand.”

Classified as probably not a substantial claim. May combine two claims.

Runs without declared provenance have no declared-evidence F1, and recovered-span scores would measure a different attribution pathway.

“Runs without declared provenance have no declaredevidence F1; recovered-span scores would measure a different attribution pathway.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Undefined evidence or recovery metrics remain undefined rather than becoming zeros.

“Undefined evidence or recovery metrics remain undefined rather than becoming zeros.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

All reported adjusted values use this expanded family; original effects, intervals, and raw p-values are unchanged.

“All reported adjusted values use this expanded family; original effects, intervals, and raw p-values are unchanged.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For methods whose units all declare provenance, recovered-source checking and declared-span checking coincide.

“For methods whose units all declare provenance, recovered-source and declared-span checking coincide.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Monte Carlo p-values use (b + 1)/(10,000 + 1), where b counts randomizations at least as extreme as the observed absolute difference.

“Monte Carlo p-values use (b + 1)/(10,000 + 1), where b counts randomizations at least as extreme as the observed absolute difference.”

• AssumptionThe authors state this as an assumption: The randomization tests assume label exchangeability within a resampling unit under the null.

Probably not a substantial claim: may not pass S3 (load-bearing).

Information-preservation studies examine grounding under compression.

“ALCE's summary-context ablation also illustrates a correctness-citation trade-off (Gao et al., 2023); information-preservation studies examine grounding under compression (Łajewska et al., 2025), and human evaluations examine verifiability as output abstractiveness changes (Worledge et al., 2024).”

• cites Łajewska et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

All primary comparisons use the same successful questions across all 21 settings: 944 on ASQA and 976 from 271 papers on QASPER.

“All primary comparisons use the same successful questions across all 21 settings: 944 on ASQA and 976 from 271 papers on QASPER.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Wallat et al. (2025) distinguish citation correctness from causal faithfulness and investigate post-rationalization.

“Wallat et al. (2025) distinguish citation correctness from causal faithfulness and investigate post-rationalization.”

• cites Wallat et al., 2025 sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

All saved answers are rescored with the corrected definition using the same DeBERTa checkpoint in float32; no answers are regenerated.

“All saved answers are rescored with the corrected definition using the same DeBERTa checkpoint in float32; no answers are regenerated.”

May combine two claims.

These gaps persist when recovery is attempted, but remain conditional on the bounded search and shared NLI evaluator.

“These gaps persist when recovery is attempted, but remain conditional on the bounded search and shared NLI evaluator.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Probably not a substantial claim: may not pass S4 (based).

The re-attributability protocol depends on the entailment threshold τ.

“The re-attributability protocol depends on the entailment threshold τ .”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Probably not a substantial claim: may not pass S3 (load-bearing).

After that analysis and a cache-coverage audit, four recovered-source versus summary-verification contrasts at nominal 0.25 for RECOMP and LLMLingua-2 on both datasets were added.

“After that analysis and a cachecoverage audit, we added four recovered-source versus summary-verification contrasts at nominal 0.25 for RECOMP and LLMLingua-2 on both datasets.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Failure to reject a difference does not establish equivalence or preservation.

“Failure to reject a difference does not establish equivalence or preservation.”

Classified as probably not a substantial claim.

The reported achieved fraction, 0.01525, is the mean of per-question context/full-source ratios, not the ratio of these token means.

“The reported achieved fraction, 0.01525, is the mean of per-question context/full-source ratios, not the ratio of these token means.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Human evaluations examine verifiability as output abstractiveness changes.

“ALCE's summary-context ablation also illustrates a correctness-citation trade-off (Gao et al., 2023); information-preservation studies examine grounding under compression (Łajewska et al., 2025), and human evaluations examine verifiability as output abstractiveness changes (Worledge et al., 2024).”

• cites Worledge et al., 2024 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

All inference is conditional on the fixed generator outputs, recovery procedure, and evaluator.

“All inference is conditional on the fixed generator outputs, recovery procedure, and evaluator.”

Classified as probably not a substantial claim. May combine two claims.

Two-sided randomization tests swap paired labels within questions on ASQA and jointly within papers on QASPER.

“Two-sided randomization tests swap paired labels within questions on ASQA and jointly within papers on QASPER.”

• AssumptionThe authors state this as an assumption: The randomization tests assume label exchangeability within a resampling unit under the null.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Recovered-source verification reads existing NLI scores from the sealed cache and makes no new model calls.

“This extension reads existing NLI scores from the sealed cache and makes no new model calls.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

Recovered-source verification is reported at nominal 0.25 for the two no-provenance methods and remains dependent on the same bounded recovery procedure and evaluator.

“Recovered-source verification is reported at nominal 0.25 for the two no-provenance methods and remains dependent on the same bounded recovery procedure and evaluator.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Small plotted differences do not establish equivalence.

“Small plotted differences do not establish equivalence.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These amendments preceded inspection of any aggregate TRUE comparison report and left the sample, thresholds, and 24 comparisons unchanged.

“These amendments preceded inspection of any aggregate TRUE comparison report and left the sample, thresholds, and 24 comparisons unchanged.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Input hashes, the extension plan, cache lookups, per-question records, and all four comparisons are retained separately from the original analysis.

“Input hashes, the extension plan, cache lookups, perquestion records, and all four comparisons are retained separately from the original analysis.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

We sample 100 questions per dataset from sorted common-cohort IDs using a fresh Python seed-13 random generator; QASPER spans 84 papers.

“We sample 100 questions per dataset from sorted common-cohort IDs using a fresh Python seed-13 random generator; QASPER spans 84 papers.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

All interrupted attempts and plans are preserved but excluded; the final batch-four run recomputes every input in a fresh cache.

“All interrupted attempts and plans are preserved but excluded; the final batch-four run recomputes every input in a fresh cache.”

May combine two claims.

A uniform 4,096-token cap preserves complete hypotheses and truncates only premises.

“An input-only scan found five undeclared units exceeding 2,048 tokens (maximum hypothesis plus prompt: 2,988), motivating a uniform 4,096-token cap that preserves complete hypotheses and truncates only premises.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Every setting uses the same 944 ASQA or 976 QASPER successful questions; n denotes that common cohort, with metric-specific omissions identified in the tables.

“Every setting uses the same 944 ASQA or 976 QASPER successful questions; n denotes that common cohort, with metric-specific omissions identified in the tables.”

• AssumptionRests on an assumption: The common successful subset, conditioned on identity success, yields comparisons that are not materially biased.

May combine two claims.

The top-10 lexical candidate pool can miss semantically matching snippets, and requiring one snippet to entail a unit can miss support distributed across snippets.

“The top-10 lexical candidate pool can miss semantically matching snippets, and requiring one snippet to entail a unit can miss support distributed across snippets.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Classified as probably not a substantial claim. May combine two claims.

Every other string scores zero; these are binary decisions, not calibrated probabilities.

“Every other string scores zero; these are binary decisions, not calibrated probabilities.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The 1.00 declared-span rates for no-provenance methods are structural; this verification mode does not attempt recovery.

“The 1.00 declared-span rates for noprovenance methods are structural; this verification mode does not attempt recovery.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

Probably not a substantial claim: may not pass S3 (load-bearing).

The original 148-test analysis is unchanged.

“The original 148-test analysis is unchanged.”

May combine two claims.

This pairing prevents comparisons from using different questions, but conditions results on identity success and omits those difficult cases.

“This pairing prevents comparisons from using different questions, but conditions results on identity success and omits those difficult cases.”

• AssumptionRests on an assumption: The common successful subset, conditioned on identity success, yields comparisons that are not materially biased.

Classified as probably not a substantial claim. May combine two claims.

The separate 24-test family uses pointwise 95% bootstrap intervals and two-sided randomization tests, each with 10,000 replicates and seed 13, question resampling on ASQA and paper clustering on QASPER, with question-weighted means and Holm adjustment.

“The separate 24-test family uses pointwise 95% bootstrap intervals and two-sided randomization tests, each with 10,000 replicates and seed 13, question resampling on ASQA and paper clustering on QASPER, with question-weighted means and Holm adjustment.”

Classified as probably not a substantial claim. May combine two claims.

These descriptive results support sensitivity analysis, not accuracy against human judgments.

“These descriptive results support sensitivity analysis, not accuracy against human judgments.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The prior DeBERTa values are the original scores for these same sampled answers.

“The prior DeBERTa values are the original scores for these same sampled answers.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Two zero-claim RECOMP answers are excluded from QASPER verification rates.

“Two zero-claim RECOMP answers are excluded from QASPER verification rates.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

We retain normalized nonbinary strings, but not every raw output, so normalization's effect cannot be quantified from the cache.

“We retain normalized nonbinary strings, but not every raw output, so normalization's effect cannot be quantified from the cache.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Fixed recovery retains selection dependence; TRUE recovery reuses one judge.

“Fixed recovery retains selection dependence; TRUE recovery reuses one judge.”

May combine two claims.

Neither recovery method removes bounded-search errors or supplies human calibration.

“Neither removes bounded-search errors or supplies human calibration.”

Probably not a substantial claim: may not pass S3 (load-bearing).

QASPER verification rates exclude 1, 2, 3, and 2 zero-claim RECOMP answers at nominal budgets 0.50, 0.25, 0.10, and 0.05, respectively; other settings use the full cohort.

“QASPER verification rates exclude 1, 2, 3, and 2 zero-claim RECOMP answers at nominal budgets 0.50, 0.25, 0.10, and 0.05, respectively; other settings use the full cohort.”

• AssumptionRests on an assumption: The common successful subset, conditioned on identity success, yields comparisons that are not materially biased.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Table 3 varies the recovery threshold while holding the scoring threshold fixed; it does not validate the evaluator or test candidate-pool size, retrieval strategy, or multi-snippet recovery.

“Table 3 varies the recovery threshold while holding the scoring threshold fixed; it does not validate the evaluator or test candidate-pool size, retrieval strategy, or multi-snippet recovery.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.

May combine two claims.

Only identity fails on 4 ASQA and 29 QASPER questions; every primary setting is evaluated on the resulting common successful subset.

“Only identity fails on 4 ASQA and 29 QASPER questions; every primary setting is evaluated on the resulting common successful subset.”

• AssumptionRests on an assumption: The common successful subset, conditioned on identity success, yields comparisons that are not materially biased.

May combine two claims.

Sampling intervals condition on the fixed generated outputs and evaluator; they do not include systematic NLI error or variation across generation runs.

“Sampling intervals condition on the fixed generated outputs and evaluator; they do not include systematic NLI error or variation across generation runs.”

• AssumptionRests on an assumption: The NLI entailment threshold provides a valid criterion for whether a source snippet supports a claim.