CoChat
Sign Up
PreprintCited by 2Topic ModelingAdvanced Text Analysis TechniquesNatural Language Processing Techniques

Attributable by Construction: Claim-Anchored Provenance for Multi-Document Summarization

Open access
Guan, Shuo·2026·arXiv
DOI 10.48550/arxiv.2606.23989arXiv 2606.23989
Open this paper in CoChat — free accountOpen PDF

Abstract

Large language models produce fluent multi-document summaries, but their attributions are typically coarse---whole documents or passages---and generated post hoc, leaving each statement hard to verify. We argue that attribution should be a structural property of generation rather than a downstream prediction. We present CAMS, a Claim-Anchored Multi-document Summarization framework that decomposes every source document into atomic claims whose provenance is resolved deterministically from verbatim quotes to token spans, clusters equivalent claims across documents while flagging inter-source conflicts, selects a support-aware and salient subset, and rewrites it so that every summary sentence terminates in claim identifiers resolving back to source spans. This yields a separation we make explicit: provenance is an invariant holding for every emitted sentence independently of model accuracy, whereas faithfulness is an objective that selection, constrained rewriting, and verification only encourage---a distinction end-to-end and post-hoc systems conflate. We evaluate on MultiNews, DiverseSumm, and zero-shot on WCEP under a two-regime protocol separating reference-free citation quality from gold-aligned localization, audited by a support model never used for selection or verification. CAMSmatches strong end-to-end and span-attribution baselines on summary quality while improving faithfulness and citation precision, raising multi-source attribution accuracy from 38% to 64% without inflating the number of cited sources, and cutting human verification time per claim by $3.4\times$. We release code and ${\sim}320$K claim--quote--span annotations over MultiNews as a reusable fine-grained attribution resource.

AI snapshot

Written from the paper’s full text.

TL;DR

CAMS is a modular multi-document summarization framework that uses atomic claims with token-level provenance as both attribution anchors and verification units, making every summary sentence traceable to source spans. It matches strong baselines on summary quality while improving faithfulness, citation precision, and especially multi-source attribution.

Key findings

  • On MultiNews, CAMS reaches ROUGE-L 25.0 and BERTScore 87.6, within 0.4 ROUGE-L of PRIMERA (25.4) and best on BERTScore, while improving AlignScore (.91), SummaC (.87), and FActScore (.90) over every baseline.
  • Under the independent evaluator M_eval, CAMS citation precision is 84 vs 76 for Attribute First and 59 for E2E ALCE, with 22 tokens per claim vs 34 and 95; TRUE-style diagnostic precision is 88.
  • Multi-source attribution accuracy is 64% vs 38% for Attribute First; removing cross-document clustering drops it to 31%. On DiverseSumm, CAMS covers 58% of divergent facts and surfaces 61% of inter-source conflicts with 73% attribution accuracy, whereas the end-to-end model surfaces only 18%.
  • Human evaluation judges 89% of CAMS claims fully supported, with average verification time 9s, about 3.4× faster than the document-citing baseline; human support correlates with independent citation precision at r = 0.78.

Methods

  • CAMS pipeline: an LLM extracts atomic claims with verbatim quotes, resolves quotes to token spans, clusters equivalent claims across documents with bidirectional entailment and detects conflicts via three-class NLI, selects clusters with a GBDT salience/self-support scorer plus MMR coverage, rewrites with inline claim IDs, and verifies support/no-overflow with bounded repair or drop.
  • Data: MultiNews as primary benchmark (44,972 train / 5,622 dev / 5,622 test), DiverseSumm (245) for conflict/diversity analysis, and WCEP (~1,000 test) for zero-shot transfer; baselines include E2E LLM ALCE, Attribute First, PRIMERA/LED + factchecker, and ESR on concatenated documents.
  • Evaluation: a two-regime protocol separates reference-free citation quality (NLI citation recall/precision with independent M_eval, plus conciseness) from gold-aligned localization (soft token-IoU ≥ 0.5 span P/R/F1 and multi-source recall), with a human study on 100–300 claims per system using three annotators.

Limitations

  • Stated in the paper: CAMS depends on LLM-based claim decomposition; extraction errors propagate, decontextualization can supply an incorrect entity/time/location, and claim equivalence for clustering is fuzzy, so clustering errors can mis-merge or split evidence. Attribution is many-to-many, and evaluating distributed attribution against gold is an open problem that the soft-matching protocol only approximates.
  • Stated in the paper: citation evaluation still relies on automatic support models, and the independent evaluator is a robustness check, not proof that circularity or verifier error is impossible. Quote-to-span matching establishes where a quoted string occurs, not that the normalized claim preserves exactly the same meaning. The pipeline incurs extraction cost that grows with source documents, raising latency; the conflict-handling policy may not suit all applications; and experiments are limited to English news.
  • Evident from the text: faithfulness is encouraged rather than guaranteed, because each learned step can fail; provenance is treated as a structural invariant, but support remains a testable objective. Attribution is also not a guarantee of real-world truth, only of support by the provided sources.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2606.23989

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

4 of 7 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    ROUGE correlates weakly with faithfulness.

    “ROUGE is reported for reference only, since it correlates weakly with faithfulness (Maynez et al., 2020 rett, 2022).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Maynez et al., 2020 source
  • Premisecitation

    Abstractive summarization systems can hallucinate content unsupported by or contradicting their inputs.

    “abstractive systems can hallucinate content unsupported byor contradicting-their inputs (Maynez et al., 2020;Goyal and Durrett, 2022).”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Maynez et al., 2020 source
    • cites Goyal and Durrett, 2022 source
  • Findingown data

    Removing the verification loop lowers faithfulness without much affecting quality.

    “Removing the verification loop (-verification) lowers faithfulness without much affecting quality”
    Quote in the paperSubstantial claim
  • Findingown data

    CAMS attributes each side of inter-source conflicts to its originating documents with 73% accuracy.

    “, attributing each side to its originating documents with 73% accuracy”
    Quote in the paperSubstantial claim
  • Findingown data

    Ablating cross-document clustering drops multi-source attribution to 31%, below even the span-first baseline (38%).

    “Ablating cross-document clustering drops this figure to 31%, below even the span-first baseline (38%)”
    Quote in the paperSubstantial claim
  • May combine two claims. 37
  • Classified as probably not a substantial claim. 15

  • May combine two claims.

    Premisecitation

    Even when systems cite their sources, the citations are usually coarse (pointing to entire documents or paragraphs) and are produced after generation, so a reader must sift through irrelevant text to confirm a statement.

    “even when systems cite their sources, the citations are usually coarse-pointing to entire documents or paragraphs-and are produced after generation, so a reader must still sift through irrelevant text to confirm any given statement (Gao et al., 2023;Slobodkin et al., 2024).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Gao et al., 2023 source

      Section 2 (Task Setup and Datasets; page unavailable) says commercial systems such as Bing Chat cite entire Web pages, whereas the paper uses 100-word passages because they are easier to verify. Section 3.3 links irrelevant citations to human review of extraneous passages. The paper evaluates post-hoc citing as one approach, but does not say citations are usually produced after generation or usually point to paragraphs. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
    • cites Slobodkin et al., 2024 source

  • May combine two claims.

    Findingown data

    CAMS attains the highest citation precision under the independent evaluator M_eval (84), but the margin is smaller than under the internal TRUE-style diagnostic (88).

    “CAMS still attains the highest citation precision under the independent evaluator ( 84), but the margin is smaller than under the internal TRUE-style diagnostic ( 88).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    CAMS is competitive with the strongest fine-tuned summarizer on surface quality-within 0.4 ROUGE-L of PRIMERA and best on BERTScore-while improving faithfulness across AlignScore, SummaC, and FActScore over every baseline.

    “CAMS is competitive with the strongest fine-tuned summarizer on surface quality-within 0.4 ROUGE-L of PRIMERA and best on BERTScore-while improving faithfulness across AlignScore, SummaC, and FActScore over every baseline.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    CAMS remains the most concise system (22 tokens per claim) at recall comparable to or above the baselines.

    “CAMS also remains the most concise system (22 tokens per claim) at recall comparable to or above the baselines.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Faithfulness and attribution gains over every baseline are statistically significant (paired bootstrap, p < 0.05).

    “Unless noted, faithfulness and attribution gains over every baseline are statistically significant (paired bootstrap, p < 0.05)”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    CAMS matches strong end-to-end and span-attribution baselines on summary quality while substantially improving faithfulness and citation precision, lifting multi-source attribution accuracy by roughly two-thirds, and exposing a controllable faithfulness-coverage trade-off.

    “CAMS matches strong end-to-end and spanattribution baselines on summary quality while substantially improving faithfulness and citation precision, lifting multi-source attribution accuracy by roughly two-thirds, and exposing a controllable faithfulness-coverage trade-off that end-to-end models leave implicit.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The ranking of citation precision is stable under M_eval, but the CAMS precision advantage shrinks from 10 points under TRUE-style (88 vs 78) to 8 points under the independent evaluator (84 vs 76).

    “The ranking is stable under M eval , but the CAMS precision advantage shrinks from 10 points under the TRUE-style diagnostic (88 vs. 78) to 8 points under the independent evaluator (84 vs. 76)”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingreasoning

    CAMS cites slightly more spans per claim than Attribute First (1.8 vs 1.6) yet uses far fewer total tokens.

    “It cites slightly more spans per claim than Attribute First (1.8 vs 1.6)-a direct consequence of aggregating evidence across documents-yet uses far fewer total tokens, because each cited span is sub-sentential rather than a whole passage.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Removing the self-support feature or the verification loop reduces precision under both evaluators.

    “Appendix D further reports that removing the self-support feature or the verification loop reduces precision under both evaluators”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Intrinsic per-module diagnostics show extraction claim support rising from 90% to 94%, a 97% quote-match rate, clustering B3 F1 of 84, and conflict-detection F1 of 72.

    “Intrinsic per-module diagnostics (extraction 90 → 94% claim support, 97% quote-match rate, clustering B 3 F1 84, conflictdetection F1 72) appear in Appendix F.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Removing self-support from the selector lowers precision even under the independent evaluator, and removing verification lowers it more substantially.

    “Removing self-support from the selector lowers precision even under the independent evaluator, and removing verification lowers it more substantially.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The end-to-end model surfaces only 18% of inter-source conflicts on DiverseSumm, typically reporting a single consensus value.

    “whereas the end-to-end model surfaces only 18%, typically reporting a single consensus value.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The localization ranking is stable across soft-overlap thresholds: stricter matching lowers absolute F1 for all systems, but CAMS retains the largest advantage on multi-source propositions.

    “The ranking is stable across thresholds: stricter matching lowers absolute F1 for all systems, but CAMS retains the largest advantage on multi-source propositions.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Applying CAMS's shared post-processor uniformly to every system raises baseline citation precision only slightly and at a large coverage cost, while reconstructing CAMS's full-pipeline precision (from 77 to 84) from its verifier-ablated variant at unchanged recall.

    “verifier-ablated CAMS variant it instead recovers the full pipeline's precision (77 → 84) at unchanged recall, reproducing CAMS (full).”
    • Also stated in: § Additional information · plain
      “The same post-processor raises baseline precision only slightly and at a large coverage cost, while reconstructing CAMS's full-pipeline precision (84) from its verifier-ablated variant.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    On DiverseSumm, CAMS covers 58% of annotated divergent facts and surfaces 61% of inter-source conflicts.

    “On DiverseSumm, which targets diverse and conflicting information across sources, CAMS covers 58% of annotated divergent facts and surfaces 61% of inter-source conflicts”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Annotators judge 89% of CAMS claims fully supported and verify each in 9s on average, about 3.4× faster than for the document-citing baseline.

    “Annotators judge 89% of CAMS claims fully supported and verify each in 9s on average-about 3.4× faster than for the document-citing baseline”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Removing cross-document clustering collapses multi-source recall while leaving single-source localization intact.

    “removing cross-document clustering collapses multi-source recall while leaving single-source localization intact (Table 3).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Human support correlates with independent citation precision at r = 0.78, recall at r = 0.71, and F1 at r = 0.75, with inter-annotator agreement κ = 0.68.

    “Human support correlates with independent citation precision at r = 0.78, recall at r = 0.71, and F1 at r = 0.75 (agreement κ = 0.68)”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    On zero-shot transfer to WCEP, CAMS remains competitive in quality and retains its faithfulness advantage, although Attribute First obtains slightly higher ROUGE-L.

    “Table 5 shows that CAMS remains competitive in quality and retains its faithfulness advantage, although Attribute First obtains slightly higher ROUGE-L.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    A modular pipeline with a structured intermediate representation is uniquely suited to the challenges of multi-document summarization.

    “We argue that a modular pipeline with a structured intermediate representation is uniquely suited to these challenges.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    The threshold θ exposes an explicit faithfulness-coverage trade-off: lowering it admits more clusters at some risk to precision, raising it yields conservative, highly supported summaries.

    “The threshold θ exposes an explicit faithfulness-coverage trade-off : lowering it admits more clusters at some risk to precision, raising it yields conservative, highly supported summaries”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductreasoning

    Faithfulness in CAMS is treated as an objective rather than a guaranteed invariant, encouraged by self-support scoring, bidirectional entailment checks during clustering, and post-rewrite verification.

    “Faithfulness, by contrast, is treated as an objective rather than a guaranteed invariant-encouraged by selfsupport scoring, bidirectional entailment checks during clustering, and post-rewrite verificationbecause each learned step can still fail”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The self-support feature is used only before generation and is never used to compute reported citation precision.

    “This feature is used only before generation and is never used to compute reported citation precision”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    Unlike span-first attribution, CAMS's claims are normalized, recombinable units that merge across documents and are checked individually.

    “Unlike span-first attribution (Slobodkin et al., 2024), which anchors generation to raw spans, our claims are normalized, recombinable units that merge across documents and are checked individually”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Slobodkin et al., 2024 source

  • May combine two claims.

    Study design and conductreasoning

    Conditioning the rewriter only on selected claim texts limits reintroduction of unselected content, and residual drift is caught by verification.

    “conditioning only on selected claim texts limits reintroduction of unselected content, and residual drift is caught by verification.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    A verifier pass is an automatic support judgment, not a proof of truth.

    “A verifier pass is an automatic support judgment, not a proof of truth, which is why the final audit uses a model never invoked by the selector or verifier.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Support decisions are deliberately split across three frozen models to avoid circular evaluation.

    “Support decisions are deliberately split across three frozen models to avoid circular evaluation.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    A human study on a 100-300 claim sample per system uses three annotators to label per-claim support and measure verification time, with agreement summarized by Cohen's or Fleiss' κ.

    “We additionally report a human study on a 100-300claim sample per system, using three annotators to label per-claim support and measuring verification time; agreement is summarized with Cohen's or Fleiss' κ”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductreasoning

    The CAMS pipeline is attribution-oriented by construction: every generated sentence must resolve to selected claim identifiers, and those identifiers map deterministically back to source spans.

    “The pipeline is thus attribution-oriented by construction: every generated sentence must resolve to selected claim identifiers, and those identifiers map deterministically back to source spans.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductreasoning

    Neither M_ver nor M_eval is used to create the distant-supervision labels, so the selector is trainable independently of the other modules.

    “Crucially, neither M ver nor M eval is used to create these labels, so the selector is trainable independently of the other modules”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Provenance is treated as a structural invariant but faithfulness as a testable objective, audited with support models separated from selection and verification.

    “We therefore treat provenance as a structural invariant but faithfulness as a testable objective, audited with support models separated from selection and verification.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    All systems' citations are first projected to a common token-span representation so comparisons are like-for-like.

    “All systems' citations are first projected to a common token-span representation so comparisons are like-for-like.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    End-to-end models tend to flatten MDS phenomena: they silently deduplicate, paper over disagreement, and emit attributions that point to a single best document even when support is distributed.

    “End-to-end models tend to flatten these phenomena: they silently deduplicate, paper over disagreement, and emit attributions that point to a single best document even when support is distributed (Huang et al., 2024).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Huang et al., 2024

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The higher span count per claim is a direct consequence of aggregating evidence across documents, and the lower total token count is because each cited span is sub-sentential rather than a whole passage.

    “It cites slightly more spans per claim than Attribute First (1.8 vs 1.6)-a direct consequence of aggregating evidence across documents-yet uses far fewer total tokens, because each cited span is sub-sentential rather than a whole passage.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductreasoning

    The quote-to-span resolution resolves the quote's location but does not by itself guarantee that the claim text is entailed by the quote; that support is scored during selection and rechecked after rewriting.

    “This resolves the quote's location but does not by itself guarantee that t i is entailed by q i ; that support is scored during selection and rechecked after rewriting.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Significance testing uses paired bootstrap resampling over document clusters with 1,000 samples and reports 95% percentile confidence intervals.

    “For significance testing we use paired bootstrap resampling over document clusters with 1,000 samples and report 95% percentile confidence intervals for automatic metrics.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The pipeline incurs extraction cost that grows with the number and length of source documents, raising latency relative to end-to-end models.

    “The pipeline incurs extraction cost that grows with the number and length of source documents, raising latency relative to end-to-end models.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The selector is trained only on MultiNews and applied to WCEP without WCEP-specific training or tuning.

    “The selector is trained only on MultiNews and applied to WCEP without WCEP-specific training or tuning.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    CAMS matches end-to-end quality while improving faithfulness and raising correct attribution of multi-source evidence from 38% to 64% over span-first baselines (a 68% relative gain), and it transfers zero-shot to WCEP with only a modest drop.

    “Empirically it matches end-to-end quality while improving faithfulness and, most distinctively, raising correct attribution of multi-source evidence from 38% to 64% over span-first baselines (a 68% relative gain), and it transfers zero-shot to WCEP with only a modest drop.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    M sel, M ver, and M eval are separate models.

    “M sel , Mver, and M eval are separate models”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    The experiments are limited to English news, and generalization to other domains and languages remains untested.

    “Finally, our experiments are limited to English news; generalization to other domains and languages remains untested.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    End-to-end models occupy a single fixed point off the faithfulness-coverage frontier, so their balance is not steerable, whereas in CAMS it is an explicit selector knob.

    “End-to-end models occupy a single fixed point off this frontier, so their balance is not steerable, whereas in CAMS it is an explicit selector knob.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The independent evaluator M eval is separated from M sel and M ver and is never called during selection, generation, verification, repair, or threshold tuning.

    “The independent evaluator M eval is intentionally separated from M sel and M ver and is never called during selection, generation, verification, repair, or threshold tuning.”
    • Also stated in: § Algorithm 2 Greedy support-aware selection (MMR) · plain
      “M eval is held out completely from this process.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    By localizing content before realizing it, CAMS is attribution-oriented by construction-every sentence traces to one or more source spans-and faithfulness-oriented, though not faithful, by construction.

    “By localizing content before realizing it, CAMS is attribution-oriented by construction-every sentence traces to one or more source spans-and faithfulness-oriented, though not faithful, by construction.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Attribution and atomic-fact factuality are usually studied apart in prior work.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    CAMS depends on the quality of LLM-based claim decomposition, so extraction errors propagate downstream, decontextualization can supply an incorrect entity, time, or location, and clustering errors can mis-merge or split evidence.

    “CAMS depends on the quality of LLM-based claim decomposition; extraction errors propagate downstream, decontextualization can supply an incorrect entity, time, or location, and claim equivalence for clustering is inherently fuzzy, so clustering errors can mis-merge or split evidence.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    All systems are evaluated on the same preprocessed inputs and matched output-length constraints.

    “All systems are evaluated on the same preprocessed inputs and matched output-length constraints.”
    Quote in the paperSubstantial claim
46 of 46

  • The paper relies on this without support.

    Instruction-tuned models routinely miscount positions and hallucinate spans when directly asked for character or token offsets.

    “A direct demand for character or token offsets is unreliable: instruction-tuned models routinely miscount positions and hallucinate spans.”

  • The paper relies on this without support.

    Embedding proximity conflates equivalence with relatedness and even contradiction.

    “Because embedding proximity conflates equivalence with relatedness-and even contradiction, since”

  • The paper relies on this without support.

    Decontextualization can introduce wrong fillers.

    “Because decontextualization can introduce wrong fillers, claim and quote are kept as separate, separately supportchecked fields rather than treated as equivalent.”

  • The paper relies on this without support.

    A gradient-boosted decision tree is sample-efficient on a few thousand examples.

    “Choosing a GBDT over a neural scorer is deliberate: it is sample-efficient on a few thousand examples, which underlies the graceful low-resource degradation in §5.9.”

  • The paper relies on this without support.

    MDS compounds faithfulness and verifiability problems because the same fact recurs across sources (redundancy), different sources disagree (conflict), and a single summary statement is often supported by evidence from several documents at once (multi-source support).

    “MDS compounds both problems.The same fact recurs across sources (redundancy), different sources disagree (conflict), and a single summary statement is often supported by evidence drawn from several documents at once (multi-source support).”

  • The paper relies on this without support.

    LLM decomposition improves recall and yields fluent, normalized claims while still anchoring each to its source at the first stage rather than recovering it later.

    “Unlike off-the-shelf OpenIE (Angeli et al., 2015) used in prior modular work (Guan and Padmakumar, 2023), LLM decomposition improves recall and yields fluent, normalized claims while still anchoring each to its source at the first stage rather than recovering it later.”

  • The paper relies on this without support.

    Attribution and atomic-fact factuality are usually studied apart in prior work.

    “We hope the claim-anchored view helps reconnect attribution and atomic-fact factuality, usually studied apart.”
7 of 7

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Quote-matching rates do not add up

    Minor

    The stated 12-point fuzzy rescue added to the 88% exact-match rate would yield 100%, not the reported 97% final matched rate.

    Reported 97 · recomputed 100

  • Verification ablation has two FActScore values

    Minor

    For MultiNews, Table 1 gives the verification-ablated CAMS FActScore as .85, whereas the fair post-processing control gives its verifier-ablated row a FActScore of .86.

2 of 2

Cites

Flagged first, then by citations

2 of the 52 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Ori Ernst, Mohit Bansal, Noah A. Smith, and Greg Dur- rett. 2021. A human-aligned span-level evaluation framework for text summarization. In Proceedings of ACL-IJCNLP.
  2. Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. Lightgbm: A highly efficient gradient boosting decision tree. In Advances in Neural Information Processing Systems (NeurIPS).

Cited by

Sorted by citations

Related

Authors
Guan, S.
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2606.23989
arXiv
2606.23989
OpenAlex
W7165800219
Cited by
0
References
52
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
multi-document summarization, provenance, attribution, faithfulness, large language models, CAMS

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review