Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models

May combine two claims.

Iteration pays inside a model's forward process and stops paying when routed through exchanged text between agents.

“Iteration pays inside a model's forward process and stops paying when routed through exchanged text between agents”

• cites Dehghani et al., 2019Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Geiping et al., 2025 sourcePartly supported

  Section 1 (p. 1) says additional iterations of the model’s latent-state recurrence can improve performance, supporting the claim that iteration pays inside the model. Neither that section nor the retrieved passages address text exchanged between agents or show that iteration stops helping in that setting. (LLM, conf=0.88)

  Experimental — accuracy not yet measured
• cites Saunshi et al., 2025 sourcePartly supported

  Section 3.1 (p. 6) reports improved results from additional loops within a model, supporting the claim that internal iteration can pay off. The paper does not assess agents exchanging text or show that iteration stops helping in that setting; it instead discusses a theoretical connection between looping and chain-of-thought reasoning (Section 6, p. 12). (LLM, conf=0.88)

  Experimental — accuracy not yet measured

May combine two claims.

At a matched generation budget, debate ties with or loses to self-consistency sampling on every task; the advantage over single-agent inference disappears and is indistinguishable from zero on math, GSM8K, and MMLU.

“at matched budget conditions it ties or even loses to self-consistency sampling”

• Also stated in: § 5.1 MAIN RESULTS: DEBATE HELPS ONLY AS MUCH AS ITS COMPUTE BUDGET · plain

  “against the budget-matched control -nine independent samples, same model and temperature spread, majority-voted -the advantage disappears in all cases and it is indistinguishable from zero on math, GSM8K, and MMLU.”

• AssumptionRests on an assumption: The 23-model pool is representative of small open-weight language models generally, so the conclusions generalise beyond the specific models tested.

May combine two claims.

Debate costs 1.6 times the wall-clock time and 3.4 times the total token count relative to the budget-matched sampling control.

“at 1.6× the wall-clock and 3.4× the token cost”

• Also stated in: § 5.1 MAIN RESULTS: DEBATE HELPS ONLY AS MUCH AS ITS COMPUTE BUDGET · plain

  “while costing 1.6× the wall-clock and 3.4× the total tokens”

May combine two claims.

On the judged biography task, claim precision is worst at the most redundant persona rung (7.1 points below baseline) and recovers 3.3 points by the maximally diverse rung.

“biography claim precision is worst at rung 0 (-7.1pp,p = 0.048), recovering +3.3pp by rung 10.”

• AssumptionRests on an assumption: The determinant of the cosine-similarity matrix of persona embeddings in a model's own representation space measures cognitive diversity as it affects debate performance.

May combine two claims.

The largest accuracy drop on every task occurs from the no-persona baseline into the most redundant persona team (rung 0); three near-clone personas cost 4.3 points on GSM8K, 4.2 on MMLU, and 7.3 on CSQA.

“the largest drop on every task is from baseline into rung 0; three near-clone personas cost -4.3pp on GSM8K (p = 0.012), -4.2 on MMLU (p = 0.003), and -7.3 on CSQA (p = 10 -4 ), even before any diversity enters.”

• AssumptionRests on an assumption: The determinant of the cosine-similarity matrix of persona embeddings in a model's own representation space measures cognitive diversity as it affects debate performance.

May combine two claims.

The debate deficit is largest for the least diverse teams and vanishes for the most diverse: strong-duplicated pairs lose 2.68 points, while four-model teams at n=5 are indistinguishable from their fifteen-sample controls.

“the deficit is largest for the least diverse teams and vanishes for the most: strong-duplicated pairs lose 2.68pp, while four-model teams at n=5 are indistinguishable from their fifteen-sample controls (+0.04/+0.56,null)”

May combine two claims.

Persona descriptions span only 11 to 19 words while per-persona drag spans 21 percentage points.

“persona descriptions span only 11-19 words while per-persona drag spans 21pp”

May combine two claims.

Description length explains under 9% of between-persona variance, with R2 = 0.087 on word count, character count uncorrelated at r = -0.01, based on 1,605 paired agent-slot observations.

“description length explains under 9% of between-persona variance (R 2 =0.087 on word count, and character count is uncorrelated outright, r= -0.01; 1,605 paired agent-slot observations)”

May combine two claims.

The overflow destroyed cells for exactly five models, all long-form thinkers served at 16-32K windows; Qwen3.5-27B's seven-agent GSM8K, MMLU, and biography cells were 93-100% empty in the final round.

“This destroyed cells for exactly five models, all long-form thinkers served at 16-32K windows; Qwen3.5-27B'sseven-agent GSM8K, MMLU, and biography cells were 93-100% empty in the final round.”

May combine two claims.

The matched ensembles repair +16.4 points in those cells against debate's +13.5, and clear the 10-point rescue bar in 22 cells where debate does not.

“they repair +16.4pp in those cells against debate's +13.5 and clear the 10-point rescue bar in 22 cells where debate does not (4 in the reverse direction).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Llama-4-Scout's maximally-diverse persona teams beat its matched sampling control on MMLU (87.0 vs. 83.0) and CSQA (91.0 vs. 89.0).

“Llama-4-Scout's maximally-diverse persona teams beat its matched sampling control on MMLU (87.0 vs. 83.0)and CSQA (91.0 vs. 89.0)”

May combine two claims.

The harm from persona diversity is not a small-team voting artifact: it persists, and on knowledge tasks deepens, at five and seven agents.

“Nor is the harm a small-team voting artifact: it persists, and on knowledge tasks deepens, at five and seven agents.”

May combine two claims.

Spreading self-consistency samples over the debate arms' temperature range (0.5-1.0) changes accuracy by no more than 0.41 points at any budget, with no task moving more than 1.5 points.

“Paired over all 92 (model, task) cells, the spread changes nothing at any budget (-0.11 to -0.41pp, all p ≥ 0.34; no task moves more than 1.5pp).”

May combine two claims.

The matched-ensemble controls show that everything model diversity contributes, including error decorrelation across families and complementary failure modes, is captured by voting over the mixed roster, and the deliberation layered on top subtracts a little.

“The matched-ensemble controls show that everything model diversity contributes (error decorrelation across families, complementary failure modes) is captured by voting over the mixed roster; the deliberation layered on top subtracts a little (Table 2).”

May combine two claims.

Mixed-model debate teams lose to majority votes over their own rosters by 1.04 points (95% CI [-1.61, -0.52] over 320 team-task cells), winning only 83 of 320 with a median delta of zero, and the deficit replicates at a second problem seed (-0.93 points).

“mixed-model teams lose to majority votes over their own rosters”

• Also stated in: § Mixed-model debate does not beat matched-budget sampling. · plain

  “debate loses by 1.04pp (95% CI [-1.61, -0.52]; 320 team-task cells), winning only 83 of 320 with a median delta of exactly zero.”

• AssumptionRests on an assumption: The 23-model pool is representative of small open-weight language models generally, so the conclusions generalise beyond the specific models tested.

May combine two claims.

Debate can repair errors: corrective flips outnumber harmful ones in all cases, and mixed teams overturn 63.7% of wrong round-one majorities versus 42.9% for homogeneous teams.

“Transcripts confirm debate can repair errors: corrective flips outnumber harmful ones in all cases, and mixed teams overturn 63.7% of wrong round-one majorities versus 42.9% for homogeneous.”

May combine two claims.

The temperature-matched debate-versus-sampling comparison stood at -1.84 points as run, -0.30 excluding bound cells, and -0.06 after re-running every affected cell at 131K.

“the temperature-matched debate-versus-sampling comparison stood at -1.84pp as run, -0.30 excluding bound cells, and -0.06 after re-running every affected cell at 131K (276 paired cells).”

May combine two claims.

On biography generation, debate at n=3 edges solo generation (55.6% vs. 54.6% claim precision) and persona teams reduce it to 51.8%.

“Debate at n=3 edges solo generation (55.6% vs. 54.6%claim precision) and persona teams reduce it to 51.8% (Figure 1).”

• AssumptionRests on an assumption: The reference articles used to classify biography claims are accurate ground truth for the factual content of the biographies.

May combine two claims.

Multi-round debate transcripts silently overflow serving context windows for long-form reasoning models, so later prompts leave no room to generate and agents return empty final answers that scorers count as wrong.

“debate transcripts silently overflow serving context windows”

• Also stated in: § 5.4 BIOGRAPHY GENERATION · plain

  “When the transcript approaches the serving context window, later prompts leave no room to generate and agents return empty final answers, which scorers count as wrong.”

May combine two claims.

Debate's genuine gains over single-agent inference are an ensemble-sampling effect: nearly all benefit arrives with the first exchange, and none survives budget matching, at 1.6 times the wall-clock and 3.4 times the token cost.

“Debate's genuine gains over single-agent inference are an ensemble-sampling effect: nearly all benefit arrives with the first exchange, and none survives budget matching, at 1.6× the wall-clock and 3.4× the token cost.”

May combine two claims.

Heterogeneous teams realize all of their benefits through majority voting alone, a result that replicates across problem seeds.

“Heterogeneous teams realize all of their benefits through majority voting alone, a result that replicates across problem seeds.”

May combine two claims.

The persona tax shrinks with model capability, with a Spearman correlation of +0.46 and p = 0.027.

“shrinks with model capability (Spearman +0.46, p = 0.027)”

May combine two claims.

The persona penalty is significant only under the Gemma judge; judge vendor, not judge scale, dominates evaluation variance.

“The persona penalty is significant only under the Gemma judge; judge vendor, not judge scale, dominates evaluation variance.”

May combine two claims.

After re-running at the full budget, the pooled comparison gives solo 49.1, debate 54.3, and SC-9 54.9; the debate-minus-SC-9 difference is -0.6 percentage points (95% CI [-2.2, +1.0]), a null result.

“After re-running the experiments at the full budget, the pooled comparison lands at solo 49.1, debate 54.3, SC-9 54.9: debate -SC-9 = -0.6pp[-2.2, +1.0], null like everywhere else.”

May combine two claims.

Eight reasoning models missed by the engine's name-matching pattern ran with a 4,096-token thinking budget, and this cap most severely affected the single-shot control: SC-9 parse rates dropped to as low as 60% when capped reasoning exhausted the budget mid-derivation.

“Eight reasoning models missed by the engine's name-matching pattern ran at a 4,096-token thinking budget, and the cap punished the single-shot control hardest: SC-9 parse rates fell as low as 60% as capped reasoning ran off the budget mid-derivation.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For quads with a weak duplicate, debate scores 0.56 percentage points higher than the matched ensemble, with a 95% CI [-0.34, +1.41] that includes zero.

“Quad, weak dup. (n=5) | 20 | 90.5 | 90.0 | +0.56 [-0.34, +1.41]”

May combine two claims.

Under both metrics, in all 23 models, the most-redundant teams remain the most redundant and the MaxDet teams remain near-optimal.

“Under both metrics, in all 23 models, the most-redundant teams remain the most redundant and the MaxDet teams remain near-optimal.”

Classified as probably not a substantial claim. May combine two claims.

When an accumulating transcript exceeds a context window, the response returns empty and scores incorrect.

“When an accumulating transcript exceeds a window the response returns empty and scores incorrect”

May combine two claims.

Binary log-odds weighting backfires (-1.68 percentage points vs. plain majority, pooled) because members with solo accuracy below 50% receive negative weights and anti-vote while still being far above 4-5-way chance.

“Binary log-odds weighting backfires (-1.68pp vs. plain majority, pooled) because members with solo accuracy below 50% receive negative weights and anti-vote while still being far above 4-5-way chance.”

May combine two claims.

Essentially the entire gain from debate rounds arrives with the first exchange (r=2); rounds 3-5 are flat, and CSQA declines beyond r=2.

“Essentially the entire gain arrives with the first exchange (r=2); rounds 3-5 are flat, and CSQA declines beyond r=2.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For quads with a strong duplicate, debate scores 0.04 percentage points higher than the matched ensemble, with a 95% CI [-0.39, +0.50] that includes zero.

“Quad, strong dup. (n=5) | 20 | 91.9 | 91.8 | +0.04 [-0.39, +0.50]”

May combine two claims.

Debate's prompt-side consumption is roughly ten times the control's and its total token bill runs 2.3-4.1× across tasks, while losing or tying on accuracy.

“Debate re-reads its peers' growing transcript at every round, so its prompt-side consumption is roughly ten times the control's and its total token bill runs 2.3-4.1×across tasks, while losing or tying on accuracy (Table 1).”

May combine two claims.

On GSM-Symbolic, every configuration's results are within a point of its GSM8K counterpart, and debate and sampling are at parity (+0.35 percentage points).

“on GSM-Symbolic, whose templates perturb GSM8K surface forms, every configuration's results are within a point of its GSM8K counterpart, and debate and sampling are at parity (+0.35pp”

May combine two claims.

Token accounting shows that the correction frees the control rather than favoring either arm: liberation increases SC-9's generated tokens more than debate's (median 1.8× vs. 1.4×).

“Realized token accounting confirms the correction unbinds the control rather than favoring either arm: liberation raises SC-9's generated tokens more than debate's (median 1.8× vs. 1.4×)”

May combine two claims.

Debate is net-corrective: helpful flips outnumber harmful ones roughly two to one, 7.6% vs. 4.0% of agent-problem pairs.

“debate is net-corrective (helpful flips outnumber harmful ones roughly two to one, 7.6% vs. 4.0% of agent-problem pairs)”

May combine two claims.

The persona penalty is judge-vendor-dependent: Gemma alone sees a uniformly significant penalty (-7.4 percentage points, p < 10^-4), while either OpenAI judge alone sees none.

“The persona penalty is judge-vendor-dependent, which we report for full transparency: Gemma alone sees a uniformly significant penalty (-7.4pp, p < 10 -4 ), while either OpenAI judge alone sees none.”

May combine two claims.

The corrected runs reveal a protocol ceiling: with three 40K-budget thinking agents, round-3 prompts reach 100-112K tokens and generation is truncated to fit the 131,072-token serving window.

“The corrected runs also expose a protocol ceiling: with three 40K-budget thinking agents, round-3 prompts reach 100-112K tokens and generation is clamped to fit the 131,072-token serving window.”

May combine two claims.

The significant deficits concentrate in mid-to-weak compositions; all-strong teams are the one composition where debate significantly edges its ensemble (+0.44).

“The significant deficits concentrate in mid-to-weak compositions; all-strong teams are the one composition where debate significantly edges its ensemble (+0.44).”

May combine two claims.

Debate is negative where significant on math, GSM8K, and CSQA, but the weak-duplicated quad arm on MMLU is the one configuration where debate significantly beats matched sampling (+2.80 [+0.90, +4.60]).

“debate is negative where significant on math, GSM8K, and CSQA, but the weak-duplicated quad arm on MMLU is the one configuration where debate significantly beats matched sampling (+2.80 [+0.90, +4.60])”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For pairs with a weak duplicate, debate scores 1.63 percentage points lower than the matched ensemble, but the 95% CI [-4.62, +1.02] includes zero.

“Pair, weak dup. (n=3) | 15 | 79.8 | 81.4 | -1.63 [-4.62, +1.02]”

May combine two claims.

The all-weak composition gains most from the first exchange (61.5 to 74.2) and then erodes.

“The all-weak composition gains most from the first exchange (61.5 → 74.2) and then erodes.”

May combine two claims.

For Qwen3.5 reasoning models, accuracy drops by half at a 16K context window and then increases steadily up to 131K as empty final rounds are eliminated.

“The Qwen3.5 thinkers lose half their accuracy at 16K and recover monotonically to 131K as empty final rounds vanish”

May combine two claims.

Debate outperforms solo by 5.2 percentage points, but sampling also outperforms solo.

“Debate still beats solo here by +5.2pp, but so does sampling”

May combine two claims.

On MMLU-Pro the same 23 models score approximately 15 points below plain MMLU, with all 23 dropping.

“on MMLU-Pro the same 23 models score ∼15 points below plain MMLU (all 23 drop)”

Probably not a substantial claim: may not pass S3 (load-bearing).

The smallest selected-team determinant observed across all models is 2.7 × 10^-10, far above underflow.

“The smallest selected-team determinant observed across all models is 2.7 × 10 -10 , far above underflow.”

May combine two claims.

With corrected budgets, debate generates a median 0.6× the completion tokens of SC-9 while matching its accuracy, because later debate rounds rely on peers' answers and finish early.

“under corrected budgets debate generates a median 0.6× SC-9's completion tokens while tying the comparison, because later rounds anchor on peers' answers and conclude early.”

Probably not a substantial claim: may not pass S3 (load-bearing).

At three rounds, a 27B-class reasoning model fills the largest context window the authors can serve.

“At three rounds, a 27B-class thinker fills the largest window we can serve.”

May combine two claims.

Of the 23 per-model debate-minus-SC-9 differences, 19 are individually null, and the four significant ones are split evenly between the two directions.

“19 of 23 per-model debate-SC-9 deltas are individually null and the four significant ones split two per side.”

May combine two claims.

Scaling to all 23 models shrinks the lead to +3.2 percentage points, not statistically significant, and correcting a second silent budget artifact eliminates it.

“Scaling to all 23 models shrinks the lead to +3.2pp, not statistically significant, and correcting a second silent budget artifact eliminates it.”

May combine two claims.

Cross-vendor agreement is moderate while intra-vendor agreement is near-perfect: the GPT-OSS-20B/120B pair agrees at κ 0.759/0.762, exceeding every cross-vendor pair (0.32-0.57).

“Cross-vendor agreement is moderate while intra-vendor agreement is near-perfect: the GPT-OSS-20B/120B pair agrees at κ 0.759/0.762(claim and fact directions), exceeding every cross-vendor pair (0.32-0.57)”

May combine two claims.

On the hardest slice, debate's directional edge over sampling came from a generation-budget cap handicapping the control, and correcting it leaves that comparison null too.

“On the hardest slice, debate's directional edge over sampling came from a generation-budget cap handicapping the control, and correcting it leaves that comparison null too (Appendix G).”

May combine two claims.

The correct multiclass form log p(K-1)/(1-p) beats debate significantly on core triples at both seeds (-1.11 percentage points at seed 42) and turns the previously null quads significantly pro-ensemble (-0.51 percentage points), while the pairs delta is directionally negative but not significant (-1.59 [-3.12, +0.18]).

“The correct multiclass form log p(K-1)/(1-p) repairs this: it beats debate significantly on core triples at both seeds (-1.11pp at seed 42) and turns the previously null quads significantly pro-ensemble (-0.51pp), while the pairs delta is directionally negative but not significant (-1.59 [-3.12, +0.18];Table 11).”

May combine two claims.

The control's +10.0 percentage point margin over solo splits into +2.0 percentage points from temperature spread and +8.0 percentage points from multiplicity.

“The control's +10.0pp margin over solo splits into +2.0ppfrom temperature spread and +8.0pp from multiplicity”

May combine two claims.

Claim precision does not penalize epistemic refusal: a model that declines subjects it does not know is judged only on what it writes, flattering honest abstainers over confabulators.

“Claim precision does not penalize epistemic refusal: a model that declines subjects it does not know (the LFM family, on up to 10 of 40 subjects in some cells) is judged only on what it writes, flattering honest abstainers over confabulators.”

May combine two claims.

The accuracy penalty from personas is a persona tax rather than a diversity tax: any personas cost small models accuracy, maximal diversity is the least harmful way to pay it, and redundant personas are the most harmful.

“the cost is a persona tax, not a diversity tax: redundant personas hurt most, while maximally-diverse teams recover part of the loss.”

• Also stated in: § 5.2 PERSONAS TAX SMALL MODELS AND DIVERSITY IS NOT THE CULPRIT · plain

  “The penalty in Figure 1 is therefore a persona tax, not a diversity tax: personas of any kind cost small models accuracy, and maximal diversity is the least harmful way to pay, and redundant personas the most.”

• AssumptionRests on an assumption: The determinant of the cosine-similarity matrix of persona embeddings in a model's own representation space measures cognitive diversity as it affects debate performance.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

On saturated benchmarks a frontier model leaves debate nothing to improve, so whether debate helps is measurable only where models can still fail.

“on saturated benchmarks a frontier model Preprint leaves debate nothing to improve, so”

Probably not a substantial claim: may not pass S1 (asserted), S2 (checkable), S3 (load-bearing), S4 (based).

Task-aligned persona choice, fine-tuned styles, or tool and information asymmetries could produce cognitive diversity that prompting cannot.

“task-aligned persona choice, fine-tuned styles, or tool and information asymmetries could produce cognitive diversity that prompting cannot”

May combine two claims.

Model diversity is harmless where persona diversity is harmful.

“model diversity is harmless where persona diversity is harmful”

Classified as probably not a substantial claim. May combine two claims.

Every condition answers identical problem sets (100 problems; biography 40 subjects; fixed sampling seed), so comparisons are paired by problem.

“Every condition answers identical problem sets (100 problems; biography 40 subjects; fixed sampling seed), so comparisons are paired by problem.”

May combine two claims.

Team accuracy is explained by aggregate member capability rather than by heterogeneity; teams do not benefit from spanning more model families once member strength is accounted for.

“The ordering is explained by aggregate member capability rather than by heterogeneity: teams do not benefit from spanning more model families once member strength is accounted for”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The biography conclusions inherit the judges' disagreement structure; the paper exposes it rather than resolves it, absent human claim-level annotation.

“The biography conclusions inherit the judges' disagreement structure: we expose it (vendor-balanced scoring, per-judge splits, κ matrices) rather than resolve it, absent human claimlevel annotation.”

• AssumptionRests on an assumption: LLM judge panel scores are a valid measure of biography claim quality, absent human annotation.

May combine two claims.

Redundant personas add correlated bias that majority voting cannot remove, while diverse personas at least decorrelate the damage.

“Redundant personas add correlated bias that majority voting cannot remove; diverse personas at least decorrelate the damage”

Classified as probably not a substantial claim. May combine two claims. The quote only partly states this claim.

Biography verdicts are parsed by last-label occurrence, and 'unsupported' is mapped to unverifiable so that substring matching cannot read it as supported.

“Verdicts are parsed by last-label occurrence, since reasoning judges deliberate before concluding, and”

Probably not a substantial claim: may not pass S4 (based).

All rungs of the dose-response ladder are determinant-selected.

“all rungs are determinant-selected”

Probably not a substantial claim: may not pass S3 (load-bearing).

Problems for which no agent produces a parseable answer are scored incorrect rather than dropped.

“Problems for which no agent produces a parseable answer are scored incorrect rather than dropped.”

Classified as probably not a substantial claim. May combine two claims.

Self-consistency runs come in two flavors, uniform temperature and the same temperature spread as debate teams, isolating the effect of deliberation itself.

“Self-consistency runs come in two flavors -uniform temperature (the control for persona debates) and the same temperature spread as debate teams (the control for temperature-diverse debates)isolating the effect of deliberation itself.”

Classified as probably not a substantial claim.

At matched inference budgets, homogeneous debate frequently fails to beat self-consistency or majority voting.

“at matched inference budgets, homogeneous debate frequently fails to beat self-consistency or majority voting (Smit et al., 2024;Zhang et al., 2025)”

• cites Smit et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Unless a condition specifies otherwise, agents receive mildly diversified sampling temperatures evenly spaced in [0.5, 1.0), so that no condition conflates its treatment with trivially identical decoding.

“unless a condition specifies otherwise, agents receive mildly diversified sampling temperatures evenly spaced in [0.5, 1.0), so that no condition conflates its treatment with trivially identical decoding.”

Classified as probably not a substantial claim. May combine two claims.

Uncertainty is estimated by bootstrap confidence intervals, paired by problem for debate-versus-control deltas and clustered over teams where teams are the sampled unit.

“Uncertainty is estimated by bootstrap (Efron, 1979) confidence intervals: paired by problem for debate-versus-control deltas, clustered over teams where teams are the sampled unit”

• cites Efron, 1979Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Per-task significance patterns do shift between seeds, and each cell rests on 100 problems (40 biography subjects).

“per-task significance patterns do shift between seeds and each cell rests on 100 problems (40 biography subjects)”

Classified as probably not a substantial claim. May combine two claims.

Biography evaluation uses a three-judge primary panel that never participates in debates, with no judge sharing a model generation with any participant.

“Biography evaluation uses a three-judge primary panel that never participates in debates -Gemma-3-27B-it, GPT-OSS-20B, and GPT-OSS-120B -with no judge sharing a model generation with any participant”

Classified as probably not a substantial claim.

Every debate configuration is paired with a generation-budget-matched self-consistency control.

“every debate configuration is paired with a generationbudget-matched self-consistency control”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Domains valuing novelty or synthesis may reward diversity differently.

“domains valuing novelty or synthesis may reward diversity differently”

May combine two claims.

Small open-weight models retain benchmark headroom and support thousands of matched controls, making the study's goal measurable.

“Small open-weight models (Gemma Team, Google DeepMind, 2024;DeepSeek-AI, 2025) make this goal measurable: they retain benchmark headroom and support thousands of matched controls.”

• cites Gemma Team, Google DeepMind, 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites DeepSeek-AI, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Du et al. (2023) report significant gains over single-agent inference for GPT-3.5/4 on arithmetic, factual questions, and biography generation.

“Du et al. (2023) report significant gains over single-agent inference for GPT-3.5/4 on arithmetic, factual questions, and biography generation.”

• cites Du et al. (2023)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

For each model and team size n in {3, 5, 7}, the persona team is the combination maximizing the diversity objective in that model's own representation space.

“for each model and team size n ∈ {3, 5, 7} we select the combination maximizing the diversity objective of Section 3.3 in that model's own representation space”

Classified as probably not a substantial claim. May combine two claims.

Model-diversity teams partition the pool into lineage classes (vendor by generation), forbid two same-class models per team, and stratify teams by empirical capability tier.

“We partition the pool into lineage classes (vendor × generation), forbid two same-class models per team, and stratify teams by empirical capability tier”

May combine two claims.

Different models bring genuinely different capabilities without imposing load on any single agent, and mixed teams suffer no analogue of the persona tax.

“Different models bring genuinely different capabilities without imposing load on any single agent: each operates in its natural mode, and mixed teams suffer no analogue of the persona tax.”

Classified as probably not a substantial claim. May combine two claims.

Multiple-choice answers are extracted position-sensitively and the explicit answer stated last in a response wins, because debate responses routinely quote other agents' answers.

“Multiplechoice answers are extracted position-sensitively and the explicit answer stated last in a response wins.We make this choice because debate responses routinely quote other agents' answers before concluding and first-match extraction systematically mis-credits quoted answers.”

May combine two claims.

Seeing other agents' biographies hurts precision relative to writing independently, extending the budget argument to the judged task.

“Seeing other agents' biographies hurts precision relative to writing independently, extending the budget argument to the judged task.”

Classified as probably not a substantial claim.

The vendor-balanced score averages the OSS pair into one vote before averaging with Gemma.

“the vendor-balanced score therefore averages the OSS pair into one vote before averaging with Gemma”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Biography claims are extracted by a deterministic parser that segments the generated biography at bullet points; no LLM takes part in the extraction step.

“Biography claims are extracted by a deterministic parser that segments the generated biography at bullet points; no LLM takes part in the extraction step”

Classified as probably not a substantial claim. May combine two claims.

Persona debates hold temperature fixed at 1.0 to avoid confounding the persona effect with temperature, and their matched control is uniform-temperature self-consistency.

“Persona debates fix T =1.0 so the persona effect is not confounded with temperature and their like-for-like control is uniform-temperature self-consistency.”

Classified as probably not a substantial claim. May combine two claims. The quote only partly states this claim.

Each debate arm is compared with a control drawn from the same model roster and given the same generation budget, which separates deliberation from sampling randomness.

“Every debate arm is compared against a control built from the same model roster at the same generation budget (generations per problem) in”

Probably not a substantial claim: may not pass S3 (load-bearing).

Persona-team selection is exactly reproducible: re-enumeration of each model's combinatorial persona space reproduces every published team.

“Persona-team selection is exactly reproducible: re-enumeration of each model's combinatorial persona space reproduces every published team”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every number in the paper is produced by a deterministic script.

“Every number in the paper is produced by a deterministic script”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The supplementary judge Muse Glimmer shares a vendor with two participant models; it is used only for the judge-coupling ablation and is excluded from headline scores.

“The supplementary judge, Muse Glimmer, fully shares a vendor with two participant models; it serves only the judge-coupling ablation and is never pooled into headline scores (Table 15).”

Classified as probably not a substantial claim. May combine two claims.

Benchmark subsampling is uniform at random without subject stratification, drawn once per task with fixed seed 42 (seed 43 for replication) and reused across all arms, so every comparison is paired on identical problems.

“Benchmark subsampling is uniform at random without subject stratification, drawn once per task with fixed seed 42 (seed 43 for the replication slice) and reused across all arms, so every comparison is paired on identical problems.”

Probably not a substantial claim: may not pass S4 (based).

Generated-token ratios near 1× confirm the budgets are matched.

“Generated-token ratios near 1× confirm the budgets are matched.”

May combine two claims.

The budget cap and context overflow are analogous: both silently disadvantage one arm of a matched comparison.

“The budget cap is context overflow's twin (Section 5.5): both silently handicap one arm of a matched comparison”

May combine two claims.

On difficult questions, single-shot reasoning with a capped budget exhausts the budget mid-derivation, whereas debate's later rounds rely on peers' answers and reach a conclusion earlier.

“On questions this hard, capped single-shot reasoning runs off the budget mid-derivation, while debate's later rounds anchor on peers' answers, arriving at a conclusion early”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

All models are open-weight releases served on a single engine version.

“All models are open-weight releases served on a single engine version”