CoChat
Sign Up
PreprintCited by 1Topic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications

Process Supervision via Verbal Critique Improves Reasoning in Large Language Models

Open access
Chen, Hao-Yuan·2026·arXiv
DOI 10.48550/arxiv.2604.21611arXiv 2604.21611
Open this paper in CoChat — free accountOpen PDF

Abstract

Inference-time scaling for LLM reasoning has focused on three axes: chain depth, sample breadth, and learned step-scorers (PRMs). We introduce a fourth axis, granularity of external verbal supervision, via Verbal Process Supervision (VPS), a training-free framework that uses structured natural-language critique from a stronger supervisor to guide an iterative generate-critique-refine loop up to a round budget R. Across GPQA Diamond, AIME 2025, and LiveCodeBench V6 (covering both closed and open models), VPS yields three key results. First, on GPQA Diamond, GPT-5.4 (High) | GPT-5.4 (Low) reaches 94.9% at R=4, surpassing the 94.1% state of the art without gradient updates. Second, on AIME 2025, VPS enables strong weak-actor rescue, boosting scores from 11.7-26.7% to 63.3-90.0% (up to +63.3 points). Third, at matched compute, VPS outperforms Reflexion by +8.5 to +12.1 points and Self-Consistency@5 by +5.0 pp (GPQA) and +8.3 pp (LiveCodeBench), isolating critique granularity as the key driver. Performance scales with the supervisor-actor capability gap (Pearson r=0.90) and degrades when errors are not linguistically expressible (e.g., code synthesis), motivating hybrid verbal-executable methods. These results establish critique granularity as a new axis of inference-time scaling.

AI snapshot

Written from the paper’s full text.

TL;DR

Verbal Process Supervision (VPS) is a training-free inference-time framework that uses step-level natural-language critique from a stronger supervisor to iteratively refine a weaker actor’s reasoning. Across GPQA Diamond, AIME 2025, and LiveCodeBench V6, VPS improves reasoning, especially in weak-actor rescue settings, and outperforms outcome-level Reflexion at matched compute.

Key findings

  • On GPQA Diamond, the GPT-5.4 (High) | GPT-5.4 (Low) configuration reaches 94.9% at R = 4, surpassing the reported SOTA of 94.1%; this is +2.1 pp over the actor standalone (92.8%).
  • On AIME 2025, weak actors scoring 11.7–26.7% standalone are lifted to 63.3–90.0%, with absolute gains up to +63.3 pp; e.g., GPT-5.4 Nano (High | Low) rises from 26.7% to 90.0% at R = 3.
  • At matched inference compute, VPS outperforms Reflexion by +8.5 pp on GPQA, +10.0 pp on AIME, and +12.1 pp on LCB; it outperforms Self-Consistency @ 5 by +5.0 pp on GPQA and +8.3 pp on LCB, and narrowly exceeds SC@5 by +1.1 pp on AIME.
  • Supervisor headroom predicts VPS gain (Pearson r = +0.90); when actor ≥ supervisor or cross-family mismatch dominates, VPS can degrade (e.g., GLM-5.1 | Nemotron on AIME: 90.2% actor peaks at 80.0%, −10.2 pp), and code synthesis shows a domain boundary where open-weight LCB pairs remain below actor baselines (−28.8 to −63.5 pp).

Methods

  • VPS is training-free: an actor generates a reasoning trajectory, a typically stronger supervisor produces structured step-level natural-language critique, and the actor regenerates conditioned on the critique for up to R rounds; no gradient updates, human labels, or task-specific reward engineering are used.
  • Evaluated on GPQA Diamond (n = 198; SOTA 94.1%), AIME 2025 (n = 30; SOTA 95.0%; pass@1), and LiveCodeBench V6 (SOTA 91.7%; pass@1), using same-family and cross-family supervisor-actor pairs including GPT-5.4, GLM-5.1, Nemotron-3-Super, Gemma 4 31B, and GPT-OSS 120B/20B.
  • Ablates round counts R ∈ {1, 2, 3, 4} and compares at matched compute against Self-Consistency @ 5 and Reflexion (outcome-level verbal critique); reported numbers are single-run point estimates.

Limitations

  • Stated: all reported numbers are single-run point estimates; narrow margins—+2.1 pp GPQA over actor standalone and +1.1 pp AIME over SC@5—require multi-seed confirmation, with seed-averaged baselines promised for camera-ready. VPS is bounded by supervisor capability, the study is English-only, one LCB row remains incomplete, and the code-synthesis domain boundary motivates hybrid verbal-executable supervision.
  • Evident from the text: round-count scaling is non-monotonic and model-pair-dependent; only 2 of 11 configurations show monotonically non-decreasing accuracy across R ∈ {1,2,3,4}, while 9 exhibit at least one regression. AIME rescue configurations show high volatility (std. dev. 6–11 pp), and several configurations degrade below the actor standalone.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2604.21611

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

3 of 3 cited sources checked · 1 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps.

    “However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Shinn et al. [2023] source

      Section 3 (p. 4) says the Evaluator assigns a scalar reward to a trajectory, but distinguishes that reward from the verbal self-reflection generated afterward. It says self-reflection can identify a specific mistaken action and recommend a different one, contrary to the claim that the verbal feedback necessarily conflates errors across steps or applies the same critique to different failures. (LLM, conf=0.86)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Findingown data

    On AIME, Gemma 4 | GPT-OSS 20B lifts the actor from 11.7% to 70.0% (+58.3 pp).

    “On AIME, Gemma 4 | GPT-OSS 20B lifts the actor from 11.7% to 70.0% (+58.3 pp)”
    Quote in the paperSubstantial claim
  • Findingown data

    Optimal R varies by model pair.

    “Optimal R varies by pair.”
    Quote in the paperSubstantial claim
  • Findingown data

    GPT-OSS 120B | 20B lifts the same actor to 63.3% (+51.6 pp).

    “GPT-OSS 120B | 20B lifts the same actor to 63.3% (+51.6 pp)”
    Quote in the paperSubstantial claim
  • Findingown data

    VPS gains are mediated by the supervisor-actor capability gap, with Pearson r = +0.90.

    “Gains are mediated by the supervisor-actor capability gap (Pearson r = +0.90)”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 5
  • May combine two claims. 42

  • Classified as probably not a substantial claim.

    Premisecitation

    Let's Verify Step by Step showed that process-level signals outperform outcome-only supervision on mathematical reasoning.

    “Let's Verify Step by Step Lightman et al. [2023] showed that process-level signals outperform outcome-only supervision on mathematical reasoning”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Lightman et al. [2023] source

  • May combine two claims.

    Findingcitation

    Reflexion underperforms the actor on GPQA (86.4% vs. 92.8%), consistent with prior findings that outcome-level reflection can introduce distribution shift when actors are already competent; VPS does not show this failure mode on the same configuration.

    “Notably, Reflexion underperforms the actor on GPQA (86.4% vs. 92.8%),consistentwithpriorfindings that outcome-level reflection can introduce distribution shift when actors are already competentHuang et al. [2023]; VPS does not show this failure mode on the same configuration.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Huang et al. [2023] source

      Split into 3 atoms — 2 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured

  • May combine two claims.

    Findingown data

    VPS outperforms Reflexion by +8.5 pp on GPQA, +10.0 pp on AIME, and +12.1 pp on LCB.

    “VPS outperforms Reflexion by +8.5 pp on GPQA, +10.0 pp on AIME, and +12.1 pp on LCB.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    On AIME 2025, VPS lifts weak actors scoring 11.7-26.7% standalone to 63.3-90.0%, yielding absolute gains of up to +63.3 points.

    “Second, on AIME 2025, VPS unlocks dramatic capability amplification in a weak-actor rescue regime: actors scoring 11.7-26.7%standalone are lifted to 63.3-90.0%,yielding absolute gains of up to +63.3 points.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Round-count scaling is non-monotonic and model-pair-dependent.

    “Round-count scaling is non-monotonic and model-pair-dependent.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    VPS outperforms Self-Consistency @ 5 by +5.0 pp on GPQA Diamond and +8.3 pp on LiveCodeBench V6.

    “and outperforms Self-Consistency @ 5 by +5.0 pp on GPQA Diamond and +8.3 pp on LiveCodeBench V6”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Across 11 completed configurations, the best score first appears at R = 4 in 6 cases, R = 3 in 3, and R = 2 in 2.

    “Across 11 completed configurations, the best score first appears at R = 4 in 6 cases, R = 3 in 3, and R = 2 in 2.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    On AIME, GLM-5.1 | Nemotron-3-Super pairs a 90.2% actor with a 92.7% supervisor; VPS peaks at 80.0%, 10 pp below the actor standalone.

    “On AIME, GLM-5.1 | Nemotron-3-Super pairs a 90.2% actor with a 92.7% supervisor; VPS peaks at 80.0% -> 10 pp below the actor standalone.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    GPT-5.4 on GPQA rises from 87.9% at R = 1 to 94.9% at R = 4 with a dip at R = 3.

    “GPT-5.4 on GPQA rises from 87.9% at R = 1 to 94.9% at R = 4 with a dip at R = 3.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Panel (b) shows an actor-ceiling effect: weak-actor configurations rise clearly above y = x, while strong actors cluster near or below it.

    “Panel (b) shows an actor-ceiling effect: weak-actor configurations rise clearly above y = x, while strong actors cluster near or below it.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    On GPQA Diamond, the GPT-5.4 (High) | GPT-5.4 (Low) configuration reaches 94.9% at R = 4, surpassing the reported state of the art of 94.1%.

    “First, on GPQA Diamond, the GPT-5.4(High) | GPT-5.4 (Low) configuration reaches 94.9% at R = 4, surpassing the reported state of the art of 94.1%, achieved purely through samefamily verbal self-refinement with zero gradient updates.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    SC@5 consumes approximately 5× actor tokens; VPS at R = 4 costs approximately 1.2-1.4× SC@5.

    “Total cost is 5× one actor trajectory; VPS at R = 4 costs ≈1.2-1.4×SC@5 (supervisor generations are 30-50% shorter than actor generations; supervisor tokens are included in all VPS cost accounting).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    GPT-5.4 zero-headroom: H = 0 pp yet Δ = +2.1 pp.

    “GPT-5.4 zero-headroom: H = 0 pp yet ∆ = +2.1 pp.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The SC@5 gap (+5.0 pp, approximately 10 extra correct answers) is more robust and less likely to reverse.

    “The SC@5 gap (+5.0 pp, ≈10 extra correct answers) is more robust and less likely to reverse.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    VPS exceeds the actor in 5 of 11 cases with actor baselines and falls below it in 6; the failures split into strong-actor/cross-family and code-synthesis domain boundary regimes.

    “VPS exceeds the actor in 5 of 11 cases with actor baselines and falls below it in 6; the failures split cleanly into two regimes: (a) strong-actor / cross-family (GLM-5.1 | Nemotron on GPQA and AIME, where low headroom or family mismatch dominates) and (b) code-synthesis domain boundary (all LCB open-weight pairs, regardless of headroom).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The same-family GPT-5.4Mini curve improves from 38.5% to 50.0% and beats both baselines at matched compute, but lacks standalone references.

    “The same-family GPT-5.4Mini curve improves from 38.5% to 50.0% and beats both baselines at matched compute, but lacks standalone references.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Error signal visibility by domain: GPQA conceptual/logical errors are high visibility and verbally sufficient (+2.1 pp); AIME algebraic/arithmetic errors are high visibility and verbally sufficient (+63.3 pp); LCB runtime/edge-case errors are low visibility and not verbally sufficient (-28 to -64 pp).

    “GPQA (science) Conceptual, logical | High | Yes | +2.1 pp”
    • Also stated in: § Additional information · plain
      “AIME (math) | Algebraic, arithmetic High | Yes | +63.3 pp”
    • Also stated in: § Additional information · plain
      “LCB (code) | Runtime, edge cases | Low | No | -28 to -64 pp”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Headroom regularities: H > 50 pp implies gain > 50 pp; H in [0, 13] pp implies marginal gain of 0-5 pp; H < 0 implies degradation in all 3 cases.

    “Three regularities hold: (1) H > 50 pp ⇒ gain > 50 pp; (2) H ∈ [0, 13] pp ⇒ marginal gain of 0-5 pp; (3) H < 0 ⇒ degradation in all 3 cases.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Panel (c) plots supervisor headroom (supervisor-actor) against VPS gain and reports Pearson r = +0.90.

    “Panel (c) plots supervisor headroom (supervisoractor) against VPS gain and reports Pearson r = +0.90.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    VPS outperforms SC@5 across benchmarks: LCB 50.0% vs 41.7% (+8.3 pp), GPQA 94.9% vs 89.9% (+5.0 pp), and AIME 90.0% vs 88.9% (+1.1 pp within likely seed variance).

    “At matched compute, VPS (50.0%) beats SC@5 (41.7%) by +8.3 pp on LCB, VPS (94.9%) beats SC@5 (89.9%) by +5.0 pp on GPQA Diamond, and VPS (90.0%) narrowly exceeds SC@5 (88.9%) by +1.1 pp on AIME 2025 -within likely seed”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    LCB is the principled exception: Gemma 4 | GPT-OSS has H = +10 pp yet falls -33.7 pp, confirming headroom is necessary but not sufficient past the verbal domain boundary.

    “LCB is the principled exception: Gemma 4 | GPT-OSS has H = +10 pp yet falls -33.7 pp, confirming headroom is necessary but not sufficient past the verbal domain boundary.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    While VPS is the strongest verbal method at matched compute, no verbal inference-time method-VPS, Reflexion, or SC@5-closes the absolute gap to standalone actors on open-weight pairs.

    “while VPS is the strongest verbal method at matched compute (Section 4.3), no verbal inference-time method -VPS, Reflexion, or SC@5 -closes the absolute gap to standalone actors on open-weight pairs.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Panel (f) shows the largest gains come with the largest volatility, especially on AIME rescue settings.

    “Panel (f) shows the largest gains come with the largest volatility, especially on AIME rescue settings.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    Several curves show interior peaks, arguing against a fixed round count and motivating adaptive stopping.

    “Several curves show interior peaks, arguing against a fixed round count and motivating adaptive stopping.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductown data

    The GPQA SOTA margin over standalone and SOTA is small (≤ 2 pp) on n = 198, so caution against overinterpretation is warranted prior to seed averaging.

    “over standalone and SOTA is small (≤ 2 pp) on n = 198; we caution against overinterpretation prior to seed averaging.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductnone given

    Reflexion shares VPS's supervisor, so the only axis of variation is critique granularity.

    “Reflexion shares VPS's supervisor, so the only axis of variation is critique granularity.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    Verbal feedback from a stronger supervisor is a sufficient and scalable reward signal for bootstrapping a self-improving reasoning loop.

    “Our central thesis is that verbal feedback from a stronger supervisor is a sufficient and scalable reward signal for bootstrapping a self-improving reasoning loop”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductnone given

    VPS operates entirely at inference time with no gradient updates, no human labels, and no additional training data.

    “VPS operates entirely at inference time -no gradient updates, no human labels, no additional training data.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    VPS benefit is mediated by supervisor-actor headroom (Pearson r = +0.90), with a principled domain boundary at code synthesis where errors are no longer linguistically representable.

    “Fourth, VPS benefit is mediated by supervisor-actor headroom (Pearson r = +0.90),with a principled domain boundary at code synthesis where errors are no longer linguistically representable.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    Three mechanisms drive non-monotonicity: over-correction, compounding errors, and critique drift.

    “Three mechanisms drive non-monotonicity: over-correction (supervisor critiques a correct step), compounding errors (stochastic regeneration accumulates failures), and critique drift (feedback becomes uninformative on nearly-correct trajectories).”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    GLM-5.1 | Nemotron on GPQA has H = +7 pp yet Δ = -18.1 pp; Nemotron's tokenizer and reasoning style introduce distribution shift beyond what H captures, and critic-actor format compatibility is a second latent variable.

    “GLM-5.1 | Nemotron (GPQA): H = +7 pp yet ∆ = -18.1 pp.Nemotron's tokenizer and reasoning style introduce distribution shift beyond what H captures; critic-actor format compatibility is a second latent variable.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    The AIME SC@5 gap (+1.1 pp) is one extra correct answer on n = 30 and is within variance; the paper claims only that VPS matches SC@5 here.

    “AIME SC@5 gap (+1.1 pp).One extra correct answer on n = 30; within variance.We claim only that VPS matches SC@5 here.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    VPS extends process supervision by replacing trained scorers with verbal critique from a stronger LLM, removing the annotation and training bottleneck.

    “VPS extends this insight by replacing trained scorers with verbal critique from a stronger LLM, removing the annotation and training bottleneck.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    SC@5 cannot rescue an 11.7% actor because majority vote over mostly-wrong samples is wrong, while VPS can.

    “The stronger argument is that SC@5 cannot rescue an 11.7% actor (majority vote over mostly-wrong samples is wrong), while VPS can.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    VPS is bounded by supervisor capability: when supervisors cannot reliably identify actor errors, critiques become uninformative.

    “VPS is bounded by supervisor capability: when supervisors cannot reliably identify actor errors, critiques become uninformative.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The supervisor is stronger than the actor and can identify errors the actor itself cannot detect.

  • May combine two claims.

    Interpretationreasoning

    The code-synthesis boundary is principled rather than a VPS-specific failure: verbal critique is most informative when errors are linguistically representable, and weaker in code synthesis where the decisive error signal lives in runtime behavior.

    “We interpret this as a principled domain boundary rather than a VPS-specific failure: verbal critique is most informative when errors are linguistically representable (sign errors, conceptual confusions, algebraic slips), and weaker in code synthesis where the decisive error signal lives in runtime behavior.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductown data

    The GPQA SOTA margin (+2.1 pp) is within single-run variance (±3.6 pp at 95% CI on n = 198) and requires multi-seed confirmation.

    “GPQA SOTA margin (+2.1 pp).Within single-run variance (±3.6 pp at 95% CI on n = 198); requires multi-seed confirmation.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    Having controlled for compute (SC@5) and verbal feedback presence (Reflexion), the remaining predictive variable is supervisor headroom, consistent with a mechanistic reading that verbal critique is effective only when the supervisor can identify errors the actor itself cannot detect.

    “Having controlled for compute (SC@5) and verbal feedback presence (Reflexion) in Section 4.3, the remaining predictive variable is supervisor headroom, consistent with a mechanistic reading: verbal critique is effective only when the supervisor can identify errors the actor itself cannot detect.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The supervisor is stronger than the actor and can identify errors the actor itself cannot detect.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    All reported numbers are single-run point estimates; narrow margins still require multi-seed confirmation.

    “All reported numbers are single-run point estimates; narrow margins -the +2.1 pp GPQA gain over actor standalone and the +1.1 pp AIME gap to SC@5 -still require multi-seed confirmation.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    The VPS vs. Reflexion difference (+8.5-12.1 pp) is strengthened by cross-benchmark replication across three domains and two model families; even granting ±3 pp variance per run, the consistent direction is not a sampling artifact.

    “VPS vs. Reflexion (+8.5-12.1 pp).Cross-benchmark replication across three domains and two model families substantially strengthens the claim; even granting ±3 pp variance per run, the consistent direction is not a sampling artifact.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The study is English-only and one LCB row remains incomplete.

    “The study is English-only and one LCB row remains incomplete.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    The AIME weak-actor rescue (+51-63 pp) is statistically robust: 11.7% to 70% represents 17.5 additional correct answers on n = 30, with negligible probability under any reasonable null.

    “AIME weak-actor rescue (+51-63 pp).Statistically robust: 11.7% → 70% represents 17.5 additional correct answers on n = 30, negligible probability under any reasonable null.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    VPS decomposes the verbal reward signal, issuing step-indexed critiques that preserve correct sub-trajectories and localize refinement to specific failure points.

    “VPS decomposes this signal, issuing step-indexed critiques that preserve correct sub-trajectories and localize refinement to specific failure points.”
    Quote in the paperSubstantial claim
43 of 43

  • The authors state this as an assumption.

    Under ideal conditions, the VPS generate-critique-refine iteration converges to a fixed point.

    “under ideal conditions converges to a fixed point τ * = F(τ * , C(τ * , x)).”

  • The paper relies on this without support.

    The supervisor is stronger than the actor and can identify errors the actor itself cannot detect.

    “verbal critique is effective only when the supervisor can identify errors the actor itself cannot detect.”
2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Baseline comparison uses one model family, not two

    Minor

    The three matched-compute rows all use GPT-5.4 variants-standard, Nano, and Mini-rather than two model families.

  • Only two listed configurations have negative headroom

    Minor

    The stated headroom breakdown says there are three cases with H < 0. Table 7 lists only two: the LCB GLM-Nemotron and GPT-OSS 120B-20B configurations.

  • A 1.1-point AIME gap is not one correct answer

    Minor

    On 30 problems, one additional correct answer changes accuracy by 3.33 percentage points, not 1.1 points.

    Reported 1.1 · recomputed 3.333333

  • Some AIME single-run percentages cannot come from 30 problems

    Minor

    A single-run pass@1 accuracy on 30 problems must be an integer multiple of 1/30. For example, the reported 90.2% actor score would correspond to 27.06 correct answers; 11.7% and 88.9% are likewise incompatible with that denominator.

4 of 4

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Curran Associates, Inc., 2023. URL https://proceedings.neurips.cc/paper_files/paper/2023/file/ 1b44b878bb782e6954cd888628510e90-Paper-Conference.pdf.

Cited by

Sorted by citations

Authors
Chen, H.-Y.
Corresponding author
Chen, Hao-Yuan
ORCID
Chen, Hao-Yuan
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2604.21611
arXiv
2604.21611
OpenAlex
W7155545114
Cited by
0
References
18
Type
posted content
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
large language model reasoning, inference-time scaling, GPQA, LiveCodeBench, program synthesis, self-consistency, reflexion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review