Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“On the reasoning benchmarks, we compare against frozen-backbone prompt-based scaffolds: zero-shot chain-of-thought, eight-shot CoT, self-consistency with ten samples [18], ReAct [28], and Reflexion [15].”

“These methods have shown promising results in tasks where correctness can be more clearly defined [29]–[31], effectively improving model reliability.”

“…prompting, self-consistency sampling, and tree-based reasoning enable models to generate explicit or multiple reasoning trajectories [7, 21, 22], evaluation remains largely centered on validating individual trajectories rather than assessing the diversity of alternative solution…”

“Standardized prompts used few-shot and chain-of-thought prompting techniques (18, 19) Representative prompt examples are provided in the Supplementary materials.”

“Such multi-sample rankings arise naturally in reasoning and program synthesis tasks, where multiple solution attempts are generated and jointly evaluated [19–21].”

“The G × multi-sample structure also appears at inference time: self-consistency [40] takes a majority vote over G chain-of-thought [41] rollouts, rationale-augmented ensembles [42] aggregate weighted samples, best-of-N sampling with a verifier or reward model picks the best of N candidates [43,…”

“Empirical studies on prompting further demonstrate that reasoning performance is highly sensitive to prompt format, demonstrations, and instruction structure (Wei et al., 2023; Wang et al., 2023; Huang et al., 2025; Zhou et al., 2023; Yang et al., 2024b; Huang et al., 2026b).”

“In language-model reasoning, self-consistency samples several reasoning paths and votes over answers [22]; Large Language Monkeys studies repeated sampling as a test-time compute axis, including the distinction between automatically verifiable and unverifiable domains [1]; process verification…”

“Language models often write intermediate reasoning before final answers, and such traces can improve performance (Wei et al., 2022; Kojima et al., 2022; Wang et al., 2023b).”

“Prior work shows that multi-agent debate can improve reasoning and factuality [15] and that sampling multiple reasoning paths can improve answers through self-consistency [16].”

“Methods like memory augmentation (Wang et al., 2024; Packer et al., 2024), test-time scaling (Yao et al., 2023a; Wang et al., 2023), and search-guided backtracking (Zhou et al., 2024a; Putta et al., 2024) enhance performance in sparse-reward environments.”

“Inference-time baselines include Chain-of-Thought prompting (Wei et al., 2022), Self-Consistency with majority voting (Wang et al., 2022), and Tree-of-Thoughts (Yao et al., 2023).”

“…inference cost, we further compare with several representative frameworks: multi-agent debate (Du et al., 2023), centralized orchestra (Shen et al., 2023), multi-agent ensembling (Wang et al., 2022), MetaGPT (Hong et al., 2023), Mixture-of-Agents (Wang et al., 2024), and AutoGen (Microsoft, 2024).”

“It has also been exploited in techniques such as self-consistency, where aggregating multiple outputs leads to improved reasoning performance [30].”

“The statistical nature and sampling-driven generation of LLMs yield unpredictable results, a challenge that can be tempered by validating outputs within the harness or by employing test-time scaling strategies[12, 13, 21, 27, 30].”

“The foundation of our test-time inference strategy introduced in section 3 is the “self-consistency” decoding method introduced by Wang et al. (2023), who demonstrated that for complex reasoning tasks such as math, sampling a diverse set of reasoning paths and marginal-izing over final answers…”

“Self-consistency voting (Wang et al., 2023) approximates induction but averages over candidates rather than validating them.”

“The method of selecting “good” trajectories (2) has recently attracted attention in large language models (LLMs), particularly in the context of self-consistency (Wang et al., 2023) as well as search and decoding strategies (Yao et al., 2023; Zhou et al., 2022).”

“These include generating parallel reasoning traces (Wang et al., 2023; Snell et al., 2024), making the model self-reflect or check its work (Shinn et al., 2023; Muennighoff et al., 2025), navigating a tree of potential completions (Yao et al., 2023) and other more sophisticated strategies (Besta et…”

“Recent work on inference-time scaling for LLMs [Wang et al., 2023, Brown et al., 2024, Snell et al., 2024] has shown that sampling more at test time improves accuracy, but these methods apply the extra budget uniformly, not adaptively.”

“More precisely, chain-of-thought prompting demonstrated that the insertion of intermediate linguistic steps can improve performance on arithmetic, commonsense, and symbolic reasoning tasks, especially for models of sufficiently large scale [1, 2].”

“Self-consistency decoding [46] further improves reliability by sampling multiple reasoning chains and selecting the most consistent answer.”

“We evaluate on established agentic benchmarks [40, 26, 69, 18] and position our work relative to single-agent reasoning advances [64, 61, 68, 52].”

“A critical aspect of MAS is the aggregation of multiple agent responses into a final decision [10, 11, 12, 13], which is typically achieved through a decision-making operation.”

“Council uses a free-form analyst state, guided by seven requested components, to organize candidate claims and qualifications for the writer.”

“Best-of-N sampling and majority voting [40] generate multiple independent solutions, while tree search methods, including Monte Carlo tree search [15, 49] and best-first search [43, 44], explore branching paths.”

“…three approaches to confidence estimation, each grounded in foundational NLP research: sampling-based consistency checks (self-consistency) [34], prompting the model to verbalize its uncertainty (self-reported confidence) [18], and leveraging internal probability mass over “yes”/“no”…”

“During inference, this internalized reasoning is further scaled using a ranking-guided Test-Time Augmentation (TTA) with a consensus-based voting scheme to ensure robust path discovery (Wang et al., 2023) (Figure 2c).”

“Central to this progress is the Chain-of-Thought (CoT) paradigm, where models generate explicit, step-by-step reasoning steps before producing a final answer [27, 25].”

“Majority voting across N inference attempts — self-consistency [Wang et al., 2023] — is the standard approach for competition mathematics.”

“Wei et al. [21] and Wang et al. [22] proposed the chain-of-thought prompting technique.”

“We use the Chain of Thought (CoT) [49], Self-Consistency (SC) [47], and K-Shot”

“Such example demonstration and parallel generation technique is common in recent prompt engineering, for example, with ReAct [58], Tree-of-Thoughts [57], and Self Consistency [51].”

“Scaling up the length of tasks a model can complete would be a major step towards realizing the true potential of general, open-ended agents (Raad et al., 2024).”

“Wang et al. (2023) propose self-consistency to exploit variance beneficially by sampling multiple reasoning paths.”

“To reduce the overall noise in this analysis, we compute our judgments using self-consistency (Wang et al., 2023), taking the majority vote over five separate inferences generated with a temperature of 0.7.”

“LLMs have made impressive advances in language understanding, dialogue generation, and reasoning, enabled by techniques such as large-scale pretraining [2, 3, 6, 18, 36, 56], chain-of-thought prompting [31, 59, 51, 58, 66], and reinforcement learning with human feedback (RLHF) [4, 43].”

“Using a pool of models strong at math, we sampled five completions per model at a temperature of 1.0 and used majority voting to select a gold answer, as is common practice [66, 67].”

“Mainstream scaling strategies such as sequential (Madaan et al., 2023) and parallel scaling (Brown et al., 2024; Wang et al., 2023) enable models to utilize more effort, elicit deeper reflection, and refine their outputs, often leading to substantial gains in answer quality (Zhang et al., 2025a).”

“This is analogous to the self-consistency method for single LLMs (multiple reasoning paths followed, then a majority vote taken); in a multi-agent setting, each agent (or agent subgroup) provides a second opinion [19].”

“• Test-time Scaling methods, including Self-Consistency (Wang et al., 2023b), Self-refine (Madaan et al., 2023), LatentSeek (Li et al., 2025a), and TTRL (Xiang et al., 2025).”

“To address this issue, prompting methods have been proposed to extend CoT reasoning by incorporating additional searching (Wang et al., 2022; Zhou et al., 2023; Fu et al., 2023; Yao et al., 2023) or self-reflection mechanisms (Sijia et al., 2024; Sijia & Baochun, 2024; Miao et al., 2024).”

“CoT prompting, introduced by (Wei et al., 2022) and expanded by (Kojima et al., 2022) enables models to break down complex problems into intermediate steps, improving performance and interpretability.”

“…persona selection with a full dose-response over the combinatorial persona space; tier-stratified heterogeneous teams evaluated against voting ensembles built from the same rosters (Wang et al., 2022; Dietterich, 2000); and context-window ceilings measured as a confound rather than assumed away.”

“Chain-of-thought prompting (Wei et al., 2022) and its extensions (Wang et al., 2023; Zelik-man et al., 2022; Khot et al., 2023) guide models with intermediate reasoning steps or structured outputs but rely on demonstrations or task-specific scaffolds.”

“…explains why majority voting performs surprisingly well: nearly 800 individuals at a livestock exhibition estimated an ox’s weight largely inaccurately, but their median closely matched the true weight (Galton, 1907), because independent errors cancel out (Grofman et al., 1983; Wang et al., 2023).”

“Sample breadth allocates parallel trajectories aggregated by majority voting Wang et al. [2023] or search Yao et al. [2023a], Hao et al. [2023].”

“Aggregation can occur at the solution level, using reward-guided techniques like Best-of-N Search (Sun et al., 2024) or guidance-free methods like Majority Voting (Wang et al., 2022) and Universal Self-Consistency (Chen et al., 2023a).”

“We conduct further experiments to compare Self-Consistency (Wang et al., 2022) with MoA and Self-MoA on the AlpacaEval 2.0 benchmark.”

“This includes using structured thought patterns like chain-of-thought [48], tree-of-thought [49], and self-consistency [50], which help the model organize and process information in a logical manner.”

“Methods such as Chain-of-Thought (CoT) and Tree-of-Thought (ToT) reasoning (Yao et al., 2023; Besta et al., 2024) extend single-agent reflection through structured deliberation, while MAD (Liang et al., 2024), Longagent (Zhao et al., 2024) and ROBIN (Gha-reeb et al., 2025) model inter-agent debates to enhance diversit…”

“Training student models on teacher-generated reasoning traces (rather than final answers alone) leads to substantial gains on multi-step reasoning tasks (Wei et al., 2022; Shridhar et al., 2023).”

“Note: The general problem of paraphrase variation causing vote splits is well known in the self-consistency literature [9]; the CME is an instantiation of this effect in the memory-poisoning setting.”

“These are standard, literature-consistent choices: a low temperature yields near-deterministic single-pass generation, while self-consistency requires a non-trivial sampling temperature to produce the diverse reasoning chains it aggregates over [22].”

“The variance-reduction direction is consistent with self-consistency [Wang et al., 2023] and mixture-of-agents ensembling [Wang et al., 2024], but AgentRoom achieves it through coordinated concurrent generation in a shared workspace rather than independent sampling and aggregation.”

“Adopting the methodology from Wang et al. (2023a), this operator aggregates five CoT reasoning paths and determines the final answer through majority voting.”

“We include 2 widely used single-agent baselines: CoT [51] and self-consistency (CoT-SC) [48]; 6 manual MAS baselines: Debate [10], Self-refine [33], ReConcile [5], MAD [28], SPP [49] and DyLAN [30].”

“Adopting the methodology from Wang et al. (2023a), this operator aggregates five CoT reasoning paths and determines the final answer through majority voting.”

“If a sub-agent receives insufficient context, it return control to the main agent, triggering additional retrieval or another delegation round.”

“One line of work improves a single response by eliciting intermediate reasoning with chain-of-thought [25, 26], decomposing problems into simpler subproblems [27], or marginalizing over sampled reasoning paths [28].”

“Given a prefix x 1: i and a target at position i +1 , thinking-token methods (Wei et al., 2022a; Kojima et al., 2022; Wang et al., 2023a) append M ≥ 0 auxiliary tokens at indices t ∈ { i +1 , . . . , i + M } before producing the final answer at a = i + M +1 .”

“We further compare primitives-based MAS with 10 existing representative MAS methods, including Chain-of-Thought (Wei et al., 2022), Self-consistency (Wang et al., 2022), LLM-Debate (Du et al., 2023), Self-Refine (Madaan et al., 2023), Quality-Diversity (Lu et al., 2024), SPP (Wang et al., 2024),…”

“Self-Consistency Analysis.”

“While this suffices for domains like math where answers are objective and easily verifiable (Wang et al., 2023), this can not be used for more general domains which do not admit objective ground truth answers.”

“We optionally apply Self-Consistency (Wang et al., 2023) which uses majority voting.”

“Almost all of these agents follow the observe–reason–act paradigm popularized by ReAct [59], layered on chain-of-thought and search-style reasoning [52, 58, 50], tool use [38], self-reflection [39], and autonomous task loops [40, 41].”

“HealthBench (Arora et al., 2025) contains health-related conversational queries scored against expert-authored rubrics covering medical accuracy, safety, and helpfulness.”

“Generic refinement (4 iterations), Self-Refine [1], Reflexion [2], Self-Consistency [7].”

“…language models are rapidly becoming a foundational architecture for collaborative and collective AI [1, 2], with applications spanning automated debate [3, 4], scientific reasoning [5], content moderation [6], collective decision-making [7, 8], agents economy [9, 10], and decentralized AI [11–13].”

“To test whether a label-free self-consistency signal could stand in for checking the reasoning, we include a majority voting baseline (Wang et al., 2023).”