Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“Consistency-based factuality approaches, including self-consistency [18] and re-asking [19], evaluate factual correctness by measuring the stability of model outputs rather than relying solely on external grounding.”

“Self-consistency leverages the generation of multiple reasoning paths and selects the most consistent answer [91].”

“These models advance urban analysis through CoT reasoning (Wei et al., 2022; Kong et al., 2024) and multi-granularity instruction tuning (Liu et al., 2024; Deng et al., 2025; Wang et al., 2022; Sanh et al., 2021; Chung et al., 2024), showing promise in navigation (Wang et al., 2025b; Wu et al.,…”

“Pass @ k is a widely used metric for evaluating language models, with recent studies indicating that performance can be significantly enhanced by increasing the number of samples k (Chen et al., 2021; Wang et al., 2023).”

“…the gradient of Equation A.5 to zero, we can obtain the closed-form solution for { Π ( j ′ ) } Jj ′ =1 in Equation A.7 shown below. where Ψ( y ( i,j ; j ′ ) ) = [ ϕ l · I ( y = n ] , and I ( · ) is an indicator function that takes the value 1 when the internal declaration is true, and 0 otherwise.”

“We evaluate pass@k, the success rate over k independent rollouts, to better estimate the upper bound of model capability (Snell et al., 2024), as recent studies show that multiple generation attempts reveal reasoning potential more accurately than few rollouts (Yue et al., 2025a; Wang et al., 2022).”

“…at the solution level , either with reward-guided Best-of-N search (Sun et al., 2024) or guidance-free voting such as rule-based Majority Voting (Wang et al., 2022; Chen et al., 2023), with variants that adapt the sample count or filter candidates (Aggarwal et al., 2023; Xue et al., 2023; Huang…”

“Recent breakthroughs in Large Language Models (LLMs) such as GPT-4 (Achiam et al. 2023) have unlocked unprece-* dented capabilities in autonomous reasoning and planning (Wei et al. 2022; Wang et al. 2023; Yao et al. 2023b; Zhao et al. 2025).”

“APR (Pan et al., 2025; Yang et al., 2025b; Zheng et al., 2025) differs from inter-trajectory parallelism such as self-consistency and majority vote (Wang et al., 2023), where multiple complete chains are sampled independently and combined only at the end.”

“Extensive experiments on the Meme-Image-No-Text, Oogiri-GO [47], and OxfordTVG-HIC [20] datasets show that HUMORCHAIN substantially outperforms existing baselines in human humor preference, Elo/BT scores, and semantic diversity.”

“For LLMs, test-time search improves reasoning and problem solving: Self-Consistency searches over multiple chains-of-thought (Wang et al., 2023); Tree-of-Thoughts explores/prunes thought trees (Yao, D. Yu, et al., 2023); and DeepSWE selects from sampled agentic coding trajectories for higher…”

“This follows evidence that sampling diverse answers and marginalizing across them improves multi-step reasoning [44] and aligns with recent work on visual reasoning and CoT prompting [26, 58].”

“Multi-agent topologies vary from parallel setups for exploration (Wang et al., 2023a) to serial pipelines with reflective refinement (Madaan et al., 2023), and even contrastive-style structures that improve reliability (Du et al., 2023; Zheng et al., 2024).”

“However, these prior methods do not achieve the consistency of majority voting, a technique well-established for mitigating selection bias (Zong et al., 2023; Wang et al., 2024).”

“As shown in Figure 1, building on recent advances in consistency-based reasoning [46, 30, 41], SCS first generates an initial trajectory and then explores its neighboring trajectories through two mechanisms.”

“Slot Filling tasks assess the model’s capacity to extract and fill missing information in structured knowledge representations, for instance, given Egelsee [SEP] country , the model should identify the answer as Switzerland, Austria, Germany .”

“5M (Li et al. 2025) dataset as foundational data sources, which are generated from publicly available web tables to eliminate privacy risks associated with real enterprise data.”

“Among the most widely used methods, self-consistency (SC) [Wang et al., 2023] aggregates outputs by majority vote, leveraging the intuition that the most frequent answer across diverse generations is likely to be correct.”

“Self-consistency (Wang et al., 2023b) spawned compute-aware variants that halt when votes converge (Li et al., 2024; Liu & Wang, 2025) or use confidence-weighted aggregation (Taubenfeld et al., 2025).”

“Self-consistency (Wang et al., 2023) improves reliability by sampling multiple reasoning paths and selecting the most frequent answer through majority voting.”

“Chain-of-Thought (CoT) prompting further enhances reasoning by encouraging step-by-step thinking [28], [29], simulating human-like decision processes [30], [31].”

“…et al., 2022), code reasoning and synthesis (Li et al., 2022; Wang et al., 2021), commonsense reasoning (Toroghi et al., 2025), mathematical problem solving (Wei et al., 2022; Wang et al., 2023a; Hendrycks et al., 2021), and multimodal understanding with vision–language modeling (Li et al., 2023;…”

“On the other hand, zero-shot Chain-of-Thought (CoT) approaches have helped in simpler tasks (Wei et al., 2022; Kojima et al., 2022; Zhang et al., 2022b; Wang et al., 2022), but they lack the granularity to handle the thousands of heterogeneous relationships between PCs and SAs, which are needed to…”

“Works [53, 215] note that LLMs can latch onto spurious or superficial correlations in graph benchmarks, indicating they may be memorizing in-distribution patterns rather than genuinely reasoning.”

“Self-Consistency [ 15 ] mitigates this by sampling multiple reasoning chains and selecting the most consistent, trading speed for reliability.”

“Sample consistency directly captures whether the model’s knowledge and reasoning are robust for a given query (Wang et al., 2022).”

“Large language models (LLMs) have demonstrated remarkable capabilities in various domains, such as reasoning and coding [1, 2, 3].”

“• Self-consistency [25, 26], which consists in querying the model multiple times ( n = 7 times), sampling the next token from the distribution with a non-zero soft-max temperature.”

“…by DeepSeek-R1; and NuminaMath-100k , a randomly selected 100k subset of NuminaMath-CoT, featuring mathematical problems ranging from Chinese high school exercises to international mathematics olympiad competitions, with each solution following a Chain of Thought (CoT) format (Wei et al., 2022).”

“In addition to the original prompt, we tested the performance of modified prompts using the following two prompt engineering strategies: Chain-of-thought (CoT): the original prompt preceded by the instruction phrase “Let’s think step by step”, encouraging the model to reason through extraction tasks (Supplementary Appe…”

“…LLM token sampling is stochastic, we conducted 500 independent, zero-shot replications per cell using a Monte Carlo approach (Robert et al., 1999; Wang et al., 2022; Wadi and Fredette, 2025; Holtzman et al., 2019), yielding N = 2 , 000 observations for the main experiment (see Appendix B for…”

“Modern agents combine chain-of-thought reasoning [Wei et al. , 2022; Wang et al. , 2023; Zhan et al. , 2026] with tool use and action [Yao et al. , 2023], enabling recent reasoning-centric models [Yan et al. , 2025; Zhang et al. , 2026] to tackle demanding reasoning and agentic benchmarks [Hu et…”

“For the generative models we compare five inference-time confidence signals that require no additional training, spanning whole-output probabilities, entity-restricted probabilities, and self-consistency vote share over sampled decodes [19], [20].”

“TTRL (Zuo et al., 2025) discards labels entirely, treating a majority vote over the model’s own samples as a reward, which is self-consistency (Wang et al., 2023a) used as a training rather than an inference-time signal, and label-free variants have followed (Zhou et al., 2026; Moradi et al., 2025;…”

“Black-box methods rely on output statistics, such as multi-sample disagreement or self-uncertainty scores, to select actions without external supervision [2, 21, 42].”

“Self-consistency samples a model repeatedly and aggregates [Wang et al., 2022], on reasoning traces the model produced itself [Wei et al., 2022]; iterated refinement asks a model to revise its own answer against its own critique [Madaan et al., 2023]; agentic loops return a model’s output to its…”

“Wang et al. (2023) show that majority-vote aggregation over multiple reasoning chains improves reasoning accuracy because correct answers are more stable across samples than hallucinated ones.”

“PRM scores guide test-time search (TTS), such as beam search, MCTS [13], or weighted majority voting [14], to select high-quality trajectories [2].”

“This paradigm is especially effective for mathematics, coding, and symbolic reasoning, where intermediate steps help decompose problems, verify partial results, and derive final answers [Wei et al., 2022, Wang et al., 2022, Zheng et al., 2023, Gao et al., 2023].”

“To isolate the role of structural diversity from sampling randomness, we compare against self-consistency–style voting [Wang et al., 2023], which aggregates 7 independent samples from the same full-parameter model; this reaches only 31 .”

“A series of follow-up studies further improve CoT through self-consistency, automatic demonstration construction, planning-based prompting, contrastive reasoning, and iterative re-reading [4, 36, 37, 41, 44].”

“Third, errors made in early reasoning steps can propagate and compound through subsequent steps, a phenomenon that is particularly problematic in long reasoning chains [22,47].”

“Self-consistency, LLM-as-a-judge methods, self-refinement, and process-reward-style judging use model-generated judgments as label-free or weakly supervised signals [3, 7, 19, 20].”

“For any distribution-free selective predictor with E [ R | emit] ≤ α holding with probability ≥ 1 − δ : where µ = E [ R ] is the base risk.”

“Self-consistency (SC) aggregates multiple samples via majority voting (using uniform or probability weighting) on the extracted answers (Wang et al., 2023).”

“A first line of work shapes the model’s reasoning through prompting and decoding strategies, including chain-of-thought prompting (Wei et al., 2022), self-consistency (Wang et al., 2022), and structured search over reasoning paths such as Tree of Thoughts (Yao et al., 2023).”

“A cornerstone of this success is the use of intermediate reasoning processes, where frameworks like Chain-of-Thought (CoT) [11, 12], Self-Consistency [13], and Tree-of-Thoughts [14] decompose intricate problems into sequential rationales.”

“…World2Mind output M can induce two failure modes: 1) modality lock-in , where the model prematurely commits to either visual appearance or AST text and ignores conflicting evidence [37, 22]; and 2) over-trust in tool results , where incomplete or noisy reconstructions are treated as ground truth.”

“Prior work suggests that chain-of-thought is effective not merely because it produces longer outputs, but because it introduces explicit intermediate states that transform difficult one-shot prediction into structured sequential computation [35, 36, 37].”

“Chain-of-Thought (CoT) prompting fundamentally enhances LLM reasoning by externalizing intermediate deductive steps [27, 28, 29, 30, 31].”

“Following the self-consistency decoding strategy [28], we run each case N times independently under identical settings (here N = 5), sampling a diverse set of trajectories rather than committing to a single greedy decode.”

“Self-consistency marginalizes over diverse reasoning paths [52]; coverage scales log-linearly with the sample count [3]; and Universal Self-Consistency uses the LLM itself to select among candidates for free-form tasks [6].”

“Other work has explored test time scaling techniques for self-verification, including SelfCheck [23] and others [30, 31, 32].”

“Self-consistency uses repeated sampling to estimate answer-level support: sample multiple reasoning paths, extract their final answers, and return the answer with the largest vote count [12].”

“Self-consistency Self-consistency methods [37] sample multiple responses and measure agreement, while retrieval-augmented verification [13] cross-references outputs against external knowledge bases.”

“The introduction of chain-of-thought (CoT) prompting [13] and self-consistency mechanisms [14] demonstrated that articulating intermediate steps improves reasoning.”

“Without communication, multiple agents largely reduce to isolated searches whose results must be merged after the fact [54, 1, 22, 18]; with unrestricted communication, useful signals can be overwhelmed by raw trajectory noise [20], and the diversity of exploration may quickly collapse.”

“(iii) Experiments on ProcessBench and Hard2Verify show that VerifySteer outperforms prompt optimization, activation steering (Rimsky et al., 2024), and self-consistency (Wang et al., 2023) baselines.”

“Large Language Models (LLMs), leveraging their massive parameter scales and high-quality training data, have demonstrated strong generalization capabilities across multiple tasks, marking an important step toward Artificial General Intelligence (AGI) [2, 3].”

“Reasoning-oriented prompting techniques such as CoT [15], self-consistency [16], ReAct [17], PoT [18], and ToT [19] improve LLM reasoning by structuring the inference process.”

“…thought through reflection or revision [53, 27, 32] and parallel approaches that sample multiple independent chains and aggregate their answers [47, 44, 3, 36]; Self-Consistency [5, 44] and Best-of-N sampling with learned reward models [23, 7] are the canonical aggregation primitives, and the…”

“For reasoning tasks, S Φ (˜ y t | x t ) is obtained by majority voting [1] and LLM-as-a-Judge [38] to break tie.”

“A natural response to sampling stochasticity is test-time scaling: draw multiple candidates and select (e.g., self-consistency [Wang et al., 2023]), as studied extensively in language models [Wang et al., 2023, Cobbe et al., 2021, Lightman et al., 2023].”

“Self-consistency (Wang et al., 2023) and chain-of-thought prompting (Wei et al., 2022) are widely used to improve answer quality.”

“…w ( s i ) = exp( s i /T ) / j exp( s j /T ) (over samples) with tunable temperature T : Source ℓ i Raw confidence s i Response probability [Wang et al., 2023b] per-tokenlog-probabilities of y i Length-normalized geometric mean of token probabilities, exp (cid:0) 1 | y i | t log P t…”

“Self-consistency samples multiple reasoning paths before aggregating final answers [24]; pass@ k evaluation measures success across repeated code-generation attempts [6]; and inference-scaling work studies repeated candidate generation as a performance axis [5].”

“The key idea is to view trajectory retrieval as a representation problem, where the same trace can be transformed into different retrieval-friendly forms.”

“Self-consistency [28] aggregates agreement across sampled reasoning paths; semantic-entropy [14] and p(True) self-evaluation [13] extend this to free-form output.”

“Large language models have been applied to automated optimization formulation and solving in operations research, leveraging their capabilities in mathematical reasoning and code generation (Brown et al., 2020; Wei et al., 2022).”

“Best-of-N sampling is the most standard of such methods, with extensive use in many domains including in autoregressive language models [1, 2, 3], diffusion models [4], and policy learning [5, 6, 7, 8].”

“The emergence of advanced reasoning models is fundamentally driven by the scaling of test-time compute, where extended CoT traces help solve more complex problems (Wei et al., 2023; Wang et al., 2023; Yao et al., 2023a; Aghajohari et al., 2025).”

“Chain-of-thought prompting Wei et al. [2022] improves general reasoning; self-consistency Wang et al. [2022] and tree-of-thought Yao et al. [2023] further explore structured inference, while listwise reranking Hou et al. [2024] demonstrates the superiority of comparative over absolute scoring, a…”

“Large language models (LLMs) have achieved remarkable progress across diverse tasks, yet they remain prone to generating inconsistent or incorrect outputs, particularly in open-ended or reasoning-intensive scenarios [41, 18].”

“A particularly popular and effective approach is Best-of-N (BoN) sampling (Stiennon et al., 2020; Nakano et al., 2021; Wang et al., 2022; Li et al., 2022; Huang et al., 2025a), where multiple candidate responses are generated for a given prompt, scored according to a reward model ˆ r , and the…”

“1,2 However, these approaches still present reasoning as long, linear text sequences that are difficult for users to inspect, compare, or debug.”

“Self-consistency [Wang et al., 2023] samples k chains from one model and takes the majority vote; Mixture-of-Agents [Wang et al., 2025] layers proposer and aggregator models; debate protocols [Smit et al., 2024] have agents critique each other before converging.”

“Second, self-consistency between parallel trajectories may be used to rank or terminate reasoning attempts (Wang et al., 2022; Mitchell et al., 2022; Weng et al., 2023; Wang et al., 2024a), and may also be combined with calibration methods for controllable efficiency gains (Xie et al., 2024; Huang…”

“Chain-of-Thought (CoT) prompting has substantially improved the reasoning capabilities of language models [39, 38, 11].”

“Recent work shows that multi-step reasoning, planning, program use, and reflection can improve complex task solving [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19].”

“Large Language Models (LLMs) have demonstrated strong capabilities in mathematical reasoning, particularly when prompted to produce explicit intermediate traces such as Chain-of-Thought (CoT) (Wei et al., 2022).”

“Chain-of-thought prompting [Wei et al., 2022] and its variants yield large gains on mathematical reasoning tasks; self-consistency [Wang et al., 2023] and tree-of-thought [Yao et al., 2023b] extend these gains further.”

“The premise is intuitive: multiple agents exchange arguments iteratively, filtering noise through mutual critique to converge toward correct answers [7, 8].”

“Parallel scaling can be especially fruitful (Snell et al., 2024) when complemented with sequential scaling methods (Wei et al., 2022; Jaech et al., 2024; Guo et al., 2025) that search for and revise solutions adaptively inside a chain of thought.”

“Several reinforcement-learning-based methods introduce iterative refinement signals, including Reflexion [71] and Self-Consistency [80], but they operate outside the Think–Answer framework or depend on majority voting instead of introspective certainty.”