Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“Methodologies such as Self-Consistency (Wang et al., 2022b), Tree of Thoughts (ToT) (Yao et al., 2023), Graph of Thoughts (GoT) (Besta et al., 2024), and Language Agent Tree Search (LATS) (Zhou et al., 2023a) formulate the reasoning process as a search problem over a vast state space.”

“This emergent ability can be further enhanced by various techniques (Wang et al., 2023b; Li et al., 2023b; Hao et al., 2023; Gao et al., 2023; OpenAI, 2024b; Guo et al., 2025).”

“Prior work has shown that prompting strategies such as Chain-of-Thought (CoT) (Wei et al., 2022), Tree-of-Thoughts (ToT) (Yao et al., 2023a), Re-Act (Yao et al., 2023b), and Self-Consistency (Wang et al., 2023b) can substantially improve the reasoning capability of large language models (LLMs).”

“More broadly, work on red-teaming language models emphasizes that model behavior can be manipulated through prompt framing and adversarial or leading instructions, which is directly relevant when judgements are elicited via structured prompts that request explanations and fixes [46].”

“Many generic methods have been proposed that improve LLMs outputs without training data, fine-tuning or reinforcement learning, which includes, among others, self-consistency 49 , debating LLMs 15 , and self-refinement 34 .”

“Response consistency (Wang et al., 2023).”

“Recent advances in LLM reasoning have been significantly propelled by RL. Chain-of-thought prompting [30] and self-consistency [29] established reasoning as a multi-step process amenable to RL optimization.”

“Test-time scaling (Wei et al., 2022; Wang et al., 2022; Brown et al., 2024; Jaech et al., 2024b; Muennighoff et al., 2025; Snell et al., 2024) studies how to convert additional inference-time computation into higher task accuracy by generating, refining, and selecting among multiple trajectories.”

“Chain-of-Thought (CoT) prompting (Wei et al., 2023) is a fundamental idea, and subsequent work like STaR (Zelikman et al., 2022) and Reflexion (Shinn et al., 2023) explore revision through trial-and-error or verbal self-reflection.”

“Prompting-based strategies like Chain-of-Thought (CoT) prompting [120], Self-Consistency [118], and Tree-of-Thoughts (ToT) [131] enable models to produce intermediate reasoning steps.”

“• Majority voting [46] (four parallel voters and one aggregator) on MMLU-Pro [47] (1,500 sampled questions), where multiple reasoning paths are generated in parallel and aggregated.”

“Self-Consistency (Wang et al. 2023; Liang et al. 2019b) samples multiple reasoning paths and selects consistent answers, improving accuracy through diverse trajectories.”

“Self-Consistency [Wang et al., 2023] None Sample consensus None Mixture-of-Thoughts (MoT) [Yue et al., 2024] None Self-consistency voting None ESC / Adaptive SC [Li et al., 2024b,a] None Stopping tests None Neural Caching [Ramírez et al., 2024] None Conf.”

“(1) Proposer: The proposer stage uses multiple LLMs (Gemini 2.5 Flash (Comanici et al., 2025) and GPT-4o (Hurst et al., 2024)) to generate diverse descriptor candidates, maximizing recall of cultural elements.”

“Large language models (LLMs) have demonstrated remarkable reasoning capabilities (Wei et al., 2022; Tang et al., 2024).”

“Robotic policies increasingly adopt the sample-and-select paradigm of test-time scaling [18, 22–24]: RoboMonkey uses a trained VLM-based verifier [9], RoVer a robot process reward model [4], MG-Select model-internal masked-distribution signals [7], and WAV forward–inverse asymmetry of world-model…”

“Best-of-N sampling [Beirami et al., 2025], self-consistency [Wang et al., 2022], particle filtering [Puri et al., 2025], and Tree-of-Thoughts [Yao et al., 2023] draw or expand many candidates and select among them.”

“Chain-of-thought prompting and zero-shot variants showed that step-by-step rationalization unlocks reasoning at scale [61–63], and self-consistency aggregates diverse rollouts to improve final-answer accuracy [64].”

“Existing work emphasizes end-to-end performance or isolated successes, but provides limited insight 2 Results”

“Some meth-ods further improve CoT through diverse path sampling and majority voting [84] and demonstrates that CoT can emerge without explicit prompting via alternative decoding strategies [83].”

“Since spatial relationship assessment requires a sequence of reasoning steps that link detected facts to relative positions and overall layouts, we incorporate the verified grounding into a chain-of-thought (CoT) process [58, 60, 69] within a vision–language model.”

“(ii) Advanced prompting: Chain-of-Thought Self-Consistency (CoT-SC, k = 5 ) [38], [39] and MedPrompt [40] with GPT-4o.”

“Self-consistency methods [Wang et al., 2023] aggregate answers from multiple independently sampled chains, but require 10–40 samples per question and discard the rich step-level information within each chain.”

“…into subgoals ordered from easy to hard; Program-of-Thoughts and PAL externalize the reasoning into executable programs, decoupling computation from reasoning and substantially reducing arithmetic and procedural errors (Wang et al., 2023; Zhou et al., 2023a; Chen et al., 2022; Gao et al., 2023).”

“Detection methods like self-consistency (Wang et al., 2022) sample multiple outputs but lack quantitative confidence measures, while correction methods like Chain-of-Verification (Dhuliawala et al., 2024) fix hallucinations uniformly without identifying which outputs need correction.”

“This observation naturally aligns with the core principle of self-consistency decoding (Wang et al., 2023) that complex reasoning tasks typically admit multiple reasoning paths toward a correct consensus, which is elaborated in Sec.”

“This aligns with findings that reasoning consistency is crucial for complex problems (Wang et al., 2022).”

“• CoT-SC (Wang et al., 2023): This method generates multiple independent reasoning paths and employs a majority-voting mechanism to select the most consistent intent judgment, thereby enhancing the reliability of memory utilization.”

“We also benchmark our method against two prominent uncertainty quantification techniques: Self-Consistency [16], and Verbalized Uncertainty [17].”

“The rise of LLM agents in recent years has achieved great success in planning (Qiao et al., 2024; Song et al., 2023), mathematical reasoning (Wang et al., 2022; Swan et al., 2023), code generation (Zhang et al., 2024c; Li et al., 2025) and tool-augmented inference (Shen et al., 2023; Jiang et al.,…”

“(1) Majority Voting (MV) (self-consistency), which selects the most frequent final answer, breaking ties uniformly at random (Wang et al., 2023a).”

“…the reasoning before answering to improve complex problem-solving through intermediate steps; (2) Self-Consistency with Chain-of-Thought (COT-SC, Wang et al. (2023b)), which ensembles multiple parallel answers from COT to produce a more accurate answer; (3) Self-Refine (Madaan et al., 2024;…”

“This approach significantly enhances the performance of LLMs by combining various prompt engineering methods.”

“Broader reasoning and refinement methods use chain-of-thought, self-consistency, decomposition, search, or process supervision to make intermediate reasoning states more explicit [14, 31, 40, 46, 70, 72, 76, 81– 83, 91, 93, 96].”

“…exchange visible messages and report accuracy gains from doing so (Du et al., 2024; Wang et al., 2025; Jiang et al., 2023), with self-consistency as the single-model analogue (Wang et al., 2023b) and routing deciding when collaboration is worth invoking (Chen et al., 2024; Ong et al., 2024).”

“Related prompting and self-improvement methods also exploit multiple sampled reasoning paths, search trees, or self-generated rationales to expose useful intermediate information [Wang et al., 2023, Yao et al., 2023b, Zelikman et al., 2022].”

“A reasoning model can be made stronger at inference time by spending more compute, and the compute goes to one of two levers: longer reasoning, letting the model think more before it answers, or more sampling, drawing n answers to one prompt and combining them [1–4].”

“…view, several representative methods correspond to different trajectories through the space: some expand width by sampling more reasoning branches [1, 2, 3]; some increase depth by extending reasoning trajectories [9, 14]; and others introduce adaptive stopping, pruning, or selection rules to…”

“Repeated independent sampling with majority aggregation exploits smooth coverage gains as the sample budget grows [56, 57], while verifiers trained over intermediate reasoning steps rerank candidates or steer search [58, 59].”

“Subsequent studies have demonstrated that variations of chain-of-thought prompting can further enhance reasoning consistency and robustness across tasks 20 .”

“The foundational paradigm is Self-Consistency or Majority Voting (Wang et al., 2023), which aggregates independent reasoning paths to find the arithmetic mode.”

“Although textual reasoning has been widely explored by the community (Wei et al., 2022; Yao et al., 2023; Wang et al., 2023; Xu et al., 2025a;b), a growing body of work suggests that strong language-side reasoning in Vision-Language Models (VLMs) does not automatically translate into visually…”

“At the same time, prior work has shown that diversity in prompts or reasoning paths can improve answer quality, as different prompts encourage the model to explore alternative reasoning trajectories and reduce correlated errors (Wang et al., 2022; Hu et al., 2025).”

“Self-consistency [26]— majority voting over multiple sampled solutions—provides a training-free alternative to learned verifiers, offering competitive accuracy at reduced deployment complexity.”

“Test-time reinforcement learning (TTRL) has emerged as a promising paradigm for self-evolving large reasoning models (LRMs), enabling online adaptation on unlabeled test inputs via self-induced rewards through majority voting.”

“A prominent line of work focuses on parallel scaling , which generates multiple reasoning trajectories and aggregates them through majority voting or reward models (Wang et al., 2022).”

“In RQ4, informed by the voting strategy used in the field of machine learning (Liang et al., 2024; Wang et al., 2022), we investigate a majority voting strategy in exploiting the inconsistency of automatic scoring by choosing the mode of the scores.”

“Particularly, with the emergence of reinforcement learning–based meth-ods [50, 59, 28, 71], some approaches [84, 99] incorporate chain-of-thought (CoT) data [88, 43, 15, 100, 86] and reasoning processes [26, 16, 48] into geolocation.”

“Self-consistency decoding (Wang et al., 2023) demonstrated substantial gains on reasoning tasks by sampling multiple chain-of-thought traces (Wei et al., 2022; Kojima et al., 2022) and taking a majority vote over final answers, treating it as an ensemble problem.”

“A key catalyst for this success is Chain-of-Thought (CoT) prompting, which encourages models to generate intermediate reasoning steps before deriving a final answer (Brown et al., 2020; Kojima et al., 2022; Wei et al., 2022).”

“We highlight that smaller models benefit more from the CoT-SFT cold start than knowledge graphs or contexts, which is essential to elicit reasoning ability.”

“A common strategy to further boost accuracy is to sample multiple candidate solutions and apply a verifier to select the best one (Cobbe et al., 2021; Wang et al., 2023; Lightman et al., 2024).”

“5-32B-Instruct (Yang et al., 2024) using Direct Inference , Chain-of-Thought (CoT) (Wei et al., 2022), Self-Consistency (SC) (Wang et al., 2022) with 5 paths, and MedPrompt (Nori et al., 2023).”

“Before agentic RL became a trend, researchers investigated lengthy reasoning chains in general tasks (Qu et al., 2025; Sui et al., 2025; Zhang et al., 2024).”

“The Reliable Data Annotator applies self-consistency (Wang et al. 2023; Wei et al. 2022) to move beyond single-path predictions, while the High-Con-sistency Annotation Filter selects the most trustworthy pseudo-labels to reduce randomness.”

“To decide the final answer from the k attempts, one can use either majority voting (Wang et al., 2023) or a verifier (especially in the code and scientific discovery domains) (Wang et al., 2024; AlphaEvolve, 2025).”

“” (2) Self-Consistency [35]”

“The advent of Chain-of-Thought (CoT) prompting [Wei et al., 2022], particularly in reasoning-enhanced models [Bi et al., 2024], suggests that models could externalize their reasoning steps.”

“Furthermore, inspired by advancements in large language models, we leverage autoregressive decoding with test-time scaling techniques [17], [18].”

“Following Qu et al. (2024); Snell et al. (2024); Xi et al. (2024), we leverage the commonly used majority vote (MV@ 𝐾 ) (Wang et al., 2023) which evaluates whether the most frequent answer among 𝐾 samples is correct.”

“However, even with self-consistency and verification strategies (Wang et al., 2023b,a) or the selection-inference framework (Creswell et al., 2023), large models still fail to generalize on high-complexity reasoning tasks (Saparov et al., 2025).”

“To provide high-quality reasoning traces for training, we employ a one-shot Chain-of-Thought (CoT) prompting scheme that elicits multi-step reasoning solution paths.”

“Recently, sampling parallel judgments and aggregating via majority vote, i.e., self-consistency (Wang et al., 2022), has been used to improve evaluator performance.”

“Wang [17] suggested self-consistency, where multiple paths of reasoning are sampled and merged by majority vote.”

“We implement six common operator structures, including: Generate (Contextual, Code), Format, Review & Revise, Ensemble, Test, and Programmer.”

“Answers supported by many independent samples are more likely to be correct, so consistency acts as an unsupervised proxy for accuracy (Wang et al., 2022; Prasad et al., 2025).”

“Self-consistency sampled several reasoning paths and took a majority vote rather than trusting one [42].”

“Eliciting reasoning from LLMs has been driven by chain-of-thought prompting and its inference-time variants such as self-consistency and tree-search decoding (Wei et al., 2022; Wang et al., 2023; Yao et al., 2023).”

“We accept a match if and only if it appears in at least 3 of 4 trials (majority) [21, 23].”

“Self-consistency decoding [19] combines multiple outputs to improve reliability and accuracy, suggesting that ensemble methods can reveal latent capabilities.”

“Single-agent prompting strategies, chain-of-thought (Wei et al., 2022), complexity-based prompting (Fu et al., 2023), self-consistency (Wang et al., 2023), tree-of-thought (Yao et al., 2023a), and graph-of-thought (Besta et al., 2024) all improve LLM performance through fixed reasoning patterns.”

“We consider two widely used such strategies: (i) self-consistency , where the most common answer is selected (Wang et al., 2023), and (ii) ORM , where an (output) reward model is used to score each generation, and the one with the highest score is returned.”

“…Large Language Models (Bai et al., 2025; Zhu et al., 2025; Li et al., 2024) (MLMs) have achieved strong performance on visual understanding tasks (Yue et al., 2024; Liu et al., 2023; Lu et al., 2023), substantially enhanced by Chain-of-Thought (CoT) reasoning (Wei et al., 2022; Wang et al., 2022).”

“Test-time scaling has emerged as a practical way to push language models beyond one-shot inference by spending additional compute at test time to search over or refine candidate solutions [52, 30, 50].”

“A first class of methods is training-free and operates purely at inference time, such as Self-Refine, Reflexion, self-verification prompting, CRITIC, and self-consistency decoding (Madaan et al., 2023; Shinn et al., 2023; Weng et al., 2023; Gou et al., 2023; Wang et al., 2022).”

“The sampling-based approach approximates P θ via Monte Carlo sampling (Neal, 1993; Wang et al., 2022).”

“…compute is allocated per instance to improve accuracy, has quickly become a central paradigm for frontier reasoning tasks in math, science, and coding (Wei et al., 2022; Wang et al., 2023; Yao et al., 2023; Snell et al., 2024; Chen et al., 2024; Lee et al., 2025; Muennighoff et al., 2025).”

“The contradiction is not about diversity per se but about whether the aggregator operates above or below the crossover threshold s ∗ .”