Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“As a comparison, we here adopt CoT-SC (Wang et al., 2023) as the counterpart of MAD.”

“By maintaining multiple candidate reasoning trajectories, it reduces the brittleness of single-chain reasoning, where early mistakes can easily compromise the entire reasoning process (Wang et al., 2022a; Zheng et al., 2025).”

“We consider such problems to be difficult because they are unlikely to be solvable simply by scaling parallel compute [5, 41, 44].”

“Our ensembling analysis relates to self-consistency work (Wang et al., 2023), but reframes aggregation as reducing incoherence.”

“…, e.g., monolithic versus specialized sub-agents [40, 50, 87]; prompting strategies , e.g., how to structure the agent’s reasoning process [34, 43, 66, 70]; tool interfaces , e.g., granularity and abstraction of external APIs [10, 51]; state management , e.g., which historical data to keep in the…”

“…medical AI; Chain-of-Thought (CoT) [63], which employs structured step-by-step medical reasoning for single-agent decision-making; Majority Voting [64], a simple aggregation of independent agent responses without explicit consensus modeling; Weighted Voting, which incorporates agent certainty…”

“Early methods, such as Best-of-N (Cobbe et al., 2021) and Self-Consistency (Wang et al., 2023), select the most scored or consistent output from independent paths but are not end-to-end optimized.”

“Techniques such as chain-of-thought prompting (Wei et al., 2022; Kojima et al., 2022) and structured methods like Tree-of-Thoughts and Graph-of-Thoughts (Yao et al., 2023; Besta et al., 2024) expand the space for deliberation.”

“Increased answer diversity also benefits some test-time scaling methods, which generate numerous candidate solutions and select the most promising among them (Li et al., 2022; Wang et al., 2023; Brown et al., 2024; Schaeffer et al., 2025).”

“, 2023) combines the Chainof-Thought (CoT) (Wei et al., 2022; Wang et al., 2022) and inter-actions with Wikipedia web API.”

“Reasoning in Language Models Large language models achieve complex reasoning through intermediate trajectories, such as chain-of-thought (CoT) (Wei et al., 2022), self-consistency (Wang et al., 2023b), and tree-of-thoughts (Yao et al., 2023).”

“Zero-shot CoT [Wei et al., 2022] 50.4 24.2 72.4 80.1 58.2 57.1 Self-Refine [Madaan et al., 2023] 49.6 24.6 72.0 79.0 57.7 56.6 Best-of-k ( k = 120) [Lightman et al., 2023] 62.6 41.4 88.7 90.1 72.4 71.0 k -way SC ( k = 120) [Wang et al., 2022] 63.0 40.6 89.8 90.3 70.5 70.8 Self-Refine + k -way SC…”

“Large language models (LLMs) have advanced in complex reasoning (Wei et al., 2022; Wang et al., 2026; Yu et al., * Equal contribution 1 University of California, San Diego 2 University of Toronto 3 Adobe Research 4 The University of New South Wales 5 CSIRO’s Data61.”

“…an implicit judge of each synthesized question quality, providing a capability-aligned signal that trains the synthesizer to propose auxiliary questions near the solver’s capability frontier, while the solver is updated using self-supervised rewards derived from its own sampled responses [49, 36].”

“Prior works has explored several families of prompting strategies to improve reasoning robustness, including chain-of-thought with self-consistency (Wang et al., 2022), Tree-of-Thoughts search over alternative reasoning branches (Yao et al., 2023), re fl ective agents that incorporate self-critique…”

“This filters out inconsistent outliers that arise from flawed reasoning paths [22].”

“January 23, 2026. capabilities are often enabled by chain-of-thought (CoT) prompting as well as other inference-time strategies (Wei et al., 2022; Wang et al., 2023; Yao et al., 2023), which encourage LLMs to generate explicit intermediate reasoning traces prior to producing a final answer.”

“Majority voting is one of the most commonly used methods [45, 51, 66, 101, 122, 139, 163, 164, 173, 192], which leverages the self-consistency [158] of LLM outputs to select the patch with the highest generation probability as the submission.”

“Privacy risks extend beyond the primary output.”

“…where operators with similar functions across cases are grouped into preliminary abstract operators; and (3) Deep Extraction for Abstract Execution Operators , where Long CoT (Wei et al. 2022) and self-consistency enable deep reasoning and multi-path search to refine task-aware abstract operators.”

“Parallel generation draws multiple candidates or decision paths and then aggregates them, e.g., self-consistency and best of N [5, 30, 37, 47], Monte Carlo Tree Search for discrete decisions [53, 63], or token-level search, such as reward-guided sampling [19, 33].”

“Chain-of-Thought (CoT) prompting (Nye et al., 2021; Wei et al., 2022) plays an important role in that progress by eliciting step-by-step reasoning from language models.”

“Sampling Budget N 8 #Initial Rollout M 1 Branching PPL Top-K 2 #Branching Times per Step 3 (i) Self-Consistency ( Majority Vote ) (Wang et al., 2022), which selects the most frequent answer across multiple trajectories as the final output; (ii) Max #Tool Call (Zeng et al., 2025), which…”

“…studies define difficulty through symbolic complexity (Tong et al., 2024), linguistic complexity (Srivatsa and Kochmar, 2024), or verifiability signals such as self-consistency and stepwise correctness (Wang et al., 2022; Lightman et al., 2023), leveraging these properties to schedule learning.”

“In the context of chain-of-thought (CoT) prompting, majority voting is widely known as self-consistency (Wang et al., 2022).”

“Chain-of-thought (Wei et al., 2022) emphasizes decomposing complex reasoning into a series of intermediate steps.”

“Appendix L gives the termination evidence and scoring rationale.”

“Self-consistency verification: Self-consistency Verification strengthens LLM reasoning by generating multiple paraphrased prompts, sampling diverse reasoning paths, and selecting answers via majority vote, thereby mitigating stochastic errors and hallucinations [157].”

“To better handle such complexity, recent reasoning-enhanced methods, such as TTE [5], UME-R1 [24], and TRACE [13], first generate an explicit chain-of-thought (CoT) rationale [41, 43] before deriving the final embedding.”

“While techniques like Chain-of-Thought, Tree-of-Thought (ToT) (Yao et al., 2023), and self-consistency (Wang et al., 2022) can boost answer quality, they are inherently limited by their reliance on well-crafted prompts.”

“LLM Ensembles: The simplest approach to combining LLM outputs is majority voting, popularized by self-consistency (Wang et al., 2023) for single-model sampling and then extended to multi-model settings through weighted voting (Yang et al., 2025b; Jiang et al., 2023) and cascaded selection (Chen et…”

“Two distinctive filtering techniques stand out: TI uses LLM logprobs [45] as a token-efficient confidence signal, exposing them to its classification agent as a tool; SP and LC instead aggregate weighted votes [64] across multiple tools and LLMs to rank candidates.”

“To validate this property, we extend beyond the standard debate setting and evaluate two additional MAS paradigms: Self-Consistency [60] and AgentVerse [6].”

“Chain-of-Thought (CoT) extensions (Wei et al., 2022) and reasoning models like OpenAI-o3 (OpenAI, 2025b) and DeepSeek-R1 (Guo et al., 2025) incentivize extended internal traces to decompose problems.”

“To enhance the stability of this automated evaluation and reduce randomness, we implement a 5-round voting mechanism (Wang et al., 2022).”

“Self-reflection strategies such as STaR (Zelikman et al., 2022) and more recent approaches (Wang et al., 2023b) leverage chain-of-thought explanations to improve reasoning and robustness.”

“Among such approaches, Self-Consistency (SC) (Wang et al., 2023), also known as Vote @ n , has become widely adopted due to its simplicity and efficiency.”

“Self-consistency decoding(Wang et al., 2022) pioneered this by sampling multiple independent reasoning paths and aggregating via majority voting, assuming independent diversity yields robust error filtering.”

“Parallel computation is achievable via response ensembling techniques such as self-consistency; however, such approaches rely on each individual agent within the ensemble to gather its own context (Wang et al., 2022; Gao et al., 2025; Knappe et al., 2024).”

“Self-consistency (Wang et al., 2023) leverages output-level variance via majority voting but does not examine internal representations.”

“Chain-of-thought prompting (Wei et al., 2023), self-consistency (Wang et al., 2023), training models on better data (An et al., 2024; 2025a), and use reinforcement learning to let model learn from human feedback or reward model to perform diverse reasoning (Guo et al., 2025; An et al., 2025b) have…”

“The standard approach allocates a uniform budget to every input, applying the same number of samples regardless of difficulty [4, 13].”

“These results highlight structured textual allocentric representations as an effective intermediate reasoning interface for video-based spatial QA in MLLMs.”

“Chain-of-Thought (Wei et al., 2022), Tree-of-Thoughts (Yao et al., 2023a), and Least-to-Most prompting (Zhou et al., 2023) decompose complex reasoning into structured steps, but operate within a single LLM rather than distributing sub-tasks across specialized agents.”

“The answers created with various logical methods are analyzed and the most consistent answer is preferred 57,58 .”

“Large language models (LLMs) have achieved remarkable progress on complex reasoning tasks (Wei et al., 2022; Wang et al., 2022), yet a fundamental challenge persists: distinguishing correct reasoning from plausible-sounding errors remains difficult without external verification (Farquhar et al.,…”

“Wang et al. [32] aggregates diverse reasoning paths through sampling and majority voting, while Pan et al. [25] dynamically adjusts decoding strategy between heuristic and deliberative modes.”

“However, as recent work notes (Wang et al., 2023; Snell et al., 2024; Yao et al., 2023; Dziri et al., 2025), pure pretraining progress is slowing due to extreme compute requirements and limited high-quality human data.”

“We compare against:  Single Agent: Standard chain-of-thought prompting  Self-Consistency: Majority vote over 5 samples[8]  Fixed Multi-Agent: 3 agents with fixed roles and 3 rounds  Random Routing: Random agent allocation with same budget Implementation.”

“LLMs exhibit impressive reasoning abilities, largely attributed to CoT prompting [24, 29, 31, 40, 48, 49] From the training perspective, several works introduce multi-modal reasoning chains [23, 43, 45, 52] and construct high-quality reasoning datasets [14, 38].”

“Methods like Self-Consistency [11] leverage this idea by sampling multiple diverse reasoning paths and aggregating the results.”

“Specifically, we follow the setting of Wang et al. (2022) We use BM25 as the retriever due to its high efficiency and strong retrieval performance.”

“Self-consistency (Wang et al., 2023) instead relies on statistical agreement, sampling multiple answers and trusting the majority.”

“Large Language Models (LLMs) and Vision Language Models (VLMs) have shown strong capabilities in problem solving, planning, and decision making by learning deductive and inductive reasoning from large-scale data.”

“…of Large Language Models (LLMs) have expanded the applicability of LLMs beyond content generation to solving complex problems [51, 23, 57, 5, 50, 63, 8, 55, 12]; and recent works have shown how this reasoning capability could be helpful in improving accuracy for solving complex and logical…”

“Recent research has looked at analyzing reasoning traces of LLM judges (Wang et al., 2023), whether these reasoning traces are useful and how their performance is affected by supervised fine-tuning or reinforcement learning (Chen et al., 2025).”

“However, we can imagine alternative elicitation strategies that effectively use much higher token spend, like sampling many trajectories in parallel from agents and using an LLM judge (or e.g. self-consistency [41]) to filter to the output most likely to be useful for the human.”

“[53], chat history in multi-turn chat, and search history in tree-of-thought [56].”

“Without target-task supervision, an agent must judge its own outputs: prior work aggregates multiple reasoning paths (Wang et al., 2022b), iterates on self-feedback (Madaan et al., 2023), and uses LLMs as judges (Zheng et al., 2023; Gu et al., 2024), while in code domains self-generated tests…”

“Recent approaches to Answer-Level Fine-Tuning (ALFT) have demonstrated compelling empirical success in aligning Large Language Models (LLMs) within complex reasoning domains, such as mathematics and code generation [Uesato et al., 2022, Lightman et al., 2023, Wang et al., 2023].”

“Various works have tried to further improve LLM reasoning through methods like self-consistency (Wang et al., 2023), tree-of-thoughts (Yao et al., 2023), and stream-of-search (Gandhi et al., 2024).”

“Prior work explores two main dimensions: parallel sampling (Wang et al., 2022b) and sequential refinement (Madaan et al., 2023; Snell et al., 2024).”

“In contrast, training-free approaches that utilize multi-step reasoning to leverage LLMs’ contextual learning have gained popularity[53, 51, 58, 63, 38].”

“Self-consistency decoding samples multiple reasoning paths and selects answers by majority vote (Wang et al., 2023).”

“…including prompt engineering, retrieval-augmented generation (RAG), fine-tuning, and agentic frameworks, from the perspective of identifying the most suitable technique for LLM-integrated HEMS, where occupants will submit various queries to LLM-integrated HEMS – analyzing their home…”

“Common proxies include token-level entropy and surprisal, sequence log-likelihood, temperature-scaled confidence, and sampling-based techniques such as self-consistency or generation variance [3], [4].”

“For each evaluation, we de-sign chain-of-thought evaluation prompting (Wei et al., 2022); full prompts are in Appendix D. Truthfulness Evaluation judges whether a candidate answer to a question is factually accurate.”

“Among these methods, self-consistency (Wang et al., 2022) is the most widely adopted parallel scaling approach, which generates multiple traces and selects the final answer through majority voting, repeatedly achieving state-of-the-art performance on reasoning tasks (OpenAI, 2024b).”

“Current TTRL approaches typically involve generating multiple solution candidates and selecting a “pseudo-label” for the model to learn from, often through self-consistency or majority voting (Wang et al., 2023; Zuo et al., 2025; Liu et al., 2025a).”

“• A novel application of the Smith-Waterman algorithm to • A topological data analysis framework for objectively quantifying • Empirical evidence that topological features provide discriminative”

“…it is standard to sample k independent outputs in parallel from a large language model (LLM) and aggregate them, e.g. , by taking the majority answer or the best@ k when a verifier is available (Wang et al., 2023; Brown et al., 2024; Li et al., 2024; Huang et al., 2025; Snell et al., 2025).”

“Inference-time correction methods: reflection (Shinn et al., 2023), self-consistency (Wang et al., 2023), self-debug (Chen et al., 2024), and extended reasoning (OpenAI, 2024; Guo et al., 2025; Yao et al., 2023b; Zhong et al., 2024) improve task accuracy but do not diagnose why the original trace…”

“Our method is related to best-of-N sampling, rejection sampling, and self-training methods that generate multiple candidates and retain high-quality outputs for inference or training [6, 8, 28, 31, 39, 41, 43, 53].”

“While we utilize objective task verifiers in our primary evaluations, this target is highly modular; for open-ended domains lacking ground-truth verifiers, ˆ µ ( x ) can be approximated using Teacher-Anchored Self-Consistency (Appendix B.6).”

“This technique aims to externalize intermediate reasoning processes and aligns with problem-solving frameworks that emphasize tracing decisions, validating intermediate results, and making reasoning processes visible (Wang et al., 2022; Wei et al., 2023).”

“By giving each reflection multiple opportunities to contribute to the learning process, echoing the principle behind self-consistency (Wang et al., 2022), Combee increases the chances that the aggregator can learn from the reflections even under large batch sizes.”

“By solving these fundamental engineering challenges, we move closer to agents that can reliably generate novel knowledge in domains beyond standard benchmarks.”