Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“The first scales inference-time computation through prompting strategies such as Chain-of-Thought [8] and self-consistency [21], decomposition strategies such as least-to-most prompting [22] and Program of Thoughts [23], or iterative self-refinement approaches [24], or through reinforcement…”

“Although existing works can verify textual reasoning, they cannot extend to latent reasoning: Existing works essentially yield different reasoning paths and utilize verifiers to validate.”

“Moreover, Re 2 yields a superior trade-off curve between test-time compute and performance compared to majority voting (Wang et al., 2022).”

“Chain-of-thought prompting (Wei et al., 2022) and its extensions (Yao et al., 2023; Wang et al., 2023b) demonstrate that eliciting intermediate reasoning steps substantially improves LLM performance on complex tasks.”

“Meanwhile, training-free alternatives, including model-based ratings like LLM-as-a-Judge (Zheng et al., 2023) and sampling-based estimates such as self-consistency (Wang et al., 2023), are still inadequate.”

“A key insight driving recent advances is test-time scaling, i.e., allocating additional computation during inference to improve reasoning (Wei et al., 2022; Wang et al., 2022; Madaan et al., 2023; Yao et al., 2023a; Shinn et al., 2023; Snell et al., 2024).”

“In such settings, a naive strategy is to invoke all candidate models for every query and aggregate their responses via scoring or voting (Li et al., 2024b; Wang et al., 2022; Jiang et al., 2023b).”

“For example, the Self-Consistency approach [43] generates multiple reasoning paths via temperature sampling and aggregates them using majority voting to obtain more robust predictions.”

“This pipeline shifts synthesis from single-source generation to an ensemble-driven distillation process [53] (See Fig.”

“Large language models have excelled in reasoning tasks such as mathematics, code generation, and logical inference through chain-of-thought prompting (Wei et al., 2022), iterative refinement, and sampling with aggregation (Wang et al., 2022b; Yao et al., 2023).”

“Complementary strategies introduce exploration–exploitation mechanisms through multi-path sampling (Wang et al., 2023) and systematic search approaches (Zhou et al., 2024; Yao et al., 2023a).”

“Parallel sampling methods generate independent reasoning traces, each unaware of insights from other attempts (Wang et al., 2022; Venkatraman et al., 2025).”

“This approach builds on the Chain-of-Thought (CoT) methods [9, 10, 11, 12, 13, 14], where LLMs are encouraged to increase the amount of generated tokens, through prompting, tools, or chaining intermediate responses, before giving a final response.”

“Moreover, we examine various training-free reward candidates, including token-level confidence (logits) (Kadavath et al., 2022), predictive entropy (Kuhn et al., 2023), self-certainty (Kang et al., 2025), and self-consistency (Wang et al., 2022; Shafayat et al., 2025).”

“We incorporate agent-specific aggregation strategies, executing each analysis multiple times and pooling results to produce stable outcomes [40], [41], [42] (see Appendix A.1).”

“Conventional reasoning supervision can implicitly teach that “reasoning is monotonic” (Wei et al. 2022), whereas Aletheia supervision teaches a conditional control rule: when a contradiction is detected, pause and revise state .”

“…test generation techniques was greatly improved by combining effective prompting strategies (such as Chain of Thought and Self-Consistency) [7], [8] and retrieval augmentation (RAG) [9], with traditional Software Engineering strategies, e.g., code coverage [10] and symbolic execution [11].”

“Under both models, TDP consistently improves Accurate Delivery compared to ReAct and CoT, and it performs on par with or slightly above Plan-and-Act in delivered correctness, with especially clear advantages when the backbone model is DeepSeek-V3.”

“Self-Input Consistency (CoT-SC) (Wang et al., 2022) pio-neered this direction by sampling multiple reasoning paths and applying majority voting to filter out random errors.”

“This paradigm is inherently brittle: due to stochastic sampling, a single unfavorable token choice can trigger hallucinations or error propagation, even when the model’s underlying distribution assigns substantial probability mass to correct or coherent outputs [6, 7].”

“We evaluated the fine-tuned models using five complementary metrics that capture both accuracy and reasoning faithfulness: (1) Greedy Accuracy [11]: evaluates correctness using deterministic decoding with the most probable token at each step; (2) Self-Consistency [11]: samples multiple reasoning…”

“(viii) Self-Consistency (Wang et al., 2022) : A multi-sample reasoning method that votes over the results to improve consistency in decision-making.”

“Furthermore, Wang et al. (2023) demonstrates the significant performance improvements achieved by simply applying majority voting to the answers derived from parallel reasoning.”

“Our consensus mechanism draws inspiration from Self-Consistency [Wang et al., 2023], which demonstrates that aggregating multiple sampling paths improves reasoning performance.”

“…allows agents to improve based on external feedback, improving on techniques such as self-refinement (Madaan et al. 2023; Welleck et al. 2022; Shinn et al. 2023), chain-of-thought (Wei et al. 2022) and self-consistency (Wang et al. 2022), all of which rely on the agent to improve its own response.”

“Prior work on LLM calibration has examined confidence elicitation through verbalized probabilities [Tian et al., 2023, Xiong et al., 2024], multiple sampling [Wang et al., 2023], and logit-based approaches [Kadavath et al., 2022].”

“57–59 Finally, the users confirm the matching to ensure that material extraction is successfully linked to the database’s flows.”

“In fact, CoT has many variants and upgraded versions, such as self-consistency CoT 44 , Tree of Thoughts (ToT) 45 , and Meta-CoT 46 .”

“Google proposed an approach to modify sampling based on the output voting [49], but its on-line nature and latency make it impractical for autonomous driving.”

“Difficulty estimation in other domains employs: (1) statistical methods analyzing performance patterns [21]; (2) LLM-as-a-judge frameworks [2, 4]; and (3) representation -based methods using hidden embeddings [34].”

“Examples include Self-consistency (Wang et al., 2022), Best-of-N (Lightman et al., 2023), and Weighted Best-of-N (Li et al., 2022).”

“Diverse CoT prompting strategies have been proposed and applied broadly Sahoo et al. [2025], including automatic Zhang et al. [2022], self-consistency Wang et al. [2023], and logical Zhao et al. [2024] CoT.”

“Another black-box approach relies on consistency, where multiple responses are sampled for the same input and their agreement is used as a proxy for confidence (Wang et al., 2023).”

“Under the banner of “reasoning LMs,” models externalize intermediate steps – e.g., chain-of-thought, scratchpads, and reflect-revise traces – and allocate more test-time compute to difficult instances (Nye et al., 2021; Shinn et al., 2023; Wang et al., 2023; Wei et al., 2022; Yao et al., 2023).”

“3) Chain-of-Thought (CoT) prompting [11], [12] is applied to enable sequential reasoning so that LLMs can accurately classify whether AD is present.”

“We evaluate LLMs in a zero-shot Chain-of-Thought (CoT, Wei et al., 2022) manner and use accuracy as the evaluation metric for all these datasets.”

“This ensures that the test cases provide sufficient functional validation, which is crucial for later evaluation.”

“By using cases where verbal thinking decreases human performance as a heuristic, we successfully identify three settings where CoT results in large decreases in model performance, leading to implications for choosing when CoT should be deployed.”

“Chain-of-thought prompting elicits intermediate reasoning steps from large models (Wei et al., 2022), self-consistency improves reliability by sampling multiple reasoning paths and marginalizing over their answers (Wang et al., 2022), and least-to-most prompting decomposes hard problems into easier…”

“…of these benchmarks’ published results. b) Multi-call inference and repeated sampling: Self-consistency aggregates multiple sampled reasoning paths, compound AI systems study how performance scales with additional model calls, and Mixture-of-Agents combines outputs from several agents [9–11].”

“These protocol choices restrict both serial depth within a trajectory and parallel breadth across independent trajectories (Wang et al., 2023; Snell et al., 2024).”

“Instruction alignment made models follow requests [31]; chain-of-thought, tree-of-thought, and self-consistency improved deliberation [51, 58, 47]; patterns such as ReAct came to interleave thinking and acting in a loop; and external tools, from function The concept is central in practice, yet the…”

“Self-consistency [9] samples diverse reasoning paths but does not intervene during sequential execution.”

“Self-consistency [Wang et al., 2023] is the no-interaction baseline.”

“…that repeated or structured inference—e.g., chain-of-thought prompting (Wei et al., 2022; Lightman et al., 2024), multiple-sample self-consistency (Wang et al., 2023; Wan et al., 2025), and verifier-guided selection (Li et al., 2023; Zhao et al., 2025)—can improve output quality for high-level,…”

“Specifically, we self-consistency prompt the model [68] post-unlearning and compare the majority vote answer to the pre-unlearning CoT answer.”

“The contradiction with Wang et al. [16] and Guo et al. [9] deserves a careful framing.”

“Chain-of-thought and decomposition prompting (Kojima et al., 2022; Wei et al., 2022; Wang et al., 2023a; Zhou et al., 2022), which lengthen outputs by construction, provide the natural-prior, short-context-theoretic baseline that our reasoning-tier null refutes.”

“The current state of the art therefore scales inference-time compute in parallel: K trajectories are sampled independently and then aggregated through majority voting [5], best-of-N selection [6–8], or LLM-based synthesis [9, 10].”

“Recent advances in large language models (LLMs) have significantly strengthened test-time reasoning through chain-of-thought prompting [1], least-to-most decomposition [2], self-consistency decoding [3], reasoning-action coupling [4], deliberate tree search [5], and tool-augmented inference [6].”

“As no-evolution references, we include a stateless single agent (SA) and majority voting (SC, k =5 ) [33] as a compute-matched comparison.”

“We compare RADAR against three types of baselines: (1) Single Agent Methods including CoT (Wei et al., 2022), ComplexCoT (Fu et al., 2023), SC (Wang et al., 2023); (2) Multi-Agent Systems including MultiPersona (Wang et al., 2024b), LLM-Debate (Du et al., 2023), LLM-Blender (Jiang et al., 2023),…”

“Subsequently, Kojima et al. [22] discovered that simply prompting “Let’s think step by step” elicits zero-shot reasoning, while subsequent studies [43, 51, 2, 10, 28] extended the boundaries of explicit CoT from angles including multi-sample majority voting, tree/graph-structured search, and…”

“A separate line of work improves reasoning by allocating more inference compute, typically via sampling-and-aggregation (Self-Consistency (Wang et al., 2022)) or explicit search (Tree of Thoughts (Yao et al., 2023)).”

“…et al., 2023; Chen et al., 2022; Wei et al., 2022; Ning et al., 2024), generating multiple candidate outputs with verification (Gou et al., 2024; Wang et al., 2023; Zhang et al., 2024b;a), and using non-linear reasoning structures to organize complex inference paths (Yao et al., 2023; Roy &…”

“With the success of reinforcement learning (Schulman et al., 2017; Shao et al., 2024; Guo et al., 2025) in LRMs, this refers to scaling the number of tokens in the reasoning traces, e.g., chains-of-thoughts (Wei et al., 2022).”

“As discussed above, this work analyzes hallucination in LLMs from a phase transition perspective and proposes a hallucination detection framework based on this view.”

“Current approaches address these requirements through prompt engineering [Wei et al., 2022, Wang et al., 2023], retrieval-augmented generation (RAG) [Lewis et al., 2020, Gao et al., 2024], and fine-tuning [Hu et al., 2022].”

“The contrast in outcomes reinforces the importance of ontological guidance for effective GraphRAG.”

“Variance under repetition is documented for reasoning and QA (Wang et al., 2023; Elazar et al., 2021; Mehta, 2026); self-consistency (Wang et al., 2023) exploits it via voting but assumes independent samples, which breaks for path-dependent trajectories.”

“Recent work has examined chain-of-thought reasoning consistency [36,37].”

“Similarly, decomposition-based prompting strategies guide models to solve problems via intermediate steps [35], [36], building upon the foundations of Chain-of-Thought (CoT) prompting [37] and Self-Consistency [38].”

“For instance, Best-of-N (BoN) (Stiennon et al., 2020; Nakano et al., 2021) and Self-consistency (SC-CoT) Wang et al. (2022) repeatedly sample multiple chains and select the best one using heuristics such as predefined rewards or the consistency.”

“…high reliability on hard problems primarily through test-time compute scaling, utilizing methods such as Chain-of-Thought (CoT) deliberation [Wei et al., 2022], multi-sample aggregation via Self-Consistency [Wang et al., 2022] or Best-of-N [Aminian et al., 2025], and verifier-based…”

“In order to aggregate them and output a final action, a simple solution is to leverage some sample method after action generation, like majority voting [16] Fig.”

“(2023) show that majority voting over sampled reasoning chains improves accuracy; we extend this from single-turn CoT to multi-step agentic settings and additionally study consistency as a diagnostic signal, not just an ensembling strategy (Section 4.4).”

“Prior work broadly falls into (i) parallel scaling, which samples multiple candidates and aggregates them (Wang et al., 2023; Brown et al., 2024; Snell et al., 2024; Lightman et al., 2024), (ii) sequential scaling, which iteratively refines a trajectory conditioned on intermediate states (Madaan et…”

“(vi) Consistency , which quantifies epistemic stability across stochastic inference settings, measuring whether repeated generations under different sampling conditions converge to clinically equivalent conclusions rather than contradictory outcomes (Savage et al., 2024; Wang et al., 2023).”

“To complement these costs, reinforcement learning fine-tuning has been proposed at the training stage (Shao et al., 2024; Wang et al., 2024; Xu et al., 2025), while reasoning-augmentation meth-ods such as Chain-of-Thought (Wei et al., 2022), Tree-of-Thoughts (Yao et al., 2023), and Self-Consistency (Wang et al., 2023b…”

“While prior work attains width-like gains through sampling-based aggregation, such as best-of-N (Gao et al., 2023) and self-consistency (Wang et al., 2022), these methods typically improve reliability by repeatedly sampling solutions for the same task.”

“Allocating additional compute at inference time has proven effective in LLMs for reasoning and code generation (Snell et al., 2025; Wang et al., 2023), motivating recent extensions to VLAs through generate-and-verify strategies (Nakamoto et al., 2024; Kwok et al., 2025; Yang et al., 2025).”

“This module is an intra-generation audit rather than an iterative self-refinement procedure.”

“By employing Chain-of-Thought (CoT) prompting/verification (Wei et al., 2022; Wang et al., 2023) and Reinforcement Learning with Verifiable Re-wards (RLVR), these models have achieved unprecedented success in complex mathematical and logical domains.”

“Recent works [31], [32], [33] have aimed to improve CoT prompting in various aspects, such as prompt format [34], prompt selection [35], prompt ensemble [36], and problem decomposition [37].”

“Chain-of-thought (CoT) prompting has been shown to elicit multi-step reasoning and improve performance on complex language tasks [27, 30, 36].”

“We evaluate both parallel scaling via self-consistency (Wang et al., 2022; Zheng et al., 2024b), where we sample multiple independent judgments with temperature T = 1 .”

“Subsequent variants, such as Self-Consistency (Wang et al., 2023) and Least-to-Most Prompting (Zhou et al., 2023), further enhance reasoning robustness and compositionality.”

“This intermediate step reduces complicated significant circuit problems into smaller, multi-step problems and enhances the circuit’s electrical logicality (Wang et al., 2023) before any code is generated.”

“We use self-consistency [61], sampling different candidate selection reasoning paths, with majority voting, to determine the final candidate Implementation.”

“Alternatively, training only a generator (with majority voting for selection) or only a verifier (using a base model for generation) yields limited performance improvements compared to training both components [4, 33, 37].”