Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“For example, self-consistency leverages agreement among multiple generated solutions as a learning signal [56], which has enhanced reasoning in tasks like math and code generation, as seen in TTRL [85], MM-UPT [59], and SRT [43].”

“As a result, they are often limited to relatively simple sub-agents such as sub-agents that are based on Chain-of-Thought (CoT) (Wei et al., 2022) and CoT with Self-Consistency (SC) (Wang et al., 2023).”

“For reference, we also report the results of self-consistency (Wang et al., 2022), which prompts models to generate multiple responses and performs majority voting to select the final answer.”

“…filtering are well-established reliability mechanisms in this literature; they have been used for answer selection at inference time [Wang et al., 2023], for filtering training data in self-improvement pipelines [Zelikman et al., 2022], and for offline reinforcement learning on…”

“Experimenting with sampling answers from the LLM to ensure decision certainty and expanding our method’s testing across diverse clinical datasets will also be critical in identifying and mitigating weaknesses [21].”

“In other words, validation accuracy is the same as majority voting accuracy (Wang et al., 2023a) in traditional LLM chain-of-thought reasoning tasks.”

“LLM Consistency : Recent work examines single-agent behavioral variation across prompt perturbations [9] and fine-tuning impacts [10], but does not address temporal drift in interactive, multi-turn scenarios or multi-agent coordination dynamics.”

“Self-Consistency (SC) (Wang et al., 2023a) improves reasoning reliability by sampling multiple reasoning paths (e.g., CoT outputs) and selecting the most consistent answer.”

“…users, with manually-designed agentic workflows being critical components of commercial AI products (AWS, 2025; Anysphere, 2025; Microsoft, 2025) while effective prompting and self-refinement strategies are still a core focus of the current research (Wei et al., 2022; Madaan et al., 2023a).”

“…shown to significantly improve performance on complex tasks, with techniques such as long chain-of-thought reasoning and self-consistency, increasing success rates by allocating more computation at inference time (Wei et al., 2022; Wang et al., 2022; Zelik-man et al., 2022; Schick et al., 2023).”

“This concept has been most thoroughly explored in large language models [27, 42, 50] and further advanced through deliberate reasoning approaches [14, 19].”

“Finally, inference-aware training (Vijayaku-mar et al., 2016; Wang et al., 2022; Chow et al., 2024) is orthogonal to our method and can be combined in the future.”

“Majority voting (Wang et al., 2023) is a test-time inference strategy that samples multiple independent responses from a model and selects the most frequently occurring answer.”

“…we sample 𝑛 responses using identical decoding settings, and compare the following aggregation methods: Cons@ 𝑛 : Standard self-consistency (Wang et al., 2023), which performs majority voting over all 𝑛 sampled responses; Mean@ 𝑛 : The average accuracy of all the 𝑛 samples, reflecting…”

“(i) Agentic Tests (Jain et al., 2025): an expert agent generates a problem-specific test_issue.py with repository interaction; candidates are scored by executing these testcases.”

“Further gains have been achieved through search-based strategies, including majority voting (Wang et al., 2022), Tree-of-Thoughts (ToT) (Yao et al., 2024), and Monte Carlo Tree Search (MCTS) (Yang et al., 2022), which allow the exploration of multiple reasoning paths.”

“Multi-agent baselines : Debate (Du et al., 2023b), Self-Consistency (SC) (Wang et al., 2023a), Refine (Madaan et al., 2023), ReConcile (Chen et al., 2023), MoA (Wang et al., 2024a), and Self-MoA (Li et al., 2025).”

“…2024) but not representational restructuring or meta-cognitive monitoring, while process supervision (Lightman et al., 2023; Uesato et al., 2022) and chain-of-thought prompting (Wei et al., 2022b; Kojima et al., 2023; Wang et al., 2022; Yao et al., 2023) elicit latent but not spontaneous behaviors.”

“Tree-of-Thought (ToT) (Yao et al., 2023a) expands on the reasoning process by considering multiple paths of reasoning and self-evaluating choices.”

“Among the valid answers, we define the pseudo-answer ˜ a ( x ) as the plurality vote, breaking ties uniformly at random [Wang et al., 2023].”

“Early works [23,53,59,61,74] completed reasoning tasks using standardized CoT prompts.”

“Prior work (Wang et al., 2022a; Brown et al., 2024) shows that test-time scaling can substantially improve LLM performance.”

“This idea draws on recent work in LLM ensemble methods, which shows that repeated or multi-model responses often yield better outputs via majority voting or similar aggregation strategies 30,31 .”

“Scaling test-time compute has emerged as a promising avenue for enhancing the performance of large language models (LLMs) (Wei et al., 2022; Wang et al., 2023; Brown et al., 2024; Welleck et al., 2024; Snell et al., 2025; Muennighoff et al., 2025).”

“It is well-accepted, even among skeptical researchers, that the parameters of modern LLMs encode a remarkable amount of world knowledge [2, 10, 17, 21, 24, 31, 47, 62], which can be leveraged by an LLM in flexible and robust ways [64, 65, 74].”

“A separate axis spends test-time compute on longer trajectories, e.g. chain-of-thought [92, 63], self-consistency [90], and reasoning-trained LMs [26], all leaving the per-token forward unchanged; theory characterizes their advantages [29, 60, 96, 77].”

“are often unpredictable and require LLM agents to operate end-to-end through planning [Wang et al., 2023, Erdogan et al., 2025], reasoning [Wei et al., 2022, Yao et al., 2022], and tool use [Schick et al., 2023, Patil et al., 2024] under uncertain and evolving conditions that far exceed what the…”

“Recent work has shown that reasoning can be elicited with chain-of-thought prompting and further improved by self-consistency decoding [35, 36].”

“Another power technique is Self-consistency , which involves sampling numerous and diverse reasoning paths across the CoT at a few hits and using generations to find the most consistent response [7].”

“Given the user question Q and the contextualized schema S linked , we generate a set of N SQL candidates (5 in this paper): where N is the number of self-consistency samples (Wang et al. 2023).”

“The “Chain-of-Frame” (CoF) [12, 41] paradigm treats video generation as a sequence of reasoning steps, in direct analogy to “Chain-of-Thought” in language models [23, 37, 38, 40, 47].”

“We compare GHS-TDA with nine representative baselines that cover chain-based, tree-based, graph-based, forest-based, and atomic reasoning paradigms: CoT (Wei et al., 2022) and its self-consistency variant CoT-SC (Wang et al., 2022), Self-Refine (Madaan et al., 2023), Analogical Prompting (Yasunaga et al., 2023), the s…”

“Initial efforts focused on prompt engineering to induce intermediate reasoning steps (Wei et al., 2022; Khot et al., 2022; Zhou et al., 2022; Zheng et al., 2023; Zhang et al., 2023b; Gao et al., 2024; Ho et al., 2025; Chen et al., 2025c; Liang et al., 2025), though these approaches remain heavily…”

“We also perform majority voting [43] on the eight sampled responses, with the results presented inside red bars in Figure 4.”

“In this work, we introduced MARS-SQL , the first framework to leverage an interactive RL policy for tool-augmented SQL generation under sparse execution re-wards within a multi-agent decomposition.”

“AIME 2024/2025 and AMC 2023 report Avg@32 [32]; remaining benchmarks use a single generation.”

“Under the classical Condorcet Jury Theorem (CJT), if each agent is correct with probability p > 1 / 2 and the correctness events are independent, then P (ˆ y MV = y ⋆ ) → 1 as N → ∞ .”

“This gain is particularly significant compared to CoT-SC , indicating that our Consistency-Weighted reflection provides quality gains beyond simple ensembling.”

“Furthermore, since we apply no direct supervision to the intermediate reasoning steps, the model’s internal chain of thought remains unconstrained and could potentially contain harmful or biased content, even if the final answer is correct.”

“Self-consistency and related sampling-based methods further stabilize in-context behaviors by aggregating multiple reasoning paths, which is especially useful under nondeterminism and partial observability [58].”

“Additionally, they only study base models and do not consider post-trained models in their analysis. et al., 2023) to scaling with a generative verifier.”

“Chain-of-Thought (CoT) prompting has significantly enhanced the reasoning abilities of language models [12, 41, 44].”

“• CoT-SC (Chain-of-Thought Self-Consistency) (Wang et al., 2023) serves as a baseline for enhancing the reasoning capabilities of language models.”

“Through generating multiple reasoning paths and selecting the most plausible one through a confidence estimation mechanism, such as self-consistency [57] and perplexity [10], this approach has achieved significant improvements.”

“Majority voting is a standard ensemble strategy for reducing prediction variance [12]; in LLM settings, related self-consistency methods similarly aggregate multiple sampled outputs to improve reliability [13].”

“The Mx agent was designed to use the maximum computational power permissible under real-time user interaction constraints, on the basis of the expectation that management reasoning capabilities would improve with increasing test-time computation 23,41–45 .”

“Diversity collapse limits self-consistency (Wang et al., 2023), pass@ k sampling (Chen et al., 2021), and test-time compute scaling (Snell et al., 2025).”

“Sampling-based methods like self-consistency (Wang et al., 2022) aggregate k reasoning paths through majority voting (maj@k) to improve accuracy on complex reasoning tasks.”

“Selection-based methods such as Best-of-N decoding (Sti-ennon et al., 2020) and self-consistency (Wang et al., 2023; Kang et al., 2025) evaluate completed trajectories post-hoc and choose among them without altering execution.”

“With the development of Vision-Language Models (VLMs) [13, 15, 30, 32–34],Reinforcement learning with verifiable rewards (RLVR) [10, 22, 24] has demonstrated its effectiveness in facilitating complex reasoning tasks.”

“C OMMIT P ACK FT+OASST yields best performance All instruction datasets provide similar boosts for code synthesis (H UMAN E VAL S YNTHESIZE ), which has been the focus of all prior work on code instruction models (Wang et al., 2023c; Luo et al., 2023; Muennighoff et al., 2022b).”

“We compare TU against a number of baselines: Mean Token Entropy (Fomicheva et al., 2020), Maximum Token Probability (Fadeeva et al., 2023), Maximum Sequence Probability (Fadeeva et al., 2023), Perplexity (Fomicheva et al., 2020), PTrue (Kada-vath et al., 2022), Self-Certainty (Kang et al., 2025), Semantic Entropy (Kuh…”

“Self-Consistency (Wang et al., 2023b) and LLM-Blender (Jiang et al., 2023a) introduced majority voting and pairwise ranking, respectively.”

“…vary inference behavior under different budgets, e.g., direct generation vs. chain-of-thought (Wei et al., 2022), self-refinement and reflection loops (Yao et al., 2022; Shinn et al., 2023; Madaan et al., 2023), or bounded deliberation via limits on steps, samples, or search (Wang et al., 2022).”

“For healthcare settings, robust activation delivers timely interventions like abnormal vitals, formulary aware order suppression etc.”

“Representative methods include self-consistency (Wang et al., 2023) and Best-of-N (BoN) selection using outcome rewards (Cobbe et al., 2021) or process rewards (Lightman et al., 2023), as well as search-based approaches that branch over intermediate steps such as such as Tree-of-Thought (Yao et…”

“To compensate, LLMs often rely on longer chains of thought (CoT) (Wei et al., 2022; Yeo et al., 2025; Chen et al., 2025b) or repeated self-refinement (Wang et al., 2023; Ling et al., 2023; Madaan et al., 2023) to re-focus, which in turn raise computational costs and inflate token usage.”

“To select among candidates, we use either majority voting or best-of-N with a Latent Process Reward Model (LPRM).”

“Unlike traditional program compilation, skill compilation takes natural language as input, which inherently introduces some non-determinism into the compilation process [55].”

“Prior work has explored various scaling strategies in language/visual-language models, including self-consistency (Wang et al., 2022), tree-based search (Yao et al., 2023; Wang et al., 2025c), verifier-guided method (Lif-shitz et al., 2025; Zhang et al., 2024a), and (multimodal) CoT (Yan et al.,…”

“Recent advances in Reinforcement Learning (RL)-based training (Shao et al., 2024) have substantially improved the reasoning capabilities of large language models (LLMs), enabling the emergence of “aha” moments and allowing them to excel in complex tasks such as coding (Jiang et al., 2024) and planning (Huang et al., 2…”

“Following previous works demonstrating that the correctness of a model is closely related to its confidence (Xie et al. 2023; Wang and Zhou 2024; Wang et al. 2023), we introduce a confidence-based method to estimate whether a model possesses sufficient capability to generate a correct next step.”

“Prompting methods such as chain-of-thought [26], Tree of Thoughts [28], [62], self-consistency [27], and Reflexion [63] show that sufficiently capable models can support task decomposition, branching search, self-critique, and multi-step inference.”

“Most evaluations compare MAS against SAS baselines such as Chain-of-Thought (CoT) [36], CoT with Self-Consistency (CoT-SC) [35], or self-refinement [25], reporting improved accuracy in tasks such as mathematical reasoning [6, 44, 19, 13, 23, 42, 40], question answering (QA) [44, 19, 13, 23, 42],…”