Self-Consistency Improves Chain of Thought Reasoning in Language Models

“…have found that even when the desired answer is fixed, introducing diversity in the reasoning processes can be highly beneficial; therefore we leverage sampling, as commonly used for open-ended text generation (Radford et al., 2019; Brown et al., 2020; Thoppilan et al., 2022), to achieve this goal.”

“In an effort to address this shortcoming, Wei et al. (2022) have proposed chain-of-thought prompting , where a language model is prompted to generate a series of short sentences that mimic the reasoning process a person might employ in solving a task.”

“Prompt with correct chain-of-thought 17.1 Prompt with imperfect chain-of-thought 14.9 + Self-consistency (40 paths) 23.4 Prompt with equations 5.0 + Self-consistency (40 paths) 6.5 PaLM-540B Zero-shot CoT (Kojima et al., 2022) 43.0 + Self-consistency (40 paths) 69.2 Table 8: Self-consistency works under imperfect prom…”

“Here we perform a study using self-consistency to see if it can help fill in the gap, over a set of common NLP tasks, including (1) Closed-Book Question Answering: BoolQ (Clark et al., 2019), HotpotQA (Yang et al., 2018), and (2) Natural Language Inference: e-SNLI (Camburu et al., 2018), ANLI (Nie et al., 2020) and RTE…”

“Structured inference methods such as chain-of-thought prompting (Wei et al., 2022), self-consistency (Wang et al., 2023b), and tree-of-thoughts (Yao et al., 2023) have made reasoning a central capability of modern language models.”

“Notably, BD can be viewed as an internal analogue to self-consistency (Wang et al., 2023).”

“Specifi-cally, “self-consistency [34]” involves making multiple predictions with the same LLM and taking the mode as the final result; “multiagent debate [35]” (MaD) directly copies other LLMs’ outputs to the current model, which then output final prediction; Bagging follows the ensemble learning…”

“They can accomplish math problems, puzzles and logic questions without prior special training[10], [11], [12].”

“…to decompose tasks (Hong et al., 2024; Li et al., 2023; Wu et al., 2023), dispatch subtasks to specialized agents (Qian et al., 2024; Hu et al., 2025) (e.g., retrieval, tool use, code execution), and aggregate re-sults (Wang et al., 2023; 2024), enabling tool-augmented and long-horizon workflows.”

“1, a strong general-purpose Turkish model—we quantify how probability assignments and categorical preferences align with patterns re-ported in psycholinguistic experiments on human speakers.”

“The topic of verification remains an open problem, and it would be of interest to study ReD under different verification methods such as Best-of-N (Wang et al., 2023), majority vote, and reward models (Christiano et al., 2023).”

“Across all settings, Bayes-optimal latent responses consistently outperform other decoding schemes, such as beam search or self-consistency (Wang et al., 2023).”

“Three are prompt-based methods: (i) zero-shot prompts (IO), (ii) zero-shot chain-of-thought (CoT) (Wei et al., 2022a), and (iii) CoT with self-consistency (CoT-SC) (Wang et al., 2022a), where each question is answered three times.”

“) We attempt to solve the problem both with a logic solver, and with self-consistency (Wang et al., 2023).”

“Existing mitigation strategies—self-consistency (Wang et al., 2023b), multi-agent debate (Du et al., 2023)—operate within natural language, yet we argue this medium itself introduces ambiguity: soft attention mechanisms inherently struggle to enforce strict inhibition of semantic associations.”

“Training LLM judges remains challenging: supervised fine-tuning (SFT) often lacks exposure to ambiguous or incorrect answers, limiting generalization, while methods like Self-Consistency and Best-of-N only partially address this [Wang et al. , 2022].”

“While not always framed as multi-agent, self-consistency is a closely related inference mechanism in which multiple chains of thought are sampled and aggregated to select a consistent answer [Wang et al., 2023].”

“Subsequent work on self-consistency [26,27] and least-to-most prompting [28] further enhanced reasoning capabilities.”

“These mechanisms have shown promise in guiding factuality (Youssef et al., 2025; Nadeem et al., 2025), reasoning depth (Wang et al., 2022; Zhang et al., 2025a), and safety alignment in general-purpose LLMs while avoiding retraining costs (Li et al., 2025; Maskey et al., 2025; Ren et al., 2025).”

“Techniques for generating explicit intermediate reasoning steps enable LLMs to achieve higher accuracy in downstream tasks, i.e., Chain-of-Thought (CoT) prompting (Wei et al. 2022), Self-Consistency decoding (Wang et al. 2022), and Tree-of-Thought (Yao et al. 2023).”

“…similar behavior through techniques such as multi-sample decoding (Leviathan et al., 2023; Gui et al., 2024; Sun et al., 2024), self-consistency (Wang et al., 2023; Li et al., 2025c), preference modeling (Rafailov et al., 2023; Ouyang et al., 2022; Sun et al., 2025; Ye et al., 2025b), and…”

“Frameworks such as ChatEval (Chan et al. 2023), De-bate (Liang et al. 2024; Nguyen, Childress, and Yin 2025), and CoT-SelfConsistency (Wang et al. 2022) simulates interactive and consensus-driven reasoning, while stance and meme-understanding frameworks like COLA (Lan et al. 2024), LoReHM (Huang et al. 2024), and MiND…”

“Baselines We compare our J UDGE F LOW with a series of baselines, including (1) Single-agent System: Standard prompting (IO), Chain-of-Thought prompting (CoT) (Wei et al., 2023), and Self-Consistency (Wang et al., 2023b); (2) Hand-crafted Multi-agent System: MultiPersona (Wang et al., 2024c), SELF-REFINE (Madaan et al…”

“A common approach is to generate multiple candidates and select the best output using an auxiliary scoring signal, including self-consistency style aggregation [43] and related sampling-and-selection schemes [19].”

“In the literature, several techniques (detailed below) are commonly applied to enhance LLMs’ ability to understand tabular data in previous work [2], [8], [14], which are absent in the proposed solution Orchestra.”

“However, the quality of a single generated reasoning trace can be unstable; self-consistency decoding improves robustness by sampling diverse reasoning paths and selecting the most consistent final answer [4].”

“Self-consistency [16] samples multiple reasoning paths and aggregates results through majority voting, reducing variance in outputs.”

“Intuitively, this sample space represents uncertainty over the set of possible correct responses to prompt 𝑥 ; greater self-consistency within the 𝑣 𝑖 empirically indicates higher correctness rates [62].”

“For instance, Self-Consistency [33] improves upon CoT by generating multiple diverse reasoning paths and selecting the final answer via a majority vote.”

“Techniques such as chain-of-thought prompting [46] and self-consistency decoding [47] further enhance multi-step reasoning capabilities.”

“…2022 The Shapley value of example i is Remark 1 Although in-context learning can be sensitive to the order of examples, our Shapley estimator is order-agnostic: it treats coalitions as sets and evaluates each subset using the current fixed example order used by the optimizer and at inference time.”

“More recently, researchers have sought to enhance visual recognition by exploiting the reasoning capabilities of LMMs [17], [69], [84], [85] through techniques such as Chain-of-Thought prompting [17], [86], [87], self-verification [85], and in-context learning [40], [41], [87], [88], [89].”

“Transformer/attention mechanisms and reasoning techniques such as chain-of-thought and tool-augmented models (Vaswani et al. 2017; Wei et al. 2022; Wang et al. 2023; Mialon et al. 2023).”

“Our approach complements prior prompt-engineering methods that improve reasoning via intermediate structure, such as chain-of-thought [22], self-consistency [21], and search-based prompting (e.g., Tree-of-Thoughts [24] and ReAct [25]).”

“Ensemble techniques in machine learning have long provided improved reliability and uncertainty estimation by combining diverse predictors [19].”

“Complementary techniques such as schema/value retrieval, few-shot selection, voting over sampled reasoning paths [32], and iterative self-feedback [20] improve correctness without enlarging model footprint.”

“Chain-of-Thought (CoT) prompting exposes intermediate steps and improves performance on arithmetic and symbolic tasks (Wei et al., 2022; Zhou et al., 2022; Chen et al., 2022).”

“For complex tasks, step-by-step prompting has become widely used (Besta et al. 2024b; Wang et al. 2023).”

“…examples (Kojima et al. 2023), and Self-Consistency, which involves sampling multiple reasoning paths and selecting the majority answer (Wang et al. 2023) More advanced methods explore non-linear reasoning paths: 1) Tree of Thought (ToT) models exploring different reasoning branches…”

“While this multi-model setup aids evaluation (Section 5.1), the same process can be used for multiple generations of a single model, analogous to self-consistency (Wang et al., 2023).”

“The value of a state is taken to be a weighted average of the evaluator LLM’s score and a self-consistency score (Wang et al., 2022), which upweights frequent candidates in the expansion stage.”

“Of course, it is not a panacea: distribution shifts, where the tuned model’s behavior diverges from its original training [4], can lead to hallucinations [5].”

“(2) Response-level methods aggregate information across multiple model generations, including self-consistency [37, 50], semantic entropy [11], and self-evaluation frameworks [6].”

“CoT [80, 84].”

“In language models, CoT prompting encourages step-by-step reasoning that enhances accuracy on complex tasks [27, 55, 57].”

“Unlike earlier models, reasoning AI is less constrained by the availability of training data and can continue to improve primarily through additional computation, both during inference (via multi-step reasoning [9, 44, 45, 48]) and training (usually via reinforcement learning [12, 17, 29, 30]).”

“On the other hand, research on LLM reasoning reliability shows that without external feedback, models often cannot reliably fix their own reasoning errors, and performance gains typically rely on explicit verification mechanisms [27]–[30].”

“…(Li et al., 2023), Chain-of-Agents for sequential long-context processing (Zhang et al., 2024b), and Tree-of-Thoughts for parallel search over reasoning paths (Yao et al., 2023) demonstrate accuracy gains on complex tasks, while self-consistency ensembles reduce failure modes (Wang et al., 2023).”

“Concretely, chain-of-thought prompting [41] and self-consistency [39] enhance logical fidelity, while least-to-most prompting [48] enables the decomposition of intricate tasks.”

“It draws loose inspiration from the self-consistency method developed by Wang et al. [41], which generates multiple completions from the same prompt and selects the most consistent answer via majority vote.”

“Some approaches use inference-time sampling or search [26, 27]; others explicitly train models to optimize reasoning under compute constraints [28, 29].”

“• Self-Consistency (SC) (Wang et al., 2022) generates N independent reasoning paths and determines the final answer by majority voting on the predicted solutions.”

“Chain-of-thought reasoning trains models to generate explicit intermediate steps rather than only final answers and improves performance on complex language tasks (Wei et al., 2022; Kojima et al., 2022; Wang et al., 2022; Zhou et al., 2022; Zhang et al., 2022).”

“Recent studies suggest that reasoning capabilities in LLMs, such as Chain-of-Thoughts (CoT) [66] and self-consistency [67], may improve task accuracy and reduce hallucinations [68, 69, 70, 71].”

“DExperts [Liu et al., 2021] uses a combination-of-experts at decoding time to reduce toxic content, while self-consistency methods [Wang et al., 2022] sample multiple reasoning paths and select the most consistent answer to reduce logical errors.”

“Fluvastatin targets proteins: HMGCR, HDAC2... 2022; Wang et al., 2022; Kojima et al., 2022; Min et al., 2024) prompting techniques and reinforcement learning strategies, which enable stepwise and logically coherent reasoning.”

“Wei et al. (2022) first demonstrated that prompting models to generate intermediate reasoning steps can substantially improve performance in arithmetic and commonsense reasoning tasks, revealing the emergence of step-by-step reasoning abilities as the model scale increases.”

“Following the setting of existing studies [38], the temperature 𝑡 is set to 0.7.”

“The model’s contributions are notable in advancing few-shot Text-to-SQL capabilities [47], particularly with limited labeled data, through novel execution-based consistency decoding [48].”

“To identify and choose the correct solution within the distribution, Self-Consistency (SC) samples multiple outputs from the LLM and selects the final response by majority voting [Wang et al., 2022].”

“( 6) Self-consistency (SC) (Wang et al., 2022): Employs a majority voting mechanism across multiple generated responses to identify the most consistent answer.”

“In the CoT setting, we additionally apply self-consistency decoding (Wang et al., 2022), generating 10 samples with top-k =20, top-p =0.8, and temperature=0.7 and using priority answer.”

“…2025); (5) CoT + Self-consistency generates three model outputs per image (using temperature=0.5) and applies consensus-based aggregation using the same model, considering only anomalies detected in at least two out of three generations, thereby reducing spurious detections (Wang et al., 2022).”

“The evaluator-FM, which may differ from the release-FM, produces this self-reflection feedback to leverage superior emergent abilities in generating actionable guidance.”

“Various CoT variants, such as self-consistency [41] and few-shot CoT [42], have been proposed to improve model performance.”

“This autonomy can be a liability, as models can be “distracted” by irrelevant information, fall into plausible “common sense” traps, or misinterpret semantic nuance, leading to incorrect solutions [15].”

“Second-moment approaches exist but lack theoretical grounding: self-consistency reduces hallucinations through diverse sampling (Wang et al., 2022) without formal tail-probability guarantees, while deep ensembles provide uncertainty estimates (Lakshminarayanan et al., 2017) but not…”

“Current decoding strategies, including top-k sampling [6, 7], self-consistency [8], and contrastive decoding [9], are largely rule-based and task-specific, limiting their ability to fully exploit the potential of LLMs’ powerful output distributions.”

“Foundational Detection Methods: Self-consistency approaches sample diverse reasoning paths, achieving +17.9% GSM8K improvement with 5x computational overhead [12].”

“Several notable CoT variants have been developed: Self-Consistency CoT [90] replaces the standard greedy decoding approach by sampling diverse reasoning paths and selecting the most consistent answer through marginalization and aggregation.”

“In addition, to gain Hand-Designed Agent Systems Chain-of-Thought (Wei et al., 2022) 64.2 ± 0.9 28.0 ± 3.1 65.4 ± 3.3 29.2 ± 3.1 COT-SC (Wang et al., 2023b) 64.4 ± 0.8 28.2 ± 3.1 65.9 ± 3.2 30.5 ± 3.2 Self-Refine (Madaan et al., 2024) 59.2 ± 0.9 27.5 ± 3.1 63.5 ± 3.4 31.6 ± 3.2 LLM Debate (Du et…”

“CoT prompting has been shown to significantly improve the reasoning capabilities of large language models (Wei et al., 2022; Nye et al., 2021; Lanchantin et al., 2023; Suzgun et al., 2023; Zelikman et al., 2022; Zhou et al., 2023; Wang et al., 2023b; Yao et al., 2023).”

“Techniques such as Chain-of-Thought (Wei et al., 2022) and Self-Consistency (Wang et al., 2022) exploit this by sampling diverse reasoning paths, while more structured approaches like Monte Carlo Tree Search (MCTS) (Zhang et al., 2024; Chopra & Shah, 2025) (Lee et al., 2025).”

“A vote over the n committed answers (Wang et al., 2023) tells whether a student’s samples agree on the right answer.”

“Extended Chain of Thought reasoning has become a central mechanism for mathematical reasoning, code generation, and complex decision making, but longer reasoning traces also increase token usage, latency, and inference cost 7,8,24,25 .”

“This simple change gives a large boost on tasks like arithmetic and multi-step question answering, and later work showed the steps can be produced without hand-written examples [44] and made more reliable by sampling several chains and taking the majority answer [77].”

“Sampling diverse reasoning paths and aggregating their answers [55], searching over intermediate states [60], revising against model-generated feedback [44], and organizing multi-agent debate [18] provide complementary ways to use additional inference.”