The DOI matches its Crossref record; 177 of the 177 references it cites were found in a registry or an index.
The self-consistency model of subjective confidence.
Abstract
How do people monitor the correctness of their answers? A self-consistency model is proposed for the process underlying confidence judgments and their accuracy. In answering a 2-alternative question, participants are assumed to retrieve a sample of representations of the question and base their confidence on the consistency with which the chosen answer is supported across representations. Confidence is modeled by analogy to the calculation of statistical level of confidence (SLC) in testing hypotheses about a population and represents the participant's assessment of the likelihood that a new sample will yield the same choice. Assuming that participants draw representations from a commonly shared item-specific population of representations, predictions were derived regarding the function relating confidence to inter-participant consensus and intra-participant consistency for the more preferred (majority) and the less preferred (minority) choices. The predicted pattern was confirmed for several different tasks. The confidence-accuracy relationship was shown to be a by-product of the consistency-correctness relationship: It is positive because the answers that are consistently chosen are generally correct, but negative when the wrong answers tend to be favored. The overconfidence bias stems from the reliability-validity discrepancy: Confidence monitors reliability (or self-consistency), but its accuracy is evaluated in calibration studies against correctness. Simulation and empirical results suggest that response speed is a frugal cue for self-consistency, and its validity depends on the validity of self-consistency in predicting performance. Another mnemonic cue-accessibility, which is the overall amount of information that comes to mind-makes an added, independent contribution. Self-consistency and accessibility may correspond to the 2 parameters that affect SLC: sample variance and sample size.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Instead, a more general computational definition posits that propositional confidence reflects the probability of making a self-consistent choice across multiple presentations of the same decision problem (Boundy-Singer et al. 2023, Caziot & Mamassian 2021, Koriat 2012).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Koriat 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984
Illusion and well‐being: A social psychological perspective on mental health
Taylor, S. E., & Brown, J. D. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.2.193 · Cited by 7,814
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
(1999) · Cited by 6,104
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Social psychology: handbook of basic principles
(2008) · Choice Reviews Online · doi:10.5860/choice.45-3496 · Cited by 5,473
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
Cited by
Metcalfe, J. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044022 · Cited by 483
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Supra-personal cognitive control and metacognition
Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., & Frith, C. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.006 · Cited by 368
Intuitions and Experiments: A Defense of the Case Method in Epistemology
Nagel, J. (2012) · Philosophy and Phenomenological Research · doi:10.1111/j.1933-1592.2012.00634.x · Cited by 337
When are two heads better than one and why?
Koriat, A. (2012) · Science · doi:10.1126/science.1216549 · Cited by 256
Self-citationMetacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“Instead, a more general computational definition posits that propositional confidence reflects the probability of making a self-consistent choice across multiple presentations of the same decision problem (Caziot & Mamassian, 2021, Koriat, 2012, Boundy-Singer et al., 2023).”
Signatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253
Consumer conviction and commitment: An appraisal‐based framework for attitude certainty
Rucker, D. D., Tormala, Z. L., Petty, R. E., & Briñol, P. (2014) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2013.07.001 · Cited by 202
The Sense of Confidence during Probabilistic Learning: A Normative Account
Meyniel, F., Schlunegger, D., & Dehaene, S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004305 · Cited by 163
Lifting the Veil of Morality: Choice Blindness and Attitude Reversals on a Self-Transforming Survey
Hall, L., Johansson, P., & Strandberg, T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045457 · Cited by 192
A meta-analysis and systematic review of reactivity to judgements of learning
Double, K. S., Birney, D. P., & Walker, S. A. (2018) · Memory · doi:10.1080/09658211.2017.1404111 · Cited by 120
The impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
The role of certainty (and uncertainty) in attitudes and persuasion
Tormala, Z. L. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.10.017 · Cited by 109
“All else equal, people are more certain of their attitudes when their attitude-relevant information is consistent rather than contradictory [23,34 ,35,36], presumably because consistency helps build people’s confidence in the accuracy of the information.”
BackgroundConfidence reflects a noisy decision reliability estimate
Boundy-Singer, Z. M., Ziemba, C. M., & Goris, R. L. T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01464-x · Cited by 71
Modeling perceptual confidence and the confidence forced-choice paradigm.
Mamassian, P., & de Gardelle, V. (2022) · Psychological Review · doi:10.1037/rev0000312 · Cited by 70
Known Unknowns: A Critical Determinant of Confidence and Calibration
Walters, D. J., Fernbach, P. M., Fox, C. R., & Sloman, S. A. (2017) · Management Science · doi:10.1287/mnsc.2016.2580 · Cited by 62
The future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
“…from a greater integration between social psychology and computational neuroscience e facilitating the development of rich frameworks that accommodate distinctions between self-and other-directed metacognition, and self-evaluations that go beyond performance or skill to also encompass affective…”
BackgroundHeuristic Cues for Meta-Reasoning Judgments: Review and Methodology
Ackerman, R. (2019) · Psihologijske teme · doi:10.31820/pt.28.1.1 · Cited by 56
Maniscalco, B., Odegaard, B., Grimaldi, P., Cho, S. H., Basso, M. A., Lau, H., & Peters, M. A. K. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008779 · Cited by 44
“, a “confirmation bias” [52]—has also been observed in other post-decisional (non-metacognitive) perceptual judgments [19,20], value judgments [53–58], and metamemory [59,60], suggesting it may be a domain-general strategy that serves also to reduce cognitive dissonance and improve self-consistency.”
BackgroundPerceptual confidence judgments reflect self-consistency
Caziot, B., & Mamassian, P. (2021) · Journal of Vision · doi:10.1167/jov.21.12.8 · Cited by 38
Investigating User Confidence for Uncertainty Presentation in Predictive Decision Making
Arshad, S. Z., Zhou, J., Bridon, C., Chen, F., & Wang, Y. (2015) · Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction · doi:10.1145/2838739.2838753 · Cited by 30
Metacognition and Uncertainty Communication in Humans and Large Language Models
Steyvers, M., & Peters, M. A. K. (2026) · Current Directions in Psychological Science · doi:10.1177/09637214251391158 · Cited by 18
“Confidence may reflect internal consistency or access to task-relevant information (Koriat, 2012) or the formation of second-order beliefs (Peters, 2022) Token likelihoods and response consistency are used to estimate uncertainty (Kadavath et al., 2022; Liu et al., 2025) Metacognitive training Some…”
Metadata
- Authors
- Koriat, A.
- Venue
- Psychological Review
- Published
- 2012-01
- Volume
- 119
- Issue
- 1
- Pages
- 80-113
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2001557538
- Cited by
- 320
- References
- 177
- FWCI
- 6.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.