The impact of evidence reliability on sensitivity and bias in decision confidence.
Open accessAbstract
Human observers effortlessly and accurately judge their probability of being correct in their decisions, suggesting that metacognitive evaluation is an integral part of decision making. It remains a challenge for most models of confidence, however, to explain how metacognitive judgments are formed and which internal signals influence them. While the decision-making literature has suggested that confidence is based on privileged access to the evidence that gives rise to the decision itself, other lines of research on confidence have commonly taken the view of a multicue model of confidence. The present study aims at manipulating one such cue: the perceived reliability of evidence supporting an initial decision. Participants made a categorical judgment of the average color of an array of eight colored shapes, for which we critically manipulated both the distance of the mean color from the category boundary (evidence strength) and the variability of colors across the eight shapes (evidence reliability). Our results indicate that evidence reliability has a stronger impact on confidence than evidence strength. Specifically, we found that evidence reliability affects metacognitive readout, the mapping from subjectively experienced certainty to expressed confidence, allowing participants to adequately adjust their confidence ratings to match changes in objective task performance across conditions. (PsycINFO Database Record
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Confidence judgments are sensitive to the variability in perceptual evidence, although sometimes to a greater or lesser degree than predicted by an ideal observer model.
“A number of studies have presented evidence that confidence judgments are sensitive to the variability in perceptual evidence, although sometimes to a greater or lesser degree than predicted by an ideal observer model (Boldt et al. 2017, Spence et al. 2016, Zylberberg et al. 2014).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Boldt et al. 2017
The Results (Effects of Evidence Mean and Variance on Confidence; page unavailable) show that higher stimulus variance lowered confidence, even in conditions matched for task difficulty. They also report a difference from the normative expectation based on accuracy, but our copy does not compare the size of the variance effect with predictions from an ideal-observer model. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558 · see citing works
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · see citing works
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · see citing works
Using confidence intervals in within-subject designs
Loftus, G. R., & Masson, M. E. J. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210951 · Cited by 2,433 · see citing works
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
DiCiccio, T., Kass, R., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 2,029 · see citing works
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,796 · see citing works
Probabilistic mental models: a Brunswikian theory of confidence
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) · Psychological Review · doi:10.1037/0033-295x.98.4.506 · Cited by 1,506 · see citing works
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · see citing works
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423 · see citing works
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,386 · cited 2× · see citing works
“Caution is advised when comparing conditions that are not matched for accuracy, though (Fleming & Lau, 2014).”
BackgroundBayesFactor: Computation of Bayes Factors for Common Designs
Morey, R. D., & Rouder, J. N. (2012) · doi:10.32614/cran.package.bayesfactor · Cited by 1,220 · see citing works
Do those who know more also know more about how much they know?*1
Lichtenstein, S., & Fischhoff, B. (1977) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(77)90001-0 · Cited by 1,107 · see citing works
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · see citing works
Bonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011 · see citing works
How do we know that we know? The accessibility model of the feeling of knowing
Koriat, A. (1993) · Psychological Review · doi:10.1037/0033-295x.100.4.609 · Cited by 895 · see citing works
Maniscalco, B., & Lau, H. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.09.021 · Cited by 883 · see citing works
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · see citing works
Bahrami, B., Olsen, K., Latham, P. E., Roepstorff, A., Rees, G., & Frith, C. D. (2010) · Science · doi:10.1126/science.1185718 · Cited by 738 · see citing works
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722 · see citing works
Zhang, H., & Maloney, L. T. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00001 · Cited by 679 · see citing works
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672 · see citing works
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667 · see citing works
Self-citationProbabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645 · see citing works
Bruyer, R., & Brysbaert, M. (2011) · Psychologica Belgica · doi:10.5334/pb-51-1-5 · Cited by 573 · see citing works
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534 · see citing works
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528 · see citing works
Choice Certainty Is Informed by Both Evidence and Decision Time
Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470 · see citing works
What determines initial feeling of knowing? Familiarity with question terms, not with the answer.
Reder, L. M., & Ritter, F. E. (1992) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.18.3.435 · Cited by 464 · see citing works
Fusaroli (2012) · doi:10.1177/0956797612436816 · Cited by 379 · see citing works
Juslin, P., Winman, A., & Olsson, H. (2000) · Psychological Review · doi:10.1037/0033-295x.107.2.384 · Cited by 379 · see citing works
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349 · see citing works
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339 · see citing works
The self-consistency model of subjective confidence.
Koriat, A. (2011) · Psychological Review · doi:10.1037/a0025648 · Cited by 327 · see citing works
Koriat, A., & Nussinson, R. (2001) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.27.1.34 · Cited by 316 · see citing works
The calibration and resolution of confidence in perceptual judgments
Baranski, J. V., & Petrusic, W. M. (1994) · Perception & Psychophysics · doi:10.3758/bf03205299 · Cited by 308 · see citing works
The construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297 · see citing works
Shared neural markers of decision confidence and error detection
Boldt, A., & Yeung, N. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0797-14.2015 · Cited by 274 · see citing works
Self-citationAutomatic integration of confidence in the brain valuation signal
Lebreton, M., Abitbol, R., Daunizeau, J., & Pessiglione, M. (2015) · Nature Neuroscience · doi:10.1038/nn.4064 · Cited by 265 · see citing works
Signatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253 · see citing works
Sources of information in metamemory: Judgments of learning and feelings of knowing
Schwartz, B. L. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03213977 · Cited by 249 · see citing works
Responses of pulvinar neurons reflect a subject's confidence in visual categorization
Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T., & Miyamoto, A. (2013) · Nature Neuroscience · doi:10.1038/nn.3393 · Cited by 226 · see citing works
Causal evidence for frontal cortex organization for perceptual decision making
Rahnev, D., Nee, D. E., Riddle, J., Larson, A. S., & D’Esposito, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1522551113 · Cited by 200 · see citing works
Accuracy of feeling-of-knowing judgments for predicting perceptual identification and relearning.
Nelson, T. O., Gerler, D., & Narens, L. (1984) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.113.2.282 · Cited by 197 · see citing works
Spatial attention increases performance but not subjective confidence in a discrimination task
Wilimzig, C., Tsuchiya, N., Fahle, M., Einhäuser, W., & Koch, C. (2008) · Journal of Vision · doi:10.1167/8.5.7 · Cited by 196 · see citing works
Moran, R., Teodorescu, A. R., & Usher, M. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.01.002 · Cited by 185 · see citing works
Robust averaging during perceptual judgment
de Gardelle, V., & Summerfield, C. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104517108 · Cited by 183 · see citing works
Unexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182 · see citing works
Action-Specific Disruption of Perceptual Confidence
Fleming, S. M., Maniscalco, B., Ko, Y., Amendi, N., Ro, T., & Lau, H. C. (2014) · Psychological Science · doi:10.1177/0956797614557697 · Cited by 169 · see citing works
Probing the locus of confidence judgments: Experiments on the time to determine confidence.
Baranski, J. V., & Petrusic, W. M. (1998) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.24.3.929 · Cited by 163 · see citing works
Measures of metacognition on signal-detection theoretic models
Barrett, A. B., Dienes, Z., & Seth, A. K. (2013) · Psychological Methods · doi:10.1037/a0033268 · Cited by 155 · see citing works
Cognitive Illusions of Authorship Reveal Hierarchical Error Detection in Skilled Typists
Logan, G. D., & Crump, M. J. C. (2010) · Science · doi:10.1126/science.1190483 · Cited by 150 · see citing works
The Hard–Easy Effect in Subjective Probability Calibration
Suantak, L., Bolger, F., & Ferrell, W. R. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0074 · Cited by 145 · see citing works
A stochastic model for individual choice behavior.
Audley, R. J. (1960) · Psychological Review · doi:10.1037/h0046438 · Cited by 143 · see citing works
Zylberberg, A., Fetsch, C. R., & Shadlen, M. N. (2016) · eLife · doi:10.7554/elife.17688 · Cited by 140 · see citing works
Vickers, D., & Packer, J. (1982) · Acta Psychologica · doi:10.1016/0001-6918(82)90006-3 · Cited by 139 · see citing works
Kinds of access: different methods for report reveal different kinds of metacognitive access
Overgaard, M. S., & Sandberg, K. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2011.0425 · Cited by 137 · see citing works
Probing the locus of confidence judgments: Experiments on the time to determine confidence.
Baranski, J. V., & Petrusic, W. M. (1998) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.24.3.929 · Cited by 111 · see citing works
Bang, D., Fusaroli, R., Tylén, K., Olsen, K., Latham, P. E., Lau, J. Y. F., Roepstorff, A., Rees, G. E., Frith, C., & Bahrami, B. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.02.002 · Cited by 108 · see citing works
Variance misperception explains illusions of confidence in simple perceptual decisions
Zylberberg, A., Roelfsema, P. R., & Sigman, M. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.05.012 · Cited by 97 · see citing works
Computations underlying confidence in visual perception.
Spence, M. L., Dux, P. E., & Arnold, D. H. (2016) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000179 · Cited by 89 · see citing works
Moreno‐Bote, R. (2010) · Neural Computation · doi:10.1162/neco.2010.12-08-930 · Cited by 89 · see citing works
Weighting Mean and Variability during Confidence Judgments
de Gardelle, V., & Mamassian, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120870 · Cited by 82 · see citing works
Tests of two theories of decision in an "expanded judgment" situation.
Irwin, F. W., Smith, W., & Mayfield, J. F. (1956) · Journal of Experimental Psychology · doi:10.1037/h0041911 · Cited by 73 · see citing works
An application of the Poisson race model to confidence calibration.
Merkle, E. C., & Zandt, T. V. (2006) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.135.3.391 · Cited by 73 · see citing works
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72 · see citing works
Evaluation of a 'bias-free' measure of awareness
Azzopardi, P., & Evans, S. (2007) · Spatial Vision · doi:10.1163/156856807779369742 · Cited by 68 · see citing works
Computation of Bayes Factors for Common Designs
Morey, R. D., & Rouder, J. N. (2015) · Cited by 58 · see citing works
Kornbrot, D. E. (2006) · Perception & Psychophysics · doi:10.3758/bf03193685 · Cited by 48 · see citing works
The disutility of the hard-easy effect in choice confidence
Merkle, E. C. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.1.204 · Cited by 46 · see citing works
Strength and weight: The determinants of choice and confidence
Kvam, P. D., & Pleskac, T. J. (2016) · Cognition · doi:10.1016/j.cognition.2016.04.008 · Cited by 40 · see citing works
Shared Mechanisms for Confidence Judgements and Error Detection in Human Decision Making
Yeung, N., & Summerfield, C. (2014) · Springer eBooks · doi:10.1007/978-3-642-45190-4_7 · Cited by 38 · see citing works
Self-citationA Case-Based Model of Probability and Pricing Judgments: Biases in Buying and Selling Uncertainty
Brenner, L. A., Griffin, D. W., & Koehler, D. J. (2011) · Management Science · doi:10.1287/mnsc.1110.1429 · Cited by 13 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Subjective Confidence Predicts Information Seeking in Decision Making
Desender, K., Boldt, A., & Yeung, N. (2018) · Psychological Science · doi:10.1177/0956797617744771 · Cited by 296 · see citing works
Self-citationMetacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256 · see citing works
“A number of studies have presented evidence that confidence judgments are sensitive to the variability in perceptual evidence – although sometimes to a greater or lesser degree than predicted by an ideal observer model (Zylberberg et al., 2014, Spence et al., 2016, Boldt et al., 2017).”
Distinct encoding of decision confidence in human medial prefrontal cortex
Bang, D., & Fleming, S. M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800795115 · Cited by 207 · see citing works
In the body's eye: the computational anatomy of interoceptive inference
Allen, M., Levy, A., Parr, T., & Friston, K. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010490 · Cited by 185 · see citing works
Human Metacognition Across Domains: Insights from Individual Differences and Neuroimaging
Rouault, M., McWilliams, A., Allen, M. G., & Fleming, S. M. (2018) · Personality Neuroscience · doi:10.1017/pen.2018.16 · Cited by 176 · see citing works
Forming global estimates of self-performance from local confidence
Rouault, M., Dayan, P., & Fleming, S. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09075-3 · Cited by 134 · see citing works
Confidence modulates exploration and exploitation in value-based learning
Boldt, A., Blundell, C., & Martino, B. D. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz004 · Cited by 120 · see citing works
Self-citationSources of Metacognitive Inefficiency
Shekhar, M., & Rahnev, D. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.007 · Cited by 117 · see citing works
Confidence guides spontaneous cognitive offloading
Boldt, A., & Gilbert, S. J. (2019) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-019-0195-y · Cited by 105 · see citing works
Self-citationA postdecisional neural marker of confidence predicts information-seeking in decision-making
Desender, K., Murphy, P., Boldt, A., Verguts, T., & Yeung, N. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.2620-18.2019 · Cited by 88 · see citing works
Self-citationBoldt, A., Schiffer, A.-M., Waszak, F., & Yeung, N. (2019) · Scientific Reports · doi:10.1038/s41598-019-40681-9 · Cited by 86 · see citing works
Self-citationUnderstanding neural signals of post-decisional performance monitoring: An integrative review
Desender, K., Ridderinkhof, K. R., & Murphy, P. R. (2021) · eLife · doi:10.7554/elife.67556 · Cited by 77 · see citing works
Modeling perceptual confidence and the confidence forced-choice paradigm.
Mamassian, P., & de Gardelle, V. (2022) · Psychological Review · doi:10.1037/rev0000312 · Cited by 70 · see citing works
Confidence in masked orientation judgments is informed by both evidence and visibility
Rausch, M., Hellmann, S., & Zehetleitner, M. (2017) · Attention Perception & Psychophysics · doi:10.3758/s13414-017-1431-5 · Cited by 69 · see citing works
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63 · see citing works
Dynamic influences on static measures of metacognition
Desender, K., Vermeylen, L., & Verguts, T. (2022) · Nature Communications · doi:10.1038/s41467-022-31727-0 · Cited by 62 · see citing works
Action information contributes to metacognitive decision-making
Wokke, M. E., Achoui, D., & Cleeremans, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-60382-y · Cited by 56 · see citing works
Heuristic Cues for Meta-Reasoning Judgments: Review and Methodology
Ackerman, R. (2019) · Psihologijske teme · doi:10.31820/pt.28.1.1 · Cited by 56 · see citing works
Human perceptual and metacognitive decision-making rely on distinct brain networks
Luzio, P. D., Tarasi, L., Silvanto, J., Avenanti, A., & Romei, V. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001750 · Cited by 55 · see citing works
Hainguerlot, M., Vergnaud, J., & de Gardelle, V. (2018) · Scientific Reports · doi:10.1038/s41598-018-23936-9 · Cited by 46 · see citing works
Metacognitive Feelings: A Predictive-Processing Perspective
Velasco, P. F., & Loev, S. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231221976 · Cited by 43 · see citing works
Manipulating Prior Beliefs Causally Induces Under- and Overconfidence
Marcke, H. V., Denmat, P. L., Verguts, T., & Desender, K. (2024) · Psychological Science · doi:10.1177/09567976241231572 · Cited by 40 · see citing works
Ende, L., Reinhard, M., & Göritz, L. (2023) · Journal of Consumer Policy · doi:10.1007/s10603-023-09537-8 · Cited by 39 · see citing works
The folded X-pattern is not necessarily a statistical signature of decision confidence
Rausch, M., & Zehetleitner, M. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007456 · Cited by 34 · see citing works
Confidence as a Priority Signal
Aguilar‐Lleyda, D., Lemarchand, M., & de Gardelle, V. (2020) · Psychological Science · doi:10.1177/0956797620925039 · Cited by 31 · see citing works
Yeon, J., Shekhar, M., & Rahnev, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-77820-6 · Cited by 30 · see citing works
Dual strategies in human confidence judgments
Bertana, A., Четвериков, А. А., van Bergen, R. S., Ling, S., & Jehee, J. F. M. (2021) · Journal of Vision · doi:10.1167/jov.21.5.21 · Cited by 27 · see citing works
Waving goodbye to contrast: self-generated hand movements attenuate visual sensitivity
Vasser, M., Vuillaume, L., Axel Cleeremans, B., & Aru, J. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niy013 · Cited by 26 · see citing works
Math anxiety relates positively to metacognitive insight into mathematical decision making
Desender, K., & Sasanguie, D. (2021) · Psychological Research · doi:10.1007/s00426-021-01511-8 · Cited by 24 · see citing works
Is predictive coding falsifiable?
Bowman, H., Collins, D., Nayak, A. K., & Cruse, D. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105404 · Cited by 24 · see citing works
Suprathreshold perceptual decisions constrain models of confidence
Locke, S. M., Landy, M. S., & Mamassian, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010318 · Cited by 23 · see citing works
Towards characterizing the canonical computations generating phenomenal experience
Peters, M. A. K. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104903 · Cited by 23 · see citing works
Uncertainty information that is irrelevant for report impacts confidence judgments.
Spence, M. L., Mattingley, J. B., & Dux, P. E. (2018) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000584 · Cited by 23 · see citing works
Wang, B., Yuan, T., & Rau, P. P. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01132-2 · Cited by 21 · see citing works
Confidence can be automatically integrated across two visual decisions.
Aguilar‐Lleyda, D., Konishi, M., Sackur, J., & de Gardelle, V. (2020) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000884 · Cited by 19 · see citing works
Confidence Guides Spontaneous Cognitive OffloadingPreprint
Boldt, A., & Gilbert, S. J. (2019) · doi:10.31234/osf.io/ct52k · Cited by 19 · see citing works
Self-citationMetacognition biases information seeking in assessing ambiguous news
Guigon, V., Villeval, M. C., & Dreher, J. (2024) · Communications Psychology · doi:10.1038/s44271-024-00170-w · Cited by 18 · see citing works
Davidson, M., Macdonald, J. S. P., & Yeung, N. (2022) · Journal of Vision · doi:10.1167/jov.22.10.20 · Cited by 17 · see citing works
Self-citationЧетвериков, А. А., & Kristjansson, A. K. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009396035 · Cited by 16 · see citing works
Perceived variability reflects the reliability of individual items
Jeong, J., & Chong, S. C. (2021) · Vision Research · doi:10.1016/j.visres.2021.02.008 · Cited by 15 · see citing works
Confidence in evaluations and value-based decisions reflects variation in experienced values.
Quandt, J., Figner, B., Holland, R. W., & Veling, H. (2021) · Journal of Experimental Psychology General · doi:10.1037/xge0001102 · Cited by 14 · see citing works
Horsfall, R., Wuerger, S. M., & Meyer, G. F. (2021) · i-Perception · doi:10.1177/2041669520978670 · Cited by 14 · see citing works
A robust confidence–accuracy dissociation via criterion attraction
Rahnev, D. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab039 · Cited by 14 · see citing works
Confidence-Guided Self Refinement for Action Prediction in Untrimmed Videos
Hou, J., Wu, X., Wang, R., Luo, J., & Jia, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2987425 · Cited by 12 · see citing works
Confidence guides priority between forthcoming tasks
Aguilar-Lleyda, D., & de Gardelle, V. (2021) · Scientific Reports · doi:10.1038/s41598-021-97884-2 · Cited by 12 · see citing works
From local to global estimations of confidence in perceptual decisions.
Cavalan, Q., Vergnaud, J., & de Gardelle, V. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001411 · Cited by 11 · see citing works
Feeling lucky? Prospective and retrospective cues for sensorimotor confidence
Fassold, M. E., Locke, S. M., & Landy, M. S. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010740 · Cited by 11 · see citing works
Exploring mathematics teachers’ perceptions of integrating digital pedagogy in rural schools
Naidoo, J. (2025) · Discover Education · doi:10.1007/s44217-025-00589-1 · Cited by 10 · see citing works
Stone, C., Mattingley, J. B., Bode, S., & Rangelov, D. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae179 · Cited by 9 · see citing works
Human-like dissociations between confidence and accuracy in convolutional neural networks
Shekhar, M., & Rahnev, D. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012578 · Cited by 9 · see citing works
Management of post-stroke fatigue: an Australian health professional survey
Blackwell, S., Crowfoot, G., Davey, J., Drummond, A. E., English, C., Galloway, M. E., Mason, G., & Simpson, D. B. (2022) · Disability and Rehabilitation · doi:10.1080/09638288.2022.2143578 · Cited by 9 · see citing works
A post-decisional neural marker of confidence predicts information-seeking in decision-makingPreprint
Desender, K., Murphy, P., Boldt, A., Verguts, T., & Yeung, N. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/433276 · Cited by 9 · see citing works
Self-citationHands of confidence: When gestures increase confidence in spatial problem-solving
Çapan, D., Furman, R., Göksun, T., & Eskenazi, T. (2023) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218231164270 · Cited by 8 · see citing works
A low-dimensional approximation of optimal confidence
Denmat, P. L., Verguts, T., & Desender, K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012273 · Cited by 7 · see citing works
Overhoff, H., Ko, Y. H., Fink, G. R., Stähl, J., Weiss, P. H., Bode, S., & Nießen, E. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.969074 · Cited by 5 · see citing works
Sánchez-Fuenzalida, N., van Gaal, S., Fleming, S. M., Haaf, J. M., & Fahrenfort, J. J. (2025) · Communications Psychology · doi:10.1038/s44271-025-00257-y · Cited by 5 · see citing works
Metacognitive Ability and the Precision of Confidence
Somatori, K., & Kunisato, Y. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.706538 · Cited by 5 · see citing works
Dis-confirmatory evidence drives confidence
Boldt, A., Sun, Y., & Desender, K. (2023) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2023.1523-0 · Cited by 5 · see citing works
Self-citationDistinct forms of uncertainty guide information seeking and subjective confidencePreprint
Edwards-Lowe, G., Chiusa, E. L., Olawole‐Scott, H., & Yon, D. (2024) · doi:10.31234/osf.io/cf4a7 · Cited by 5 · see citing works
Zhang, Y., Huang, C., Zhang, L., Xinyao, T., Shuai, Q., & Jin, Y. (2026) · Journal of Consumer Behaviour · doi:10.1002/cb.70172 · Cited by 4 · see citing works
Priors for natural image statistics inform confidence in perceptual decisions
West, R. K., A-Izzeddin, E. J., Sewell, D. K., & Harrison, W. J. (2025) · Consciousness and Cognition · doi:10.1016/j.concog.2025.103818 · Cited by 4 · see citing works
Aesthetic Considerations in the Development of Plate Tectonics
Miyata-Sturm, M. E. (2024) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2024.05.004 · Cited by 3 · see citing works
Switching the motor response weakens confidence serial dependence
Bocheva, M., & Rahnev, D. (2025) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02748-9 · Cited by 3 · see citing works
What the eyes, confidence, and partner’s identity can tell about change of mind
Sanchez, R., Tomei, A.-C., Mamassian, P., Vidal, M., & Desantis, A. (2024) · Neuroscience of Consciousness · doi:10.1093/nc/niae018 · Cited by 3 · see citing works
RSD-15K: A Large-Scale User-Level Annotated Dataset for Suicide Risk Detection on Social Media
Zheng, S., Tao, Y., & Zhou, T. (2025) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew67478.2025.00029 · Cited by 3 · see citing works
Yeon, J., Shekhar, M., & Rahnev, D. (2020) · doi:10.17605/osf.io/pn283 · Cited by 3 · see citing works
Suprathreshold perceptual decisions constrain models of confidencePreprint
Locke, S. M., Landy, M. S., & Mamassian, P. (2021) · doi:10.31234/osf.io/p6395 · Cited by 3 · see citing works
Desender, K., & Verguts, T. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.03.616475 · Cited by 3 · see citing works
Segregated Co-activation Patterns in the Emergence of Decision Confidence During Visual Perception
Jaeger, C., Glim, S., Dimulescu, C., Ries, A., Sorg, C., & Wohlschläger, A. M. (2020) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2020.557693 · Cited by 2 · see citing works
Yeon, J., Shekhar, M., & Rahnev, D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/439463 · Cited by 2 · see citing works
Confidence in complex risk judgments: the roles of uncertainty, experience, and affectPreprint
Stephensen, M. B., Martiny-Huenger, T., & Schulze, C. (2021) · doi:10.31234/osf.io/gk7xc · Cited by 2 · see citing works
Schiffer, A., Boldt, A., Waszak, F., & Yeung, N. (2017) · doi:10.31219/osf.io/mtus8 · Cited by 2 · see citing works
Self-citationUncertain Precision: Neurobiological and Physiological Correlates of Conservative Confidence BiasPreprint
Allen, M., Hauser, T. U., Schwarzkopf, D. S., Dolan, R. J., & Rees, G. E. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.01.502365 · Cited by 2 · see citing works
Metacognitive bias resulting from trade-off between local and global motion signals
Lee, A., Yabuki, H., Lee, I. C. L., & Or, C. C.-F. (2023) · Journal of Vision · doi:10.1167/jov.23.10.7 · Cited by 1 · see citing works
Derrien, D., Garric, C., Sergent, C., & Sylvie Chokron, A. (2025) · Cognitive Neuropsychology · doi:10.1080/02643294.2025.2570940 · Cited by 1 · see citing works
Scene variability affects action decisions, confidence and behaviour dynamics
Aguilar‐Lleyda, D., Pozo, A. G.-D., López‐Moliner, J., & de la Malla, C. (2026) · Communications Psychology · doi:10.1038/s44271-026-00448-1 · Cited by 1 · see citing works
A Faster VR Body to Speed Up Choices
Yu, D., Bergström, J., & Hornbæk, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790543 · Cited by 1 · see citing works
Mahlaba, S. C. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1783496 · Cited by 1 · see citing works
The Effects of a Blind Selection Process on Gender Discrimination in Applicant Selection
Ingalls, S. (2018) · CSUSB ScholarWorks (California State University, San Bernardino) · Cited by 1 · see citing works
Londoño, D. M. M., Martínez, C. H., & Gutierrez, A. P. (2023) · psicología desde el caribe · doi:10.14482/psdc.39.2.153 · Cited by 1 · see citing works
Accessing the mind: relating metacognition to attention, memory, and cognitive function
Matthews, J. (2019) · Figshare · doi:10.26180/5c5a1486c5372 · Cited by 1 · see citing works
Beyond the Privacy Calculus: Dynamics Behind Online Self-DisclosurePreprint
Wagner, A. (2021) · RePEc: Research Papers in Economics · doi:10.26083/tuprints-00019049 · Cited by 1 · see citing works
Rausch, M., Hellmann, S., & Zehetleitner, M. (2017) · doi:10.31234/osf.io/dmwa4 · Cited by 1 · see citing works
The pragmatics of confidence in perceptual and value-based choice
Folke, N. E. T. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.22112
Rys, W. (2020) · Arrow@dit (Dublin Institute of Technology)
The Master of Detecting Deception: Machine Learning
Yang, C., Niu, C., & Shen, X. (2021) · Lecture notes in networks and systems · doi:10.1007/978-981-16-2102-4_72
McLain, D. L. (2023) · The BRC Academy Journal of Business · doi:10.15239/j.brcacadjb.2023.13.01.ja04
Priors for Natural Image Statistics Inform Confidence in Perceptual DecisionsPreprint
West, R. K., A-Izzeddin, E. J., Sewell, D. K., & Harrison, W. J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4882462
A common algorithm for confidence judgements across visual, auditory and audio-visual decisionsPreprint
West, R. K., Matthews, N. L., Mattingley, J. B., & Sewell, D. K. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.12.637846
Xue, K., Fung, H., & Rahnev, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5387422
Green, M. L., & Pratte, M. S. (2025) · Cognition · doi:10.1016/j.cognition.2025.106347
Implicit adaptation’s effect on sensorimotor and motor confidencePreprint
Evans, M. H., Taylor, J. A., & Landy, M. S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.15.694412
Guessing reveals internal models of perceptual precisionPreprint
Myers, C., Firestone, C., & Halberda, J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.15.699528
Tan, B., Raghoebar, S., Zhang, C., Quandt, J., & Veling, H. (2026) · Royal Society Open Science · doi:10.1098/rsos.251616
Interferences between decisional variables : behavioural and computational studies
Bioud, E. (2019) · theses.fr (ABES) · doi:10.70675/5a7bf3b9zcb60z48bdz8ea4z5effd60bb856
The Role of Metacognition in Occupational Pursuits : Evidence from Laboratory Experiments
Cavalan, Q. (2023) · theses.fr (ABES) · doi:10.70675/7fb86a89zd36fz4d73zae75zb74f435a571f
The Future of Self-Knowledge: A Call for Socratic AI
Dorsch, J. (2026) · Studies in brain and mind · doi:10.1007/978-3-032-16161-1_9
Confidence Judgments Reflect the Standard Error of Noisy Evidence Samples Across DomainsPreprint
West, R. K., Sewell, D. K., & Scheibehenne, B. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.20.719573
A post-decisional neural marker of confidence predicts information-seeking in decision-makingPreprint
Yeung, N., Desender, K., Verguts, T., Boldt, A., & Murphy, P. (2019) · OSF Preprints (OSF Preprints)
Self-citation
- Authors
- Boldt, A., de Gardelle, V., & Yeung, N.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Boldt, Annika
- Venue
- Journal of Experimental Psychology: Human Perception and Performance
- Published
- 2017-08
- Volume
- 43
- Issue
- 8
- Pages
- 1520-1531
- ISSN
- 0096-1523 (ISSN-L)
- 1939-1277
- PMC
- PMC5524444
- OpenAlex
- W2605154204
- Cited by
- 110
- References
- 71
- Citations by year
- 2026: 15 · 2025: 10 · 2024: 13 · 2023: 11 · 2022: 13 · 2021: 13 · 2020: 9 · 2019: 13 · 2018: 9 · 2017: 4
- FWCI
- 5.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Experimental Psychology Human Perception & Performance (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- HAL (submittedVersion, other-oa)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Economic and Social Research Council
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- metacognition, decision confidence, reliability of evidence, quality of evidence, confidence bias, categorical judgment, variability, confidence calibration
- MeSH terms
- Metacognition, Adolescent, Adult, Color Perception, Decision Making, Female, Humans, Judgment, Male, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review