Comparing Bayesian and non-Bayesian accounts of human confidence reports
Open accessPublished version of a preprint
The DOI matches its Crossref record; 107 of the 110 references it cites were found in a registry or an index; 19 of the 38 sources its claims cite were checked for support.
Abstract
Humans can meaningfully report their confidence in a perceptual or cognitive decision. It is widely believed that these reports reflect the Bayesian probability that the decision is correct, but this hypothesis has not been rigorously tested against non-Bayesian alternatives. We use two perceptual categorization tasks in which Bayesian confidence reporting requires subjects to take sensory uncertainty into account in a specific way. We find that subjects do take sensory uncertainty into account when reporting confidence, suggesting that brain areas involved in reporting confidence can access low-level representations of sensory uncertainty, a prerequisite of Bayesian inference. However, behavior is not fully consistent with the Bayesian hypothesis and is better described by simple heuristic models that use uncertainty in a non-Bayesian way. Both conclusions are robust to changes in the uncertainty manipulation, task, response modality, model comparison metric, and additional flexibility in the Bayesian model. Our results suggest that adhering to a rational account of confidence behavior may require incorporating implementational constraints.
Overview
CoChat Summary
## TL;DR
This paper tests whether human confidence reports in perceptual categorization are Bayesian, using two tasks that require subjects to use trial-to-trial sensory uncertainty. The authors find that people do use uncertainty, but their confidence behavior is better fit by simple non-Bayesian heuristic models than by Bayesian models.
## Key findings
- In Experiment 1, the Bayes model beat the Fixed model by a summed LOO difference of 2265 [498, 4253], showing that subjects take trial-to-trial sensory uncertainty into account rather than relying only on a point estimate.
- Adding decision noise improved the Bayesian fit by 804 [510, 1134], but the Bayesian model with decision noise (Bayes-dN) was still outperformed by heuristic models: Lin by 1398 [571, 2644] and Quad by 1167 [858, 2698].
- The heuristic models remained better after multiple robustness checks: with non-parametric reliability–uncertainty mapping, Quad still beat Bayes-dN by 1676 [839, 2730]; with incorrect generative-model assumptions, Quad still beat Bayes-dN by 768 [399, 1144].
- Results were consistent across the paper’s controls and replications: in Task A and Task B separately, Quad beat Bayes-dN by 581 [278, 938] and 978 [406, 1756], respectively; in a separate-response experiment, Lin beat Bayes-dN by 396 [186, 622]; and in a Task-B-only experiment, Quad beat Bayes-dN by 1361 [777, 2022].
## Methods
- The paper ran three experiments on perceptual category judgment and confidence: Experiment 1 used a single button press for combined category-confidence reports; Experiment 2 separated category and confidence responses and added trial-by-trial feedback; Experiment 3 used Task B only.
- Experiment 1 had 11 subjects; Experiment 2 had 8 subjects; Experiment 3 had 15 subjects. Tasks used drifting Gabors or ellipses, with reliability manipulated by contrast or ellipse elongation, and participants were trained extensively before testing.
- The authors fit 75 models from 6 distinct model families using MCMC, compared models mainly with leave-one-out cross-validated log likelihood (LOO), and also checked AIC, BIC, AICc, and WAIC; they performed model recovery and several robustness analyses.
## Limitations
- The paper states that, because of the short presentation time, the results may not generalize to tasks requiring integration of evidence over time.
- The authors state that, because the stimuli are very low-level, they cannot say much about high-level stimuli like faces.
- They also state that they only considered explicit confidence ratings, so the findings may not extend to implicit confidence measures. As evident from the text, the tasks were tightly controlled lab perceptual tasks with trained subjects and specific stimulus manipulations, so broader ecological generalization remains limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
12 Valid · 2 Not valid · 7 Not checked · 96 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Recent studies have attempted to test the BCH [19, 20] but, because of their experimental designs, are unable to meaningfully distinguish the Bayesian model from any other model of confidence.”
§ Comparing Bayesian and non-Bayesian accounts of human confidence reports > Introduction
What the sources say
- Disputedcites [19] L Aitchison, 2015, Doubly Bayesian analysis of confidence in perceptual decision-making, PLoS Comput Biol sourceExperimental — accuracy not yet measured
The Introduction says that one-dimensional designs cannot distinguish heuristic from Bayes-optimal confidence, but explicitly describes this study’s multidimensional design as a way to test that distinction. Results > Model selection reports that the two-response data significantly favored the Bayesian model over the Max and Difference models. The paper therefore makes the contrary point about its own experimental design, while acknowledging that it cannot test every possible heuristic model. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [20] JI Sanders, 2016, Signatures of a statistical computation in the human sense of confidence, Neuron sourceExperimental — accuracy not yet measured
The Discussion reports that the study compared human confidence with predictions from a statistical confidence model, supporting its identification as an attempt to test Bayesian confidence. It also notes that other algorithms can approximate Bayes-optimal predictions, but does not say the experimental design was unable to meaningfully distinguish the Bayesian model from any other confidence model. The cited passages have section labels but no page numbers. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Because we are interested in subjects’ intrinsic computation of confidence, we did not instruct or incentivize them to assign probability ranges to each button (e.g., by using a scoring rule [34–36]).”
§ Comparing Bayesian and non-Bayesian accounts of human confidence reports > Results > Experiment 1 During each session, each subject completed two orientation categorization tasks, Tasks A and B. On each trial, a category C was selected randomly (both categories were equally probable), and a stimulus s was drawn from the corresponding stimulus distribution and displayed. The subject categorized the stimulus and simultaneously reported their confidence on a 4-point scale, with a single button press (Fig 1a). Using a single button press for choice and confidence may prevent post-choice influences on the confidence judgment ([25], but see [26]) and emphasized that confidence should reflect the observer’s perception rather than a preceding motor response. The categories were defined by normal distributions on orientation, which differed by task (Fig 1b). In Task A, the distributions had different means (±μC) and the same standard deviation (σC); leftward-tilting stimuli were more likely to be from category 1. Variants of Task A are common in decision-making studies [27]. In Task B, the distributions had the same mean (0°) and different standard deviations (σ1, σ2); stimuli around the horizontal were more likely to be from category 1. Variants of Task B are less common [28–30] but have some properties of perceptual organization tasks; for example, a subject may have to detect when a stimulus belongs to a narrow category (e.g., in which two line segments are collinear) that is embedded in a a broader category (e.g., in which two line segments are unrelated). Subjects were highly trained on the categories; during training, we only used highest-reliability stimuli, and we provided trial-to-trial category correctness feedback. Subjects were then tested with 6 different reliability levels, which were chosen randomly on each trial. During testing, correctness feedback was withheld to avoid the possibility that confidence simply reflects a learned mapping between stimulus orientation and reliability and the probability of being correct [30–33].
What the sources say
- Supportedcites [34] S Massoni, 2014, Confidence measurement in the light of signal detection theory, Front Psychol source
The citation identifies a scoring rule as an example of a way to incentivize confidence reports; the citing authors’ statement about what they did not do is their own methodological description. In “Elicitation Rules,” the source explicitly identifies and uses a Quadratic Scoring Rule, so it supports the cited example. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [35] GW Brier, 1950, Verification of forecasts expressed in terms of probability, Monthly Weather Review doi:10.1175/1520-0493(1950)078
- Not checked — no full text of the sourcecites [36] T Gneiting, 2007, Strictly proper scoring rules, prediction, and estimation, J Am Stat Assoc source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After fitting our core models, our results did not differ substantially from experiment 1: Lin fits better than Bayes-dN by 396 [186, 622] and fits better than Fixed by 2095 [1344, 2889] (S6 Fig and S6 Table).”
§ Comparing Bayesian and non-Bayesian accounts of human confidence reports > Results > Model comparison
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This feature improves Bayes-dN’s fit by 908 [318, 1661], but it still underperforms Quad by 768 [399, 1144] (S1 Table).”
§ Comparing Bayesian and non-Bayesian accounts of human confidence reports > Results > Model comparison
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This feature improves Bayes-dN’s fit by 1310 [580, 2175], but it still underperforms Quad by 362 [162, 602] (S1 Table).”
§ Comparing Bayesian and non-Bayesian accounts of human confidence reports > Results > Model comparison
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
75 more claims
Create a free account to see all 117 claims and every source verdict.
- It may state two separate claims as one. 14
- Probably not a substantial claim. 26
- Borderline: one of the tests for a substantial claim is unclear. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Other work has revealed how people adjust their confidence criteria in the face of changing stimulus uncertainty (Adler & Ma 2018, Aitchison et al. 2015, Denison et al. 2018).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Adler & Ma 2018
Citations
Cites
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
The VideoToolbox software for visual psychophysics: transforming numbers into movies
Pelli, D. G. (1997) · Spatial Vision · doi:10.1163/156856897x00366 · Cited by 11,098
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611 · cited 1×
“−1295 [−2051,−734] −2105 [−3353,−1281] −77 [−1881, 1321] −953 [−2922, 565] −3545 [−5177,−2401] −3799 [−5455,−2521] −361 [−675,−135] −1581 [−2477,−986] −2401 [−3750,−1551] −290 [−2170, 1090] −1172 [−3186, 358] −3549 [−5189,−2402] −4136 [−5848,−2777] 1910 [72, 3813] −847 [−2103, 660] −2361 [−3442,−1517] −3043 [−4489,−19…”
Interplay between Cortical Spreading Depolarization and Seizures
Kramer, D. R., Fujii, T., Ohiorhenuan, I., & Liu, C. Y. (2017) · Stereotactic and Functional Neurosurgery · doi:10.1159/000452841 · Cited by 3,696
An Energy Budget for Signaling in the Grey Matter of the Brain
Attwell, D., & Laughlin, S. B. (2001) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-200110000-00001 · Cited by 3,543 · cited 1×
“−345 [−933, 262] −3497 [−4860,−1817] −2836 [−4544,−1122] −3127 [−4549,−1575] −2449 [−4200,−969] 606 [6, 1269]”
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.2307/2291091 · Cited by 2,312
Research works printed but not linked: 1
- Orhan AE, Jacobs RA. Are performance limitations in visual short-term memory tasks due to capacity limitations of model mismatch? arXiv. 2014 Jul;.
Cited by
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“Other work has revealed how people adjust their confidence criteria in the face of changing stimulus uncertainty (Aitchison et al., 2015, Adler & Ma, 2018, Denison et al., 2018).”
Sources of Metacognitive Inefficiency
Shekhar, M., & Rahnev, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.007 · Cited by 119
“Of course, it is possible that some of them are also due to processing or resource limitations, especially when computing the probability of being correct is complex or resource demanding [75,77].”
BackgroundHumans incorporate attention-dependent uncertainty into perceptual decisions and confidence
Denison, R. N., Adler, W. T., Carrasco, M., & Ma, W. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717720115 · Cited by 122
“In the Bayesian model, decisions depend on the relative posterior probabilities of the two categories, leading the observer to shift his or her decision boundaries in measurement space, based on the attention condition (4, 5) (Fig.”
BackgroundMethodResultInfluentialSelf-citationAcerbi, L., Dokka, K., Angelaki, D. E., & Ma, W. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006110 · Cited by 111
Self-citationSubjective confidence reflects representation of Bayesian probability in cortex
Geurts, L. S., Cooke, J. R. H., van Bergen, R. S., & Jehee, J. F. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01247-w · Cited by 104
“pp(mm|ss) = 1 ZZ exp �− 1 2σσmm(2)(ss) angle(mm, ss)2� (8) 15”
Li, H.-H., & Ma, W. J. (2020) · Nature Communications · doi:10.1038/s41467-020-15581-6 · Cited by 80
Self-citationContextual influence on confidence judgments in human reinforcement learning
Lebreton, M., Bacily, K., Palminteri, S., & Engelmann, J. B. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006973 · Cited by 81
“We acknowledge that other models and model families could provide a better, mechanistic and/or principled account of both learning performance and confidence judgments [1,23,55,56].”
MethodConfidence reflects a noisy decision reliability estimate
Boundy-Singer, Z. M., Ziemba, C. M., & Goris, R. L. T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01464-x · Cited by 71
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
“Several articles have compared directly two or more of these alternatives (Adler & Ma, 2018; Aitchison et al., 2015; H.-H. Li & Ma, 2020), but a consensus is yet to emerge.”
The future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
“In what follows, we suggest approaches to redressing this balance.”
BackgroundMethodStudying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56
Self-citationLimitations of Proposed Signatures of Bayesian Confidence
Adler, W. T., & Ma, W. J. (2018) · Neural Computation · doi:10.1162/neco_a_01141 · Cited by 45
Self-citationReverse engineering of metacognition
Guggenmos, M. (2022) · eLife · doi:10.7554/elife.75420 · Cited by 60
“Of note, the model proposed here does not consider prior distributions over the stimulus categories (see e.g. Adler and Ma, 2018a ).”
InfluentialShekhar, M., & Rahnev, D. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001524 · Cited by 82
“For example, if the stimulus manipulation changes not only the mean but also the variance of the underlying distributions, then con fi dence criteria may vary accordingly (Adler & Ma, 2018a; Denison et al., 2018).”
BackgroundConfidence and central tendency in perceptual judgment
Xiang, Y., Graeber, T. W., Enke, B., & Gershman, S. J. (2021) · Attention Perception & Psychophysics · doi:10.3758/s13414-021-02300-6 · Cited by 59
“For example, Adler and Ma (2018) developed several models that map probability representations of uncertainty onto confidence in a non-Bayesian way, and presented experimental evidence that some of these models outperformed the Bayesian model in predicting confidence judgments.”
BackgroundPriors and payoffs in confidence judgments
Locke, S. M., Gaffin-Cahn, E., Hosseinizaveh, N., Mamassian, P., & Landy, M. S. (2020) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-020-02018-x · Cited by 41
Attractor dynamics reflect decision confidence in macaque prefrontal cortex
Wang, S., Falcone, R., Richmond, B. J., & Averbeck, B. B. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01445-x · Cited by 47
Evidence for metacognitive bias in perception of voluntary action
Charles, L., Chardin, C., & Haggard, P. (2019) · Cognition · doi:10.1016/j.cognition.2019.104041 · Cited by 51
Performance Monitoring for Sensorimotor Confidence: A Visuomotor Tracking Study
Locke, S. M., Mamassian, P., & Landy, M. S. (2019) · Cognition · doi:10.1016/j.cognition.2020.104396 · Cited by 40
Neurocomputational mechanisms of confidence in self and others
Bang, D., Moran, R., Daw, N. D., & Fleming, S. M. (2022) · Nature Communications · doi:10.1038/s41467-022-31674-w · Cited by 39
Imperfect Bayesian inference in visual perception
Stengård, E., & van den Berg, R. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006465 · Cited by 36
A comprehensive assessment of current methods for measuring metacognition
Rahnev, D. (2025) · Nature Communications · doi:10.1038/s41467-025-56117-0 · Cited by 108
The folded X-pattern is not necessarily a statistical signature of decision confidence
Rausch, M., & Zehetleitner, M. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007456 · Cited by 41
“Finally, we examined if relying confidence on evidence about discriminability is a beneficial strategy, or if it is an example of a suboptimal mental shortcut to the probability of being correct [6,27,33–36], i.e. a heuristic [37,38].”
BackgroundMiyoshi, K., & Lau, H. (2020) · Psychological Review · doi:10.1037/rev0000184 · Cited by 33
Natural statistics support a rational account of confidence biases
Webb, T. W., Miyoshi, K., So, T. Y., Rajananda, S., & Lau, H. (2023) · Nature Communications · doi:10.1038/s41467-023-39737-2 · Cited by 31
Discrete confidence levels revealed by sequential decisions
Lisi, M., Mongillo, G., Milne, G. A., Dekker, T. M., & Goréa, A. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00953-1 · Cited by 32
Measuring metacognition: A comprehensive assessment of current methodsPreprint
Rahnev, D. (2023) · doi:10.31234/osf.io/waz9h · Cited by 25
Suprathreshold perceptual decisions constrain models of confidence
Locke, S. M., Landy, M. S., & Mamassian, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010318 · Cited by 29
“Adler & Ma [11] investigated categorisation behaviour when category means differed but variances were matched versus when category variances differed but means were matched.”
BackgroundResultInfluentialMetacognition and confidence: A review and synthesisPreprint
Fleming, S. M. (2023) · doi:10.31234/osf.io/ge7tz · Cited by 27
Towards characterizing the canonical computations generating phenomenal experience
Peters, M. A. K. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104903 · Cited by 33
Measures of metacognitive efficiency across cognitive models of decision confidence.
Rausch, M., Hellmann, S., & Zehetleitner, M. (2023) · Psychological Methods · doi:10.1037/met0000634 · Cited by 23
Noisy and hierarchical visual memory across timescales
Brady, T. F., Robinson, M. M., & Williams, J. R. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00276-2 · Cited by 39
“Decision models have been rigorously applied in many visual memory tasks beyond eyewitness memory 99–102 .”
MethodDecision prioritization and causal reasoning in decision hierarchies
Zylberberg, A. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009688 · Cited by 23
“…[55, 56], the influence of non-task factors such as mood or personality traits [56, 57], experiments with subtle stimulus manipulations [58, 59] and modeling studies [60] suggest that there may be systematic deviations between confidence and the posterior probability that a choice is correct.”
Pilipenko, A., & Samaha, J. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1944-23.2024 · Cited by 21
Optimal metacognitive decision strategies in signal detection theory
Maniscalco, B., Charles, L., & Peters, M. A. K. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02510-7 · Cited by 25
“…be preferable for the observer to forgo attempting to implement the optimal calibration strategy and instead resort to simpler heuristics that approximate the optimal strategy well enough while incurring significantly less computational costs (Adler & Ma, 2018; Jones, 1999; Schwartz et al., 2011).”
Re-thinking the fixed-criterion model of perceptual decision-makingPreprint
Lee, J. L., Denison, R. N., & Ma, W. J. (2021) · doi:10.31234/osf.io/ys8mb · Cited by 18
“, 2018 [20]) or level of attention (Denison et al.”
BackgroundSelf-citationWinter, C. J., & Peters, M. A. K. (2022) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-021-02358-2 · Cited by 17
Reduced Context Updating but Intact Visual Priors in Autism
Randeniya, R., Vilares, I., Mattingley, J. B., & Garrido, M. I. (2021) · Computational Psychiatry · doi:10.5334/cpsy.69 · Cited by 17
Bayesian confidence in optimal decisionsPreprint
Calder-Travis, J. M., Charles, L., Bogacz, R., & Yeung, N. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/j8sxz · Cited by 14
The role of sensory uncertainty in simple contour integration
Zhou, Y., Acerbi, L., & Ma, W. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006308 · Cited by 14
Self-citationA dissociation between the use of implicit and explicit priors in perceptual inference
Bévalot, C., & Meyniel, F. (2024) · Communications Psychology · doi:10.1038/s44271-024-00162-w · Cited by 19
West, R. K., Harrison, W. J., Matthews, N. L., Mattingley, J. B., & Sewell, D. K. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011245 · Cited by 13
Fernández-Vargas, J., Tremmel, C., Valeriani, D., Bhattacharyya, S., Cinel, C., Citi, L., & Poli, R. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abf2e4 · Cited by 14
Expressions for Bayesian confidence of drift diffusion observers in fluctuating stimuli tasks
Calder-Travis, J., Bogacz, R., & Yeung, N. (2023) · Journal of Mathematical Psychology · doi:10.1101/2020.02.25.965384 · Cited by 21
“Regarding lapses, it would be tricky to directly model lapses that affect the response produced (Adler & Ma, 2018; Ratcliff & Tuerlinckx, 2002), because we do not have expressions for the probability distribution over decisions and response times generated by the non-lapse diffusion process.”
Challenging the fixed-criterion model of perceptual decision-making
Lee, J. L., Denison, R. N., & Ma, W. J. (2023) · Neuroscience of Consciousness · doi:10.1093/nc/niad010 · Cited by 32
“2018); (Adler and Ma 2018)) meets both criteria for distinguishing between a fixed and flexible criterion.”
BackgroundSelf-citationA meta-learning BCI for estimating decision confidence
Tremmel, C., Fernández-Vargas, J., Stamos, D., Cinel, C., Pontil, M., Citi, L., & Poli, R. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac7ba8 · Cited by 13
Consensus goals in the field of visual metacognitionPreprint
Rahnev, D., Balsdon, T., Charles, L., et al. (2021) · doi:10.31234/osf.io/z8v5x · Cited by 11
Introspective inference counteracts perceptual distortion
Mihali, A., Broeker, M. D., Ragalmuto, F. D. M., & Horga, G. (2023) · Nature Communications · doi:10.1038/s41467-023-42813-2 · Cited by 9
Challenging the Bayesian confidence hypothesis in perceptual decision-making
Xue, K., Shekhar, M., & Rahnev, D. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2410487121 · Cited by 23
Yu, J., Fiore, V. G., Briggs, R. W., Braud, J., Rubia, K., Adinoff, B. H., & Gu, X. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14917 · Cited by 13
“Thus, each choice selection can be associated with a degree of uncertainty, representing the estimated probability the chosen action might not be correct (Meyniel et al. , 2015; Adler & Ma, 2018; Atiya et al. , 2020).”
BackgroundResultInfluentialWhat’s in a sample? Epistemic uncertainty and metacognitive awareness in risk taking
Olschewski, S., & Scheibehenne, B. (2024) · Cognitive Psychology · doi:10.1016/j.cogpsych.2024.101642 · Cited by 13
“Laboratory experiments in that area of research typically focus on perceptual decision making (e.g., Adler & Ma, 2018; Desender, Boldt, & Yeung, 2018; Shekhar & Rahnev, 2021).”
A Deep Audiovisual Approach for Human Confidence Classification
Chanda, S., Fitwe, K., Deshpande, G., Schuller, B. W., & Patel, S. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.674533 · Cited by 11
On why we lack confidence in some signal-detection-based analyses of confidence
Arnold, D. H., Johnston, A., Adie, J. M., & Yarrow, K. (2023) · Consciousness and Cognition · doi:10.1016/j.concog.2023.103532 · Cited by 8
Metacognition in the audiovisual McGurk illusion: perceptual and causal confidence
Meijer, D., & Noppeney, U. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0348 · Cited by 11
“For instance, observers’ confidence judgements may reflect the posterior probability at the particular perceptual estimate or the entropy of the full bimodal posterior probability distribution [10,56].”
BackgroundSubjective confidence reflects representation of Bayesian probability in cortexPreprint
Geurts, L. S., Cooke, J. R. H., van Bergen, R. S., & Jehee, J. F. M. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.10.439272 · Cited by 8
What do models of visual perception tell us about visual phenomenology?Preprint
Denison, R. N., Block, N., & Samaha, J. (2020) · doi:10.31234/osf.io/7p8jg · Cited by 8
Expressions for Bayesian confidence of drift diffusion observers in dynamic stimuli tasksPreprint
Calder-Travis, J. M., Bogacz, R., & Yeung, N. (2020) · doi:10.17605/osf.io/tk3vp · Cited by 8
It’s not the spoon that bends: Internal states of the observer determine serial dependencePreprint
Ozkirli, A., & Pascucci, D. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.10.19.563128 · Cited by 11
“However, not all human behavior strictly adheres to Bayesian and optimality principles 16–19 .”
BackgroundConfidence Is Influenced by Evidence Accumulation Time in Dynamical Decision Models
Hellmann, S., Zehetleitner, M., & Rausch, M. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00205-9 · Cited by 12
“For this purpose, researchers formulate mathematical models of decision-making and confidence (Adler & Ma, 2018; Guggenmos, 2022; Mamassian & de Gardelle, 2021; Moran, 2015; Pereira et al., 2021; Pleskac & Busemeyer, 2010; Ratcliff & Starns, 2009, 2013; Rausch et al., 2018, 2023; Rausch et al.,…”
A low-dimensional approximation of optimal confidence
Denmat, P. L., Verguts, T., & Desender, K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012273 · Cited by 8
The energy metabolic footprint of predictive processing in the human brainPreprint
Hechler, A., de Lange, F. P., & Riedl, V. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.12.08.570804 · Cited by 9
Berlemont, K., Martin, J., Sackur, J., & Nadal, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-63582-8 · Cited by 7
“= − + + + I J S J S I I I t ( ) (5) C tot C C C C AC AC stim C noise C CD , , , , ,”
Suboptimal but intact integration of Bayesian components during perceptual decision-making in autism
Fazioli, L., Hadad, B., Denison, R. N., & Yashar, A. (2025) · Molecular Autism · doi:10.1186/s13229-025-00639-3 · Cited by 11
A confidence framing effect: Flexible use of evidence in metacognitive monitoring
Sakamoto, Y., & Miyoshi, K. (2024) · Consciousness and Cognition · doi:10.1016/j.concog.2024.103636 · Cited by 7
Inferring an Observer’s Prediction Strategy in Sequence Learning Experiments
Uppal, A., Ferdinand, V., & Marzen, S. (2020) · Entropy · doi:10.3390/e22080896 · Cited by 5
“Suboptimal performance has been documented in motion perception [23], 3-D object recognition [24], object localization and identification [25], cue integration [26], signal detection [27], confidence reports [28], the relationship between confidence”
BackgroundMiyoshi, K., Webb, T. W., Rahnev, D., & Lau, H. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00049-8 · Cited by 12
Alós‐Ferrer, C., & Garagnani, M. (2025) · Cognitive Psychology · doi:10.1016/j.cogpsych.2025.101779 · Cited by 4
Priors for natural image statistics inform confidence in perceptual decisions
West, R. K., A-Izzeddin, E. J., Sewell, D. K., & Harrison, W. J. (2025) · Consciousness and Cognition · doi:10.1016/j.concog.2025.103818 · Cited by 5
The role of sensory uncertainty in simple contour integrationPreprint
Zhou, Y., Acerbi, L., & Ma, W. J. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/350082 · Cited by 6
Self-citationThe folded X-pattern is not necessarily a statistical signature of decision confidencePreprint
Rausch, M., & Zehetleitner, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/426635 · Cited by 3
Optimal Metacognitive Decision Strategies in Signal Detection TheoryPreprint
Maniscalco, B., Charles, L., & Peters, M. A. K. (2022) · doi:10.31234/osf.io/jyg8s · Cited by 4
Xue, K., Fung, H., & Rahnev, D. (2026) · Cognition · doi:10.1016/j.cognition.2026.106490 · Cited by 6
“…findings have identified systematic violations of this pattern, with some manipulations producing a double-increase pattern where easier conditions lead to increased confidence for both correct and error trials (Adler & Ma, 2018a; Kiani et al., 2014; Rausch et al., 2018; Van Den Berg et al., 2016).”
The folded X-pattern is not necessarily a statistical signature of decision confidence
Rausch, M., & Zehetleitner, M. (2019) · Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) · Cited by 3
Towards Characterizing the Canonical Computations Generating Phenomenal Experience.Preprint
Peters, M. (2021) · Neuroscience and Biobehavioral Reviews · doi:10.31234/osf.io/bqfr6 · Cited by 23
Suprathreshold perceptual decisions constrain models of confidencePreprint
Locke, S. M., Landy, M. S., & Mamassian, P. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/p6395 · Cited by 3
SalemGarcia_2021Preprint
Salem-Garcia, N., Palminteri, S., & Lebreton, M. P. (2021) · doi:10.31234/osf.io/k7w38 · Cited by 3
Modeling Confidence in Causal JudgmentsPreprint
O’Neill, K. J., Henne, P., Pearson, J. M., et al. (2021) · doi:10.31234/osf.io/cgvwf · Cited by 3
“Alterna-tively, confidence in causal judgments may come from a more heuristic approach (Adler & Ma, 2018).”
BackgroundGGSDT: A unified signal detection framework for confidence data analysisPreprint
Miyoshi, K., & Nishida, S. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.28.514329 · Cited by 3
Challenging the Bayesian confidence hypothesis in perceptual decision makingPreprint
Xue, K., Shekhar, M., & Rahnev, D. (2023) · doi:10.31234/osf.io/mf5zp · Cited by 3
Computational and Neuronal Basis of Visual Confidence
Goris, R. L. T., Fu, Z., & Fetsch, C. R. (2025) · Annual Review of Vision Science · doi:10.1146/annurev-vision-110323-120909 · Cited by 5
Learning to be confident: How agents learn confidence based on prediction errors
Denmat, P. L., Desender, K., & Verguts, T. (2025) · Cognition · doi:10.1016/j.cognition.2025.106332 · Cited by 5
Using artificial neural networks to reveal the human confidence computation
Shekhar, M., Fung, H., Saxena, K., Rafiei, F., & Rahnev, D. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013827 · Cited by 4
Fiore, V. G., & Gu, X. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118821 · Cited by 5
Rong, Y., & Peters, M. A. K. (2023) · Open Mind · doi:10.1162/opmi_a_00100 · Cited by 5
“For example, in addition to the models explored here, researchers have suggested that metacognitive computations rely on: Bayesian confidence (Adler & Ma, 2018a), balance of evidence across stimulus alternatives (Vickers, 1979), reaction time (Kiani et al., 2014), complete “ blindness ” to…”
Bits of confidence: Metacognition as uncertainty reduction
Fitousi, D. (2025) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02752-z · Cited by 4
Point estimate observers: A new class of models for perceptual decision making.
Schütt, H. H., Yoo, A. H., Calder-Travis, J. M., & Ma, W. J. (2023) · Psychological Review · doi:10.1037/rev0000402 · Cited by 1
Self-citationProbing doors to visual awareness: Choice set, visibility, and confidence
Martinez‐Saito, M. (2022) · Visual Cognition · doi:10.1080/13506285.2022.2086333 · Cited by 9
“This should induce degenerate decisions, assuming that subjects need to integrate out contrast values to perform optimal decision making (Fleming & Daw, 2017; Peters & Lau, 2015; but see Adler & Ma, 2018), which would lead to lower metacognitive accuracy.”
BackgroundBerlemont, K., Martin, J., Sackur, J., & Nadal, J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/648022 · Cited by 2
“[2012], Adler and Ma [2018], or by using postdecision wagering (subjects can choose a safe option, with low reward regardless of the correct choice) Vickers [1979 (reeditited in 2014], Kepecs and Mainen [2012], Fleming et al.”
Yu, J., Fiore, V. G., Briggs, R. W., Braud, J., Rubia, K., Adinoff, B. H., & Gu, X. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.08.031757 · Cited by 2
Social context alters metacognitionPreprint
Mahmoodi, A., Ringwald, K. G., Wittmann, M. K., & Mehring, C. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ez8qw · Cited by 2
Confidence and central tendency in perceptual judgmentPreprint
Xiang, Y., Graeber, T. W., Enke, B., & Gershman, S. J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/knvu2 · Cited by 2
Decision Prioritization and Causal Reasoning in Decision HierarchiesPreprint
Zylberberg, A. (2021) · doi:10.31234/osf.io/agt5s · Cited by 2
Using artificial neural networks to relate external sensory features to internal decisional evidencePreprint
Green, M. L., Hu, M., Denison, R. N., & Rahnev, D. (2023) · doi:10.31234/osf.io/b8ah2 · Cited by 2
Confidence is influenced by evidence accumulation time in dynamical decision modelsPreprint
Hellmann, S., Zehetleitner, M., & Rausch, M. (2023) · doi:10.31234/osf.io/5ze8t · Cited by 2
dynConfiR: The R package for sequential sampling models of decision confidencePreprint
Hellmann, S., Zehetleitner, M., & Rausch, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/e354s · Cited by 1
Computational characterization of metacognitive ability in subjective decision-makingPreprint
Plate, C. R., Govil, D., Zheng, C. Y., Boundy-Singer, Z. M., Ziemba, C. M., & López-Guzmán, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.23.655775 · Cited by 3
“However, there is increasing recognition that confidence reports generally do not reflect a participant’s estimate of making a correct decision (the so-called “Bayesian confidence hypothesis”) 1 , even for simple perceptual decisions 39–44 .”
Implicitly learned bias impacts decision-making but not metacognition
Schorn, J. M., & Knowlton, B. J. (2025) · Consciousness and Cognition · doi:10.1016/j.concog.2025.103857 · Cited by 1
Task-relevant information availability shapes eye movements and perceptual judgment confidence
Desbordes, T. J., Alahyane, N., & Guillaume, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-13814-6 · Cited by 2
“This pattern of results for confidence modulation, in Experiment 2 but not in Experiment 1, is difficult to reconcile with studies emphasizing the role of uncertainty in confidence ratings 70,71 .”
Derrien, D., Garric, C., Sergent, C., & Chokron, S. (2025) · Cognitive Neuropsychology · doi:10.1080/02643294.2025.2570940 · Cited by 1
“Detection responses were “Yes” or “No”, while discrimination responses were “’X’” or “’O’”, each paired with a continuous (Figure 1B) confidence scale, from “Not sure at all” to “Absolutely sure”(Adler & Ma, 2018).”
Metadata
- Authors
- Adler, W. T., & Ma, W. J.
- Affiliations
- New York University (US)
- Corresponding author
- Adler, William T.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-11-13
- Volume
- 14
- Issue
- 11
- Pages
- e1006572
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC6258566
- OpenAlex
- W2950975704
- Cited by
- 118
- References
- 110
- Citations by year
- 2026: 5 · 2025: 19 · 2024: 19 · 2023: 23 · 2022: 12 · 2021: 12 · 2020: 14 · 2019: 8 · 2018: 6
- FWCI
- 5.95
- Type
- journal article
- Language
- en
- Update notices
- new_version (2018-11-27)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation (DGE-1342536)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- confidence reports, Bayesian inference, sensory uncertainty, perceptual categorization, decision-making, heuristics, rational model, metacognition
- MeSH terms
- Adult, Bayes Theorem, Behavior, Decision Making, Female, Humans, Male, Probability, Models, Statistical, Observer Variation, Normal Distribution, Poisson Distribution, Uncertainty, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.