The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Subjective Confidence Predicts Information Seeking in Decision Making
Open accessAbstract
There is currently little direct evidence regarding the function of subjective confidence in decision making: The tight correlation between objective accuracy and subjective confidence makes it difficult to distinguish each variable’s unique contribution. Here, we created conditions in a perceptual decision task that were matched in accuracy but differed in subjective evaluation of accuracy by orthogonally varying the strength versus variability of evidence. Confidence was reduced with variable (vs. weak) evidence, even across conditions matched for difficulty. Building on this dissociation, we constructed a paradigm in which participants ( N = 20) could choose to seek further information before making their decision. The data provided clear support for the hypothesis that subjective confidence predicts information seeking in decision making: Participants were more likely to sample additional information before giving a response in the condition with low confidence, despite matched accuracy. In a preregistered replication ( N = 50), these findings were replicated with increased task difficulty levels.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
mediation:R Package for Causal Mediation Analysis
Tingley, D., Yamamoto, T., Hirose, K., Keele, L., & Imai, K. (2014) · Journal of Statistical Software · doi:10.18637/jss.v059.i05 · Cited by 4,155
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Feedback and Self-Regulated Learning: A Theoretical Synthesis
Butler, D. L., & Winne, P. H. (1995) · Review of Educational Research · doi:10.3102/00346543065003245 · Cited by 3,334
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 1×
“Models of decision making and confidence The dominant characterization of decision making is in terms of continuous accumulation of evidence (Gold & Shadlen, 2007; Ratcliff & McKoon, 2008).”
BackgroundSelf-Regulated Learning: Beliefs, Techniques, and Illusions
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143823 · Cited by 1,468
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 2×
“When the ratio is smaller than 1, metacognitive sensitivity is suboptimal, meaning that not all available information from the first-order response is used in the metacognitive judgment (Fleming & Lau, 2014).”
BackgroundMethodRepresentation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 2×
“metacognition, decision making, confidence, consciousness, subjective confidence, open data, preregistered Received 10/17/16; Revision accepted 10/30/17 correlated—expressions of evidence quality (Kiani & Shadlen, 2009).”
BackgroundManiscalco, B., & Lau, H. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.09.021 · Cited by 883
Relating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Changes of mind in decision-making
Resulaj, A., Kiani, R., Wolpert, D. M., & Shadlen, M. N. (2009) · Nature · doi:10.1038/nature08275 · Cited by 678
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667
Self-citationConfidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534
Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making
Donner, T. H., Siegel, M., Fries, P., & Engel, A. K. (2009) · Current Biology · doi:10.1016/j.cub.2009.07.066 · Cited by 515
A default Bayesian hypothesis test for correlations and partial correlations
Wetzels, R., & Wagenmakers, E.-J. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0295-x · Cited by 510
Rhesus monkeys know when they remember
Hampton, R. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071600998 · Cited by 493 · cited 3×
“…was indeed better on trials where participants waived the option of seeing the stimulus again (M = 94.0%, 95% CI = [91.2, 96.9]), compared with forced-decision trials (M = 88.9%, 95% CI = [86.4, 91.4]), t(19) = 5.07, p .001, BF = 394 (for a similar finding in monkeys, see Hampton, 2001).”
BackgroundResultInfluentialEvidence that judgments of learning are causally related to study choice
METCALFE, J., & FINN, B. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.1.174 · Cited by 409
Do apes and children know what they have seen?
Call, J., & Carpenter, M. (2001) · Animal Cognition · doi:10.1007/s100710100078 · Cited by 404
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
The uncertain response in the bottlenosed dolphin (Tursiops truncatus).
Smith, J. D., Schull, J., Strote, J., McGee, K., Egnor, R., & Erb, L. (1995) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.124.4.391 · Cited by 286
Replication in Psychological Science
Lindsay, D. S. (2015) · Psychological Science · doi:10.1177/0956797615616374 · Cited by 280
Shared neural markers of decision confidence and error detection
Boldt, A., & Yeung, N. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0797-14.2015 · Cited by 274
Self-citationA common mechanism underlies changes of mind about decisions and confidence
van den Berg, R., Anandalingam, K., Zylberberg, A., Kiani, R., Shadlen, M. N., & Wolpert, D. M. (2016) · eLife · doi:10.7554/elife.12192 · Cited by 270
Foote, A. L., & Crystal, J. D. (2007) · Current Biology · doi:10.1016/j.cub.2007.01.061 · Cited by 266
Moran, R., Teodorescu, A. R., & Usher, M. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.01.002 · Cited by 185
Robust averaging during perceptual judgment
de Gardelle, V., & Summerfield, C. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104517108 · Cited by 183
Explicit representation of confidence informs future value-based decisions
Folke, T., Jacobsen, C., Fleming, S. M., & Martino, B. D. (2016) · Nature Human Behaviour · doi:10.1038/s41562-016-0002 · Cited by 183
Macdonald, J. S. P., Mathan, S., & Yeung, N. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00082 · Cited by 180
Self-citationOn the interpretation of removable interactions: A survey of the field 33 years after Loftus
Wagenmakers, E.-J., Krypotos, A.-M., Criss, A. H., & Iverson, G. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0158-0 · Cited by 168
Pelley, M. E. L. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0026478 · Cited by 131
Confidence Is the Bridge between Multi-stage Decisions
van den Berg, R., Zylberberg, A., Kiani, R., Shadlen, M. N., & Wolpert, D. M. (2016) · Current Biology · doi:10.1016/j.cub.2016.10.021 · Cited by 125
The impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
Self-citationPurcell, B. A., & Kiani, R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1524685113 · Cited by 106 · cited 1×
“…in adaptive behavior (Meyniel et al., 2015), in line with findings that choices made with low confidence are less likely to be repeated (Folke, Jacobsen, Fleming, & De Martino, 2016) and have less influence on decisions about whether or not to switch environments (Purcell & Kiani, 2016).”
ResultKnow thyself: Metacognitive networks and measures of consciousness
Pasquali, A., Timmermans, B., & Cleeremans, A. (2010) · Cognition · doi:10.1016/j.cognition.2010.08.010 · Cited by 102
Computations underlying confidence in visual perception.
Spence, M. L., Dux, P. E., & Arnold, D. H. (2016) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000179 · Cited by 89 · cited 1×
“, 2017) and related manipulations (Spence et al., 2016), our results stand in apparent contrast to recent findings that evidence mean more strongly influences choice and confidence than evidence weight (Kvam & Pleskac, 2016).”
ResultStrength and weight: The determinants of choice and confidence
Kvam, P. D., & Pleskac, T. J. (2016) · Cognition · doi:10.1016/j.cognition.2016.04.008 · Cited by 48
Evaluating Replication ResultsPreprint
Simonsohn, U. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2259879 · Cited by 38
Cited by
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
“Future work should characterize the role of metacognitive flexibility in adapting one’s workflows across different GenAI interfaces and interaction modes.”
BackgroundHow Local and Global Metacognition Shape Mental Health
Seow, T. X. F., Rouault, M., Gillan, C. M., & Fleming, S. M. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.05.013 · Cited by 159
Confidence controls perceptual evidence accumulation
Balsdon, T., Wyart, V., & Mamassian, P. (2020) · Nature Communications · doi:10.1038/s41467-020-15561-w · Cited by 137
Forming global estimates of self-performance from local confidence
Rouault, M., Dayan, P., & Fleming, S. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09075-3 · Cited by 134
Human VMPFC encodes early signatures of confidence in perceptual decisions
Gherman, S., & Philiastides, M. G. (2018) · eLife · doi:10.7554/elife.38293 · Cited by 107
“While dedicated research will be necessary to establish the functional role of these early signals, fast pre-response confidence signals could be necessary to regulate the link between decision and impending action, for example with low confidence signalling the need for additional evidence (Desender et al., 2018).”
Background
Metadata
- Authors
- Desender, K., Boldt, A., & Yeung, N.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2018-04-02
- Volume
- 29
- Issue
- 5
- Pages
- 761-778
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2795530874
- Cited by
- 302
- References
- 38
- FWCI
- 16.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.