Does interaction matter? Testing whether a confidence heuristic can replace interaction in collective decision-making
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In a range of contexts, individuals arrive at collective decisions by sharing confidence in their judgements. This tendency to evaluate the reliability of information by the confidence with which it is expressed has been termed the 'confidence heuristic'. We tested two ways of implementing the confidence heuristic in the context of a collective perceptual decision-making task: either directly, by opting for the judgement made with higher confidence, or indirectly, by opting for the faster judgement, exploiting an inverse correlation between confidence and reaction time. We found that the success of these heuristics depends on how similar individuals are in terms of the reliability of their judgements and, more importantly, that for dissimilar individuals such heuristics are dramatically inferior to interaction. Interaction allows individuals to alleviate, but not fully resolve, differences in the reliability of their judgements. We discuss the implications of these findings for models of confidence and collective decision-making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925
Relating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Self-citationNeural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809
Bahrami, B., Olsen, K., Latham, P. E., Roepstorff, A., Rees, G., & Frith, C. D. (2010) · Science · doi:10.1126/science.1185718 · Cited by 738
Self-citationTwo-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
Fusaroli (2012) · doi:10.1177/0956797612436816 · Cited by 379
When are two heads better than one and why?
Koriat, A. (2012) · Science · doi:10.1126/science.1216549 · Cited by 256
Harvey, N. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01014-0 · Cited by 239
Relating inter-individual differences in metacognitive performance on different perceptual tasks
Song, C., Kanai, R., Fleming, S. M., Weil, R. S., Schwarzkopf, D. S., & Rees, G. (2011) · Consciousness and Cognition · doi:10.1016/j.concog.2010.12.011 · Cited by 158 · cited 4×
“In line with previous studies (e.g., Fleming et al., 2010, and Song et al., 2011, who build on Galvin, Podd, Drga, & Whitmore, 2003; Kornbrot, 2006), we used the measure, AROC, to quantify each dyad member’s metacognitive accuracy, and thereby the credibility of his confidence estimates.”
BackgroundMethodInfluentialSelf-citation
Cited by
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Fusaroli, R., & Tylén, K. (2016) · Cognitive Science · doi:10.1111/cogs.12251 · Cited by 252
Self-citationKnowing Ourselves Together: The Cultural Origins of Metacognition
Heyes, C., Bang, D., Shea, N., Frith, C. D., & Fleming, S. M. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.02.007 · Cited by 232
Self-citationComparing Bayesian and non-Bayesian accounts of human confidence reports
Adler, W. T., & Ma, W. J. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006572 · Cited by 118
Confidence matching in group decision-making
Bang, D., Aitchison, L., Moran, R., Herce Castanon, S., Rafiee, B., Mahmoodi, A., Lau, J. Y. F., Latham, P. E., Bahrami, B., & Summerfield, C. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0117 · Cited by 141
Self-citationDoubly Bayesian Analysis of Confidence in Perceptual Decision-Making
Aitchison, L., Bang, D., Bahrami, B., & Latham, P. E. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004519 · Cited by 131
Self-citationThe impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
“Given these findings, it could be argued that similar benefits could be caused by a matching in the metacognitive readout: Participants who assign the same confidence label to the same internal level of certainty should be able to benefit much more from communicating their confidence levels, which require no further t…”
BackgroundNeurocomputational mechanisms of confidence in self and others
Bang, D., Moran, R., Daw, N. D., & Fleming, S. M. (2022) · Nature Communications · doi:10.1038/s41467-022-31674-w · Cited by 39
Self-citationIdentifying cultural differences in metacognition.
van der Plas, E., Zhang, S., Dong, K., Bang, D., Li, J., Wright, N. D., & Fleming, S. M. (2022) · Journal of Experimental Psychology: General · doi:10.1037/xge0001209 · Cited by 32
Self-citation
Metadata
- Authors
- Bang, D., Fusaroli, R., Tylén, K., Olsen, K., Latham, P. E., Lau, J. Y. F., Roepstorff, A., Rees, G., Frith, C. D., & Bahrami, B.
- Venue
- Consciousness and Cognition
- Publisher
- Elsevier BV
- Published
- 2014-05
- Volume
- 26
- Pages
- 13-23
- ISSN
- 1053-8100 (ISSN-L)
- OpenAlex
- W2010410761
- Cited by
- 107
- References
- 12
- FWCI
- 4.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.