The Bayesian sampler: Generic Bayesian inference causes incoherence in human probability judgments.
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Human probability judgments are systematically biased, in apparent tension with Bayesian models of cognition. But perhaps the brain does not represent probabilities explicitly, but approximates probabilistic calculations through a process of sampling, as used in computational probabilistic models in statistics. Naïve probability estimates can be obtained by calculating the relative frequency of an event within a sample, but these estimates tend to be extreme when the sample size is small. We propose instead that people use a generic prior to improve the accuracy of their probability estimates based on samples, and we call this model the Bayesian sampler. The Bayesian sampler trades off the coherence of probabilistic judgments for improved accuracy, and provides a single framework for explaining phenomena associated with diverse biases and heuristics such as conservatism and the conjunction fallacy. The approach turns out to provide a rational reinterpretation of "noise" in an important recent model of probability judgment, the probability theory plus noise model (Costello & Watts, 2014, 2016a, 2017; Costello & Watts, 2019; Costello, Watts, & Fisher, 2018), making equivalent average predictions for simple events, conjunctions, and disjunctions. The Bayesian sampler does, however, make distinct predictions for conditional probabilities and distributions of probability estimates. We show in 2 new experiments that this model better captures these mean judgments both qualitatively and quantitatively; which model best fits individual distributions of responses depends on the assumed size of the cognitive sample. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Probability Theory: The Logic of Science
Jaynes, E. T. (2003) · doi:10.1017/cbo9780511790423 · Cited by 4,045
Gigerenzer, G., & Gaissmaier, W. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145346 · Cited by 4,037 · cited 1×
“Human probability judgments appear to be systematically biased, apparently suggesting that human probabilistic reasoning is not based on normative Bayesian principles, but instead on heuristic approximations of various kinds (e.g., Gigerenzer & Gaissmaier, 2011; Tversky & Kahneman, 1974).”
BackgroundExtensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
AIC model selection using Akaike weights
Wagenmakers, E.-J., & Farrell, S. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03206482 · Cited by 2,684
MCMC Using Hamiltonian Dynamics
Neal, R. M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-6 · Cited by 2,574
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995 · cited 1×
“Such methods are routinely used to approximate probabilistic calculations in Bayesian machine learning (Craiu & Rosenthal, 2014; Ghahramani, 2015; Neal, 2011), artificial intelligence (Frey, Dayan, & Hinton, 1997), and cognitive science (Chater & Manning, 2006; Chater & Oaksford, 2008; Tenenbaum,…”
MethodHow to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Homo Heuristicus: Why Biased Minds Make Better Inferences
Gigerenzer, G., & Brighton, H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01006.x · Cited by 1,801
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122 · cited 2×
“…over perception (Gershman, Vul, & Tenenbaum, 2009; Knill & Richards, 1996; Yuille & Kersten, 2006), language processing (Chater & Manning, 2006; Griffiths, Steyvers, & Tenenbaum, 2007), categorization (Sanborn, Griffiths, & Navarro, 2010), intuitive physics (Battaglia, Hamrick, & Tenenbaum,…”
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
Stewart, N., Chater, N., & Brown, G. D. A. (2006) · Cognitive Psychology · doi:10.1016/j.cogpsych.2005.10.003 · Cited by 737
Self-citationSimulation as an engine of physical scene understanding
Battaglia, P. W., Hamrick, J. B., & Tenenbaum, J. B. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1306572110 · Cited by 681
Simultaneous over- and underconfidence: the role of error in judgment processes
Erev, I., Wallsten, T. S., & Budescu, D. V. (1994) · Psychological Review · doi:10.1037/0033-295x.101.3.519 · Cited by 644
Gilden, D. L., Thornton, T., & Mallon, M. W. (1995) · Science · doi:10.1126/science.7892611 · Cited by 641
Cognitive emissions of 1/f noise.
Gilden, D. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.1.33 · Cited by 516
Vul (2014) · doi:10.1111/cogs.12101 · Cited by 502
Probabilistic models of language processing and acquisition
Chater, N., & Manning, C. D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.006 · Cited by 411 · cited 3×
“…as perception, language processing, categorization, intuitive physics, motor con-trol, and reasoning (Baker et al., 2017; Battaglia et al., 2013; Chater & Manning, 2006; Chater & Oaksford, 2008; Evans & Over, 2013; Gershman et al., 2009; Griffiths et al., 2007; Hahn & Oaksford, 2007; Knill &…”
Hilbert, M. (2012) · Psychological Bulletin · doi:10.1037/a0025940 · Cited by 391 · cited 2×
“Indeed, many have argued that there is a cognitive mechanism that regresses people’s estimates toward .5 (Costello & Watts, 2014; Dougherty, Gettys, & Ogden, 1999; Erev et al., 1994; Hilbert, 2012).”
BackgroundRational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369 · cited 3×
“…& Richards, 1996; Yuille & Kersten, 2006), language processing (Chater & Manning, 2006; Griffiths, Steyvers, & Tenenbaum, 2007), categorization (Sanborn, Griffiths, & Navarro, 2010), intuitive physics (Battaglia, Hamrick, & Tenenbaum, 2013; Sanborn, Mansinghka, & Griffiths, 2013), motor…”
MethodSelf-citationA re‐examination of probability matching and rational choice
Shanks, D. R., Tunney, R. J., & McCarthy, J. D. (2002) · Journal of Behavioral Decision Making · doi:10.1002/bdm.413 · Cited by 322
Bayesian Spiking Neurons I: Inference
Deneve, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.91 · Cited by 313 · cited 1×
“In addition, it’s two-stage nature echoes work in computational neuroscience that has posited that brain regions and even individual neurons perform Bayesian inference on the input that they receive (Deneve, 2008; Pfister, Dayan, & Lengyel, 2010).”
BackgroundContext effects produced by question orders reveal quantum nature of human judgments
Wang, Z., Solloway, T., Shiffrin, R. M., & Busemeyer, J. R. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407756111 · Cited by 289
Probabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
Reconciling intuitive physics and Newtonian mechanics for colliding objects
Sanborn, A. N., Mansinghka, V. K., & Griffiths, T. L. (2013) · Psychological Review · doi:10.1037/a0031912 · Cited by 189
Self-citationAragones, E., Gilboa, I., Postlewaite, A., & Schmeidler, D. (2005) · American Economic Review · doi:10.1257/000282805775014308 · Cited by 123 · cited 1×
“…such sampling models can often efficiently approximate complex probabilistic distributions (MacKay, 2003; Metropolis, Rosenbluth, Rosenbluth, Teller, & Teller, 1953; Robert & Casella, 2013), where symbolic computation is completely intractable (Aragones, Gilboa, Postlewaite, & Schmeidler, 2005).”
BackgroundTypical versus atypical unpacking and superadditive probability judgment
Sloman, S., Rottenstreich, Y., Wisniewski, E., Hadjichristidis, C., & Fox, C. R. (2004) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.30.3.573 · Cited by 102
Wedell, D. H., & Moro, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.08.003 · Cited by 79
A theory of learning to infer.
Dasgupta, I., Schulz, E., Tenenbaum, J. B., & Gershman, S. J. (2020) · Psychological Review · doi:10.1037/rev0000178 · Cited by 70
Aitchison, L., & Lengyel, M. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005186 · Cited by 67 · cited 1×
“Theseresults imply that people are instead using an algorithm that generates autocorrelated samples such as Markov Chain Monte Carlo (MCMC; Gershman et al., 2009; Lieder, Griffiths, & Goodman, 2012; Metropolis et al., 1953) or more complex alternatives (Aitchison & Lengyel, 2016; Zhu et al., 2018).”
BackgroundLinda is not a bearded lady: configural weighting and adding as the cause of extension errors
Nilsson, H., Winman, A., Juslin, P., & Hansson, G. (2009) · Journal of Experimental Psychology General · doi:10.1037/a0017351 · Cited by 64 · cited 1×
“…model, configural weighted averaging , assumes that a person’s estimate of a conjunction is the weighted sum of its constituents (e.g., Juslin et al., 2009; Nilsson, Winman, Juslin, & Hansson, 2009), so as a result it predicts the conjunction fallacy always occurs at chance or above chance rates.”
BackgroundTypes of approximation for probabilistic cognition: Sampling and variational.
Sanborn, A. N. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.06.008 · Cited by 45 · cited 1×
“This approach may also be the starting point for neuroscientific and psychological hypotheses, although we do not consider it further here (Dasgupta, Schulz, Tenenbaum, & Gershman, 2019; Gershman & Beck, 2017; Ma, Beck, Latham, & Pouget, 2006; Sanborn, 2017).”
BackgroundSelf-citation
Cited by
Pothos, E. M., & Busemeyer, J. R. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-033020-123501 · Cited by 223
A theory of learning to infer.
Dasgupta, I., Schulz, E., Tenenbaum, J. B., & Gershman, S. J. (2020) · Psychological Review · doi:10.1037/rev0000178 · Cited by 70
Wiest, M. C. (2025) · Neuroscience of Consciousness · doi:10.1093/nc/niaf011 · Cited by 34
“…et al. 2009, Conte et al. 2009b, a, Blutner et al. 2013, Pothos and Busemeyer 2013a, b; Wang et al. 2014, Bruza et al. 2015, Busemeyer et al. 2017, Zhu et al. 2020, Pothos and Busemeyer 2022) that are often accounted for by multiple ad hoc heuristics under the classical framework (Gigerenzer and…”
Metadata
- Authors
- Zhu, J.-Q., Sanborn, A. N., & Chater, N.
- Venue
- Psychological Review
- Published
- 2020-10
- Volume
- 127
- Issue
- 5
- Pages
- 719-748
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W3011898673
- Cited by
- 97
- References
- 37
- FWCI
- 7.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.