Cited by 342Visual perception and processing mechanismsDecision-Making and Behavioral EconomicsNeural and Behavioral Psychology Studies

Suboptimality in perceptual decision making

Open access
Rahnev, Dobromir, Denison, Rachel N.·2018·Behavioral and Brain Sciences

Published version of a preprint

Abstract

Human perceptual decisions are often described as optimal. Critics of this view have argued that claims of optimality are overly flexible and lack explanatory power. Meanwhile, advocates for optimality have countered that such criticisms single out a few selected papers. To elucidate the issue of optimality in perceptual decision making, we review the extensive literature on suboptimal performance in perceptual tasks. We discuss eight different classes of suboptimal perceptual decisions, including improper placement, maintenance, and adjustment of perceptual criteria; inadequate tradeoff between speed and accuracy; inappropriate confidence ratings; misweightings in cue combination; and findings related to various perceptual illusions and biases. In addition, we discuss conceptual shortcomings of a focus on optimality, such as definitional difficulties and the limited value of optimality claims in and of themselves. We therefore advocate that the field drop its emphasis on whether observed behavior is optimal and instead concentrate on building and testing detailed observer models that explain behavior across a wide range of tasks. To facilitate this transition, we compile the proposed hypotheses regarding the origins of suboptimal perceptual decisions reviewed here. We argue that verifying, rejecting, and expanding these explanations for suboptimal behavior – rather than assessing optimality per se – should be among the major goals of the science of perceptual decision making.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1017/s0140525x18000936

Cites

320 of 320 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When behavioral data fail to conform to Bayesian optimality predictions, researchers frequently appeal to auxiliary assumptions such as suboptimal priors, cognitive capacity limitations, or approximation algorithms to account for deviations.

    “when behavioral data fail to conform to the predictions of Bayesian optimality, researchers frequently appeal to auxiliary assumptions—such as “suboptimal” priors, cognitive capacity limitations, or the use of approximation algorithms—to account for these deviations (Rahnev and Denison 2018; Sanborn and Chater 2016).”

    From The myth of the Bayesian brain (2025) · cites this paper as Rahnev and Denison 2018

    Section 5.1 says new findings are often modeled with flexibly chosen Bayesian components, and Section 3.8 describes priors invoked to explain perceptual biases. Section 4.2 also discusses computational capacities as a limit on optimality. The passages do not establish that researchers frequently invoke approximation algorithms specifically to explain deviations. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Alternative non-Bayesian models grounded in heuristics, dynamical systems, or adaptation mechanisms can often account for the same neural patterns with equal or greater parsimony and explanatory clarity.

    “Moreover, alternative non-Bayesian models—grounded in heuristics, dynamical systems, or adaptation mechanisms—can often account for the same neural patterns with equal or even greater parsimony and explanatory clarity (Rahnev and Denison 2018).”

    From The myth of the Bayesian brain (2025) · cites this paper as Rahnev and Denison 2018

    Section 5.3 argues that models should be judged by how well they describe behavior rather than by whether they support optimal decisions, and notes that heuristic rules can produce close-to-optimal behavior. Section 5.2 also leaves open the possibility of a non-Bayesian observer model. The cited passages do not establish that heuristic, dynamical-systems, or adaptation models account for the same neural patterns with equal or greater parsimony and explanatory clarity; section 3.8 instead discusses adaptation within a Bayesian framework. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Persistent deviations from Bayesian-optimal behavior in tightly controlled tasks, unexplainable by noise, heuristics, or approximation, would falsify normative claims of the Bayesian brain hypothesis.

    “In tightly controlled tasks where prior probabilities and likelihoods are explicitly defined, persistent deviations from Bayesian-optimal behavior—unexplainable by noise, heuristics, or approximation—would falsify normative claims (Rahnev and Denison 2018).”

    From The myth of the Bayesian brain (2025) · cites this paper as Rahnev and Denison 2018

    Section 5.3 says the many findings of suboptimality make the assumption that the brain is built for optimal decisions suspect. Section 4.2 says deviations can challenge components of a specified model, but it does not say they would falsify normative Bayesian claims generally. Section 2.2 also distinguishes experimentally defined priors from likelihood functions derived under assumptions, so the claim overstates how fully the tasks define both. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Different suboptimalities may coexist, and the same kind of computational constraints that affect first-order cognition are likely to affect the suboptimality of metacognition.

    “More generally, different suboptimalities may coexist, and the same kind of computational constraints that affect first-order cognition are likely to affect the suboptimality of metacognition (Rahnev & Denison 2018).”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Rahnev & Denison 2018

    Section 3.5 reports several sources of suboptimal confidence judgments, and §4.2 says computational complexity can make optimal perceptual decisions unachievable. The copy does not establish that different suboptimalities coexist in the same decision or that the same computational constraints affect first-order cognition and metacognition. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • The meaningfulness of a Bayes-optimal result is questionable and the use of Bayesian modelling is disputed.

    “However, the meaningfulness of a Bayes-optimal result is questionable [48] and the use of Bayesian modelling is disputed [49–53].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 32

  1. Adler William T Ma Wei Ji 2017a Human Confidence Reports Account for Sensory Uncertainty but in a Non-Bayesian Way bioRxiv 93203 https://www.biorxiv.org/content/early/2017/05/18/093203
  2. Barlow HB 1961 Possible Principles Underlying the Transformation of Sensory Messages Sensory Communication Rosenblith WA MIT Press
  3. Brooke JB MacRae AW 1977 Error Patterns in the Judgment and Production of Numerical Proportions Perception & Psychophysics 21 4 336 40 http://www.springerlink.com/index/10.3758/BF03199483 7383813 · DOI
  4. Busemeyer Jerome R Myung In Jae 1992 An Adaptive Approach to Human Decision Making: Learning Theory, Decision Theory, and Human Performance Journal of Experimental Psychology: General 121 2 177 94 http://psycnet.apa.org/journals/xge/121/2/177.html
  5. Cowan Nelson 2005 Working Memory Capacity New York Psychology Press
  6. Gigerenzer Gerd Selten Reinhard 2002 Bounded Rationality Cambridge, MA MIT Press
  7. Green DM Swets John A 1966 Signal Detection Theory and Psychophysics New York John Wiley & Sons Ltd
  8. Griffin Dale Tversky Amos 1992 The Weighing of Evidence and the Determinants of Confidence Cognitive Psychology 24 3 411 35 http://www.sciencedirect.com/science/article/pii/001002859290013R
  9. Healy Alice F Kubovy Michael 1981 Probability Matching and the Formation of Conservative Decision Rules in a Numerical Analog of Signal Detection Journal of Experimental Psychology: Human Learning and Memory 7 5 344 54
  10. Jastrow Joseph 1892 Studies from the University of Wisconsin: On the Judgment of Angles and Positions of Lines The American Journal of Psychology 5 2 214 http://www.jstor.org/stable/1410867?origin=crossref
  11. Jaynes Edwin T 2003 Probability Theory: The Logic of Sicence Cambridge University Press
  12. Landy Michael S Banks Martin S Knill David C 2011 Ideal-Observer Models of Cue Integration 5 29 Sensory Cue Integration Trommershäuser J Körding KP Landy MS New York Oxford University Press
  13. Luu Long Stocker Alan A 2016 Choice-Induced Biases in Perception bioRxiv http://biorxiv.org/content/early/2016/04/01/043224.abstract
  14. Maloney Laurence T Landy Michael S 1989 A Statistical Framework for Robust Fusion of Depth Information 1154 63 Proceedings of SPIE Pearlman WA http://proceedings.spiedigitallibrary.org/proceeding.aspx?articleid=1262206
  15. Maniscalco Brian Lau Hakwan 2010 Comparing Signal Detection Models of Perceptual Decision Confidence Journal of Vision 10 7 213 213 http://jov.arvojournals.org/article.aspx?articleid=2138292
  16. Osgood Charles Egerton 1953 Method and Theory in Experimental Psychology Oxford University Press
  17. Ramachandran V 1990 Interactions between Motion, Depth, Color and Form: The Utilitarian Theory of Perception 346 360 Vision: Coding and efficiency Blakemore C Cambridge, England Cambridge University Press
  18. Regenwetter Michel Dana Jason Davis-Stober Clintin P Guo Ying 2011 Parsimonious Testing of Transitive or Intransitive Preferences: Reply to Birnbaum (2011) Psychological Review 118 4 684 88 http://doi.apa.org/getdoi.cfm?doi=10.1037/a0025291 22003844 · DOI
  19. Rosas Pedro Wichmann Felix A 2011 Cue Combination: Beyond Optimality 144 52 Sensory Cue Integration Trommershäuser J Körding KP Landy MS New York Oxford University Press
  20. Simon Herbert 1957 A behavioral model of rational choice Models of man, social and rational: Mathematical essays on rational human behavior in a social setting New York Wiley 99 118
  21. Song Amanda Koizumi Ai Lau Hakwan 2015 A Behavioral Method to Manipulate Metacognitive Awareness Independent of Stimulus Awareness Behavioral Methods in Consciousness Research Overgaard M Oxford Oxford University Press
  22. Stocker Alan A Simoncelli Eero P 2006b Sensory Adaptation within a Bayesian Framework for Perception Advances in Neural Information Processing Systems 18 1291 98
  23. Swets John A Green DM 1961 Sequential Observations by Human Observers of Signals in Noise.” Pp. 177–95 in Information theory: Proceedings of the fourth London symposium Cherry C London Butterworth
  24. Tanner WP 1956 Theory of Recognition Journal of the Acoustical Society of America 28 882 88
  25. Treisman Michel Faulkner Andrew 1984 The Setting and Maintenance of Criteria Representing Levels of Confidence Journal of Experimental Psychology: Human Perception and Performance 10 1 119 39 http://discovery.ucl.ac.uk/20033/
  26. Trommershäuser Julia Körding Konrad P Landy Michael S 2011 Sensory Cue Integration New York Oxford University Press
  27. Turnbull WH 1961 The Correspondence of Isaac Newton 3 1688 1694 Cambridge Cambridge University Press
  28. Vickers D 1979 Decision Processes in Visual Perception New York Academic Press
  29. Ward Lawrence M Lockhead GR 1970 Sequential Effects and Memory in Category Judgments Journal of Experimental Psychology 84 1 27 34 https://scholars.duke.edu/display/pub651252
  30. Watson Charles S Kellogg Steven C Kawanishi David T Lucas Patrick A 1973 The Uncertain Response in Detection-Oriented Psychophysics Journal of Experimental Psychology 99 2 180 85
  31. Wei Xue-Xin Stocker Alan A 2012 Efficient Coding Provides a Direct Link between Prior and Likelihood in Perceptual Bayesian Inference Advances in Neural Information Processing Systems 25 1313 21
  32. Wohlgemuth A 1911 On the After-Effect of Seen Movement Cambridge University Press https://books.google.com/books?id=Z6AhAQAAIAAJ

Cited by

Sorted by citations

Authors
Rahnev, D., & Denison, R. N.
Affiliations
  • Georgia Institute of Technology (US)
  • New York University (US)
Venue
Behavioral and Brain Sciences
Published
2018
Volume
41
Pages
e223-e223
ISSN
  • 0140-525X (ISSN-L)
  • 1469-1825
OpenAlex
W2790916085
Cited by
342
References
320
Citations by year
2026: 23 · 2025: 36 · 2024: 34 · 2023: 62 · 2022: 45 · 2021: 42 · 2020: 37 · 2019: 48 · 2018: 12 · 2017: 2
FWCI
20.70
Type
journal article
Language
en
Open access
Locations
  • Behavioral and Brain Sciences (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
National Eye Institute (F32EY025533, T32EY007136)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
perceptual decision making, suboptimal performance, principle of optimality, speed-accuracy trade-off, confidence ratings, cue combination, perceptual illusions, perceptual bias, model observer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review