Signal detection by human observers: A cutoff reinforcement learning model of categorization decisions under uncertainty.

Erev, Ido·1998·Psychological Review

Abstract

Previous experimental examinations of binary categorization decisions have documented robust behavioral regularities that cannot be predicted by signal detection theory (D.M. Green & J.A. Swets, 1966/1988). The present article reviews the known regularities and demonstrates that they can be accounted for by a minimal modification of signal detection theory: the replacement of the "ideal observer" cutoff placement rule with a cutoff reinforcement learning rule. This modification is derived from a cognitive game theoretic analysis (A.E. Roth & I. Erev, 1995). The modified model reproduces all 19 experimental regularities that have been considered. In all cases,it outperforms the original explanations. Some of these previous explanations are based on important concepts such as conservatism, probability matching, and "the gambler's fallacy" that receive new meanings given the current results. Implications for decision-making research and for applications of traditional signal detection theory are discussed.

Cites (4)

  1. On the psychology of prediction.
    Kahneman, Daniel, Tversky, Amos · 1973 · Psychological Review
  2. RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT 1, 2
    Herrnstein, R. J. · 1961 · Journal of the Experimental Analysis of Behavior
  3. Simultaneous over- and underconfidence: the role of error in judgment processes
    Erev, Ido, Wallsten, Thomas S., Budescu, David V. · 1994 · Psychological Review
  4. A THEORY OF THE ACQUISITION OF SPEED-SKILL∗
    CROSSMAN, E. R. F. W. · 1959 · Ergonomics

Show all 4 references

Cited by (9)

  1. The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks.
    Bogacz, Rafal, Brown, Eric, Moehlis, Jeff, Holmes, Philip, Cohen, Jonathan D. · 2006 · Psychological Review
  2. Decisions from Experience and the Effect of Rare Events in Risky Choice
    Hertwig, Ralph, Barron, Greg, Weber, Elke U., Erev, Ido · 2004 · Psychological Science
  3. Mindful Judgment and Decision Making
    Weber, Elke U., Johnson, Eric J. · 2009 · Annual Review of Psychology
  4. Small feedback‐based decisions and their limited correspondence to description‐based decisions
    Barron, Greg, Erev, Ido · 2003 · Journal of Behavioral Decision Making
  5. SSL: A Theory of How People Learn to Select Strategies.
    Rieskamp, Jörg, Otto, Philipp E. · 2006 · Journal of Experimental Psychology: General

See all 108

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Signal detection by human observers: A cutoff reinforcement learning model of categorization decisions under uncertainty. https://app.cochat.ai/papers/10.1037//0033-295x.105.2.280
The paper
Erev, I. (1998). Signal detection by human observers: A cutoff reinforcement learning model of categorization decisions under uncertainty. Psychological Review. https://doi.org/10.1037//0033-295x.105.2.280

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.