Acquisition and extinction in autoshaping.

Kakade, Sham, Dayan, Peter·2002·Psychological Review

Abstract

C. R. Gallistel and J. Gibbon (2000) presented quantitative data on the speed with which animals acquire behavioral responses during autoshaping, together with a statistical model of learning intended to account for them. Although this model captures the form of the dependencies among critical variables, its detailed predictions are substantially at variance with the data. In the present article, further key data on the speed of acquisition are used to motivate an alternative model of learning, in which animals can be interpreted as paying different amounts of attention to stimuli according to estimates of their differential reliabilities as predictors.

Cites (4)

  1. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
    Pearce, John M., Hall, Geoffrey · 1980 · Psychological Review
  2. A theory of attention: Variations in the associability of stimuli with reinforcement
    Mackintosh, N. J. · 1975 · Psychological Review
  3. Behavioral studies of Pavlovian conditioning
    Rescorla, R A · 1988 · Annual Review of Neuroscience
  4. Learning and selective attention
    Dayan, Peter, Kakade, Sham, Montague, P. Read · 2000 · Nature Neuroscience

Show all 4 references

Cited by (23)

  1. Learning the value of information in an uncertain world
    Behrens, Timothy E J, Woolrich, Mark W, Walton, Mark E, Rushworth, Matthew F S · 2007 · Nature Neuroscience
  2. Opponent interactions between serotonin and dopamine
    Daw, Nathaniel D, Kakade, Sham, Dayan, Peter · 2002 · Neural Networks
  3. Modulators of decision making
    Doya, Kenji · 2008 · Nature Neuroscience
  4. The learning curve: Implications of a quantitative analysis
    Gallistel, Charles R., Fairhurst, Stephen, Balsam, Peter · 2004 · Proceedings of the National Academy of Sciences
  5. Bayesian theories of conditioning in a changing world
    Courville, Aaron C., Daw, Nathaniel D., Touretzky, David S. · 2006 · Trends in Cognitive Sciences

See all 102

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Acquisition and extinction in autoshaping. https://app.cochat.ai/papers/10.1037//0033-295x.109.3.533
The paper
Kakade, S., & Dayan, P. (2002). Acquisition and extinction in autoshaping. Psychological Review. https://doi.org/10.1037//0033-295x.109.3.533

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.