Time, rate, and conditioning.

Abstract

The authors draw together and develop previous timing models for a broad range of conditioning phenomena to reveal their common conceptual foundations: First, conditioning depends on the learning of the temporal intervals between events and the reciprocals of these intervals, the rates of event occurrence. Second, remembered intervals and rates translate into observed behavior through decision processes whose structure is adapted to noise in the decision variables. The noise and the uncertainties consequent on it have both subjective and objective origins. A third feature of these models is their timescale invariance, which the authors argue is a very important property evident in the available experimental data. This conceptual framework is similar to the psychophysical conceptual framework in which contemporary models of sensory processing are rooted. The authors contrast it with the associative conceptual framework.

Cites (11)

1. Toward an instance theory of automatization.
   Logan, Gordon D. · 1988 · Psychological Review
2. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
   Pearce, John M., Hall, Geoffrey · 1980 · Psychological Review
3. A theory of attention: Variations in the associability of stimuli with reinforcement
   Mackintosh, N. J. · 1975 · Psychological Review
4. The Computational Brain
   Churchland, Patricia S., Sejnowski, Terrence J. · 1992
5. Episodic-like memory during cache recovery by scrub jays
   Clayton, Nicola S., Dickinson, Anthony · 1998 · Nature
6. SUBJECTIVE PROBABILITY AND DELAY
   Rachlin, Howard, Raineri, Andres, Cross, David · 1991 · Journal of the Experimental Analysis of Behavior
7. Probability of shock in the presence and absence of cs in fear conditioning.
   Rescorla, Robert A. · 1968 · Journal of Comparative and Physiological Psychology
8. Behavioral studies of Pavlovian conditioning
   Rescorla, R A · 1988 · Annual Review of Neuroscience
9. Associative vs topographical accounts of the immediate shock-freezing deficit in rats: Implications for the response selection rules governing species-specific defensive reactions
   Fanselow, Michael S · 1986 · Learning and Motivation
10. Event representation in Pavlovian conditioning: Image and action
    Holland, Peter C. · 1990 · Cognition

Show all 11 references

Cited by (57)

1. Dopamine in motivational control: rewarding, aversive, and alerting
   Bromberg-Martin, Ethan S., Matsumoto, Masayuki, Hikosaka, Okihide · 2010 · Neuron
2. Maximizing exposure therapy: An inhibitory learning approach
   Craske, Michelle G., Treanor, Michael, Conway, Christopher C., Zbozinek, Tomislav, Vervliet, Bram · 2014 · Behaviour Research and Therapy
3. Discrete coding of reward probability and uncertainty by dopamine neurons
   Fiorillo, Christopher D., Tobler, Philippe N., Schultz, Wolfram · 2003 · Science
4. Context and Behavioral Processes in Extinction: Table 1.
   Bouton, Mark E. · 2004 · Learning & Memory
5. Optimizing inhibitory learning during exposure therapy
   Craske, Michelle G., Kircanski, Katharina, Zelikowsky, Moriel, Mystkowski, Jayson, Chowdhury, Najwa, Baker, Aaron · 2008 · Behaviour Research and Therapy

See all 1,115