Time, rate, and conditioning.

Abstract

The authors draw together and develop previous timing models for a broad range of conditioning phenomena to reveal their common conceptual foundations: First, conditioning depends on the learning of the temporal intervals between events and the reciprocals of these intervals, the rates of event occurrence. Second, remembered intervals and rates translate into observed behavior through decision processes whose structure is adapted to noise in the decision variables. The noise and the uncertainties consequent on it have both subjective and objective origins. A third feature of these models is their timescale invariance, which the authors argue is a very important property evident in the available experimental data. This conceptual framework is similar to the psychophysical conceptual framework in which contemporary models of sensory processing are rooted. The authors contrast it with the associative conceptual framework.

Cites (209)

1. A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement
   Robert A. Rescorla · 1972 · Medical Entomology and Zoology
2. The Psychology of Learning and Motivation: Advances in Research and Theory
   2010 · Psychology of Learning and Motivation
3. Principles of Behavior
   Skinner, B. F., Hull, Clark L. · 1944 · The American Journal of Psychology
4. Behavior of Organisms
   B. F. Skinner · 1938
5. Toward an instance theory of automatization.
   Logan, Gordon D. · 1988 · Psychological Review
6. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
   Pearce, John M., Hall, Geoffrey · 1980 · Psychological Review
7. A theory of attention: Variations in the associability of stimuli with reinforcement
   Mackintosh, N. J. · 1975 · Psychological Review
8. The organization of learning
   Charles Randy Gallistel · 1990
9. The Psychology of Animal Learning
   Hill, Winfred F., Mackintosh, N. J. · 1976 · The American Journal of Psychology
10. RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT 1, 2
    Herrnstein, R. J. · 1961 · Journal of the Experimental Analysis of Behavior

Show all 209 references

Cited by (66)

1. Dopamine in motivational control: rewarding, aversive, and alerting
   Bromberg-Martin, Ethan S., Matsumoto, Masayuki, Hikosaka, Okihide · 2010 · Neuron
2. Maximizing exposure therapy: An inhibitory learning approach
   Craske, Michelle G., Treanor, Michael, Conway, Christopher C., Zbozinek, Tomislav, Vervliet, Bram · 2014 · Behaviour Research and Therapy
3. Discrete coding of reward probability and uncertainty by dopamine neurons
   Fiorillo, Christopher D., Tobler, Philippe N., Schultz, Wolfram · 2003 · Science
4. Context and Behavioral Processes in Extinction: Table 1.
   Bouton, Mark E. · 2004 · Learning & Memory
5. Optimizing inhibitory learning during exposure therapy
   Craske, Michelle G., Kircanski, Katharina, Zelikowsky, Moriel, Mystkowski, Jayson, Chowdhury, Najwa, Baker, Aaron · 2008 · Behaviour Research and Therapy

See all 1,115