The dynamics of operant conditioning.

Dragoi, Valentin, Staddon, J. E. R.·1999·Psychological Review

Abstract

Existing models of operant learning are relatively insensitive to historical properties of behavior and applicable to only limited data sets. This article proposes a minimal set of principles based on short-term and long-term memory mechanisms that can explain the major static and dynamic properties of operant behavior in both single-choice and multiresponse situations. The critical features of the theory are as follows: (a) The key property of conditioning is assessment of the degree of association between responses and reinforcement and between stimuli and reinforcement; (b) the contingent reinforcement is represented by learning expectancy, which is the combined prediction of response-reinforcement and stimulus-reinforcement associations; (c) the operant response is controlled by the interplay between facilitatory and suppressive variables that integrate differences between expected (long-term) and experienced (short-term) events; and (d) very-long-term effects are encoded by a consolidated memory that is sensitive to the entire reinforcement history. The model predicts the major qualitative features of operant phenomena and then suggests an experimental test of theoretical predictions about the joint effects of reinforcement probability and amount of training on operant choice. We hypothesize that the set of elementary principles that we propose may help resolve the long-standing debate about the fundamental variables controlling operant conditioning.

Cites (7)

  1. Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system
    Gray, Jeffrey A. · 1982 · Behavioral and Brain Sciences
  2. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
    Pearce, John M., Hall, Geoffrey · 1980 · Psychological Review
  3. Specious reward: A behavioral theory of impulsiveness and impulse control.
    Ainslie, George · 1975 · Psychological Bulletin
  4. The formation of learning sets.
    Harlow, Harry F. · 1949 · Psychological Review
  5. Toward a modern theory of adaptive networks: Expectation and prediction.
    Sutton, Richard S., Barto, Andrew G. · 1981 · Psychological Review
  6. Individual choice behavior: A theoretical analysis.
    Luce, R. Duncan · 2005
  7. Statistical theory of spontaneous recovery and regression
    Estes, W. K. · 1955 · Psychological Review

Show all 7 references

Cited by (9)

  1. Tonic dopamine: Opportunity costs and the control of response vigor
    Niv, Yael, Daw, Nathaniel D., Joel, Daphna, Dayan, Peter · 2007 · Psychopharmacology
  2. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI
    Knutson, Brian, Fong, Grace W, Bennett, Shannon M, Adams, Charles M, Hommer, Daniel · 2003 · NeuroImage
  3. A framework for the unification of the behavioral sciences
    Gintis, Herbert · 2007 · Behavioral and Brain Sciences
  4. TIME AND MEMORY: TOWARDS A PACEMAKER‐FREE THEORY OF INTERVAL TIMING
    Staddon, J. E. R., Higa, J. J. · 1999 · Journal of the Experimental Analysis of Behavior
  5. Critical Period After Stroke Study (CPASS): A phase II clinical trial testing an optimal time for motor recovery after stroke in humans
    Dromerick, Alexander W., Geed, Shashwati, Barth, Jessica, Brady, Kathaleen, Giannetti, Margot L., Mitchell, Abigail, Edwardson, Matthew A., Tan, Ming T., Zhou, Yizhao, Newport, Elissa L. et al. · 2021 · Proceedings of the National Academy of Sciences

See all 81

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The dynamics of operant conditioning. https://app.cochat.ai/papers/10.1037//0033-295x.106.1.20
The paper
Dragoi, V., & Staddon, J. E. R. (1999). The dynamics of operant conditioning. Psychological Review. https://doi.org/10.1037//0033-295x.106.1.20

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.