Instrumental Conditioning

Classical conditioning II: Current research and theory.

Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works

A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.

Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works

A theory of attention: Variations in the associability of stimuli with reinforcement

Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works

Operant Behavior: Areas of Research and Application,

Honig, W. K. (1966) · Medical Entomology and Zoology · Cited by 2,656 · see citing works

Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.

Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · see citing works

Behavior Theory and Conditioning

Bitterman, M. E., & Spence, K. W. (1957) · The American Journal of Psychology · doi:10.2307/1419251 · Cited by 1,460 · see citing works

Animal intelligence; experimental studies

Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100 · see citing works

A model for stimulus generalization in Pavlovian conditioning.

Pearce, J. M. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.61 · Cited by 1,046 · see citing works

Motivational control of goal-directed action

Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works

How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements

Bindra, D. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00059380 · Cited by 732 · see citing works

Instrumental Responding following Reinforcer Devaluation

Adams, C. D., & Dickinson, A. (1981) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748108400816 · Cited by 687 · see citing works

THE CORRELATION‐BASED LAW OF EFFECT1

Baum, W. M. (1973) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1973.20-137 · Cited by 673 · see citing works

Method and theory in the study of avoidance.

Herrnstein, R. (1969) · Psychology Review · doi:10.1037/h0026786 · Cited by 489 · see citing works

Contemporary Approaches to Conditioning and Learning

D'Amato, M. R., McGuigan, F. J., & Lumsden, D. B. (1974) · The American Journal of Psychology · doi:10.2307/1422037 · Cited by 447 · see citing works

Postconditioning devaluation of a reinforcer affects instrumental responding.

Colwill, R., & Rescorla, R. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.11.1.120 · Cited by 375 · see citing works

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338 · see citing works

Occasion Setting in Pavlovian Conditioning

Holland, P. (1992) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60488-0 · Cited by 312 · see citing works

THE EFFECT OF CONTINGENCY UPON THE APPETITIVE CONDITIONING OF FREE‐OPERANT BEHAVIOR

Hammond, L. J. (1980) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1980.34-297 · Cited by 291 · see citing works

Postconditioning devaluation of a reinforcer affects instrumental responding.

Colwill, R. M., & Rescorla, R. A. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.11.1.120 · Cited by 273 · see citing works

Associations between the discriminative stimulus and the reinforcer in instrumental learning.

Colwill, R., & Rescorla, R. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.2.155 · Cited by 259 · see citing works

Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus.

Lovibond, P. (1983) · Journal of experimental psychology. Animal behavior processes · doi:10.1037/0097-7403.9.3.225 · Cited by 257 · see citing works

Learning Theory and Behavior

Curtis, J. H., & Mowrer, O. H. (1960) · The American Catholic Sociological Review · doi:10.2307/3708617 · Cited by 256 · see citing works

Purposive Behavior in Animals and Man

Young, P. T., & Tolman, E. C. (1933) · The American Journal of Psychology · doi:10.2307/1414208 · Cited by 249 · see citing works

Modern learning theory.

Hj, E. (1956) · PubMed · Cited by 244 · see citing works

Associative Structures In Instrumental Learning

Colwill, R., & Rescorla, R. (1986) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60016-x · Cited by 242 · see citing works

Reinforcement and the organization of behavior in golden hamsters: Hunger, environment, and food reinforcement.

Shettleworth, S. J. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.1.1.56 · Cited by 233 · see citing works

Aversion, Avoidance, and Anxiety

(2014) · Psychology Press eBooks · doi:10.4324/9781315808154 · Cited by 219 · see citing works

The reply of a physiologist to psychologists.

Pavlov, I. P. (1932) · Psychological Review · doi:10.1037/h0069929 · Cited by 199 · see citing works

Response acquisition with delayed reinforcement.

Lattal, K. A., & Gleeson, S. (1990) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.16.1.27 · Cited by 177 · see citing works

A demonstration of observational learning in rats using a bidirectional control.

Heyes, C., & Gr, D. (1990) · PubMed · Cited by 166 · see citing works

An approach through the looking-glass

Hershberger, W. A. (1986) · Animal Learning & Behavior · doi:10.3758/bf03200092 · Cited by 149 · see citing works

A critical review of latent learning and related experiments.

Thistlethwaite, D. L. (1951) · Psychological Bulletin · doi:10.1037/h0055171 · Cited by 143 · see citing works

Evidence for the hierarchical structure of instrumental learning

Colwill, R., & Rescorla, R. (1990) · Animal Learning & Behavior · doi:10.3758/bf03205241 · Cited by 131 · see citing works

Instrumental Performance following Reinforcer Devaluation Depends upon Incentive Learning

Balleine, B., & Dickinson, A. (1991) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640749108401271 · Cited by 126 · see citing works

Imitation in rats: Initial responding and transfer evidence

Heyes, C. M., Dawson, G. R., & Nokes, T. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640749208401018 · Cited by 124 · see citing works

Reinforcement and the organization of behavior in golden hamsters: Hunger, environment, and food reinforcement.

Shettleworth, S. J. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.1.1.56 · Cited by 124 · see citing works

Pavlovian Processes in the Motivational Control of Instrumental Performance

Dickinson, A., & Dawson, G. (1987) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748708402264 · Cited by 118 · see citing works

On the Rate of Formation of a Conditioned Reflex

Skinner, B. F. (1932) · The Journal of General Psychology · doi:10.1080/00221309.1932.9918467 · Cited by 115 · see citing works

Contingency Effects with Maintained Instrumental Reinforcement

Dickinson, A., & Charnock, D. J. K. (1985) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748508401177 · Cited by 115 · see citing works

Learning Theory and the Symbolic Processes

Mowrer, O. H. (1961) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-196112000-00020 · Cited by 112 · see citing works

Free-operant acquisition with delayed reinforcement

Dickinson, A., Watt, A. A., & Griffiths, W. J. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640749208401019 · Cited by 99 · see citing works

THE FORMATION OF A SIMPLE HABIT IN GUINEA‐PIGS

Grindley, G. C. (1932) · British Journal of Psychology General Section · doi:10.1111/j.2044-8295.1932.tb00655.x · Cited by 94 · see citing works

STEADY‐STATE PERFORMANCE ON FIXED‐, MIXED‐, AND RANDOM‐RATIO SCHEDULES

Mazur, J. (1983) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1983.39-293 · Cited by 92 · see citing works

Evidence for an association between the discriminative stimulus and the response-outcome association in instrumental learning.

Rescorla, R. A. (1990) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.16.4.326 · Cited by 80 · see citing works

ON A PARTICULAR FORM OF CONDITIONED REFLEX

Miller, S., Konorski, J., & Skinner, B. F. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-187 · Cited by 69 · see citing works

Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule

Dickinson, A., & Mulatero, C. W. (1989) · Behavioural Processes · doi:10.1016/0376-6357(89)90039-9 · Cited by 67 · see citing works

Signalling and incentive processes in instrumental reinforcer devaluation.

Balleine, B. W., & Dickinson, A. (1992) · PubMed · Cited by 65 · see citing works

Discrimination between reinforced action patterns in the rat

Morgan, M. J., & Nicholas, D. J. (1979) · Learning and Motivation · doi:10.1016/0023-9690(79)90047-x · Cited by 62 · see citing works

DIFFERENTIAL REINFORCEMENT OF OTHER BEHAVIOR (DRO): A YOKED‐CONTROL COMPARISON1

Davis, J., & Bitterman, M. E. (1971) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1971.15-237 · Cited by 53 · see citing works

The pavlovian analysis of instrumental conditioning

Gormezano, I., & Tait, R. W. (1976) · Pavlovian Journal of Biological Science · doi:10.1007/bf03000536 · Cited by 53 · see citing works

Comparisons of stimulus learning and response learning in a punishment situation

Bolles, R. C., Holtz, R., Dunn, T. C., & Hill, W. L. (1980) · Learning and Motivation · doi:10.1016/0023-9690(80)90022-3 · Cited by 53 · see citing works

Motivational Control of Instrumental Performance: The Role of Prior Experience of The Reinforcer

Dickinson, A., & Dawson, G. (1988) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748808402313 · Cited by 52 · see citing works

Incentive learning and the motivational control of instrumental performance

Dickinson, A., & Dawson, G. R. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748908401185 · Cited by 48 · see citing works

Motivational control of instrumental performance following a shift from thirst to hunger.

Dickinson, A., & Balleine, B. W. (1990) · PubMed · Cited by 46 · see citing works

Performance on ratio and interval schedules with matched reinforcement rates.

Dawson, G. R., & Dickinson, A. (1990) · PubMed · Cited by 36 · see citing works

The unknown epistemology of E. C. Tolman

Amundson, R. (1986) · British Journal of Psychology · doi:10.1111/j.2044-8295.1986.tb02217.x · Cited by 35 · see citing works

Incentive learning and the motivational control of instrumental performance by thirst

López, M., Balleine, B. W., & Dickinson, A. (1992) · Animal Learning & Behavior · doi:10.3758/bf03197955 · Cited by 27 · see citing works

The effects of response contingency and reinforcement identity on response suppression by alternative reinforcement

Williams, B. A. (1989) · Learning and Motivation · doi:10.1016/0023-9690(89)90018-0 · Cited by 22 · see citing works

Response elimination in rats with schedules of omission training, including yoked and response-independent reinforcement comparisons

Uhl, C. N. (1974) · Learning and Motivation · doi:10.1016/0023-9690(74)90008-3 · Cited by 20 · see citing works

Signaling unearned reinforcers removes the suppression produced by a zero correlation in an operant paradigm

Hammond, L. J., & Weinberg, M. (1984) · Animal Learning & Behavior · doi:10.3758/bf03199982 · Cited by 19 · see citing works

A note on depression of instrumental responding after one trial of outcome devaluation.

Rescorla, R. A. (1994) · PubMed · Cited by 16 · see citing works

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works

The role of the basal ganglia in habit formation

Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402 · see citing works

Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex

Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129 · see citing works

The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking

Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450 · see citing works

The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.

Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works

Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates

Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329 · see citing works

The role of the dorsomedial striatum in instrumental conditioning

Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · see citing works

Nucleus accumbens shell and core dopamine: differential role in behavior and addiction

Di Chiara, G. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00286-3 · Cited by 996 · see citing works

Choosing the greater of two goods: neural currencies for valuation and decision making

Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works

The role of prelimbic cortex in instrumental conditioning

Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423 · see citing works

Associative theories of goal-directed behaviour: a case for animal–human translational models

Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424 · see citing works

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416 · see citing works

Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation

Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · see citing works

The integrative function of the basal ganglia in instrumental conditioning

Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356 · see citing works

The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm

LeDoux, J. E., Moscarello, J., Sears, R., & Campese, V (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.166 · Cited by 348 · see citing works

Associative learning and animal cognition

Dickinson, A. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0220 · Cited by 219 · see citing works

Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens

Dalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214 · see citing works

Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans

de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200 · see citing works

Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping performance in rats.

Cardinal, R. N., Parkinson, J. A., Lachenal, G., Halkerston, K. M., Rudarakanchana, N., Hall, J., Morrison, C. H., Howes, S. R., Robbins, T. W., & Everitt, B. J. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.4.553 · Cited by 201 · see citing works

On habits and addiction: an associative analysis of compulsive drug seeking

Ostlund, S. B., & Balleine, B. W. (2008) · Drug Discovery Today: Disease Models · doi:10.1016/j.ddmod.2009.07.004 · Cited by 147 · see citing works

A fundamental role for context in instrumental learning and extinction

Bouton, M. E., & Todd, T. P. (2014) · Behavioural Processes · doi:10.1016/j.beproc.2014.02.012 · Cited by 152 · see citing works

Activation of μ-Opioid Receptors in the Dorsal Striatum is Necessary for Adult Social Attachment in Monogamous Prairie Voles

Burkett, J. P., Spiegel, L. L., Inoue, K., Murphy, A. Z., & Young, L. J. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2011.117 · Cited by 133 · see citing works

Conflicted between goal-directed and habitual control, an fMRI investigation

Watson, P., van Wingen, G., & de Wit, S. (2018) · eneuro · doi:10.1523/eneuro.0240-18.2018 · Cited by 84 · see citing works

A bottom up approach towards the acquisition and expression of sequential representations applied to a behaving real-world device: Distributed Adaptive Control III

Verschure, P. F. M. J., & Voegtlin, T. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00029-x · Cited by 73 · see citing works

The role of opioid processes in reward and decision-making

Laurent, V., Morse, A. K., & Balleine, B. W. (2015) · British Journal of Pharmacology · doi:10.1111/bph.12818 · Cited by 64 · see citing works

Goal-directed actions transiently depend on dorsal hippocampus

Bradfield, L. A., Leung, B. K., Boldt, S., Liang, S., & Balleine, B. W. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0693-8 · Cited by 65 · see citing works

Some factors that restore goal-direction to a habitual behavior

Trask, S., Shipman, M. L., Green, J. T., & Bouton, M. E. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107161 · Cited by 63 · see citing works

The Effect of Ratio and Interval Training on Pavlovian-Instrumental Transfer in Mice

Wiltgen, B. J., Sinclair, C., Lane, C., Barrows, F., Molina, M., & Chabanon-Hicks, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048227 · Cited by 28 · see citing works

Do asian elephants (Elephas maximus) apply causal reasoning to tool-use tasks?

Nissani, M. (2006) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.32.1.91 · Cited by 28 · see citing works

LLMs don’t know anything: reply to Yildirim and Paul

Goddu, M. K., Noë, A., & Thompson, E. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.06.008 · Cited by 10 · see citing works

ABC: A Psychological Theory of Anticipative Behavioral Control

Hoffmann, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02565-5_2 · Cited by 8 · see citing works

Revealing abrupt transitions from goal-directed to habitual behavior

Moore, S., Wang, Z., Zhu, Z., Wang, J., Sun, R., Lee, Y. A., Charles, A., & Kuchibhotla, K. V. (2026) · Nature Communications · doi:10.1038/s41467-026-71048-0 · Cited by 3 · see citing works

DETERMINING QUALITY REQUIREMENTS AT THE UNIVERSITIES TO IMPROVE THE QUALITY OF EDUCATION

Mustafa, N. H., Kelesbayev, D., & Alibekova, Z. D. (2018) · The Journal of Economic Research & Business Administration · doi:10.26577/be-2018-2-2141

Susquehanna Chorale Spring Concert "Roots and Wings"

Hawkins, D. (2017)

Facilitation and retardation of flavour aversion conditioning following prior exposure to the CS.

Bennett, C. H., Tremain, M., & Mackintosh, N. J. (1996) · PubMed · doi:10.1080/713932632 · Cited by 15 · see citing works

TECHNICAL NOTES ON CPP: Place conditioning in a two‐ or three‐conditioning compartment apparatus: a comparative study with morphine and U‐50,488

Morales, L., Pérez‐García, C., Herradón, G., et al. (2007) · Addiction Biology · doi:10.1111/j.1369-1600.2007.00071.x · Cited by 23 · see citing works

The conditioning of negative attitudes to unfamiliar items of information

Carriero, N. J. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80062-8 · Cited by 2 · see citing works