Instrumental Responding following Reinforcer Devaluation

Adams, Christopher D.; Dickinson, Anthony

doi:10.1080/14640748108400816

Cited by 687Neurotransmitter Receptor Influence on BehaviorMemory and Neural MechanismsBehavioral and Psychological Studies

Instrumental Responding following Reinforcer Devaluation

Adams, Christopher D., Dickinson, Anthony·1981·The Quarterly Journal of Experimental Psychology Section B

DOI 10.1080/14640748108400816

Open this paper in CoChat — free account

Abstract

In two experiments, hungry rats were given instrumental lever-press training for an appetitive reinforcer and, in addition, were exposed to another type of food which was not contingent on lever pressing. In the first experiment, exposure to each type of food was on separate days, whereas in the second experiment rats were exposed to each type of food in strict alternation within each session. Subsequently, a food aversion was conditioned to the reinforcer for the experimental group and to the non-contingent food for the control group. In both experiments, animals with an aversion to the reinforcer responded less in an extinction test than animals with an aversion to the non-contingent food. Subsequent reacquisition tests confirmed that the aversion to the non-contingent food in the control group was of comparable strength with that to the reinforcer in the experimental group. The results were discussed in terms of whether the reinforcer is encoded in the associative structure set up by exposure to an instrumental contingency.

Integrity signals

Registry

Crossref · 10.1080/14640748108400816

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Interference occurs through retrieval inhibition.
“In such paradigms, interference occurs through retrieval inhibition (Adams and Dickinson, 1981; Anderson et al., 2000; MacLeod and Macrae, 2001; Wixted, 2004).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Adams and Dickinson, 1981
An RR schedule of reinforcement tends to promote action-outcome learning and goal-directed decision making.
“We chose an RR schedule of reinforcement for this experiment because tends to promote action-outcome learning and goal-directed decision making 38,39,42,86”
From A dual-pathway architecture for stress to disrupt agency and promote habit (2025) · cites this paper as [39]
An RI schedule of reinforcement tends to promote habit formation.
“We chose an RI reinforcement schedule for this experiment because it tends to promote habit formation 38,39,42,86”
From A dual-pathway architecture for stress to disrupt agency and promote habit (2025) · cites this paper as [39]

Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Learning theory and behavior.
Mowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670 · see citing works
Learning Theory and Behavior
Gonzalez, R. C., & Mowrer, O. H. (1962) · The American Journal of Psychology · doi:10.2307/1419634 · Cited by 1,584 · see citing works
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · see citing works
Reinforcement, expectancy, and learning.
Bolles, R. C. (1972) · Psychological Review · doi:10.1037/h0033120 · Cited by 1,059 · see citing works
Conditioned Aversion to Saccharin Resulting from Exposure to Gamma Radiation
García, J., Kimeldorf, D. J., & Koelling, R. A. (1955) · Science · doi:10.1126/science.122.3160.157 · Cited by 1,011 · see citing works
Contemporary Approaches to Conditioning and Learning
D'Amato, M. R., McGuigan, F. J., & Lumsden, D. B. (1974) · The American Journal of Psychology · doi:10.2307/1422037 · Cited by 447 · see citing works
The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning.
Holland, P. C., & Rescorla, R. A. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.1.4.355 · Cited by 326 · see citing works
Mechanisms of Learning and Motivation
Dickinson, A., & Boakes, R. A. (2014) · Psychology Press eBooks · doi:10.4324/9781315802435 · Cited by 302 · see citing works
Self-citation
Flavor-illness aversions: potentiation of odor by taste in rats
Rusiniak, K. W., Hankins, W. G., García, J., & Brett, L. P. (1979) · Behavioral and Neural Biology · doi:10.1016/s0163-1047(79)90688-5 · Cited by 279 · see citing works
Effect of response-independent reinforcers during extinction.
Rescorla, R. A., & Skucy, J. C. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0026793 · Cited by 266 · see citing works
Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning.
Holland, P. C., & Straub, J. J. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.1.65 · Cited by 254 · see citing works
The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning.
Holland, P. C., & Rescorla, R. A. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.1.4.355 · Cited by 222 · see citing works
Acquisition of sodium by rats: Interaction of innate mechanisms and latent learning.
Krieckhaus, E. E., & Wolf, G. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025547 · Cited by 138 · see citing works
Potentiation instead of overshadowing in the pigeon
Clarke, J., Westbrook, R. F., & Irwin, J. (1979) · Behavioral and Neural Biology · doi:10.1016/s0163-1047(79)90705-2 · Cited by 131 · see citing works
Novel taste facilitation of the association of visual cues with toxicosis in rats.
Galef, B. G., & Osborne, B. (1978) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0077531 · Cited by 131 · see citing works
Intentional behavior and motivation : a cognitive theory
Irwin, F. W. (1971) · Medical Entomology and Zoology · Cited by 124 · see citing works
"What is Learned?"—An empirical enigma.
Rozeboom, W. W. (1958) · Psychological Review · doi:10.1037/h0045256 · Cited by 106 · see citing works
Second-order conditioning: Implications for theories of learning.
Rescorla, R. A. (1973) · Cited by 104 · see citing works
Taste potentiates color-sickness associations in pigeons and quail
Lett, B. T. (1980) · Animal Learning & Behavior · doi:10.3758/bf03199594 · Cited by 90 · see citing works
Studies in learning and motivation: I. Equal reinforcements in both end-boxes, followed by shock in one end-box.
Tolman, E. C., & Gleitman, H. (1949) · Journal of Experimental Psychology · doi:10.1037/h0062845 · Cited by 66 · see citing works
Sign-Gestalt or conditioned reflex.
Tolman, E. C. (1933) · Psychological Review · doi:10.1037/h0071472 · Cited by 58 · see citing works
Some conditions for the dissociation of consummatory and instrumental behavior in rats
Holman, E. W. (1975) · Learning and Motivation · doi:10.1016/0023-9690(75)90015-6 · Cited by 58 · see citing works
A reply to 'Sign-Gestalt or Conditioned Reflex?'
Miller, N. E. (1935) · Psychological Review · doi:10.1037/h0054961 · Cited by 53 · see citing works
Post-Conditioning Devaluation of an Instrumental Reinforcer has no Effect on Extinction Performance
Adams, C. D. (1980) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748008401838 · Cited by 47 · see citing works
Self-citation
Taste-mediated conditioned aversion to an exteroceptive stimulus following LiCl poisoning.
Morrison, G. R., & Collyer, R. (1974) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0035947 · Cited by 46 · see citing works
Conditional reflex theory and motivational behavior.
Ea, A. (1974) · PubMed · Cited by 44 · see citing works
Recall (Versus Recognition) of Taste and Immunization Against Aversive Taste Anticipations Based on Illness
Chen, J.-S., & Amsel, A. (1980) · Science · doi:10.1126/science.7403850 · Cited by 27 · see citing works
Aversion to the reinforcer differentially affects conditioned reinforcement and instrumental responding.
Wilson, C. L., Sherman, J. E., & Holman, E. W. (1981) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.7.2.165 · Cited by 20 · see citing works
Secondary extinction of lever-pressing behavior in the albino rat.
Rozeboom, W. W. (1957) · Journal of Experimental Psychology · doi:10.1037/h0046073 · Cited by 11 · see citing works

Flagged first, then by citations

Sorted by citations

Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129 · see citing works
Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Self-citation
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
Self-citation
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · see citing works
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · see citing works
Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M. R., & Obeso, J. A. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2915 · Cited by 1,134 · see citing works
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Self-citation
Goals and Habits in the Brain
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
Chronic Stress Causes Frontostriatal Reorganization and Affects Decision-Making
Dias-Ferreira, E., Sousa, J. C., Melo, I., Morgado, P., Mesquita, A. R., Cerqueira, J. J., Costa, R. M., & Sousa, N. (2009) · Science · doi:10.1126/science.1171203 · Cited by 858 · see citing works
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748 · see citing works
Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum
Belin, D., & Everitt, B. J. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.019 · Cited by 697 · see citing works
From the ventral to the dorsal striatum: devolving views of their roles in drug addiction
Everitt, B. J., & Robbins, T. W. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.010 · Cited by 675 · see citing works
Neural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642 · see citing works
Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions
Gremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · see citing works
Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder
Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., & de Wit, S. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10071062 · Cited by 609 · see citing works
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · see citing works
The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · see citing works
New developments in human neurocognition: clinical, genetic and brain imaging correlates of impulsivity and compulsivity
Fineberg, N. A., Chamberlain, S. R., Goudriaan, A. E., Stein, D. J., Vanderschuren, L. J. M. J., Gillan, C. M., Shekar, S., Gorwood, P. A. P. M., Voon, V., Morein-Zamir, S., et al. (2014) · CNS Spectrums · doi:10.1017/s1092852913000801 · Cited by 488 · see citing works
Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum
Corbit, L. H., Nie, H., & Janak, P. H. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.024 · Cited by 486 · see citing works
Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models
Huang, V. S., Haith, A., Mazzoni, P., & Krakauer, J. W. (2011) · Neuron · doi:10.1016/j.neuron.2011.04.012 · Cited by 472 · see citing works
Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · see citing works
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445 · see citing works
Associative theories of goal-directed behaviour: a case for animal–human translational models
Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424 · see citing works
Self-citation
Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416 · see citing works
Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning
Ostlund, S. B., & Balleine, B. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5443-06.2007 · Cited by 379 · see citing works
“For instance, pavlovian conditioned approach behavior (Holland and Straub, 1979) and instrumental lever pressing (Adams and Dickinson, 1981; Colwill and Rescorla, 1985) are both sensitive to post-training manipulations of outcome value, indicating that, in each case, performance is mediated by a…”
Background
The effect of the instrumental training contingency on susceptibility to reinforcer devaluation
Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338 · see citing works
Self-citation
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories – indications for novel treatments of addiction
Everitt, B. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12644 · Cited by 318 · see citing works
Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats
Zapata, A., Minney, V. L., & Shippenberg, T. S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4072-10.2010 · Cited by 296 · see citing works
Model-based learning protects against forming habits
Gillan, C. M., Otto, A. R., Phelps, E. A., & Daw, N. D. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0347-6 · Cited by 283 · see citing works
Habits without values.
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280 · see citing works
Alcohol seeking by rats: action or habit?
Dickinson, A., Wood, N., & Smith, J. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/0272499024400016 · Cited by 268 · see citing works
Self-citation
Endocannabinoid Modulation of Orbitostriatal Circuits Gates Habit Formation
Gremel, C. M., Chancey, J. H., Atwood, B. K., Luo, G., Neve, R., Ramakrishnan, C., Deisseroth, K., Lovinger, D. M., & Costa, R. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.043 · Cited by 251 · see citing works
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251 · see citing works
Associative learning and animal cognition
Dickinson, A. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0220 · Cited by 219 · see citing works
Self-citation
Corticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia
Morris, R. W., Quail, S., Griffiths, K. R., Green, M. J., & Balleine, B. W. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.06.005 · Cited by 197 · see citing works
Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans
de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200 · see citing works
Self-citation
Still at the Choice‐Point: Action Selection and Initiation in Instrumental Conditioning
BALLEINE, B. W., & OSTLUND, S. B. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.006 · Cited by 184 · see citing works
Oral cocaine seeking by rats: Action or habit?
Miles, F. J., Everitt, B. J., & Dickinson, A. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.5.927 · Cited by 175 · see citing works
Self-citation
Engagement in digital interventions.
Nahum-Shani, I., Shaw, S. D., Carpenter, S. M., Murphy, S. A., & Yoon, C. (2022) · American Psychologist · doi:10.1037/amp0000983 · Cited by 177 · see citing works
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169 · see citing works
Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior
Gruber, A. J., & McDonald, R. J. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00050 · Cited by 173 · see citing works
Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits
Lingawi, N. W., & Balleine, B. W. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4806-11.2012 · Cited by 172 · see citing works
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
Akam, T., Rodrigues-Vaz, I., Marcelo, I., Zhang, X., Pereira, M., Oliveira, R. F., Dayan, P., & Costa, R. M. (2021) · Neuron · doi:10.1016/j.neuron.2020.10.013 · Cited by 170 · see citing works
Endocannabinoid signaling is critical for habit formation
Hilário, M. R. F. (2007) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.006.2007 · Cited by 164 · see citing works
Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions
Hart, G., Leung, B. K., & Balleine, B. W. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.11.003 · Cited by 166 · see citing works
Contextual control of instrumental actions and habits.
Thrailkill, E. A., & Bouton, M. E. (2015) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000045 · Cited by 165 · see citing works
On habits and addiction: an associative analysis of compulsive drug seeking
Ostlund, S. B., & Balleine, B. W. (2008) · Drug Discovery Today: Disease Models · doi:10.1016/j.ddmod.2009.07.004 · Cited by 147 · see citing works
Unlimited Associative Learning and the origins of consciousness: a primer and some predictions
Birch, J., Ginsburg, S., & Jablonka, E. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09772-0 · Cited by 149 · see citing works
Memory systems and the addicted brain
Goodman, J., & Packard, M. G. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00024 · Cited by 140 · see citing works
Instrumental Conditioning
Dickinson, A. (1994) · Animal Learning and Cognition · doi:10.1016/b978-0-08-057169-0.50009-7 · Cited by 200 · see citing works
Self-citation
Translational assessment of reward and motivational deficits in psychiatric disorders
Der-Avakian, A., Barnes, S. A., Markou, A., & Pizzagalli, D. A. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_5004 · Cited by 122 · see citing works
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121 · see citing works
Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement
DeRusso, A. L. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00017 · Cited by 111 · see citing works
Context, attention, and the switch between habit and goal-direction in behavior
Bouton, M. E. (2021) · Learning & Behavior · doi:10.3758/s13420-021-00488-z · Cited by 100 · see citing works
Regulation of habit formation in the dorsal striatum
Malvaez, M., & Wassum, K. M. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.11.005 · Cited by 96 · see citing works
Stimulus-outcome interactions during instrumental discrimination learning by rats and humans.
de Wit, S., Niry, D., Wariyar, R., Aitken, M. R. F., & Dickinson, A. (2007) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.33.1.1 · Cited by 93 · see citing works
Self-citation
Premotor cortex is critical for goal-directed actions
Gremel, C. M., & Costa, R. M. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00110 · Cited by 75 · see citing works
Determining the effects of training duration on the behavioral expression of habitual control in humans: a multilaboratory investigation
Pool, E. R., Gera, R., Fransen, A., Perez, O. D., Cremer, A., Aleksic, M., Tanwisuth, S., Quail, S., Ceceli, A. O., Manfredi, D. A., et al. (2022) · Learning & Memory · doi:10.1101/lm.053413.121 · Cited by 74 · see citing works
Understanding artificial agency
Dung, L. (2025) · The Philosophical Quarterly · doi:10.1093/pq/pqae010 · Cited by 69 · see citing works
The role of opioid processes in reward and decision-making
Laurent, V., Morse, A. K., & Balleine, B. W. (2015) · British Journal of Pharmacology · doi:10.1111/bph.12818 · Cited by 64 · see citing works
Impairments in goal-directed actions predict treatment response to cognitive-behavioral therapy in social anxiety disorder
Alvares, G. A., Balleine, B. W., & Guastella, A. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094778 · Cited by 63 · see citing works
Directive and incentive functions of affective action consequences: An ideomotor approach
Eder, A. B., Rothermund, K., De Houwer, J., & Hommel, B. (2015) · Psychological Research · doi:10.1007/s00426-014-0590-4 · Cited by 60 · see citing works
Some factors that restore goal-direction to a habitual behavior
Trask, S., Shipman, M. L., Green, J. T., & Bouton, M. E. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107161 · Cited by 63 · see citing works
The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning
Lex, B., & Hauber, W. (2010) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2009.11.002 · Cited by 61 · see citing works
Habits are negatively regulated by histone deacetylase 3 in the dorsal striatum
Malvaez, M., Greenfield, V. Y., Matheos, D. P., Angelillis, N. A., Murphy, M. D., Kennedy, P. J., Wood, M. A., & Wassum, K. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.01.025 · Cited by 56 · see citing works
Role of the Perigenual Anterior Cingulate and Orbitofrontal Cortex in Contingency Learning in the Marmoset
Jackson, S. A. W., Horst, N. K., Pears, A., Robbins, T. W., & Roberts, A. C. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw067 · Cited by 48 · see citing works
Control over a stressor involves the posterior dorsal striatum and the act/outcome circuit
Amat, J., Christianson, J. P., Aleksejev, R. M., Kim, J., Richeson, K. R., Watkins, L. R., & Maier, S. F. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12609 · Cited by 50 · see citing works
Instrumental learning in a mouse model for obsessive-compulsive disorder: Impaired habit formation in Sapap3 mutants
Ehmer, I., Feenstra, M., Willuhn, I., & Denys, D. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107162 · Cited by 37 · see citing works
Leveraging cognitive neuroscience for making and breaking real-world habits
Buabang, E. K., Donegan, K. R., Rafei, P., & Gillan, C. M. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.10.006 · Cited by 34 · see citing works
A dual-pathway architecture for stress to disrupt agency and promote habit
Giovanniello, J. R., Paredes, N., Wiener, A., Ramírez-Armenta, K., Oragwam, C., Uwadia, H. O., Yu, A. L., Lim, K., Pimenta, J. S., Vilchez, G. E., et al. (2025) · Nature · doi:10.1038/s41586-024-08580-w · Cited by 30 · see citing works
The Effect of Ratio and Interval Training on Pavlovian-Instrumental Transfer in Mice
Wiltgen, B. J., Sinclair, C., Lane, C., Barrows, F., Molina, M., & Chabanon-Hicks, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048227 · Cited by 28 · see citing works
Recent developments in the habit hypothesis of OCD and compulsive disorders
Gillan, C. M. (2021) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2020_199 · Cited by 27 · see citing works
Predictive Representations: Building Blocks of Intelligence
Carvalho, W., Tomov, M. S., de Cothi, W., Barry, C., & Gershman, S. J. (2024) · Neural Computation · doi:10.1162/neco_a_01705 · Cited by 15 · see citing works
Affective experience and evidence for animal consciousness.
Butlin, P., & University of Arkansas Press (2020) · Philosophical Topics · doi:10.5840/philtopics20204816 · Cited by 6 · see citing works
Revealing abrupt transitions from goal-directed to habitual behavior
Moore, S., Wang, Z., Zhu, Z., Wang, J., Sun, R., Lee, Y. A., Charles, A., & Kuchibhotla, K. V. (2026) · Nature Communications · doi:10.1038/s41467-026-71048-0 · Cited by 3 · see citing works

Research on the Elastic Fulcrum of Lever Using an Elastic Fulcrum of Cross Flexure
Masuo, R., & Maeda, C. (1962) · Transactions of the Japan Society of Mechanical Engineers · doi:10.1299/kikai1938.28.1225
Acquisition of operant behavior in rats with delayed reinforcement: A retractable-lever procedure
McNamara, A. A., Johnson, L. E., Tate, C., et al. (2014) · Behavioural Processes · doi:10.1016/j.beproc.2014.11.014 · Cited by 5 · see citing works
Reinforcement of Competing Behavior during Extinction
Leitenberg, H., Rawson, R. A., & Bath, K. E. (1970) · Science · doi:10.1126/science.169.3942.301 · Cited by 151 · see citing works
Noncontingent reinforcement: Arbitrary versus maintaining reinforcers for escape‐maintained problem behavior
Newman, Z. A., Roscoe, E. M., Errera, N. P., & Davis, C. R. (2021) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.821 · Cited by 21 · see citing works
Resurgence following differential reinforcement of alternative behavior implemented with and without extinction
Brown, K. R., Greer, B. D., Craig, A. R., Sullivan, W. E., Fisher, W. W., & Roane, H. S. (2020) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.588 · Cited by 36 · see citing works

Authors: Adams, C. D., & Dickinson, A.
Affiliations: University of Cambridge (GB)
ORCID: Adams, Christopher D.
Dickinson, Anthony
Venue: The Quarterly Journal of Experimental Psychology Section B
Publisher: SAGE Publications
Published: 1981-05
Volume: 33
Issue: 2b
Pages: 109-121
ISSN: 0272-4995 (ISSN-L)
1464-1321
DOI: 10.1080/14640748108400816
OpenAlex: W1971037745
Cited by: 687
References: 30
Citations by year: 2026: 15 · 2025: 30 · 2024: 37 · 2023: 38 · 2022: 32 · 2021: 38 · 2020: 34 · 2019: 29 · 2018: 35 · 2017: 37 · 2016: 35 · 2015: 16 · 2014: 31 · 2013: 22 · 2012: 25
FWCI: 0.70
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: The Quarterly Journal of Experimental Psychology Section B (publishedVersion)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Keywords: instrumental responding, reinforcer devaluation, food aversion, extinction, reacquisition, associative structures, lever pressing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Instrumental Responding following Reinforcer Devaluation

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks