The DOI matches its Crossref record; 132 of the 132 references it cites were found in a registry or an index.
Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control
Open accessAbstract
This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We and others have shown that extinction weakens instrumental responding, but does not erase the original learning. Instead, extinction involves a form of context-specific inhibition (rather than unlearning) of the response”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019
In the citing paper
“For example, we have performed many studies of the renewal effect: If the context is changed after extinction has been learned, the original response can return.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019
In the citing paper
“Over the years, our extinction research has documented that extinction does not erase what has been learned before it, but instead interferes with it.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019
In the citing paper
“It is worth noting that the range of cues that can constitute context is arguably very wide, potentially including time, drug states, deprivation and stress states, and other behaviors among other things (e.g., Bouton, 2019; Bouton et al., 2021a, b).”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Addiction motivation reformulated: an affective processing model of negative reinforcement
Baker, T. B., Piper, M. E., McCarthy, D. E., Majeskie, M. R., & Fiore, M. C. (2004) · Psychological Review · doi:10.1037/0033-295x.111.1.33 · Cited by 2,162
Chronic stress, drug use, and vulnerability to addiction
Sinha, R. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1441.030 · Cited by 1,904
Context, time, and memory retrieval in the interference paradigms of Pavlovian learning
Bouton, M. E. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.80 · Cited by 1,896
Self-citationEffects of an expanding-spaced vs massed exposure schedule on fear reduction and return of fear
Rowe, M. K., & Craske, M. G. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10016-x · Cited by 1,782
Relationship between stress, eating behavior, and obesity
Torres, S. J., & Nowson, C. A. (2007) · Nutrition · doi:10.1016/j.nut.2007.08.008 · Cited by 1,622
The reinstatement model of drug relapse: history, methodology and major findings
Shaham, Y., Shalev, U., Lu, L., de Wit, H., & Stewart, J. (2003) · Psychopharmacology · doi:10.1007/s00213-002-1224-x · Cited by 1,615
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Handbook of Contemporary Learning Theories
Mowrer, R. R. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691 · Cited by 787
Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation
Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 635
Stress-induced reinstatement of drug seeking: 20 years of progress
Mantsch, J. R., Baker, D. A., Funk, D., Lê, A. D., & Shaham, Y. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2015.142 · Cited by 438
An experimental study of punishment.
Estes, W. K. (1944) · The Psychological Monographs · doi:10.1037/h0093550 · Cited by 386
Renewal of drug seeking by contextual cues after prolonged extinction in rats.
Crombag, H. S., & Shaham, Y. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.1.169 · Cited by 380
Pavlovian to instrumental transfer: a neurobehavioural perspective.
Holmes, N. M., Marchand, A., & Coutureau, E. (2010) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.03.007 · Cited by 327
Occasion Setting in Pavlovian Conditioning
Holland, P. (1992) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60488-0 · Cited by 312
Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats
Zapata, A., Minney, V. L., & Shippenberg, T. S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4072-10.2010 · Cited by 296
Renewal after the extinction of free operant behavior
Bouton, M. E., Todd, T. P., Vurbic, D., & Winterbauer, N. E. (2011) · Learning & Behavior · doi:10.3758/s13420-011-0018-6 · Cited by 281
Self-citationA retrieval cue for extinction attenuates spontaneous recovery.
Brooks, D. C., & Bouton, M. E. (1993) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.19.1.77 · Cited by 272
Self-citationEffect of response-independent reinforcers during extinction.
Rescorla, R. A., & Skucy, J. C. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0026793 · Cited by 266
Cocaine-but not food-seeking behavior is reinstated by stress after extinction
Ahmed, S. H., & Koob, G. F. (1997) · Psychopharmacology · doi:10.1007/s002130050347 · Cited by 257
A Role of Ventral Tegmental Area Glutamate in Contextual Cue-Induced Relapse to Heroin Seeking
Bossert, J. M., Liu, S. Y., Lu, L., & Shaham, Y. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3207-04.2004 · Cited by 241
Brooks, D. C., & Bouton, M. E. (1994) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.20.4.366 · Cited by 235
Self-citationHammack, S. E., Cheung, J., Rhodes, K. M., Schutz, K. C., Falls, W. A., Braas, K. M., & May, V. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2008.12.013 · Cited by 230
Bouton, M. E. (1991) · Cited by 218
Self-citationRECENCY, REPEATABILITY, AND REINFORCER RETRENCHMENT: AN EXPERIMENTAL ANALYSIS OF RESURGENCE
Lieving, G. A., & Lattal, K. A. (2003) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2003.80-217 · Cited by 217
State-dependent fear extinction with two benzodiazepine tranquilizers.
Bouton, M. E., Kenney, F. A., & Rosengard, C. (1990) · Behavioral Neuroscience · doi:10.1037//0735-7044.104.1.44 · Cited by 212
Self-citationTranslational and reverse translational research on the role of stress in drug craving and relapse
Sinha, R., Shaham, Y., & Heilig, M. A. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2263-y · Cited by 208
Stress reinstates nicotine seeking but not sucrose solution seeking in rats
Buczek, Y., Lê, A. D., Wang, A., Stewart, J., & Shaham, Y. (1999) · Psychopharmacology · doi:10.1007/s002130050992 · Cited by 206
The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking
Hamlin, A. S., Newby, J. M., & McNally, G. P. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.01.063 · Cited by 188
Renewal of Extinguished Lever-Press Responses upon Return to the Training Context
Nakajima, S., Tanaka, S., Urushihara, K., & Imada, H. (2000) · Learning and Motivation · doi:10.1006/lmot.2000.1064 · Cited by 181
State-dependent fear extinction with two benzodiazepine tranquilizers.
Bouton, M. E., Kenney, F. A., & Rosengard, C. (1990) · Behavioral Neuroscience · doi:10.1037/0735-7044.104.1.44 · Cited by 178
Self-citationRenewal of extinguished cocaine-seeking
Hamlin, A. S., Clemens, K. J., & McNally, G. P. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.11.018 · Cited by 170
Contextual control of instrumental actions and habits.
Thrailkill, E. A., & Bouton, M. E. (2015) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000045 · Cited by 165
Self-citationBehavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders
Jean-Richard-Dit-Bressel, P., Killcross, S., & McNally, G. P. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0047-3 · Cited by 160
Shahan, T. A., & Craig, A. R. (2016) · Behavioural Processes · doi:10.1016/j.beproc.2016.10.006 · Cited by 157
A fundamental role for context in instrumental learning and extinction
Bouton, M. E., & Todd, T. P. (2014) · Behavioural Processes · doi:10.1016/j.beproc.2014.02.012 · Cited by 152
Self-citationReinforcement of Competing Behavior during Extinction
Leitenberg, H., Rawson, R. A., & Bath, K. E. (1970) · Science · doi:10.1126/science.169.3942.301 · Cited by 151
Retrieval Variability: Sources and Consequences
Miller, R. R., Kasprow, W. J., & Schachtman, T. R. (1986) · The American Journal of Psychology · doi:10.2307/1422275 · Cited by 145
FORGETTING AS RETRIEVAL FAILURE
Spear, N. E. (1971) · Elsevier eBooks · doi:10.1016/b978-0-12-355050-7.50007-2 · Cited by 143
A MODEL OF RESURGENCE BASED ON BEHAVIORAL MOMENTUM THEORY
Shahan, T. A., & Sweeney, M. M. (2011) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2011.95-91 · Cited by 142
Renewal of drug seeking by contextual cues after prolonged extinction in rats.
Crombag, H. S., & Shaham, Y. (2002) · Behavioral Neuroscience · doi:10.1037//0735-7044.116.1.169 · Cited by 139
Mechanisms of resurgence of an extinguished instrumental behavior.
Winterbauer, N. E., & Bouton, M. E. (2010) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0017365 · Cited by 137
Self-citationTHE ROLE OF THE REINFORCER AS A STIMULUS
REID, R. L. (1958) · British Journal of Psychology · doi:10.1111/j.2044-8295.1958.tb00658.x · Cited by 136
Conditioned reinforcement: Neglected or outmoded explanatory construct?
Williams, B. A. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210950 · Cited by 133
Cocaine seeking by rats is a goal-directed action.
Olmstead, M., Lafond, M. V., Everitt, B., & Dickinson, A. (2001) · Behavioral Neuroscience · doi:10.1037/0735-7044.115.2.394 · Cited by 133
Mechanisms of renewal after the extinction of instrumental behavior.
Todd, T. P. (2013) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0032236 · Cited by 125
Sweeney, M. M., & Shahan, T. A. (2013) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.26 · Cited by 121
Inhibitory associations between S and R in extinction
Rescorla, R. A. (1993) · Animal Learning & Behavior · doi:10.3758/bf03197998 · Cited by 121
Context-Induced Relapse to Alcohol Seeking After Punishment in a Rat Model
Marchant, N. J., Khuc, T., Pickens, C. L., Bonci, A., & Shaham, Y. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.07.007 · Cited by 120
Todd, T. P., Winterbauer, N. E., & Bouton, M. E. (2011) · Learning & Behavior · doi:10.3758/s13420-011-0051-5 · Cited by 118
Self-citationEvidence for the hierarchical structure of instrumental learning
Colwill, R. M., & Rescorla, R. A. (1990) · Animal Learning & Behavior · doi:10.3758/bf03205241 · Cited by 118
Pavlovian-to-instrumental transfer in cocaine seeking rats.
LeBlanc, K. H., Ostlund, S. B., & Maidment, N. T. (2012) · Behavioral Neuroscience · doi:10.1037/a0029534 · Cited by 111
Mantsch, J. R., & Goeders, N. E. (1999) · Psychopharmacology · doi:10.1007/s002130050905 · Cited by 109
Trask, S., Thrailkill, E. A., & Bouton, M. E. (2016) · Behavioural Processes · doi:10.1016/j.beproc.2016.10.003 · Cited by 100
Self-citationDavidson, T. L. (1993) · Psychological Review · doi:10.1037/0033-295x.100.4.640 · Cited by 94
Alcohol as a cue for extinction: State dependency produced by conditioned inhibition
Cunningham, C. L. (1979) · Animal Learning & Behavior · doi:10.3758/bf03209656 · Cited by 93
Bouton, M. E., Rosengard, C., Achenbach, G. G., Peck, C. A., & Brooks, D. C. (1993) · PubMed · Cited by 90
Self-citationContextual Conditioning and Reinstatement of Extinguished Instrumental Responding
Baker, A., Steinwald, H., & Bouton, M. (1991) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640749108401267 · Cited by 88
Self-citationChaudhri, N., Sahuque, L. L., Cone, J. J., & Janak, P. H. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06517.x · Cited by 87
Ostlund, S. B., & Balleine, B. W. (2007) · Animal Learning & Behavior · doi:10.3758/bf03196073 · Cited by 82
Panlilio, L. V., Thorndike, E. B., & Schindler, C. W. (2003) · Psychopharmacology · doi:10.1007/s00213-002-1193-0 · Cited by 82 · cited 2×
“The parallel is also supported by the fact that punished responding recovers if time elapses after punishment (spontaneous recovery; e.g., Estes 1944) or if the original phase 1 reinforcer is presented again in a response-independent manner after punishment (reinstatement; Panlilio et al. 2003).”
Some factors modulating the strength of resurgence after extinction of an instrumental behavior
Winterbauer, N. E., Lucke, S., & Bouton, M. E. (2012) · Learning and Motivation · doi:10.1016/j.lmot.2012.03.003 · Cited by 79
Self-citationGordon, W. C., & Spear, N. E. (1973) · Journal of Experimental Psychology · doi:10.1037/h0035301 · Cited by 78
Miller, R. R., & Escobar, M. E. (2002) · Behavioural Processes · doi:10.1016/s0376-6357(02)00012-8 · Cited by 75
Antecedent reinforcement schedule training and operant response reinstatement in rats
Franks, G. J., & Lattal, K. A. (1976) · Animal Learning & Behavior · doi:10.3758/bf03214424 · Cited by 75
Role of the discriminative properties of the reinforcer in resurgence
Bouton, M. E., & Trask, S. (2015) · Learning & Behavior · doi:10.3758/s13420-015-0197-7 · Cited by 71
Self-citationBasic and translational evaluation of renewal of operant responding
Kelley, M. E., Liddon, C. J., Ribeiro, A., Greif, A. E., & Podlesnik, C. A. (2015) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.209 · Cited by 70
Response inhibition in Extinction
Rescorla, R. A. (2010) · doi:10.1080/713932655 · Cited by 70
Context-induced relapse after extinction versus punishment: similarities and differences
Marchant, N. J., Campbell, E. J., Pelloux, Y., Bossert, J. M., & Shaham, Y. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4929-1 · Cited by 70
Recent and Remote Extinction Cues Reduce Spontaneous Recovery
Brooks, D. C. (2000) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/027249900392986 · Cited by 67
Renewal after the punishment of free operant behavior.
Bouton, M. E., & Schepers, S. T. (2014) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000051 · Cited by 66
Self-citationNakajima, S., Urushihara, K., & Masaki, T. (2002) · Learning and Motivation · doi:10.1016/s0023-9690(02)00009-7 · Cited by 62
Intertrial interval as a contextual stimulus
Bouton, M. E., & Garcı́a-Gutiérrez, A. (2006) · Behavioural Processes · doi:10.1016/j.beproc.2005.12.003 · Cited by 62
Self-citationTrask, S., & Bouton, M. E. (2015) · Learning & Behavior · doi:10.3758/s13420-015-0195-9 · Cited by 62
Self-citationCONTEXT CHANGE EXPLAINS RESURGENCE AFTER THE EXTINCTION OF OPERANT BEHAVIOR
Trask, S., Schepers, S. T., & Bouton, M. E. (2015) · Revista Mexicana de Análisis de la Conducta · doi:10.5514/rmac.v41.i2.63772 · Cited by 61
Self-citationTrask, S., & Bouton, M. E. (2014) · Learning & Behavior · doi:10.3758/s13420-014-0145-y · Cited by 59
Self-citationMechanisms of renewal after the extinction of discriminated operant behavior
Todd, T. P., Vurbic, D., & Bouton, M. (2014) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000021 · Cited by 59
Self-citationRenewal during functional communication training
Saini, V., Sullivan, W. E., Baxter, E. L., DeRosa, N. M., & Roane, H. S. (2018) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.471 · Cited by 58
Lattal, K. M. (2007) · Behavioral Neuroscience · doi:10.1037/0735-7044.121.6.1280 · Cited by 57
Winterbauer, N. E., & Bouton, M. E. (2012) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0028853 · Cited by 57
Self-citationThe interoceptive cue properties of ghrelin generalize to cues produced by food deprivation
Davidson, T. L., Kanoski, S. E., Tracy, A. L., Walls, E. K., Clegg, D. J., & Benoit, S. C. (2005) · Peptides · doi:10.1016/j.peptides.2005.02.014 · Cited by 56
Contextual Control of Discriminated Operant Behavior
Bouton, M., Todd, T. P., & León, S. P. (2014) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000002 · Cited by 56
Self-citationAn extinction retrieval cue attenuates renewal but not reacquisition of alcohol seeking.
Willcocks, A. L., & McNally, G. P. (2014) · Behavioral Neuroscience · doi:10.1037/a0035595 · Cited by 55
Pelloux, Y., Hoots, J. K., Cifani, C., Adhikary, S., Martin, J. A., Minier-Toribio, A. M., Bossert, J. M., & Shaham, Y. (2017) · Addiction Biology · doi:10.1111/adb.12527 · Cited by 54
Information Processing in Animals: Memory Mechanisms
Devine, J. V., Spear, N. E., & Miller, R. R. (1983) · The American Journal of Psychology · doi:10.2307/1422827 · Cited by 54
Schepers, S. T., & Bouton, M. E. (2015) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000061 · Cited by 53
Self-citationEvaluation of renewal mitigation of negatively reinforced socially significant operant behavior
Kelley, M. E., Jimenez‐Gomez, C., Podlesnik, C. A., & Morgan, A. C. (2018) · Learning and Motivation · doi:10.1016/j.lmot.2018.05.003 · Cited by 53
Learning to inhibit the response during instrumental (operant) extinction.
Bouton, M. E., Trask, S., & Carranza-Jasso, R. (2016) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000102 · Cited by 51
Self-citationWelker, R. L., & McAuley, K. (1978) · Animal Learning & Behavior · doi:10.3758/bf03209643 · Cited by 50
Colwill, R. (1991) · Animal Learning & Behavior · doi:10.3758/bf03197893 · Cited by 47
Lorazepam reinstates punishment-suppressed remifentanil self-administration in rats
Panlilio, L. V., Thorndike, E. B., & Schindler, C. W. (2004) · Psychopharmacology · doi:10.1007/s00213-004-2040-2 · Cited by 46
Schepers, S. T., & Bouton, M. E. (2017) · Psychological Science · doi:10.1177/0956797617719084 · Cited by 46
Self-citationInterference in pigeons’ long-term memory viewed as a retrieval problem
Thomas, D. R., McKelvie, A. R., Ranney, M. A., & Moye, T. B. (1981) · Animal Learning & Behavior · doi:10.3758/bf03209794 · Cited by 42
Contextual influences on the interaction between conflicting memories in the rat
Spear, N. E., Smith, G. J., Bryan, R. G., Gordon, W. C., Timmons, R., & Chiszar, D. (1980) · Animal Learning & Behavior · doi:10.3758/bf03199606 · Cited by 41
The influence of context-reinforcer associations on instrumental performance
Pearce, J. M., & Hall, G. (1979) · Animal Learning & Behavior · doi:10.3758/bf03209710 · Cited by 41
Spontaneous recovery of instrumental discriminative responding
Rescorla, R. A. (1997) · Animal Learning & Behavior · doi:10.3758/bf03209854 · Cited by 41
Summation and transfer of negative occasion setting
Morell, J. R., & Holland, P. C. (1993) · Animal Learning & Behavior · doi:10.3758/bf03213394 · Cited by 39
Inactivation of the Prelimbic Cortex Attenuates Context-Dependent Operant Responding
Trask, S., Shipman, M. L., Green, J. T., & Bouton, M. E. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3361-16.2017 · Cited by 38
Self-citationSpontaneous recovery after training with multiple outcomes
Rescorla, R. A. (1996) · Animal Learning & Behavior · doi:10.3758/bf03198949 · Cited by 37
Understanding the balance between goal-directed and habitual behavioral control
Corbit, L. H. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.010 · Cited by 37
Winterbauer, N. E., & Bouton, M. E. (2011) · Learning and Motivation · doi:10.1016/j.lmot.2011.01.002 · Cited by 35
Self-citationContext as a conditional cue in operant discrimination reversal learning.
Thomas, D. R., McKelvie, A. R., & Mah, W. L. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.11.2.317 · Cited by 35
Generalization of a restraint-induced discriminative stimulus to cocaine in rats
Mantsch, J. R., & Goeders, N. E. (1998) · Psychopharmacology · doi:10.1007/s002130050531 · Cited by 34
A reminder of extinction reduces relapse in an animal model of voluntary behaviorPreprint
Nieto, J., Uengoer, M., & Bernal‐Gamboa, R. (2017) · Learning & Memory · doi:10.1101/lm.044495.116 · Cited by 32
Resurgence of instrumental behavior after an abstinence contingency
Bouton, M. E., & Schepers, S. T. (2013) · Learning & Behavior · doi:10.3758/s13420-013-0130-x · Cited by 31
Self-citationWestern diet and the weakening of the interoceptive stimulus control of appetitive behavior
Sample, C. H., Jones, S., Hargrave, S. L., Jarrard, L. E., & Davidson, T. L. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.06.020 · Cited by 31
Bouton, M. E., & Hendrix, M. C. (2011) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0021214 · Cited by 29
Self-citationStimuli previously associated with reinforcement mitigate resurgence
Craig, A. R., Browning, K. O., & Shahan, T. A. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.278 · Cited by 29
Schepers, S. T., & Bouton, M. E. (2018) · Appetite · doi:10.1016/j.appet.2018.10.016 · Cited by 29
Self-citationReducing spontaneous recovery and reinstatement of operant performance through extinction-cues
Bernal‐Gamboa, R., Gámez, A. M., & Nieto, J. (2016) · Behavioural Processes · doi:10.1016/j.beproc.2016.11.010 · Cited by 28
Baker, A. G. (1990) · Animal Learning & Behavior · doi:10.3758/bf03205240 · Cited by 27
Trask, S., Keim, C. L., & Bouton, M. E. (2018) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.446 · Cited by 27
Self-citationInteroceptive “satiety” signals produced by leptin and CCK
Kanoski, S. E., Walls, E. K., & Davidson, T. L. (2007) · Peptides · doi:10.1016/j.peptides.2007.02.015 · Cited by 24
Thrailkill, E. A., & Bouton, M. E. (2015) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000064 · Cited by 24
Self-citationContextual control of chained instrumental behaviors.
Thrailkill, E. A., Trott, J. M., Zerr, C. L., & Bouton, M. E. (2016) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000112 · Cited by 24
Self-citationEffects of differential rates of alternative reinforcement on resurgence of human behavior
Smith, B. M., Smith, G. S., Shahan, T. A., Madden, G. J., & Twohig, M. P. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.241 · Cited by 24
Response-outcome associations remain functional through interference treatments
Rescorla, R. A. (1996) · Animal Learning & Behavior · doi:10.3758/bf03199016 · Cited by 23
Transfer of Inhibitory Stimulus Control in Operant Feature-Negative Discriminations
Holland, P. C., & Coldwell, S. F. (1993) · Learning and Motivation · doi:10.1006/lmot.1993.1020 · Cited by 23
Thrailkill, E. A., & Bouton, M. E. (2015) · Learning & Behavior · doi:10.3758/s13420-015-0193-y · Cited by 22
Self-citationRenewal of signaled shuttle box avoidance in rats
Nakajima, S. (2014) · Learning and Motivation · doi:10.1016/j.lmot.2013.12.002 · Cited by 22
Secondary extinction in Pavlovian fear conditioning
Vurbic, D., & Bouton, M. E. (2011) · Learning & Behavior · doi:10.3758/s13420-011-0017-7 · Cited by 17
Self-citationExtinction and the associative structure of heterogeneous instrumental chains
Thrailkill, E. A., & Bouton, M. E. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2016.06.005 · Cited by 17
Self-citationA translational analysis of ABA and ABC renewal of operant behavior
Liddon, C. J., Kelley, M. E., Rey, C. N., Liggett, A. P., & Ribeiro, A. (2018) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.496 · Cited by 17
The recency effect in pigeons’ long-term memory
Thomas, D. R., Moye, T. B., & Kimose, E. (1984) · Animal Learning & Behavior · doi:10.3758/bf03199809 · Cited by 16
Stepping back from ‘persistence and relapse’ to see the forest: Associative interference
Polack, C. W., Jozefowiez, J., & Miller, R. R. (2017) · Behavioural Processes · doi:10.1016/j.beproc.2017.03.014 · Cited by 16
Trask, S., & Bouton, M. E. (2017) · Learning & Behavior · doi:10.3758/s13420-017-0304-z · Cited by 16
Self-citationBeyond the breakpoint: reinstatement, renewal, and resurgence of ratio‐strained behavior
Kincaid, S. L., & Lattal, K. A. (2018) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.433 · Cited by 14
Factors that influence the persistence and relapse of discriminated behavior chains
Thrailkill, E. A., & Bouton, M. E. (2017) · Behavioural Processes · doi:10.1016/j.beproc.2017.04.009 · Cited by 12
Self-citationTrask, S. (2018) · Learning & Behavior · doi:10.3758/s13420-018-0339-9 · Cited by 12
An extinction cue reduces appetitive Pavlovian reinstatement in rats
Brooks, D. C., & Fava, D. A. (2017) · Learning and Motivation · doi:10.1016/j.lmot.2017.04.002 · Cited by 9
An experimental demonstration of AAB renewal in children with autism spectrum disorder
Cohenour, J. M., Volkert, V. M., & Allen, K. D. (2018) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.443 · Cited by 9
Extending the Domain of Memory Retrieval
Spear, N. E. (2014) · doi:10.4324/9781315798820-17 · Cited by 8
Research works printed but not linked: 2
- Bouton ME, Winterbauer NE, Vurbic D (2012) Context and extinction: mechanisms of relapse in drug self-administration. In M. Haselgrove & L. Hogarth (Eds.), Clinical applications of learning theory (pp. 103–133). East Sussex, UK: Psychology Press
- Rescorla RA (1995) Full preservation of a response-outcome association through training with a second outcome. Q J Exp Psychol 48b:252–261
Cited by
Sorted by citations
Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning
Bouton, M. E., Maren, S., & McNally, G. P. (2020) · Physiological Reviews · doi:10.1152/physrev.00016.2020 · Cited by 438
Self-citationThe power of predictions: An emerging paradigm for psychological research
Hutchinson, J. B., & Barrett, L. F. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721419831992 · Cited by 216
Habits and Goals in Human Behavior: Separate but Interacting Systems
Wood, W., Mazar, A., & Neal, D. T. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691621994226 · Cited by 171
Context, attention, and the switch between habit and goal-direction in behavior
Bouton, M. E. (2021) · Learning & Behavior · doi:10.3758/s13420-021-00488-z · Cited by 100
Self-citationLocal D2- to D1-neuron transmodulation updates goal-directed learning in the striatum
Matamales, M., McGovern, A. E., Mi, J. D., Mazzone, S. B., Balleine, B. W., & Bertran‐Gonzalez, J. (2020) · Science · doi:10.1126/science.aaz5751 · Cited by 95
Metadata
- Authors
- Bouton, M. E.
- Affiliations
- University of Vermont (US)
- Corresponding author
- Bouton, Mark E.
- ORCID
- Bouton, Mark E.
- Venue
- Psychopharmacology
- Published
- 2018-10-22
- Volume
- 236
- Issue
- 1
- Pages
- 7-19
- ISSN
- 0033-3158 (ISSN-L)
- 1432-2072
- PMC
- PMC6374202
- OpenAlex
- W2897986552
- Cited by
- 118
- References
- 131
- Citations by year
- 2026: 14 · 2025: 14 · 2024: 7 · 2023: 14 · 2022: 7 · 2021: 26 · 2020: 23 · 2019: 12
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (RO1 DA033123)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- extinction, operant conditioning, retroactive interference, contextual control, contextual cues, punishment, discrimination reversal, differential reinforcement of alternative behavior, habit learning, stress, deprivation, temporal cues
- MeSH terms
- Animals, Conditioning, Classical, Conditioning, Operant, Cues, Discrimination Learning, Extinction, Psychological, Humans, Reinforcement, Psychology, Reversal Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review