Unexpected food outcomes can return a habit to goal-directed action
Open accessAbstract
Three experiments examined the return of a habitual instrumental response to the status of goal-directed action. In all experiments, rats received extensive training in which lever pressing was reinforced with food pellets on a random-interval schedule of reinforcement. In Experiment 1, the extensively-trained response was not affected by conditioning a taste aversion to the reinforcer, and was therefore considered a habit. However, if the response had earned a new and unexpected food pellet during the final training session, the response was affected by taste aversion conditioning to the (first) reinforcer, and had thus been converted to a goal-directed action. In Experiment 3, 30 min of prefeeding with an irrelevant food pellet immediately before the test also converted a habit back to action, as judged by the taste-aversion devaluation method. That result was consistent with difficulty in finding evidence of habit with the sensory-specific satiety method after extensive instrumental training (Experiment 2). The results suggest that an instrumental behavior's status as a habit is not permanent, and that a habit can be returned to action status by associating it with a surprising reinforcer (Experiment 1) or by giving the animal an unexpected prefeeding immediately prior to the action/habit test (Experiment 3).
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In both experiments, the behavior's status as a habit was not permanent; it could readily switch back to a goal-directed action again.
“In both of these experiments, the behavior’s status as a habit was not permanent; it could readily switch back to a goal-directed action again.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton et al., 2020
After an unexpected change in reinforcer type, the lever-press response was affected by devaluation, suggesting it had returned to action status.
“But after an unexpected change in reinforcer type, the lever-press response was affected by devaluation, suggesting that it had returned to action status.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton et al., 2020
An unexpected 30-min pre-feeding with an irrelevant food pellet just before the test converted the habit evident in controls back to a goal-directed action that was depressed by the devalued reinforcer.
“But experimental subjects received an unexpected 30-min pre-feeding with an irrelevant food pellet in the home cage just before the test. As can be seen, this treatment converted the habit evident in the controls back to a goal-directed action that was depressed by the devalued reinforcer.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton et al., 2020, Experiment 3
On the attention-modulation account, the switch back to R-O after unexpected reinforcers or context change would be created by merely increasing attention to R and the consequent associative retrieval of O.
“On this account, the switch back to R-O after unexpected reinforcers or context change (Bouton et al., 2020; Steinfeld & Bouton, 2021; Trask et al., 2020) would be created by merely increasing attention to R (and the consequent associative retrieval of O).”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton et al., 2020
Surprising reinforcers may provide a form of context change to activate action after habit learning.
“To explain why the presentation of surprising reinforcers also seems to activate action after habit learning (Bouton et al., 2020; Trask et al., 2020), we could thus note that they may provide a form of context change (e.g., Bouton et al., 2021b).”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
Cognitive Processes in Animal Behavior
Hill, W. F., Hulse, S. H., Fowler, H., & Honig, W. K. (1979) · The American Journal of Psychology · doi:10.2307/1421585 · Cited by 1,595 · see citing works
Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445 · see citing works
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
Information Processing in Animals: Memory Mechanisms.
indicated, N. A. (1986) · Contemporary Psychology · doi:10.1037/024459 · Cited by 1,022 · see citing works
A specific role for posterior dorsolateral striatum in human habit learning
Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06796.x · Cited by 769 · see citing works
Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation
Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 635 · see citing works
SOP: A Model of Automatic Memory Processing in Animal Behavior
Wagner, A. R. (2014) · doi:10.4324/9781315798820-6 · Cited by 516 · see citing works
Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory
Kehoe, E. J., Klein, S. B., & Mowrer, R. R. (1991) · The American Journal of Psychology · doi:10.2307/1423162 · Cited by 483 · see citing works
Associative theories of goal-directed behaviour: a case for animal–human translational models
Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424 · see citing works
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388 · see citing works
The effect of the instrumental training contingency on susceptibility to reinforcer devaluation
Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338 · see citing works
Evolution of a Structured Connectionist Model of Pavlovian Conditioning (AESOP)
Klein, S. B., & Mowrer, R. R. (2014) · Psychology Press eBooks · doi:10.4324/9781315801896-13 · Cited by 330 · see citing works
Motivational control after extended instrumental training
Dickinson, A., Balleine, B. W., Watt, A. A., González, F., & Boakes, R. A. (1995) · Animal Learning & Behavior · doi:10.3758/bf03199935 · Cited by 286 · see citing works
Postconditioning devaluation of a reinforcer affects instrumental responding.
Colwill, R. M., & Rescorla, R. A. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.11.1.120 · Cited by 273 · see citing works
Associations between the discriminative stimulus and the reinforcer in instrumental learning.
Colwill, R., & Rescorla, R. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.2.155 · Cited by 259 · see citing works
Shifting the balance between goals and habits: Five failures in experimental habit induction.
de Wit, S., Kindt, M., Knot, S. L., Verhoeven, A. A. C., Robbins, T. W., Gasull-Camós, J., Evans, M., Mirza, H., & Gillan, C. M. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000402 · Cited by 217 · see citing works
The strength of the orienting response during Pavlovian conditioning.
Kaye, H., & Pearce, J. M. (1984) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.10.1.90 · Cited by 209 · see citing works
Contextual control of instrumental actions and habits.
Thrailkill, E. A., & Bouton, M. E. (2015) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000045 · Cited by 165 · see citing works
Self-citationEffect of reinforcer devaluation on discriminative control of instrumental behavior.
Colwill, R. M., & Rescorla, R. A. (1990) · PubMed · Cited by 163 · see citing works
Instrumental responding remains sensitive to reinforcer devaluation after extensive training.
Colwill, R. M., & Rescorla, R. A. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.11.4.520 · Cited by 124 · see citing works
Error bars in within-subject designs: a comment on Baguley (2012)
Cousineau, D., & O’Brien, F. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0441-z · Cited by 119 · see citing works
Restoration of the orienting response to a light by a change in its predictive accuracy
Wilson, P. N., Boumphrey, P., & Pearce, J. M. (2007) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724999208250600 · Cited by 103 · see citing works
Choice and contingency in the development of behavioral autonomy during instrumental conditioning.
Kosaki, Y., & Dickinson, A. (2010) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0016887 · Cited by 101 · see citing works
Davidson, T. L. (1993) · Psychological Review · doi:10.1037/0033-295x.100.4.640 · Cited by 94 · see citing works
Expectancies and the Priming of STM
Wagner, A. R. (2018) · Routledge eBooks · doi:10.4324/9780203710029-7 · Cited by 87 · see citing works
Thrailkill, E. A., Trask, S., Vidal, P., Alcalá, J. A., & Bouton, M. E. (2018) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000188 · Cited by 71 · see citing works
Self-citationFurlong, T. M., Supit, A. S. A., Corbit, L. H., Killcross, S., & Balleine, B. W. (2015) · Addiction Biology · doi:10.1111/adb.12316 · Cited by 68 · see citing works
Bradfield, L. A., Hart, G., & Balleine, B. W. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.09.008 · Cited by 64 · see citing works
Some factors that restore goal-direction to a habitual behavior
Trask, S., Shipman, M. L., Green, J. T., & Bouton, M. E. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107161 · Cited by 63 · see citing works
Self-citationBidirectional Instrumental Conditioning
Dickinson, A., Campos, J., Varga, Z., & Balleine, B. (1996) · The Quarterly journal of experimental psychology. B, Comparative and physiological psychology · doi:10.1080/713932637 · Cited by 59 · see citing works
Restoring the Associability of a Pre-Exposed CS by a Surprising Event
Hall, G., & Pearce, J. M. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400881 · Cited by 59 · see citing works
Shipman, M. L., Trask, S., Bouton, M. E., & Green, J. T. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.07.010 · Cited by 56 · see citing works
Self-citationSchepers, S. T., & Bouton, M. E. (2017) · Psychological Science · doi:10.1177/0956797617719084 · Cited by 46 · see citing works
Self-citationSpontaneous recovery of instrumental discriminative responding
Rescorla, R. A. (1997) · Animal Learning & Behavior · doi:10.3758/bf03209854 · Cited by 38 · see citing works
Female rats express habitual behavior earlier in operant training than males.
Schoenberg, H. L., Sola, E. X., Seyller, E., et al. (2018) · Behavioral Neuroscience · doi:10.1037/bne0000282 · Cited by 38 · see citing works
Spontaneous recovery after training with multiple outcomes
Rescorla, R. A. (1996) · Animal Learning & Behavior · doi:10.3758/bf03198949 · Cited by 37 · see citing works
The Psychology of Habit: Theory, Mechanisms, Change, and Contexts
Verplanken (2018) · Cited by 36 · see citing works
A Critical Review of Habit Theory of Drug Dependence
Hogarth, L. (2018) · Springer eBooks · doi:10.1007/978-3-319-97529-0_18 · Cited by 33 · see citing works
Delayed rewards facilitate habit formation.
Urcelay, G. P., & Jonkman, S. (2019) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000221 · Cited by 30 · see citing works
Context and renewal of habits and goal-directed actions after extinction.
Steinfeld, M. R., & Bouton, M. E. (2020) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000247 · Cited by 24 · see citing works
Self-citationDickinson, A., & Perez, O. D. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812098-9.00001-2 · Cited by 23 · see citing works
Actions and Habits: Psychological Issues in Dual-System Theory
Dickinson, A., & Pérez, O. D. (2018) · CaltechAUTHORS (California Institute of Technology) · Cited by 9 · see citing works
The role of serotonin 1B in the representation of outcomes
Corbit, L. H., Kendig, M. D., & Moul, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-38938-4 · Cited by 7 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Dickinson A (1994). Instrumental conditioning In Mackintosh NJ (Ed.) Animal learning and cognition: Handbook of perception and cognition series (2nd Ed., pp. 45– 79). San Diego, CA: Academic Press.
Cited by
Sorted by citations
Context, attention, and the switch between habit and goal-direction in behavior
Bouton, M. E. (2021) · Learning & Behavior · doi:10.3758/s13420-021-00488-z · Cited by 100 · see citing works
Self-citationSome factors that restore goal-direction to a habitual behavior
Trask, S., Shipman, M. L., Green, J. T., & Bouton, M. E. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107161 · Cited by 63 · see citing works
Self-citationRenewal of goal direction with a context change after habit learning.
Steinfeld, M. R., & Bouton, M. E. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000422 · Cited by 34 · see citing works
Self-citation
- Authors
- Bouton, M. E., Broomer, M. C., Rey, C. N., & Thrailkill, E. A.
- Affiliations
- University of Vermont (US)
- Corresponding author
- Bouton, Mark E.
- Venue
- Neurobiology of Learning and Memory
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 169
- Pages
- 107163
- ISSN
- 1074-7427 (ISSN-L)
- PMC
- PMC7060822
- OpenAlex
- W3000399799
- Cited by
- 65
- References
- 45
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 32 · 2023: 10 · 2022: 6 · 2021: 6 · 2020: 7 · 2019: 1
- FWCI
- 3.89
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Neurobiology of Learning and Memory (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- habit, goal-directed action, instrumental behavior, taste aversion, prefeeding, sensory-specific satiety, rats
- MeSH terms
- Animals, Behavior, Animal, Conditioning, Operant, Extinction, Psychological, Female, Goals, Habits, Reinforcement, Psychology, Rats, Wistar
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review