Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“…observed in our study between habit and instrumental uncertainty is however in agreement with neuro-computational models which posit that arbitration between goal-directed and habitual systems relies on the relative uncertainty of predictions from each system (Daw et al., 2005; Lee et al., 2014).”
ResultGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · cited 3×
“Habits, on the other hand, are defined by Stimulus-Response (S-R) associations and are not affected by outcome devaluation or degradation of the R-O contingency (Dickinson, 1994; Balleine and Dickinson, 1998).”
BackgroundTwo-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 2×
“Yet, these stimuli can considerably influence instrumental responding (Rescorla and Soloman, 1967; Holland, 2004; Thrailkill and Bouton, 2015).”
BackgroundNeural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642
Gremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · cited 2×
“In fact, habitual responding after such limited training is typically observed in experiments using RI schedules (Lingawi and Balleine, 2012; Gremel and Costa, 2013) and/or drug self-administration (Barker et al.”
BackgroundHabitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum
Corbit, L. H., Nie, H., & Janak, P. H. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.024 · Cited by 486 · cited 1×
“Indeed, in a previous study from our laboratory, 8 weeks of training under random ratio 3 and exposure to ethanol were necessary to induce habit in rats trained with sucrose (Corbit et al., 2012).”
BackgroundSelf-citationLesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · cited 2×
“These results however could suggest an important role for reward-predictive stimuli in the formation and/or expression of S-R habit, and are consistent with previous studies demonstrating facilitated habit expression in presence of discriminative cues (Faure et al., 2005, 2010).”
BackgroundResultRelations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388 · cited 15×
“Stimulus presentations during devaluation Frontiers in Integrative Neuroscience | www.frontiersin.org 11 September 2017 | Volume 11 | Article 23 tests could then lead to the expression of habit through PIT.”
BackgroundInfluentialSpeed/accuracy trade-off between the habitual and the goal-directed processes
Keramati, M., Dezfouli, A., & Piray, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002055 · Cited by 346 · cited 1×
“Furthermore, strong automaticity and short lever press latencies in the DT5 procedure are consistent with the rapid development of habit observed in this study (Keramati et al., 2011).”
ResultThe effect of the instrumental training contingency on susceptibility to reinforcer devaluation
Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338
The effect of viscosity on ad libitum food intake
Zijlstra, N., Mars, M., de Wijk, R. A., Westerterp-Plantenga, M. S., & de Graaf, C. (2008) · International Journal of Obesity · doi:10.1038/sj.ijo.0803776 · Cited by 247
Dickinson, A. (1994) · Animal Learning and Cognition · doi:10.1016/b978-0-08-057169-0.50009-7 · Cited by 200 · cited 2×
“Habits, on the other hand, are defined by Stimulus-Response (S-R) associations and are not affected by outcome devaluation or degradation of the R-O contingency (Dickinson, 1994; Balleine and Dickinson, 1998).”
BackgroundAmygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits
Lingawi, N. W., & Balleine, B. W. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4806-11.2012 · Cited by 172 · cited 1×
“In fact, habitual responding after such limited training is typically observed in experiments using RI schedules (Lingawi and Balleine, 2012; Gremel and Costa, 2013) and/or drug self-administration (Barker et al., 2014; Loughlin et al., 2017), and does not fit well with the acknowledged habit…”
BackgroundContextual control of instrumental actions and habits.
Thrailkill, E. A., & Bouton, M. E. (2015) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000045 · Cited by 165 · cited 2×
“Yet, these stimuli can considerably influence instrumental responding (Rescorla and Soloman, 1967; Holland, 2004; Thrailkill and Bouton, 2015).”
BackgroundResultInstrumental uncertainty as a determinant of behavior under interval schedules of reinforcement
DeRusso, A. L. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00017 · Cited by 111
Cited by
Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training
Vandaele, Y., Mahajan, N. R., Ottenheimer, D. J., Richard, J. M., Mysore, S. P., & Janak, P. H. (2019) · eLife · doi:10.7554/elife.49536 · Cited by 108
“Based on our previous study, we expected a transition from goal-directed to habitual control over early training sessions (Vandaele et al., 2017).”
BackgroundMethodInfluentialSelf-citationContext, attention, and the switch between habit and goal-direction in behavior
Bouton, M. E. (2021) · Learning & Behavior · doi:10.3758/s13420-021-00488-z · Cited by 100
“The earlier experiment had suggested that rats learned to respond to lever-insertion more quickly than to the tone, perhaps because it was indeed the more salient stimulus (e.g., Holland et al., 2014; Vandaele et al., 2017).”
BackgroundMethodShipman, M. L., Trask, S., Bouton, M. E., & Green, J. T. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.07.010 · Cited by 56
Simmler, L. D., & Ozawa, T. (2019) · Neurochemistry International · doi:10.1016/j.neuint.2019.104464 · Cited by 40
Revealing abrupt transitions from goal-directed to habitual behavior
Moore, S., Wang, Z., Zhu, Z., Wang, J., Sun, R., Lee, Y. A., Charles, A., & Kuchibhotla, K. V. (2026) · Nature Communications · doi:10.1038/s41467-026-71048-0 · Cited by 3
“We adapted existing protocols for food-driven tasks 29,85,86 in mice to suit our task structure with thirst as the motivator 87 .”
Metadata
- Authors
- Vandaele, Y., Pribut, H. J., & Janak, P. H.
- Venue
- Frontiers in Integrative Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2017-09-27
- Volume
- 11
- Pages
- 23-23
- ISSN
- 1662-5145 (ISSN-L)
- OpenAlex
- W2759370097
- Cited by
- 58
- References
- 15
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.