Habituation of reinforcer effectiveness
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin etal., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect "accelerated-HRE." Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Habituation: a model phenomenon for the study of neuronal substrates of behavior
Thompson, R. F., & Spencer, W. A. (1966) · Psychological Review · doi:10.1037/h0022681 · Cited by 2,608
Rankin, C. H., Abrams, T., Barry, R. J., Bhatnagar, S., Clayton, D. F., Colombo, J., Coppola, G., Geyer, M. A., Glanzman, D. L., Marsland, S., et al. (2009) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2008.09.012 · Cited by 1,665
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Evaluating Dopamine Reward Pathway in ADHD: Clinical Implications
Volkow, N. D., Wang, G.-J., Kollins, S. H., Wigal, T. L., Newcorn, J. H., Telang, F., Fowler, J. S., Zhu, W., Logan, J., Ma, Y., et al. (2009) · JAMA · doi:10.1001/jama.2009.1308 · Cited by 728 · cited 1×
“This is particularly important for understanding the role of reinforcement mechanisms in the leading psychosocial (behavior therapy) and pharmacological (psychostimulant) ADHD treatments (Volkow et al., 2005, 2009; Tripp and Wickens, 2012).”
BackgroundKuczenski, R., & Segal, D. S. (1997) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1997.68052032.x · Cited by 623 · cited 1×
“In rodents, methylphenidate blocks the DA transporter and increases DA overflow in the nucleus accumbens and dorsal striatum (Kuczenski and Segal, 1997; Segal and Kuczenski, 1999).”
BackgroundThe impact of reinforcement contingencies on AD/HD: A review and theoretical appraisal
Luman, M., Oosterlaan, J., & Sergeant, J. A. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.11.001 · Cited by 541
Evaluating vigilance deficits in ADHD: A meta-analysis of CPT performance.
Huang-Pollock, C. L., Karalunas, S. L., Tam, H., & Moore, A. N. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0027205 · Cited by 359 · cited 1×
“Children with ADHD exhibit a steeper decrease in target detection over time than do typically developing children (e.g., Huang-Pollock et al., 2006; for a review, see Huang-Pollock et al., 2012), which is interpreted as a deficit in sustained attention.”
BackgroundLuman, M., Tripp, G., & Scheres, A. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.021 · Cited by 335 · cited 1×
“The HRE hypothesis also addresses the disconnect between neurobiological models and psychological models of reinforcement: “The scarcity of studies testing neurobiological predictions is explained partly by a lack in knowledge of how to test some of these predictions in humans” (Luman et al., 2010).”
BackgroundHabituation in rodents: a review of behavior, neurobiology, and genetics
LEUSSIS, M., & BOLIVAR, V (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.03.006 · Cited by 330 · cited 1×
“As others (McSweeney et al., 1996a; Leussis and Bolivar, 2006) have pointed out, if differences in baseline responding are not taken into consideration, differences attributed to habituation may actually be due to baseline differences in absolute response levels.”
BackgroundDonny, E. C., Chaudhri, N., Caggiula, A. R., Evans-Martin, F. F., Booth, S., Gharib, M. A., Clements, L. A., & Sved, A. F. (2003) · Psychopharmacology · doi:10.1007/s00213-003-1473-3 · Cited by 304
Volkow, N. D., Wang, G.-J., Fowler, J. S., Telang, F., Maynard, L., Logan, J., Gatley, S. J., Pappas, N., Wong, C., Vaska, P., et al. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.7.1173 · Cited by 281 · cited 1×
“Volkow et al. (2004) also demonstrated that oral methylphenidate increased extracellular DA on PET scan in healthy subjects.”
BackgroundChaudhri, N., Caggiula, A. R., Donny, E. C., Palmatier, M. I., Liu, X., & Sved, A. F. (2006) · Psychopharmacology · doi:10.1007/s00213-005-0178-1 · Cited by 271 · cited 1×
“…Gomer and Jakubczak, 1974; Winterbauer and Balleine, 2007), methamphetamine (Gancarz et al., 2012a; Lloyd et al., 2012b), and nicotine (Chaudhri et al., 2006a; Palmatier et al., 2006; Chaudhri et al., 2007; Raiff and Dallery, 2009), enhance the primary reinforcing effectiveness of sensory stimuli.”
BackgroundTelevision watching increases motivated responding for food and energy intake in children
Temple, J. L., Giacomelli, A. M., Kent, K. M., Roemmich, J. N., & Epstein, L. H. (2007) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/85.2.355 · Cited by 259
The Role of Nicotine in Smoking: A Dual-Reinforcement Model
Caggiula, A. R., Donny, E. C., Palmatier, M. I., Liu, X., Chaudhri, N., & Sved, A. F. (2008) · Nebraska Symposium on Motivation · doi:10.1007/978-0-387-78748-0_6 · Cited by 226
Attention Deficit Disorder With Hyperactivity: A Specific Hypothesis of Reward Dysfunction
HAENLEIN, M., & CAUL, W. F. (1987) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-198705000-00014 · Cited by 213
Psychophysiological response of ADHD children to reward and extinction
IABONI, F., DOUGLAS, V. I., & DITTO, B. (1997) · Psychophysiology · doi:10.1111/j.1469-8986.1997.tb02422.x · Cited by 146
The gut–brain dopamine axis: a regulatory system for caloric intake
de Araujo, I. E., Ferreira, J. G., Tellez, L. A., Ren, X., & Yeckel, C. W. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.02.026 · Cited by 140 · cited 1×
“…“neutral” implies that these stimuli have no effects, which is clearly untrue when referring to them as reinforcers. addition to food or water restriction, post-absorptive effects of ingested stimuli may affect the reinforcing effectiveness of predictive sensory stimuli (de Araujo et al., 2012).”
BackgroundChaudhri, N., Caggiula, A. R., Donny, E. C., Booth, S., Gharib, M., Craven, L., Palmatier, M. I., Liu, X., & Sved, A. F. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0522-0 · Cited by 123 · cited 10×
“Kamin, L. J. (1969). “Predictability, surprise, attention, and conditioning,” in Punish-”
BackgroundInfluentialSonuga‐Barke, E. J. S. (2011) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02444.x · Cited by 43 · cited 2×
“Despite the central role of reinforcement in theories of ADHD (Haenlein and Caul, 1987; Sagvolden et al., 2005), there is considerable controversy regarding the exact nature of the dysfunction (Luman et al., 2005; Sonuga-Barke, 2011).”
Background
Cited by
Versaggi, C. L., King, C. P., & Meyer, P. J. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4341-7 · Cited by 60
“The initial reinforcing properties of these stimuli are likely to be important for this effect, because nicotine and other stimulants may disrupt the habituation to the sensory reinforcement maintained by a variety of stimuli (Lloyd et al. 2012, 2014a, 2014b).”
Impaired P1 Habituation and Mismatch Negativity in Children with Autism Spectrum Disorder
Ruiz-Martínez, F. J., Rodríguez-Martínez, E. I., Wilson, C. E., Yau, S., Saldaña, D., & Gómez, C. M. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-04299-0 · Cited by 53
Rosch, K. S., Fosco, W. D., Pelham, W. E., Waxmonsky, J. G., Bubnik, M. G., & Hawk, L. W. (2016) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-015-0031-x · Cited by 43
“Second, the acute analogue model does not capture whether reinforcers lose their effectiveness over time (Lloyd et al. 2014).”
Self-citation
Metadata
- Authors
- Lloyd, D. R., Medina, D. J., Hawk, L. W., Fosco, W. D., & Richards, J. B.
- Venue
- Frontiers in Integrative Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2014
- Volume
- 7
- Pages
- 107-107
- ISSN
- 1662-5145 (ISSN-L)
- OpenAlex
- W2069330285
- Cited by
- 53
- References
- 20
- FWCI
- 1.74
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.