Modeling operant behavior in the Parkinsonian rat
Open accessAbstract
Mathematical principles of reinforcement (MPR; Killeen, 1994) is a quantitative model of operant behavior that contains three parameters representing motor capacity (delta), motivation (a), and short term memory (lambda). The present study applied MPR to characterize the effects of bilateral infusions of 6-OHDA into the substantia nigra pars compacta in the rat, a model of Parkinson's disease. Rats were trained to lever press under a 5-component fixed-ratio (5, 15, 30, 60, and 100) schedule of food reinforcement. Rats were tested for 15 days prior to dopamine lesions and again for 15 days post-lesion. To characterize functional loss relative to lesion size, rats were grouped according to the extent and the degree of lateralization of their dopamine loss. Response rates decreased as a function of dopamine depletion, primarily at intermediate ratios. MPR accounted for 98% of variance in pre- and post-lesion response rates. Consistent with reported disruptions in motor behavior induced by dopaminergic lesions, estimates of delta increased when dopamine was severely depleted. There was no support for different estimates of a based on pre- and post-lesion performance of any lesion group, suggesting that dopamine loss has negligible effects on incentive motivation. The present study demonstrates the usefulness of combining operant techniques with a theoretical model to better understand the effects of a neurochemical manipulation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Operant learning is impaired in PD.
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Avila et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 1× · see citing works
“Recently, Schultz and colleagues have shown that DA neurons are sensitive to deviations from reinforcer expectation when contingencies exist between a stimulus and the presentation (or omission) of reinforcement [24,61,66], suggesting a role for DA neurons in coding for predictive errors in associative learning [68].”
BackgroundGetting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,544 · see citing works
ON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING <sup>1</sup>
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460 · see citing works
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000 · see citing works
Description of Parkinson's Disease as a Clinical Syndrome
Fahn, S. (2003) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2003.tb07458.x · Cited by 979 · see citing works
Multiple Parallel Memory Systems in the Brain of the Rat
White, N. M., & McDonald, R. J. (2002) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2001.4008 · Cited by 888 · see citing works
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817 · see citing works
Schwarting, R. K. W., & Huston, J. P. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00040-8 · Cited by 741 · see citing works
Lundblad, M., Andersson, M., Winkler, C., Kirik, D., Wierup, N., & Cenci, M. A. (2002) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01843.x · Cited by 664 · see citing works
Neuroleptic-Induced "Anhedonia" in Rats: Pimozide Blocks Reward Quality of Food
Wise, R. A., Spindler, J., de Wit, H., & Gerberg, G. J. (1978) · Science · doi:10.1126/science.566469 · Cited by 636 · see citing works
Salamone, J. D., Cousins, M. S., & Bucher, S. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90108-2 · Cited by 460 · see citing works
Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., & Mahan, K. (1991) · Psychopharmacology · doi:10.1007/bf02245659 · Cited by 436 · see citing works
Zigmond, M. J., Acheson, A., Stachowiak, M. K., & Strickerm, E. M. (1984) · Archives of Neurology · doi:10.1001/archneur.1984.04050190062015 · Cited by 342 · see citing works
Dopamine: a key regulator to adapt action, emotion, motivation and cognition
Nieoullon, A., & Coquerel, A. (2003) · Current Opinion in Neurology · doi:10.1097/00019052-200312002-00002 · Cited by 315 · see citing works
Baldo, B. A., & Kelley, A. E. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0741-z · Cited by 312 · see citing works
Deficits in Feeding Behavior after Intraventricular Injection of 6-Hydroxydopamine in Rats
Zigmond, M. J., & Stricker, E. M. (1972) · Science · doi:10.1126/science.177.4055.1211 · Cited by 296 · see citing works
Cannon, C. M., & Palmiter, R. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-34-10827.2003 · Cited by 280 · see citing works
Aberman, J. E., & Salamone, J. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00004-4 · Cited by 263 · see citing works
Mathematical principles of reinforcement
Killeen, P. R. (1994) · Springer eBooks · doi:10.1007/978-3-032-17450-5_4 · Cited by 262 · see citing works
Self-citationZigmond, M. J., & Stricker, E. M. (1973) · Science · doi:10.1126/science.182.4113.717 · Cited by 250 · see citing works
Baldo, B. A., Sadeghian, K., Basso, A. M., & Kelley, A. E. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00293-0 · Cited by 228 · see citing works
Salamone, J. D., Wisniecki, A., Carlson, B. B., & Correa, M. (2001) · Neuroscience · doi:10.1016/s0306-4522(01)00249-4 · Cited by 198 · see citing works
Castañeda, E., Whishaw, I., & Robinson, T. E. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-06-01847.1990 · Cited by 192 · see citing works
Self-citationKleen, J. K., Sitomer, M. T., Killeen, P. R., & Conrad, C. D. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.4.842 · Cited by 175 · see citing works
Self-citationCompulsive, Abnormal Walking Caused by Anticholinergics in Akinetic, 6-Hydroxydopamine-Treated Rats
Schallert, T. J., Whishaw, I. Q., Ramirez, V. D., & Teitelbaum, P. (1978) · Science · doi:10.1126/science.564552 · Cited by 161 · see citing works
Koch, M., Schmid, A., & Schnitzler, H. (2000) · Psychopharmacology · doi:10.1007/s002130000505 · Cited by 158 · see citing works
McCullough, L. D., & Salamone, J. D. (1992) · Brain Research · doi:10.1016/0006-8993(92)91654-w · Cited by 154 · see citing works
Salamone, J. D., Kurth, P. A., McCullough, L. D., Sokolowski, J. D., & Cousins, M. S. (1993) · Brain Research · doi:10.1016/0006-8993(93)90958-p · Cited by 136 · see citing works
Ishiwari, K., Weber, S. M., Mingote, S., Correa, M., & Salamone, J. D. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.08.007 · Cited by 128 · see citing works
Is dopamine required for natural reward?
Cannon, C. M., & BSEIKRI, M. (2004) · Physiology & Behavior · doi:10.1016/j.physbeh.2004.04.020 · Cited by 106 · see citing works
Cunha, C. D., Angelucci, M. E. M., Canteras, N. S., Wonnacott, S., & Takahashi, R. N. (2002) · Cellular and Molecular Neurobiology · doi:10.1023/a:1020736131907 · Cited by 105 · see citing works
Pimozide attenuates acquisition of lever-pressing for food in rats
Wise, R. A., & Schwartz, H. V. (1981) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(81)90225-2 · Cited by 101 · see citing works
Mingote, S., Weber, S. M., Ishiwari, K., Correa, M., & Salamone, J. D. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.03972.x · Cited by 101 · see citing works
Farrar, A. M., Pereira, M., VELASCO, F. F., Hockemeyer, J., Müller, C. E., & Salamone, J. D. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0554-5 · Cited by 100 · see citing works
Cunha, C. D., Wietzikoski, S., Lovato, E. C. W., Miyoshi, E., Ferro, M. M., Anselmo-Franci, J. A., & Canteras, N. S. (2003) · Neurobiology of Learning and Memory · doi:10.1016/s1074-7427(03)00008-x · Cited by 99 · see citing works
Mobini, S., Chiang, T.-J., Ho, M.-Y., et al. (2000) · Psychopharmacology · doi:10.1007/s002130000486 · Cited by 97 · see citing works
‘Disengage’ sensorimotor deficit following apparent recovery from unilateral dopamine depletion
Schallert, T. J., & Hall, S. (1988) · Behavioural Brain Research · doi:10.1016/0166-4328(88)90003-4 · Cited by 94 · see citing works
Salamone, J. D., Cousins, M. S., Maio, C., Champion, M., Turski, T., & Kovach, J. (1996) · Psychopharmacology · doi:10.1007/bf02249408 · Cited by 93 · see citing works
Killeen, P. R., & Sitomer, M. T. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00017-2 · Cited by 88 · see citing works
Self-citationMcFarland, K., & Ettenberg, A. (1995) · Psychopharmacology · doi:10.1007/bf02246264 · Cited by 80 · see citing works
Kelland, M. D., Chiodo, L. A., & Freeman, A. S. (1990) · Synapse · doi:10.1002/syn.890060213 · Cited by 78 · see citing works
Robinson, S., Rainwater, A., Hnasko, T. S., & Palmiter, R. D. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0579-9 · Cited by 77 · see citing works
Effect of bilateral 6-OHDA lesions of the substantia nigra on locomotor activity in the rat
Sakai, K., & Gash, D. M. (1994) · Brain Research · doi:10.1016/0006-8993(94)91533-4 · Cited by 76 · see citing works
Salamone, J. D. (1995) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(94)00294-s · Cited by 74 · see citing works
Kheramin, S., Body, S., Herrera, F. M., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.05.017 · Cited by 74 · see citing works
How Does the Limbic System Assist Motor Learning? A Limbic Comparator Hypothesis (Part 1 of 2)
Brooks, V. B. (2008) · Brain Behavior and Evolution · doi:10.1159/000118670 · Cited by 70 · see citing works
DARPP-32 knockout mice exhibit impaired reversal learning in a discriminated operant task
Heyser, C. J., Fienberg, A. A., Greengard, P., & Gold, L. H. (2000) · Brain Research · doi:10.1016/s0006-8993(00)02272-1 · Cited by 69 · see citing works
Lindner, M. D., Plone, M. A., Francis, J. M., Blaney, T. J., Salamone, J. D., & Emerich, D. F. (1997) · Behavioural Brain Research · doi:10.1016/s0166-4328(96)02240-1 · Cited by 60 · see citing works
Hamilton, M. E., Mele, A., & Pert, A. (1992) · Brain Research · doi:10.1016/0006-8993(92)91498-4 · Cited by 54 · see citing works
Conditioned inhibition and excitation in operant discrimination learning.
Brown, P. L., & Jenkins, H. M. (1967) · Journal of Experimental Psychology · doi:10.1037/h0024985 · Cited by 48 · see citing works
Models of ratio schedule performance.
Bizo, L. A., & Killeen, P. R. (1997) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.23.3.351 · Cited by 46 · see citing works
Self-citationRats don’t always respond faster for more food: The paradoxical incentive effect
Bizo, L. A., Kettle, L. C., & Killeen, P. R. (2001) · Animal Learning & Behavior · doi:10.3758/bf03192816 · Cited by 44 · see citing works
Self-citationModels of ratio schedule performance.
Bizo, L. A., & Killeen, P. R. (1997) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.23.3.351 · Cited by 44 · see citing works
Self-citationExtending mathematical principles of reinforcement into the domain of behavioral pharmacology
Reilly, M. P. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00027-5 · Cited by 41 · see citing works
Self-citationFunctional role of the limbic system and basal ganglia in motivated behaviors
Ono, T., Nishijo, H., & Nishino, H. (2000) · Journal of Neurology · doi:10.1007/pl00007780 · Cited by 40 · see citing works
Effects of haloperidol and d-amphetamine on perceived quantity of foods and tones
Martin-Iverson, M. T., Wilkie, D. M., & Fibiger, H. C. (1987) · Psychopharmacology · doi:10.1007/bf00187260 · Cited by 39 · see citing works
Fahn, S. (1989) · Movement Disorders · doi:10.1002/mds.870040502 · Cited by 35 · see citing works
Calaminus, C., & Hauber, W. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0532-y · Cited by 34 · see citing works
Nishino, H., Hattori, S., Muramoto, K., et al. (1991) · Brain Research Bulletin · doi:10.1016/0361-9230(91)90143-8 · Cited by 33 · see citing works
Zhang, Z., Rickard, J. F., Asgari, K., Body, S., Bradshaw, C. M., & Szabadi, E. (2004) · Psychopharmacology · doi:10.1007/s00213-004-2049-6 · Cited by 32 · see citing works
Roizen, M. F., Kopin, I. J., Thoa, N. B., et al. (1976) · Brain Research · doi:10.1016/0006-8993(76)90862-3 · Cited by 31 · see citing works
Dopamine receptor blockade and extinction differentially affect behavioral variability.
Rick, J. H., Horvitz, J. C., & Balsam, P. D. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.2.488 · Cited by 24 · see citing works
Modeling the effects of fluoxetine on food-reinforced behavior
Sanabria, F., Acosta, J. I., Killeen, P. R., Neisewander, J. L., & Bizo, L. A. (2008) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e3282f3df9b · Cited by 23 · see citing works
Self-citationZhang, Z., Rickard, J. F., Body, S., et al. (2005) · Psychopharmacology · doi:10.1007/s00213-005-2258-7 · Cited by 21 · see citing works
Striatal dopamine and the interface between orienting and ingestive functions
Hall, S., & Schallert, T. J. (1988) · Physiology & Behavior · doi:10.1016/0031-9384(88)90307-1 · Cited by 20 · see citing works
Haloperidol, dynamics of choice, and the parameters of the matching law
Aparício, C. F. (2007) · Behavioural Processes · doi:10.1016/j.beproc.2007.02.024 · Cited by 19 · see citing works
Tran-Nguyen, L. T. L., Castañeda, E., & MacBeth, T. (1996) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(96)00068-8 · Cited by 8 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- [43]Posadas-Sánchez D Evaluating models of motivation: Role of reinforcer quality, lever force, and drug effects Unpublished Dissertation Arizona State University Tempe 2004
- [63]Stephens DW Krebs JR Foraging Theory Princeton University Press Princeton, NJ 1986
Cited by
Sorted by citations
Huang, V. S., Haith, A., Mazzoni, P., & Krakauer, J. W. (2011) · Neuron · doi:10.1016/j.neuron.2011.04.012 · Cited by 472 · see citing works
Model-Based and Model-Free Mechanisms of Human Motor Learning
Haith, A. M., & Krakauer, J. W. (2013) · Advances in Experimental Medicine and Biology · doi:10.1007/978-1-4614-5465-6_1 · Cited by 263 · see citing works
- Authors
- Avila, I., Reilly, M. P., Sanabria, F., Posadas-Sánchez, D., Chavez, C. L., Banerjee, N., Killeen, P., & Castañeda, E.
- Affiliations
- Arizona State University (US)
- Central Michigan University (US)
- The University of Texas at El Paso (US)
- Corresponding author
- Reilly, Mark P.
- Venue
- Behavioural Brain Research
- Publisher
- Elsevier BV
- Published
- 2009-03
- Volume
- 198
- Issue
- 2
- Pages
- 298-305
- ISSN
- 0166-4328 (ISSN-L)
- PMC
- PMC2664313
- OpenAlex
- W1972836433
- Cited by
- 35
- References
- 74
- Citations by year
- 2023: 1 · 2022: 2 · 2021: 1 · 2020: 2 · 2019: 3 · 2018: 2 · 2017: 3 · 2016: 2 · 2015: 3 · 2014: 2 · 2013: 5 · 2012: 2
- FWCI
- 0.87
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Behavioural Brain Research (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- scholarworks - UTEP (The University of Texas at El Paso) (submittedVersion)
- Funders
- Howard Hughes Medical Institute
- American Psychological Association
- Arizona State University
- National Institutes of Health
- National Institute of Mental Health (T32MH018882, 5T32 MH18882, R01MH066860)
- National Institute on Drug Abuse (Z01DA000485, K01DA000485, KO1 DA00485)
- National Institute of General Medical Sciences (5 T34 GM08491-10, T34GM008491)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease model, 6-hydroxydopamine, substantia nigra pars compacta, dopamine depletion, operant behavior, fixed-ratio schedules, lever pressing, response rate, motor capacity, motivation, short-term memory
- MeSH terms
- Animals, Conditioning, Operant, Disease Models, Animal, Dopamine, Food, Male, Memory, Short-Term, Microinjections, Motivation, Motor Activity, Parkinson Disease, Reinforcement, Psychology, Reinforcement Schedule, Substantia Nigra, Sympatholytics, Time Factors, Oxidopamine, Rats, Sprague-Dawley, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
