Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning.
Abstract
A crucial aspect of organizing goal-directed behavior is the ability to form neural representations of relationships between environmental stimuli, actions and reinforcement. Very little is known yet about the neural encoding of response-reward relationships, a process which is deemed essential for purposeful behavior. To investigate this, tetrode recordings were made in the medial prefrontal cortex (PFC) of rats performing a Go-NoGo task. After task acquisition, a subset of neurons showed a sustained change in firing during the rewarded action sequence that was triggered by a specific visual cue. When these changes were monitored in the course of learning, they were seen to develop in parallel with the behavioral learning curve and were highly sensitive to a switch in reward contingencies. These sustained changes correlated with the reward-associated action sequence, not with sensory or reward-predicting properties of the cue or individual motor acts per se. This novel type of neural plasticity may contribute to the formation of response-reinforcer associations and of behavioral strategies for guiding goal-directed action.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Neural activity in the PFC is related to engagement of specific action-outcome associations.
“Electrophysiological studies using primates (Matsumoto et al., 2003; Matsumoto and Tanaka, 2004) and rats (Mulder et al., 2003) have found neural activity in the PFC related to engagement of specific action–outcome associations.”
From The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD (2015) · cites this paper as Mulder et al., 2003
Cites
Dynamics of the Hippocampal Ensemble Code for Space
Wilson, M. A., & McNaughton, B. L. (1993) · Science · doi:10.1126/science.8351520 · Cited by 2,350 · see citing works
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · see citing works
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527 · see citing works
Anatomy of motor learning. I. Frontal cortex and attention to action
Jueptner, M., Stephan, K. M., Frith, C. D., Brooks, D. J., Frackowiak, R. S. J., & Passingham, R. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.3.1313 · Cited by 624 · see citing works
NEURAL SELECTION AND CONTROL OF VISUALLY GUIDED EYE MOVEMENTS
Schall, J. D., & Thompson, K. G. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.241 · Cited by 489 · see citing works
Long-term plasticity in hippocampal place-cell representation of environmental geometry
Lever, C., Wills, T., Cacucci, F., Burgess, N., & O'Keefe, J. (2002) · Nature · doi:10.1038/416090a · Cited by 465 · see citing works
Baldwin, A. E., Holahan, M. R., Sadeghian, K., & Kelley, A. E. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.84 · Cited by 122 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407 · see citing works
Top-Down Control of Motor Cortex Ensembles by Dorsomedial Prefrontal Cortex
Narayanan, N. S., & Laubach, M. (2006) · Neuron · doi:10.1016/j.neuron.2006.10.021 · Cited by 311 · see citing works
Internally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217 · see citing works
Self-citationCorticostriatal Interactions during Learning, Memory Processing, and Decision Making
Pennartz, C. M. A., Berke, J. D., Graybiel, A. M., Ito, R., Lansink, C. S., van der Meer, M., Redish, A. D., Smith, K. S., & Voorn, P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3177-09.2009 · Cited by 213 · see citing works
Self-citationInfluence of the hippocampus on interneurons of the rat prefrontal cortex
Tierney, P. L., Dégenètais, E., Thierry, A., Glowinski, J., & Gioanni, Y. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03501.x · Cited by 192 · see citing works
Hart, G., Leung, B. K., & Balleine, B. W. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.11.003 · Cited by 166 · see citing works
The why, what, where, when and how of goal-directed choice: neuronal and computational principles
Verschure, P. F. M. J., Pennartz, C. M. A., & Pezzulo, G. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0483 · Cited by 131 · see citing works
“Neurophysiological studies in rodents and primates indicate that prefrontal neurons can encode task rules that need to be followed to obtain a goal [94], individual actions or chunks of actions leading up to a goal [95–97], and goals and goal sites themselves [98,99].”
BackgroundIndicators and criteria of consciousness in animals and intelligent machines: an inside-out approach
Pennartz, C. M. A., Farisco, M., & Evers, K. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00025 · Cited by 121 · see citing works
Self-citationSerotonergic neuromodulation of synaptic plasticity
Higa, G. S. V., Viana, F. J. C., Francis-Oliveira, J., Cruvinel, E., Franchin, T. S., Marcourakis, T., Ulrich, H., & De Pasquale, R. (2024) · Neuropharmacology · doi:10.1016/j.neuropharm.2024.110036 · Cited by 29 · see citing works
The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD
Natsheh, J. Y., & Shiflett, M. W. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00326 · Cited by 21 · see citing works
- Authors
- Mulder, A. B., Nordquist, R. E., Örgüt, O., & Pennartz, C. M. A.
- Corresponding author
- Mulder, Antonius B.
- Venue
- Behavioural Brain Research
- Publisher
- Elsevier BV
- Published
- 2003-11
- Volume
- 146
- Issue
- 1-2
- Pages
- 77-88
- ISSN
- 0166-4328 (ISSN-L)
- OpenAlex
- W2159485971
- Cited by
- 84
- References
- 7
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 2 · 2022: 5 · 2021: 3 · 2020: 2 · 2019: 3 · 2018: 3 · 2017: 4 · 2016: 3 · 2015: 4 · 2014: 5 · 2013: 4 · 2012: 3
- FWCI
- 2.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behavioural Brain Research (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- medial prefrontal cortex, operant conditioning, neuroplasticity, reward contingency, go/no-go task, goal-directed behavior, rats
- MeSH terms
- Action Potentials, Analysis of Variance, Animals, Behavior, Animal, Conditioning, Operant, Discrimination Learning, Electrophysiology, Learning, Male, Neurons, Photic Stimulation, Psychomotor Performance, Reaction Time, Reinforcement, Psychology, Visual Perception, Rats, Wistar, Prefrontal Cortex, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
