A Model of Prefrontal Cortical Mechanisms for Goal-directed Behavior
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Many behavioral tasks require goal-directed actions to obtain delayed reward. The prefrontal cortex appears to mediate many aspects of goal-directed decision making. This article presents a model of prefrontal cortex function emphasizing the influence of goal-related activity on the choice of the next motor output. The model can be interpreted in terms of key elements of Reinforcement Learning Theory. Different neocortical minicolumns represent distinct sensory input states and distinct motor output actions. The dynamics of each minicolumn include separate phases of encoding and retrieval. During encoding, strengthening of excitatory connections forms forward and reverse associations between each state, the following action, and a subsequent state, which may include reward. During retrieval, activity spreads from reward states throughout the network. The interaction of this spreading activity with a specific input state directs selection of the next appropriate action. Simulations demonstrate how these mechanisms can guide performance in a range of goal-directed tasks, and provide a functional framework for some of the neuronal responses previously observed in the medial prefrontal cortex during performance of spatial memory tasks in rats.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 5×
“These functions are often learned using variants of temporal difference (TD) learning (Sutton & Barto, 1998; Sutton, 1988).”
BackgroundMethodInfluentialA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“Research has focused on the similarity between the error term in TD learning and the activity of dopaminergic neurons (Schultz, Dayanm, & Montague, 1997; Montague, Dayan, & Sejnowski, 1996 ).”
BackgroundThe prefontral cortex and cognitive control
Miller, E. K. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036228 · Cited by 2,016 · cited 2×
“ior (Corbit & Balleine, 2003; Killcross & Coutureau, 2003; Miller & Cohen, 2001; Fuster, 1995), and prefrontal units show firing dependent upon the association of cues and future responses (Miller, 2000).”
BackgroundStorage of 7 +/- 2 short-term memories in oscillatory subcycles
Lisman, J. E., & Idiart, M. A. P. (1995) · Science · doi:10.1126/science.7878473 · Cited by 1,471
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Wood, E. R., Dudchenko, P. A., Robitsek, R. J., & Eichenbaum, H. (2000) · Neuron · doi:10.1016/s0896-6273(00)00071-4 · Cited by 992 · cited 2×
“For example, a rat in an instrumental task must generate lever presses to obtain food reward (Wyble, Hyman, Rossi, & Hasselmo, 2004; Corbit & Balleine, 2003; Killcross & Coutureau, 2003), and a rat in a T-maze must run down the stem of the maze to obtain food reward in one arm of the maze (Baeg et al., 2003; Ferbintea…”
MethodReward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Hasselmo, M. E., Bodelón, C., & Wyble, B. P. (2002) · Neural Computation · doi:10.1162/089976602317318965 · Cited by 875
Self-citationThe orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · cited 1×
“Some neurons in the prefrontal cortex change their response to specific stimuli based on changes in the association between stimuli and reward (Mulder et al., 2003; Schoenbaum, Chiba, & Gallagher, 2000; Thorpe, Rolls, & Maddison, 1983 ).”
BackgroundCoordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Hasselmo, M. E. (2005) · Hippocampus · doi:10.1002/hipo.20116 · Cited by 502
Self-citationThe role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Dynamics of Population Code for Working Memory in the Prefrontal Cortex
Baeg, E. H., Kim, Y. B., Huh, K., Mook-Jung, I., Kim, H. T., & Jung, M. W. (2003) · Neuron · doi:10.1016/s0896-6273(03)00597-x · Cited by 338
Klink, R., & Alonso, A. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.4.1813 · Cited by 228 · cited 2×
“... direction back to the minicolumn activated by the previous state, which is activated by a separate buffer holding a(te � 1). Spiking network simulations suggest that intrinsic afterdepolarization properties can provide this buffer function in a variety of regions including the prefrontal cortex (Koene & Hasselmo,…”
BackgroundFransén, E., Alonso, A. A., & Hasselmo, M. E. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-03-01081.2002 · Cited by 137
Self-citationHaj-Dahmane, S., & Andrade, R. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.3.1197 · Cited by 126
Mulder, A. B., Nordquist, R. E., Örgüt, O., & Pennartz, C. M. A. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.016 · Cited by 84 · cited 2×
“Some neurons in the prefrontal cortex change their response to specific stimuli based on changes in the association between stimuli and reward (Mulder et al., 2003; Schoenbaum, Chiba, & Gallagher, 2000; Thorpe, Rolls, & Maddison, 1983).”
Background
Cited by
Whittington, J. C. R., Muller, T. H., Mark, S., Chen, G., Barry, C., Burgess, N., & Behrens, T. E. J. (2020) · Cell · doi:10.1016/j.cell.2020.10.024 · Cited by 660
Hasselmo, M. E. (2005) · Hippocampus · doi:10.1002/hipo.20116 · Cited by 502
Self-citationHyman, J. M., Zilli, E. A., Paley, A. M., & Hasselmo, M. E. (2005) · Hippocampus · doi:10.1002/hipo.20106 · Cited by 313
Self-citationCombined Social and Spatial Coding in a Descending Projection from the Prefrontal Cortex
Murugan, M., Jang, H. J., Park, M., Miller, E. M., Cox, J., Taliaferro, J. P., Parker, N. F., Bhave, V., Hur, H., Liang, Y., et al. (2017) · Cell · doi:10.1016/j.cell.2017.11.002 · Cited by 311
Representation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 252
Metadata
- Authors
- Hasselmo, M. E.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2005-07-01
- Volume
- 17
- Issue
- 7
- Pages
- 1115-1129
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2097132100
- Cited by
- 96
- References
- 18
- FWCI
- 3.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.