The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory
Abstract
An Important aspect of cognitive control is the ability to appropriately select, update, and maintain contextual information related to behavioral goals, and to me this information to coordinate processing over extended periods. In our novel, neurobiologicaUy based, connectionist computational model, the selection, updating, and maintenance of context occur through Interactions between the prefrontal cortex @'PC) and dofamlne (DA) neuiotiuismitter system. Phasic DAactivity serves two simultaneous and synergistic functions: (1) a gating function, which regulates the access of information to active memory mechanisms subserved by PFC; and (2) a learning function, whlcn auowa me to discover wast uifonnation is relevant for selection as context. We present a simulation that establishes the computational viability of these postulated neurobiological mechanisms for subserving control functions. The need for a control mechanism in cognition has been long noted within psychology. Virtually all theorists agree that some mechanism is needed to guide, coordinate, and update behavior in a flexible fashionparticularly in novel or complex tasks (Norman and Shallice 1986). In particular, control over processing requires that information related both to current context and to behavioral goals be actively represented, such that these representations can bias behavior in favor of goal-directed activities over extended periods. Indeed, most computationally explicit theories of human behavior have included such a mechanism as a fundamental component. For example, in production models, goal states represented in declarative memory are used to coordinate the' sequence of production firings involved in complex behaviors (e.g., Anderson 1983); One critical feature of goal representations in production systems is that they must be actively represented and maintained throughout the course of a sequence of behaviors. Such formulations of a control (or executive) mechanism closely parallel theorizmg about the nature of frontal lobe function (Bianchi 1922; Darnasio 1985; Luria 19691, and clinical observations of patients with frontal lesions who often exhibit impairments in tasks requiring control over behavior-the so-called dysexecutive syndrome. Shallice (Nonnan and Shallice 1986; Shallice, 1982,1988) explicitly noted this relationship, using the production framework to describe his theory of a supervisory attentional system (SAS) as a mechanism by wmcn the frontal lobes coordinate complex cognitive processes and select nonroutine actions. While these efforts have provided insights into the types of processes that may be engaged by cognitive control, they d6 not map transparently onto underlyingneural mechanisms. They have also not fully addressed several critical issues, such as how a control can develop through learning. A number of recently proposed connectionist models of prefrontal function incorporate some of the central features of control processes in production models, such as the active maintenance of goal representations (Dehaene and Changeux 1992; Guigon et al. 1991; Levine and Prueitt 1989). Connectionist models have the advantage of both being mechanistically explicit and using a computational architecture that maps more naturally onto neural mechanisms than traditional production models. In this chapter, we report on work that uses this framework to address a critical question about cognitive control: How can a learn to choose and appropriately update representations in active memory that can be used to control behavior? This is an extension of our ongoing effort to specify the neural underpinnings of cognitive control (Braver et al. 1995a; Cohen, Braver, and WReilly 1996; Cohen and Servan-Schreiber 1992), reviewed briefly below as background. A central hypothesis in our work is that a cardinal function of prefrontal cortex (PFC) is to actively maintain context information. We use the general term context to include not.only goal representations, which have their influence on planning and overt behavior, but also representations that may have their effect earlier in the processing stream, on interpretive or attentional processes. We assume that a primary function of PFC is tomaintain task-relevant context represmtations in an active state. These active context representations .serve to mediate control by modulating the flow of information within task-specific pathways such that processing in the task-relevant pathway is favored, over a (possibly stronger) competing pathway. This function of PFC can also be thought of as a component of working memory 0, commonly defined as the collection of mechanisms respowible for the on-line maintenance and manipulation of information necessary to perform a cognitive task (Baddeley and Hitch 1994). From this perspective, context can be viewed as the subset of representations within WM that govern how other representations are used. As noted above, there is long-standing recognition th
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Attention to Action: Willed and Automatic Control of Behavior
Norman, D. A., & Shallice, T. (1986) · Consciousness and Self-Regulation · doi:10.1007/978-1-4757-0629-1_1 · Cited by 4,455
Specific impairments of planning
Shallice, T. (1982) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1982.0082 · Cited by 3,741
Stuss, D. T., & Benson, D. F. (1986) · Raven Press eBooks · Cited by 2,636
A continuous performance test of brain damage
Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D., & Beck, L. H. (1956) · Journal of Consulting Psychology · doi:10.1037/h0043220 · Cited by 2,261
Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes
MILNER, B. (1963) · Archives of Neurology · doi:10.1001/archneur.1963.00460070100010 · Cited by 2,217 · cited 1×
“Increased distractibility and perseveration are hallmarks of neurological damage to PFC (Darnasio 1985; Engle, Kane, and Thholski 1999; Milner 1963; Owen et al. 1991; Stuss and Benson 1986) and of psychiatric disorders known to involve P'FC such as schizophrenia (Malmo 1974; Nuechterlein and Dawson…”
BackgroundTemporal dynamics of brain activation during a working memory task
Cohen, J. D., Perlstein, W. M., Braver, T. S., Nystrom, L. E., Noll, D. C., Jonides, J., & Smith, E. E. (1997) · Nature · doi:10.1038/386604a0 · Cited by 1,876
Grace, A. A. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90196-u · Cited by 1,831
Cognitive Deficit Caused by Regional Depletion of Dopamine in Prefrontal Cortex of Rhesus Monkey
Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979) · Science · doi:10.1126/science.112679 · Cited by 1,500
Context, cortex, and dopamine: A connectionist approach to behavior and biology in schizophrenia.
Cohen, J. D., & Servan-Schreiber, D. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.45 · Cited by 1,479
Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque
Miller, E. K., Erickson, C. A., & Desimone, R. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05154.1996 · Cited by 1,452
D1 Dopamine Receptors in Prefrontal Cortex: Involvement in Working Memory
Sawaguchi, T., & Goldman-Rakic, P. S. (1991) · Science · doi:10.1126/science.1825731 · Cited by 1,364
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Engle, R. W., Kane, M. J., & Tuholski, S. W. (1999) · Models of Working Memory · doi:10.1017/cbo9781139174909.007 · Cited by 1,195
Bechara, A., Tranel, D., Damasio, H., & Damasio, A. R. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.2.215 · Cited by 1,179
Transient and sustained activity in a distributed neural system for human working memory
Courtney, S. M., Ungerleider, L. G., Keil, K., & Haxby, J. V. (1997) · Nature · doi:10.1038/386608a0 · Cited by 960
A Network Model of Catecholamine Effects: Gain, Signal-to-Noise Ratio, and Behavior
Servan-Schreiber, D., Printz, H., & Cohen, J. D. (1990) · Science · doi:10.1126/science.2392679 · Cited by 767
Developments in the concept of working memory.
Baddeley, A., & Hitch, G. J. (1994) · Neuropsychology · doi:10.1037//0894-4105.8.4.485 · Cited by 758
Functional and Anatomical Aspects of Prefrontal Pathology in Schizophrenia
Goldman-Rakic, P. S., & Selemon, L. D. (1997) · Schizophrenia Bulletin · doi:10.1093/schbul/23.3.437 · Cited by 668
Owen, A. M., Roberts, A. C., Polkey, C. E., Sahakian, B. J., & Robbins, T. W. (1991) · Neuropsychologia · doi:10.1016/0028-3932(91)90063-e · Cited by 657
Dissociating working memory from task difficulty in human prefrontal cortex
Barch, D. M., Braver, T. S., Nystrom, L. E., Forman, S. D., Noll, D. C., & Cohen, J. D. (1997) · Neuropsychologia · doi:10.1016/s0028-3932(97)00072-9 · Cited by 590
Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function
Braver, T. S., Barch, D. M., & Cohen, J. D. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00116-x · Cited by 507
Hernández-López, S., Bargas, J., Surmeier, D. J., Reyes, A., & Galarraga, E. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-09-03334.1997 · Cited by 495
Cohen, J. D., Braver, T. S., & O´Reilly, R. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0138 · Cited by 487
Schizophrenic Deficits in the Processing of Context: A Test of a Theoretical Model
Servan-Schreiber, D. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830120037008 · Cited by 462
Effects of bromocriptine on human subjects depend on working memory capacity
Kimberg, D. Y., DʼEsposito, M., & Farah, M. J. (1997) · Neuroreport · doi:10.1097/00001756-199711100-00032 · Cited by 413
Damásio, A. R., & Anderson, S. W. (1993) · The Clinical Neuropsychologist · Cited by 324
A stochastic reinforcement learning algorithm for learning real-valued functions
Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 295
Facilitation of Working Memory in Humans by a D2 Dopamine Receptor Agonist
Luciana, M., Depue, R. A., Arbisi, P., & Leon, A. (1992) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1992.4.1.58 · Cited by 271
Neuronal activity in posterior parietal area 7a during the delay periods of a spatial memory task
Constantinidis, C., & Steinmetz, M. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.2.1352 · Cited by 248
Sesack, S. R., Snyder, C. L., & Lewis, D. A. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630208 · Cited by 226
Interactions between dopamine and amino acid-induced excitation and inhibition in the striatum
Chiodo, L. A., & Berger, T. W. (1986) · Brain Research · doi:10.1016/0006-8993(86)90976-5 · Cited by 211
Excitation of rat prefrontal cortical neurons by dopamine: An in vitro electrophysiological study
Penit-Soria, J., Audinat, E., & Crepel, F. (1987) · Brain Research · doi:10.1016/0006-8993(87)90509-9 · Cited by 204
A Theory of Dopamine Function and Its Role in Cognitive Deficits in Schizophrenia
Cohen, J. D., & Servan-Schreiber, D. (1993) · Schizophrenia Bulletin · doi:10.1093/schbul/19.1.85 · Cited by 201
Sawaguchi, T., Matsumura, M., & Kubota, K. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.6.1401 · Cited by 195
The predictive brain: temporal coincidence and temporal order in synaptic learning mechanisms.
Montague, P. R., & Sejnowski, T. J. (1994) · Learning & Memory · doi:10.1101/lm.1.1.1 · Cited by 185
Activity of dopamine neurons in the behaving primate
Schultz, W. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90011-p · Cited by 178
Modeling some effects of frontal lobe damage—Novelty and perseveration
Levine, D. S., & Prueitt, P. S. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90027-0 · Cited by 162
Toward a Theory of Information Processing in Graded, Random, and Interactive Networks
McClelland, J. L. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/1477.003.0039 · Cited by 132
Progress in the Use of Interactive Models for Understanding Attention and Performance
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/1478.003.0026 · Cited by 117
The Mechanism of the Brain and the Function of the Frontal Lobes.
Bianchi, L. (1922) · JAMA · doi:10.1001/jama.1922.02640130063034 · Cited by 114
Moody, S. L., Wise, S. P., di Pellegrino, G., & Zipser, D. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-01-00399.1998 · Cited by 99
Law-Tho, D., Desce, J. M., & Crépel, F. (1995) · Neuroscience Letters · doi:10.1016/0304-3940(95)11414-r · Cited by 93
Neural Correlates of Learning in the Prefrontal Cortex of the Monkey: A Predictive Model
Guigon, E., Dorizzi, B., Burnod, Y., & Schultz, W. (1995) · Cerebral Cortex · doi:10.1093/cercor/5.2.135 · Cited by 52
A Computational Model of Prefrontal Cortex Function
Braver, T. S., Cohen, J. D., & Servan‐Schreiber, D. (1994) · neural information processing systems · Cited by 41
Braver, T. S., Cohen, J. D., & Servan‐Schreiber, D. (1995) · Schizophrenia Research · doi:10.1016/0920-9964(95)95338-a · Cited by 8
Cited by
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Updating P300: An integrative theory of P3a and P3b
Polich, J. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.019 · Cited by 7,919
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
The variable nature of cognitive control: a dual mechanisms framework
Braver, T. S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.010 · Cited by 2,482
Kane, M. J., & Engle, R. W. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196323 · Cited by 2,229
Metadata
- Venue
- Control of Cognitive Processes
- Publisher
- The MIT Press
- Published
- 2000-10-23
- Pages
- 713-738
- OpenAlex
- W157262510
- Cited by
- 416
- References
- 48
- FWCI
- 5.56
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.