Bilinearity, rules, and prefrontal cortex
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Humans can be instructed verbally to perform computationally complex cognitive tasks; their performance then improves relatively slowly over the course of practice. Many skills underlie these abilities; in this paper, we focus on the particular question of a uniform architecture for the instantiation of habitual performance and the storage, recall, and execution of simple rules. Our account builds on models of gated working memory, and involves a bilinear architecture for representing conditional input-output maps and for matching rules to the state of the input and working memory. We demonstrate the performance of our model on two paradigmatic tasks used to investigate prefrontal and basal ganglia function.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 2×
“Both triples and rules are implemented using random distributed (binary) representations, and rule matching, which could also perform a primitive form of unification, involves an operation similar to that in our associative memory, namely settling in a Hopfield network (Hopfield, 1982) or Boltzmann machine (Hinton and…”
BackgroundMethodRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 2×
“…system maps to in input space; bottom-up connections an analytical or recognition model (Dayan et al., 1995; Hinton and Zemel, 1994; Hinton et al., 1995; Mumford, 1994; Neisser, 1967; Rao and Ballard, 1999), which implements the possibly complex map from a new input into its underlying coordinates.”
BackgroundEpisodic memory: from mind to brain
Tulving, E. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135114 · Cited by 4,950 · cited 1×
“Of course, other features associated with episodic memory, such as the notion of mental time travel (Tulving, 2002), and the explicit storage of substantial context surrounding a memory, are of less importance for rules.”
BackgroundAcquisition of cognitive skill
Anderson, J. R. (1982) · Psychological Review · doi:10.1037/0033-295x.89.4.369 · Cited by 3,663 · cited 3×
“The 12AX task has more complex temporal dependencies, and so this is more challenging.”
BackgroundMethodN-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies.
Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005) · Human Brain Mapping · doi:10.1002/hbm.20131 · Cited by 3,560
Toward an instance theory of automatization.
Logan, G. D. (1988) · Psychological Review · doi:10.1037/0033-295x.95.4.492 · Cited by 3,466 · cited 4×
“, Bunge, 2004), and act according to a mixture of the output of this forward-model system and a more slowly trained, automatized, habitual control system (e.g., Anderson, 1982; Daw et al., 2005; Dickinson, 1985; Logan, 1988; Sloman, 1996).”
BackgroundMethodInfluentialCellular basis of working memory
Goldman-Rakic, P. S. (1995) · Neuron · doi:10.1016/0896-6273(95)90304-6 · Cited by 2,663
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 5×
“To use terminology borrowed from conditioning (Daw et al., 2005; Dickinson, 1985), the extensive training may be building a habit, or a collection thereof; by comparison, humans can presumably use rules more akin to a forward-model of the task (e.g., Bunge, 2004), and act according to a mixture of…”
BackgroundMethodInfluentialSelf-citationBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Temporal dynamics of brain activation during a working memory task
Cohen, J. D., Perlstein, W. M., Braver, T. S., Nystrom, L. E., Noll, D. C., Jonides, J., & Smith, E. E. (1997) · Nature · doi:10.1038/386604a0 · Cited by 1,876 · cited 2×
“…published psychological or functional neuro-imaging test of the 12AX task, it is a variant of the N-back working memory task (Braver et al., 2001; Cohen et al., 1997; Gevins and Cutillo, 1993; Rowe et al., 2000), which, along with other areas, is known to involve various prefrontal regions (see…”
BackgroundOptimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 1×
“This approach has been considered in the domain of motor control (e.g., Sanger, 1995; Todorov, 2004), and has obvious application to cognitive control too.”
BackgroundModulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 4×
“The first is the extensive line of work into the psychological and neural substrates of complex tasks that are putatively dependent on extensive regions of prefrontal cortex (Badre and D’Esposito, 2007; Brass and von Cramon, 2002, 2004; Bunge, 2004; Christoff and Gabrieli, 2000; Cohen et al., 1996; Cooper and Shallice…”
BackgroundInfluentialProbabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationAn information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183 · cited 4×
“We model two cases—first, one of the conditional input-output tasks that Koechlin et al. (2003) and Koechlin and Summerfield (2007) used to investigate an apparent hierarchy of control structures in extensive regions of lateral prefrontal cortex; and second, the conditional one-back 12AX task…”
BackgroundMethodInfluentialThe "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Self-citationPsychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051
Learning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
Badre, D., Poldrack, R. A., Paré-Blagoev, E. J., Insler, R. Z., & Wagner, A. D. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.023 · Cited by 914 · cited 2×
“…and modeling how subjects perform a range of tasks that pose graded computational challenges with respect to conditional input-output mappings (Badre et al., 2005; Badre and D’Esposito, 2007; Boettiger and D’Esposito, 2005; Fusi et al., 2007; Koechlin et al., 2003; Koechlin and Summerfield,…”
BackgroundOlshausen, B., Anderson, C., & Van Essen, D. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-11-04700.1993 · Cited by 908
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879 · cited 19×
“The output includes actions with external consequences, such as pressing a left or right lever, and ones with internal consequences, such as reading or gating (Frank et al., 2001) the current sensory observation into working memory, or indeed clearing some element of working memory.”
BackgroundMethodInfluentialSeparating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840 · cited 3×
“However, as also implied in the work of Dayan (2006) and Tenenbaum and Freeman (2000), we suggest that this abstraction is useful, since it allows us to focus on the relationship between rules and habits, and, in the longer run, to consider the status of rules with respect to the overall…”
BackgroundMethodHuman prefrontal cortex: processing and representational perspectives
Wood, J. N., & Grafman, J. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1033 · Cited by 721 · cited 2×
“The first is the extensive line of work into the psychological and neural substrates of complex tasks that are putatively dependent on extensive regions of prefrontal cortex (Badre and D’Esposito, 2007; Brass and von Cramon, 2002, 2004; Bunge, 2004; Christoff and Gabrieli, 2000; Cohen et al., 1996; Cooper and Shallice…”
BackgroundDifferent time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 2×
“, 2007) of a particular, influential conditional visuo-motor task that has been administered to monkeys (Pasupathy and Miller, 2005).”
BackgroundBadre, D., & D'Esposito, M. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.2082 · Cited by 615
Cohen, J. D., Braver, T. S., & O´Reilly, R. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0138 · Cited by 487 · cited 4×
“Building on the ideas of Hochreiter and Schmidhuber (1997), PBWM suggests that key to the use of working memory is the non-linear operation of gating (Braver and Cohen, 2000; Cohen et al., 1996; Frank et al., 2001); namely that corticostriato-thalamo-cortical loops (Alexander and Crutcher, 1990) would allow cortical (…”
BackgroundInfluentialBanishing the homunculus: Making working memory work
Hazy, T. E., Frank, M. J., & O’Reilly, R. C. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.04.067 · Cited by 385 · cited 4×
“…weights effectively by hand (a tactic we also borrow) to show that their overall model could support the computations required for the 12AX task; they later considered how such weights could emerge through on-line learning (Hazy et al., 2006, 2007; O’Reilly and Frank, 2006; O’Reilly et al., 2007).”
BackgroundMethodInfluentialPersistent neural activity: prevalence and mechanisms
Major, G., & Tank, D. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.017 · Cited by 320
Decomposing components of task preparation with functional magnetic resonance imaging.
Brass, M., & Cramon, D. Y. V. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904323057335 · Cited by 302
Fusi, S., Asaad, W. F., Miller, E. K., & Wang, X.-J. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.017 · Cited by 199 · cited 6×
“It has also led to a more complete model (Fusi et al., 2007) of a particular, influential conditional visuo-motor task that has been administered to monkeys (Pasupathy and Miller, 2005).”
BackgroundMethodInfluential
Cited by
Is the rostro-caudal axis of the frontal lobe hierarchical?
Badre, D., & D'Esposito, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2667 · Cited by 946
Learning latent structure: carving nature at its joints
Gershman, S. J., & Niv, Y. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.008 · Cited by 326
“Other recent variants of the gating framework have explored how it can support performance in a variety of complex tasks [37, 46], but direct experimental evidence supporting its central claims remains scant.”
BackgroundThe Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers
Botvinick, M. M., & Cohen, J. D. (2014) · Cognitive Science · doi:10.1111/cogs.12126 · Cited by 322
Rigotti, M. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00024 · Cited by 184
Teixeira da Silva, J. A., & Dobránszki, J. (2015) · Accountability in Research · doi:10.1080/08989621.2014.899909 · Cited by 158
Metadata
- Authors
- Dayan, P.
- Venue
- Frontiers in Computational Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2007
- Volume
- 1
- Pages
- 1-1
- ISSN
- 1662-5188 (ISSN-L)
- OpenAlex
- W1968491104
- Cited by
- 65
- References
- 32
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.