Recurrent network models of sequence generation and memory
Open accessAbstract
Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here we demonstrate that, starting from random connectivity and modifying a small fraction of connections, a largely disordered recurrent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network Training (PINning), to model and match cellular resolution imaging data from the posterior parietal cortex during a virtual memory-guided two-alternative forced-choice task. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This has already been done to aid the interpretation of the neural dynamics underlying decision making in the PFC, working memory in the posterior parietal cortex, and object or action representation in the visual system.
“This has already been done to aid the interpretation of the neural dynamics underlying decision making in the PFC (Sussillo, 2014), working memory in the posterior parietal cortex (Rajan et al., 2016) and object or action representation in the visual system (Tacchetti et al., 2016; Yamins and DiCarlo, 2016a,b).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Rajan et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 84 · Cited by 351
Research works printed but not linked: 1
- Jaeger H Becker S Thrun S Obermayer K Adaptive nonlinear system identification with echo state networks Advances in Neural Information Processing Systems 2003 15 Cambridge MA MIT Press 593 600
- Authors
- Rajan, K., Harvey, C. D., & Tank, D. W.
- Affiliations
- Princeton University (US)
- Harvard University (US)
- Corresponding author
- Rajan, Kanaka
- Harvey, Christopher D.
- Tank, David W.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2016-04
- Volume
- 90
- Issue
- 1
- Pages
- 128-142
- ISSN
- 0896-6273 (ISSN-L)
- PMC
- PMC4824643
- OpenAlex
- W2295845209
- Cited by
- 351
- References
- 84
- Citations by year
- 2026: 28 · 2025: 33 · 2024: 34 · 2023: 29 · 2022: 34 · 2021: 43 · 2020: 34 · 2019: 40 · 2018: 30 · 2017: 33 · 2016: 12 · 2015: 1
- FWCI
- 24.15
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Institutes of Health (5r01mh083686-10)
- National Institute of Mental Health (R01MH107620, R01-MH083686)
- National Institute of Neurological Disorders and Stroke (U01NS090541, R01NS089521, RC1NS068148)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- recurrent neural networks, neural sequences, working memory, random connectivity, posterior parietal cortex, two-alternative forced-choice task, cellular resolution imaging, synaptic interactions, memory-guided behavior
- MeSH terms
- Algorithms, Animals, Choice Behavior, Decision Making, Memory, Short-Term, Models, Neurological, Neural Pathways, Neurons, Parietal Lobe, Mice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review