Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
An emerging paradigm proposes that neural computations can be understood at the level of dynamic systems that govern low-dimensional trajectories of collective neural activity. How the connectivity structure of a network determines the emergent dynamical system, however, remains to be clarified. Here we consider a novel class of models, gaussian-mixture, low-rank recurrent networks in which the rank of the connectivity matrix and the number of statistically defined populations are independent hyperparameters. We show that the resulting collective dynamics form a dynamical system, where the rank sets the dimensionality and the population structure shapes the dynamics. In particular, the collective dynamics can be described in terms of a simplified effective circuit of interacting latent variables. While having a single global population strongly restricts the possible dynamics, we demonstrate that if the number of populations is large enough, a rank R network can approximate any R-dimensional dynamical system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When RNN architecture is explicitly designed to include dedicated neural subpopulations, these subpopulations can improve model performance on particular types of tasks (Beiran et al., 2021; Dubreuil et al., 2022).”
From Remapping in a recurrent neural network model of navigation and context inference (2023) · cites this paper as Beiran et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 4
- Dubreuil, A., Valente, A., Beiran, M., Mastrogiuseppe, F., and Ostojic, S. (2020). Complementary roles of dimensionality and population structure in neural computations. bioRxiv , page 2020.07.03.185942.
- Eliasmith, C. and Anderson, C. H. C. H. (2003). Neural engineering : computation, representation, and dynamics in neurobiological systems . MIT Press.
- Nakatsukasa, Y. (2019). The low-rank eigenvalue problem. arXiv , page 1905.11490.
- Schuessler, F., Mastrogiuseppe, F., Dubreuil, A., Ostojic, S., and Barak, O. (2020b). The interplay between randomness and structure during learning in RNNs. arXiv , page 2006.11036.
Cited by
The role of population structure in computations through neural dynamics
Dubreuil, A., Valente, A., Beiran, M., Mastrogiuseppe, F., & Ostojic, S. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01088-4 · Cited by 237
“(36)); the dashed line shows the total input, which changes signs between the two contexts, leading to opposite responses.”
BackgroundSelf-citationFlexible multitask computation in recurrent networks utilizes shared dynamical motifs
Driscoll, L., Shenoy, K., & Sussillo, D. (2022) · doi:10.1101/2022.08.15.503870 · Cited by 217
“Recent work on subpopulation structure for the implementation of multiple complex tasks provides insight for these findings 21,29 .”
BackgroundFlexible multitask computation in recurrent networks utilizes shared dynamical motifs
Driscoll, L. N., Shenoy, K., & Sussillo, D. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01668-6 · Cited by 214
“…the all-to-all connectivity possible in our networks as well as the fact that no regularizations or constraints to induce modularity were employed in the training of the RNNs. Recent work on subpopulation structure for the implementation of multiple tasks provides insight for these findings 22,33 .”
Jazayeri, M., & Ostojic, S. (2021) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2021.08.002 · Cited by 196
“Remarkably, these latent dynamics can be represented in terms of effective circuits that describe how incoming sensory latent variables interact with internally generated latent variables [86].”
BackgroundSelf-citationThe low-rank hypothesis of complex systems
Thibeault, V., Allard, A., & Desrosiers, P. (2024) · Nature Physics · doi:10.1038/s41567-023-02303-0 · Cited by 148
“Despite its frequent use—often implicit, but sometimes very explicit 35,36 —the low-rank hypothesis has yet to be verified experimentally for real networks in all their diversity.”
Metadata
- Authors
- Beiran, M., Dubreuil, A., Valente, A., Mastrogiuseppe, F., & Ostojic, S.
- Affiliations
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France manuel.beiran@ens.fr
- Inserm (FR)
- Gatsby Computational Neuroscience Unit (GB)
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2021-05-13
- Volume
- 33
- Issue
- 6
- Pages
- 1572-1615
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W3039250185
- Cited by
- 92
- References
- 0
- Citations by year
- 2026: 22 · 2025: 21 · 2024: 15 · 2023: 16 · 2022: 10 · 2021: 6
- FWCI
- 6.17
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- SDL (submittedVersion, other-oa)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Agence Nationale de la Recherche (ANR-17-EURE-0017, ANR-16-CE37-0016)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Nonlinear Dynamics and Pattern Formation
- Keywords
- Gaussian mixture model, population structure, latent variables, dynamical systems, network connectivity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks. https://app.cochat.ai/papers/10.1162/neco_a_01381
- The paper
- Beiran, M., Dubreuil, A., Valente, A., Mastrogiuseppe, F., & Ostojic, S. (2021). Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks. Neural Computation. https://doi.org/10.1162/neco_a_01381
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.