The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks
Open accessAbstract
Large-scale neural recordings have established that the transformation of sensory stimuli into motor outputs relies on low-dimensional dynamics at the population level, while individual neurons exhibit complex selectivity. Understanding how low-dimensional computations on mixed, distributed representations emerge from the structure of the recurrent connectivity and inputs to cortical networks is a major challenge. Here, we study a class of recurrent network models in which the connectivity is a sum of a random part and a minimal, low-dimensional structure. We show that, in such networks, the dynamics are low dimensional and can be directly inferred from connectivity using a geometrical approach. We exploit this understanding to determine minimal connectivity required to implement specific computations and find that the dynamical range and computational capacity quickly increase with the dimensionality of the connectivity structure. This framework produces testable experimental predictions for the relationship between connectivity, low-dimensional dynamics, and computational features of recorded neurons.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Shadlen, M. N., & Newsome, W. T. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03870.1998 · Cited by 2,178
Context-dependent computation by recurrent dynamics in prefrontal cortex
Mante, V., Sussillo, D., Shenoy, K. V., & Newsome, W. T. (2013) · Nature · doi:10.1038/nature12742 · Cited by 1,847
Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity
van Vreeswijk, C., & Sompolinsky, H. (1996) · Science · doi:10.1126/science.274.5293.1724 · Cited by 1,811
Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons
Brunel, N. (2000) · Journal of Computational Neuroscience · doi:10.1023/a:1008925309027 · Cited by 1,726
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Probabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Dimensionality reduction for large-scale neural recordings
Cunningham, J. P., & Yu, B. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3776 · Cited by 1,219
Neuronal correlates of a perceptual decision
Newsome, W. T., Britten, K. H., & Movshon, J. A. (1989) · Nature · doi:10.1038/341052a0 · Cited by 1,177
Generating Coherent Patterns of Activity from Chaotic Neural Networks
Sussillo, D., & Abbott, L. F. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.018 · Cited by 1,092
Theory of orientation tuning in visual cortex.
Ben-Yishai, R., Bar-Or, R. L., & Sompolinsky, H. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.9.3844 · Cited by 1,086
Stimulus onset quenches neural variability: A widespread cortical phenomenon
Churchland, M. M., Yu, B. M., Cunningham, J. P., Sugrue, L. P., Cohen, M. R., Corrado, G. S., Newsome, W. T., Clark, A. M., Hosseini, P., Scott, B. B., et al. (2010) · Nature Neuroscience · doi:10.1038/nn.2501 · Cited by 1,084
Chaos in random neural networks
Sompolinsky, H., Crisanti, A., & Sommers, H. J. (1988) · Physical Review Letters · doi:10.1103/physrevlett.61.259 · Cited by 1,061
Amit, D. (1997) · Cerebral Cortex · doi:10.1093/cercor/7.3.237 · Cited by 1,059
Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural Networks
Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1985) · Physical Review Letters · doi:10.1103/physrevlett.55.1530 · Cited by 1,058
Kanerva, P. (2009) · Cognitive Computation · doi:10.1007/s12559-009-9009-8 · Cited by 970
Functional specificity of local synaptic connections in neocortical networks
Ko, H., Hofer, S. B., Pichler, B., Buchanan, K. A., Sjöström, P. J., & Mrsic-Flogel, T. D. (2011) · Nature · doi:10.1038/nature09880 · Cited by 857
Why neurons mix: high dimensionality for higher cognition
Fusi, S., Miller, E. K., & Rigotti, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.01.010 · Cited by 766
Cortical connectivity and sensory coding
Harris, K. D., & Mrsic-Flogel, T. D. (2013) · Nature · doi:10.1038/nature12654 · Cited by 651
Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks
Sussillo, D., & Barak, O. (2013) · Neural Computation · doi:10.1162/neco_a_00409 · Cited by 575
Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems
(2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.826381 · Cited by 543
Slow dynamics and high variability in balanced cortical networks with clustered connections
Litwin-Kumar, A., & Doiron, B. (2012) · Nature Neuroscience · doi:10.1038/nn.3220 · Cited by 539
Learning Recurrent Neural Networks with Hessian-Free Optimization
Martens, J., & Sutskever, I. (2011) · International Conference on Machine Learning · Cited by 525
Flexible timing by temporal scaling of cortical responses
Wang, J., Narain, D., Hosseini, E. A., & Jazayeri, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-017-0028-6 · Cited by 443
On simplicity and complexity in the brave new world of large-scale neuroscience
Gao, P., & Ganguli, S. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.04.003 · Cited by 405
Neural engineering: Computation, representation, and dynamics in neurobiological systems
(2003) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(03)90181-7 · Cited by 399
Temporal Complexity and Heterogeneity of Single-Neuron Activity in Premotor and Motor Cortex
Churchland, M. M., & Shenoy, K. V. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00095.2007 · Cited by 356 · cited 3×
“Actual cortical connectivity appears to be neither fully random nor fully structured (Harris and Mrsic-Flogel, 2013), and the activity of individual neurons displays a similar mixture of stereotypy and disorder (Rigotti et al., 2013; Mante et al., 2013; Churchland and Shenoy, 2007).”
Eigenvalue Spectra of Random Matrices for Neural Networks
Rajan, K., & Abbott, L. F. (2006) · Physical Review Letters · doi:10.1103/physrevlett.97.188104 · Cited by 320
Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons
Ostojic, S. (2014) · Nature Neuroscience · doi:10.1038/nn.3658 · Cited by 303
Self-citationGirko, V. L. (1985) · Theory of Probability & Its Applications · doi:10.1137/1129095 · Cited by 292
Stimulus-dependent suppression of chaos in recurrent neural networks
Rajan, K., Abbott, L. F., & Sompolinsky, H. (2010) · Physical Review E · doi:10.1103/physreve.82.011903 · Cited by 279
Flexible Sensorimotor Computations through Rapid Reconfiguration of Cortical Dynamics
Remington, E. D., Narain, D., Hosseini, E. A., & Jazayeri, M. (2018) · Neuron · doi:10.1016/j.neuron.2018.05.020 · Cited by 269
Predictive Coding of Dynamical Variables in Balanced Spiking Networks
Boerlin, M., Machens, C. K., & Denève, S. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003258 · Cited by 266
Functional, But Not Anatomical, Separation of “What” and “When” in Prefrontal Cortex
Machens, C. K., Romo, R., & Brody, C. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3276-09.2010 · Cited by 260
Neural circuits as computational dynamical systems
Sussillo, D. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.01.008 · Cited by 247
Recurrent neural networks as versatile tools of neuroscience research
Barak, O. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.06.003 · Cited by 244
Computational Aspects of Feedback in Neural Circuits
Maass, W., Joshi, P., & Sontag, E. D. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020165 · Cited by 242
Rigotti, M. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00024 · Cited by 184
Abstract context representations in primate amygdala and prefrontal cortex
Saez, A., Rigotti, M., Ostojic, S., Fusi, S., & Salzman, C. D. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.024 · Cited by 183
Self-citationOutliers in the spectrum of iid matrices with bounded rank perturbations
Tao, T. (2013) · Probability Theory and Related Fields · doi:10.1007/s00440-011-0397-9 · Cited by 158
Transition to Chaos in Random Networks with Cell-Type-Specific Connectivity
Aljadeff, J., Stern, M., & Sharpee, T. O. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.088101 · Cited by 151
Asynchronous Rate Chaos in Spiking Neuronal Circuits
Harish, O., & Hansel, D. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004266 · Cited by 120
Roudi, Y., & Latham, P. E. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030141 · Cited by 115
Shiino, M., & Fukai, T. (1993) · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · doi:10.1103/physreve.48.867 · Cited by 111
Properties of networks with partially structured and partially random connectivity
Ahmadian, Y., Fumarola, F., & Miller, K. D. (2015) · Physical Review E · doi:10.1103/physreve.91.012820 · Cited by 105
Scaling Properties of Dimensionality Reduction for Neural Populations and Network Models
Williamson, R. C., Cowley, B. R., Litwin-Kumar, A., Doiron, B., Kohn, A., Smith, M. A., & Yu, B. M. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005141 · Cited by 102
Learning Universal Computations with Spikes
Thalmeier, D., Uhlmann, M., Kappen, H. J., & Memmesheimer, R.-M. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004895 · Cited by 90
Intrinsically-generated fluctuating activity in excitatory-inhibitory networks
Mastrogiuseppe, F., & Ostojic, S. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005498 · Cited by 85
Self-citationLocal Dynamics in Trained Recurrent Neural Networks
Rivkind, A., & Barak, O. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.258101 · Cited by 72
Balanced neural architecture and the idling brain
Doiron, B., & Litwin-Kumar, A. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00056 · Cited by 44
Chaos in Highly Diluted Neural Networks
Tirozzi, B., & Tsodyks, M. V. (1991) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/14/8/001 · Cited by 39
Cited by
Long-term stability of cortical population dynamics underlying consistent behavior
Gallego, J. A., Perich, M. G., Chowdhury, R. H., Solla, S. A., & Miller, L. E. (2020) · Nature Neuroscience · doi:10.1038/s41593-019-0555-4 · Cited by 405
Artificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
Large-scale neural recordings call for new insights to link brain and behavior
Urai, A. E., Doiron, B., Leifer, A. M., & Churchland, A. K. (2022) · Nature Neuroscience · doi:10.1038/s41593-021-00980-9 · Cited by 328
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
The role of population structure in computations through neural dynamics
Dubreuil, A., Valente, A., Beiran, M., Mastrogiuseppe, F., & Ostojic, S. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01088-4 · Cited by 237
Self-citation
Metadata
- Authors
- Mastrogiuseppe, F., & Ostojic, S.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 99
- Issue
- 3
- Pages
- 609-623.e29
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2883380036
- Cited by
- 391
- References
- 53
- FWCI
- 13.83
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.