The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Neural population geometry: An approach for understanding biological and artificial neural networks
Open accessAbstract
Advances in experimental neuroscience have transformed our ability to explore the structure and function of neural circuits. At the same time, advances in machine learning have unleashed the remarkable computational power of artificial neural networks (ANNs). While these two fields have different tools and applications, they present a similar challenge: namely, understanding how information is embedded and processed through high-dimensional representations to solve complex tasks. One approach to addressing this challenge is to utilize mathematical and computational tools to analyze the geometry of these high-dimensional representations, i.e., neural population geometry. We review examples of geometrical approaches providing insight into the function of biological and artificial neural networks: representation untangling in perception, a geometric theory of classification capacity, disentanglement, and abstraction in cognitive systems, topological representations underlying cognitive maps, dynamic untangling in motor systems, and a dynamical approach to cognition. Together, these findings illustrate an exciting trend at the intersection of machine learning, neuroscience, and geometry, in which neural population geometry provides a useful population-level mechanistic descriptor underlying task implementation. Importantly, geometric descriptions are applicable across sensory modalities, brain regions, network architectures, and timescales. Thus, neural population geometry has the potential to unify our understanding of structure and function in biological and artificial neural networks, bridging the gap between single neurons, population activities, and behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2008) · Journal of Machine Learning Research · Cited by 33,051
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“There is a long history of relating dynamic motifs in recurrent networks to cognitive functions: fixed points and memory [52,53], line attractors and integration [54], and limit cycles with various neuronal oscillation patterns [55].”
BackgroundNonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Fully integrated silicon probes for high-density recording of neural activity
Jun, J. J., Steinmetz, N. A., Siegle, J. H., Denman, D. J., Bauza, M., Barbarits, B., Lee, A. K., Anastassiou, C. A., Andrei, A., Aydın, Ç., et al. (2017) · Nature · doi:10.1038/nature24636 · Cited by 2,190
Cover, T. M. (1965) · IEEE Transactions on Electronic Computers · doi:10.1109/pgec.1965.264137 · Cited by 2,044
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Context-dependent computation by recurrent dynamics in prefrontal cortex
Mante, V., Sussillo, D., Shenoy, K. V., & Newsome, W. T. (2013) · Nature · doi:10.1038/nature12742 · Cited by 1,847
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · cited 1×
“Approaches focused on studying geometric properties of these manifolds are becoming more widely used as advances in experimental neuroscience expand our ability to probe large neural populations [14], and advances in ANNs [15,16] introduce new challenges of interpretation.”
BackgroundThe importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093
The space of interactions in neural network models
Gardner, E. (1988) · Journal of Physics A: Mathematical and General · doi:10.1088/0305-4470/21/1/030 · Cited by 1,047
Untangling invariant object recognition
DiCarlo, J. J., & Cox, D. D. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.06.010 · Cited by 959
The Isomap Algorithm and Topological Stability
Balasubramanian, M., & Schwartz, E. L. (2002) · Science · doi:10.1126/science.295.5552.7a · Cited by 839
Cortical Control of Arm Movements: A Dynamical Systems Perspective
Shenoy, K. V., Sahani, M., & Churchland, M. M. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150509 · Cited by 839
The Manifold Ways of Perception
Seung, H. S., & Lee, D. D. (2000) · Science · doi:10.1126/science.290.5500.2268 · Cited by 811
From the neuron doctrine to neural networks
Yuste, R. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3962 · Cited by 754
Neural constraints on learning
Sadtler, P. T., Quick, K. M., Golub, M. D., Chase, S. M., Ryu, S. I., Tyler-Kabara, E. C., Yu, B. M., & Batista, A. P. (2014) · Nature · doi:10.1038/nature13665 · Cited by 713
Neural Manifolds for the Control of Movement
Gallego, J. A., Perich, M. G., Miller, L. E., & Solla, S. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.05.025 · Cited by 674
Simple models for reading neuronal population codes.
Seung, H. S., & Sompolinsky, H. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.22.10749 · Cited by 603
High-dimensional geometry of population responses in visual cortex
Stringer, C., Pachitariu, M., Steinmetz, N., Carandini, M., & Harris, K. D. (2019) · Nature · doi:10.1038/s41586-019-1346-5 · Cited by 594
Histology of the nervous system of man and vertebrates
y Cajal, S. R. (1995) · Cited by 553
Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V., & McDermott, J. H. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.044 · Cited by 544
How the brain keeps the eyes still
Seung, H. S. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.13339 · Cited by 534
Neural theory of association and concept-formation
Amari, S.-I. (1977) · Biological Cybernetics · doi:10.1007/bf00365229 · Cited by 500
The Geometry of Abstraction in the Hippocampus and Prefrontal Cortex
Bernardi, S., Benna, M. K., Rigotti, M., Munuera, J., Fusi, S., & Salzman, C. D. (2020) · Cell · doi:10.1016/j.cell.2020.09.031 · Cited by 489
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
Clique topology reveals intrinsic geometric structure in neural correlations
Giusti, C., Pastalkova, E., Curto, C., & Itskov, V. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1506407112 · Cited by 381
Chaudhuri, R., Gerçek, B., Pandey, B., Peyrache, A., & Fiete, I. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0460-x · Cited by 373
Mutual Information, Fisher Information, and Population Coding
Brunel, N., & Nadal, J.-P. (1998) · Neural Computation · doi:10.1162/089976698300017115 · Cited by 350
Cortical population activity within a preserved neural manifold underlies multiple motor behaviors
Gallego, J. A., Perich, M. G., Naufel, S. N., Ethier, C., Solla, S. A., & Miller, L. E. (2018) · Nature Communications · doi:10.1038/s41467-018-06560-z · Cited by 345
Geometry of abstract learned knowledge in the hippocampus
Nieh, E. H., Schottdorf, M., Freeman, N. W., Low, R. J., Lewallen, S., Koay, S. A., Pinto, L., Gauthier, J. L., Brody, C. D., & Tank, D. W. (2021) · Nature · doi:10.1038/s41586-021-03652-7 · Cited by 331
Towards the neural population doctrine
Saxena, S., & Cunningham, J. P. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.02.002 · Cited by 321
Symmetry and phaselocking in chains of weakly coupled oscillators
Kopell, N., & Ermentrout, G. B. (1986) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160390504 · Cited by 315
Motor Cortex Embeds Muscle-like Commands in an Untangled Population Response
Russo, A. A., Bittner, S. R., Perkins, S. M., Seely, J. S., London, B. M., Lara, A. H., Miri, A., Marshall, N. J., Kohn, A., Jessell, T. M., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.004 · Cited by 311
Self-citationObservations on the scratch‐reflex in the spinal dog
Sherrington, C. S. (1906) · The Journal of Physiology · doi:10.1113/jphysiol.1906.sp001139 · Cited by 291
Bayesian Computation through Cortical Latent Dynamics
Sohn, H., Narain, D., Meirhaeghe, N., & Jazayeri, M. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.012 · Cited by 231
Navigating the Neural Space in Search of the Neural Code
Jazayeri, M., & Afraz, A. (2017) · Neuron · doi:10.1016/j.neuron.2017.02.019 · Cited by 228
Classification and Geometry of General Perceptual Manifolds
Chung, S., Lee, D. D., & Sompolinsky, H. (2018) · Physical Review X · doi:10.1103/physrevx.8.031003 · Cited by 223
Self-citationJazayeri, M., & Ostojic, S. (2021) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2021.08.002 · Cited by 196
Separability and geometry of object manifolds in deep neural networks
Cohen, U., Chung, S., Lee, D. D., & Sompolinsky, H. (2020) · Nature Communications · doi:10.1038/s41467-020-14578-5 · Cited by 188
Self-citationRusso, A. A., Khajeh, R., Bittner, S. R., Perkins, S. M., Cunningham, J. P., Abbott, L. F., & Churchland, M. M. (2020) · Neuron · doi:10.1016/j.neuron.2020.05.020 · Cited by 158
Self-citationThe neural architecture of language: Integrative modeling converges on predictive processing
(2020) · doi:10.1101/2020.06.26.174482 · Cited by 129
Analyzing biological and artificial neural networks: challenges with opportunities for synergy?
Barrett, D. G. T., Morcos, A. S., & Macke, J. H. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.01.007 · Cited by 127
Perceptual straightening of natural videos
Hénaff, O. J., Goris, R. L. T., & Simoncelli, E. P. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0377-4 · Cited by 126
Reconceiving the hippocampal map as a topological template
Dabaghian, Y. A., Brandt, V. L., & Frank, L. M. (2014) · eLife · doi:10.7554/elife.03476 · Cited by 124
Representational geometry of perceptual decisions in the monkey parietal cortex
Okazawa, G., Hatch, C. E., Mancoo, A., Machens, C. K., & Kiani, R. (2021) · Cell · doi:10.1016/j.cell.2021.05.022 · Cited by 124
Eichenbaum, H. (2017) · Neuroscience Letters · doi:10.1016/j.neulet.2017.04.006 · Cited by 113
Probing variability in a cognitive map using manifold inference from neural dynamicsPreprint
Low, R. J., Lewallen, S., Aronov, D., Nevers, R., & Tank, D. W. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/418939 · Cited by 80
Geometry of neural computation unifies working memory and planning
Ehrlich, D. B., & Murray, J. D. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2115610119 · Cited by 51
Object manifold geometry across the mouse cortical visual hierarchyPreprint
Froudarakis, E., Cohen, U., Diamantaki, M., Patel, S. S., Tan, Z., Muhammad, T., Walker, E. Y., Reimer, J., Berens, P., Sompolinsky, H., et al. (2020) · eLife · doi:10.1101/2020.08.20.258798 · Cited by 49
Linear readout of object manifolds
Chung, S., Lee, D. D., & Sompolinsky, H. (2016) · Physical review. E · doi:10.1103/physreve.93.060301 · Cited by 41
Self-citationUntangling in Invariant Speech RecognitionPreprint
Stephenson, C., Feather, J., Padhy, S., Elibol, O. H., Tang, H., McDermott, J. H., & Chung, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01787 · Cited by 38
Self-citationVisualizing the PHATE of Neural NetworksPreprint
Gigante, S., Charles, A. S., Krishnaswamy, S., & Mishne, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.02831 · Cited by 35
State-dependent geometry of population activity in rat auditory cortex
Kobak, D., Pardo‐Vázquez, J. L., Valente, M., Machens, C. K., & Renart, A. (2019) · eLife · doi:10.7554/elife.44526 · Cited by 27
Cited by
Abstract representations emerge naturally in neural networks trained to perform multiple tasks
Johnston, W. J., & Fusi, S. (2023) · Nature Communications · doi:10.1038/s41467-023-36583-0 · Cited by 89
Goldstein, A., Grinstein-Dabush, A., Schain, M., Wang, H., Hong, Z., Aubrey, B., Nastase, S. A., Zada, Z., Ham, E., Feder, A., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-46631-y · Cited by 64
Geometric transformation of cognitive maps for generalization across hippocampal-prefrontal circuits
Tang, W., Shin, J. D., & Jadhav, S. P. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.112246 · Cited by 59
Circuit mechanisms for disentangled representations and generalization in the hippocampus
Tang, W., Chang, H., Liu, C., Perez-Hernandez, S., Zheng, W. Y., Park, J., Karaba, L. A., Oliva, A., & Fernandez-Ruiz, A. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02491-x
Metadata
- Authors
- Chung, S., & Abbott, L. F.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2021-10
- Volume
- 70
- Pages
- 137-144
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W3154632195
- Cited by
- 270
- References
- 58
- FWCI
- 3.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.