Universal dimensions of visual representation
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Do visual neural networks learn brain-aligned representations because they share architectural constraints and task objectives with biological vision or because they share universal features of natural image processing? We characterized the universality of hundreds of thousands of representational dimensions from networks with different architectures, tasks, and training data. We found that diverse networks learn to represent natural images using a shared set of latent dimensions, despite having highly distinct designs. Next, by comparing these networks with human brain representations measured with functional magnetic resonance imaging, we found that the most brain-aligned representations in neural networks are those that are universal and independent of a network’s specific characteristics. Each network can be reduced to fewer than 10 of its most universal dimensions with little impact on its representational similarity to the brain. These results suggest that the underlying similarities between artificial and biological vision are primarily governed by a core set of universal representations that are convergently learned by diverse systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These empirical findings have led to the theoretical proposal of representational Universality: different information-processing systems (ANNs and brains) all converge upon the same shared representational structures because there exist ‘general-purpose dimensions that have little to do with the details of a network’s architecture or task objective’ [12]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent results suggest that contrasting different ANNs with neural data may start to yield diminishing returns: models with drastically different architectures and training regimes all match neural data with similar accuracy, especially when parametric flexibility is allowed in the model–brain mapping [6,12–14]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“These networks were 20 ResNet-18 architectures trained on image classification using the Tiny ImageNet dataset [11, 26, 19].”
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“Previous work has shown that in many neural networks trained on natural images, the first layer contains general-purpose V1-like filters tuned to orientation, frequency, and color, whereas subsequent layers contain filters that appear to be increasingly specialized [18, 31].”
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“All were trained on ImageNet for object classification [25] and obtained from the torchvision library [23, 28].”
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473 · cited 3×
“All were trained on ImageNet for object classification [25] and obtained from the torchvision library [23, 28].”
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 1×
“The fourth set included 20 untrained ResNet-18 models [11] with different random weights, which were created using Kaiming normal initialization [12].”
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826 · cited 1×
“We then selected the top 100 dimensions with the highest universality scores and visualized the image representations of these 100 dimensions in a 2D space using uniform manifold approximation and projection (UMAP) [21].”
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“Theories of efficient coding suggest that frequency-and orientation-tuned filters are consistently observed in the first layer of vision systems because they constitute efficient bases that are adapted to the statistics of natural images [22, 27].”
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Research works printed but not linked: 4
- Y. Le, X. Yang, Tiny imagenet visual recognition challenge. CS 231N 7, 3 (2015).
- A. Krizhevsky I. Sutskever G. E. Hinton “ImageNet classification with deep convolutional neural networks ” in Advances in Neural Information Processing Systems F. Pereira C. Burges L. Bottou K. Weinberger Eds. (Curran Associates Inc. 2012) vol. 25 pp. 1097–1105.
- J. S. Prince G. Fajardo G. A. Alvarez T. Konkle “Manipulating dropout reveals an optimal balance of efficiency and robustness in biological and machine visual systems ” in The Twelfth International Conference on Learning Representations (Open Review 2024); https://openreview.net/pdf?id=ADDCErFzev.
- B. S. Robinson N. Drenkow C. Conwell M. Bonner “A sparse null code emerges in deep neural networks ” in Proceedings of UniReps: The First Workshop on Unifying Representations in Neural Models M. Fumero E. Rodolá C. Domine F. Locatello K. Dziugaite C. Mathilde Eds. (PMLR 2024) vol. 243 of Proceedings of Machine Learning Research pp. 302–314.
Cited by
The Universal Weight Subspace HypothesisPreprint
Kaushik, P., Chaudhari, S., Vaidya, A., Chellappa, R., & Yuille, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.05117 · Cited by 37
Reanimating Images using Neural Representations of Dynamic Stimuli
Yeung, J., Luo, A. F., Sarch, G. H., Henderson, M. M., Ramanan, D., & Tarr, M. J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00502 · Cited by 20
Convolutional architectures are cortex-aligned de novo
Kazemian, A., Elmoznino, E., & Bonner, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01142-3 · Cited by 24
“This suggests that for highly trained DNNs, architectural and objective-based constraints are relatively weak 8–10 .”
Self-citationUniversality of representation in biological and artificial neural networks
Hosseini, E., Casto, C., Zaslavsky, N., Conwell, C., Richardson, M., & Fedorenko, E. (2024) · doi:10.1101/2024.12.26.629294 · Cited by 10
Luo, A. F., Yeung, J., Zawar, R., Dewan, S., Henderson, M. M., Wehbe, L., & Tarr, M. J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.05266 · Cited by 16
“This observation raises an important question about the nature of each model’s learned features and their alignment with one another: Do these models converge upon similar feature representations (Chen & Bonner, 2024) for category selective brain regions despite their varied training paradigms?”
Background
Metadata
- Authors
- Chen, Z., & Bonner, M. F.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Chen, Zirui
- Venue
- Science Advances
- Published
- 2025-07-04
- Volume
- 11
- Issue
- 27
- Pages
- eadw7697-eadw7697
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC12219468
- OpenAlex
- W4411948297
- Cited by
- 16
- References
- 36
- Citations by year
- 2026: 12 · 2025: 3
- FWCI
- 8.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Science Advances (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- OSF Preprints (OSF Preprints) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- representational similarity, latent dimensions, universal representation, dimensionality reduction, functional MRI
- MeSH terms
- Brain, Brain Mapping, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Vision, Ocular, Visual Perception, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.