Individual gaze shapes diverging neural representations
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Complex visual stimuli evoke diverse patterns of gaze, but previous research suggests that their neural representations are shared across brains. Here, we used hyperalignment to compare visual responses between observers viewing identical stimuli. We find that individual eye movements enhance cortical visual responses but also lead to representational divergence. Pairwise differences in the spatial distribution of gaze and in semantic salience predict pairwise representational divergence in V1 and inferior temporal cortex, respectively. This suggests that individual gaze sculpts individual visual worlds.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Even within species, there are well-known systematic differences between individuals [61–63]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [61]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Proceedings of the National Academy of Sciences
Richards, J. W. (1915) · Science · doi:10.1126/science.42.1074.161 · Cited by 13,983
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Hogan, A., Lorenzomammana, Tkianai, et al. (2020) · Zenodo · doi:10.5281/zenodo.3983579 · Cited by 2,738
ultralytics/yolov5: v4.0 - nn.SiLU() activations, Weights & Biases logging, PyTorch Hub integration
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Tkianai, YxNONG, Hogan, A., et al. (2021) · Zenodo · doi:10.5281/zenodo.4418161 · Cited by 2,738
ultralytics/yolov5: Initial Release
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Hogan, A., Lorenzomammana, Tkianai, et al. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3908559 · Cited by 2,731
EAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
The ventral visual pathway: an expanded neural framework for the processing of object quality
Kravitz, D. J., Saleem, K. S., Baker, C. I., Ungerleider, L. G., & Mishkin, M. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.10.011 · Cited by 1,173
The functional architecture of the ventral temporal cortex and its role in categorization
Grill-Spector, K., & Weiner, K. S. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3747 · Cited by 837 · cited 1×
“…activation in the ventral stream is only weakly modulated by eye movements ( 9 ) and may reflect broader visual field coverage ( 10 ) than previously assumed ( 1 , 11 , 12 ) and that individual representations of movie stimuli can be aligned across observers via linear transformations ( 13 – 16 ).”
A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex
Haxby, J. V., Guntupalli, J. S., Connolly, A. C., Halchenko, Y. O., Conroy, B. R., Gobbini, M. I., Hanke, M., & Ramadge, P. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.026 · Cited by 648
Eccentricity bias as an organizing principle for human high-order object areas
Hasson, U., Levy, I., Behrmann, M., Hendler, T., & Malach, R. (2002) · Neuron · doi:10.1016/s0896-6273(02)00662-1 · Cited by 578
Neurocinematics: The Neuroscience of Film
Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., & Heeger, D. J. (2008) · Projections · doi:10.3167/proj.2008.020102 · Cited by 536
Variability of eye movements when viewing dynamic natural scenes
Dorr, M., Martinetz, T., Gegenfurtner, K. R., & Barth, E. (2010) · Journal of Vision · doi:10.1167/10.10.28 · Cited by 450 · cited 1×
“On the other hand, a range of previous results suggests that individual gaze may not matter much for the representation of complex, naturalistic stimuli: Eye - tracking studies have found higher interpersonal coherence for gaze toward directed content ( 6 , 7 ) and stimuli with salient motion ( 8 ).”
Infant viewing of social scenes is under genetic control and is atypical in autism
Constantino, J. N., Kennon-McGill, S., Weichselbaum, C., Marrus, N., Haider, A., Glowinski, A. L., Gillespie, S., Klaiman, C., Klin, A., & Jones, W. (2017) · Nature · doi:10.1038/nature22999 · Cited by 337 · cited 1×
“…in gaze were highly consistent during the eye - tracking session, and previous studies have shown trait - like individual gaze biases ( 21 , 22 ) which are shaped by genes ( 23 , 24 ) and experience ( 25 ) and may be tuned to idiosyncratic characteristics of the visual system ( 26 – 28 ).”
Seeing faces is necessary for face-domain formation
Arcaro, M. J., Schade, P. F., Vincent, J. L., Ponce, C. R., & Livingstone, M. S. (2017) · Nature Neuroscience · doi:10.1038/nn.4635 · Cited by 308 · cited 1×
“…in gaze were highly consistent during the eye - tracking session, and previous studies have shown trait - like individual gaze biases ( 21 , 22 ) which are shaped by genes ( 23 , 24 ) and experience ( 25 ) and may be tuned to idiosyncratic characteristics of the visual system ( 26 – 28 ).”
The Functional Neuroanatomy of Human Face Perception
Grill-Spector, K., Weiner, K. S., Kay, K., & Gomez, J. (2017) · Annual Review of Vision Science · doi:10.1146/annurev-vision-102016-061214 · Cited by 262 · cited 1×
“This resonates with the foveal bias of face - and text - preferring neural populations in IT ( 1 , 19 , 20 ) and strongly suggests that individual gaze shapes individual visual worlds ( 3 ).”
The Organization and Operation of Inferior Temporal Cortex
Conway, B. R. (2018) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091517-034202 · Cited by 255 · cited 1×
“…activation in the ventral stream is only weakly modulated by eye movements ( 9 ) and may reflect broader visual field coverage ( 10 ) than previously assumed ( 1 , 11 , 12 ) and that individual representations of movie stimuli can be aligned across observers via linear transformations ( 13 – 16 ).”
Benson, N. C., Butt, O. H., Brainard, D. H., & Aguirre, G. K. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003538 · Cited by 222
Peterson, M. F., & Eckstein, M. P. (2013) · Psychological Science · doi:10.1177/0956797612471684 · Cited by 201 · cited 1×
“…in gaze were highly consistent during the eye - tracking session, and previous studies have shown trait - like individual gaze biases ( 21 , 22 ) which are shaped by genes ( 23 , 24 ) and experience ( 25 ) and may be tuned to idiosyncratic characteristics of the visual system ( 26 – 28 ).”
Hyperalignment: Modeling shared information encoded in idiosyncratic cortical topographies
Haxby, J. V., Guntupalli, J. S., Nastase, S. A., & Feilong, M. (2020) · eLife · doi:10.7554/elife.56601 · Cited by 184 · cited 2×
“Previous research has demonstrated that representations of complex visual stimuli in the human inferior temporal cortex (IT) can be decoded across brains using hyperalignment ( 13 , 17 ).”
Individual differences in visual salience vary along semantic dimensions
de Haas, B., Iakovidis, A. L., Schwarzkopf, D. S., & Gegenfurtner, K. R. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820553116 · Cited by 181
Genetic Influence on Eye Movements to Complex Scenes at Short Timescales
Kennedy, D. P., D'Onofrio, B. M., Quinn, P. D., Bölte, S., Lichtenstein, P., & Falck‐Ytter, T. (2017) · Current Biology · doi:10.1016/j.cub.2017.10.007 · Cited by 123 · cited 1×
“…in gaze were highly consistent during the eye - tracking session, and previous studies have shown trait - like individual gaze biases ( 21 , 22 ) which are shaped by genes ( 23 , 24 ) and experience ( 25 ) and may be tuned to idiosyncratic characteristics of the visual system ( 26 – 28 ).”
Reliable individual differences in fine-grained cortical functional architecture
Feilong, M., Nastase, S. A., Guntupalli, J. S., & Haxby, J. V. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.08.029 · Cited by 68
Social content and emotional valence modulate gaze fixations in dynamic scenes
Rubo, M., & Gamer, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22127-w · Cited by 62
An fMRI dataset in response to “The Grand Budapest Hotel”, a socially-rich, naturalistic movie
Castello, M. V. D. O., Chauhan, V. S., Jiahui, G., & Gobbini, M. I. (2020) · Scientific Data · doi:10.1038/s41597-020-00735-4 · Cited by 61 · cited 1×
“…activation in the ventral stream is only weakly modulated by eye movements ( 9 ) and may reflect broader visual field coverage ( 10 ) than previously assumed ( 1 , 11 , 12 ) and that individual representations of movie stimuli can be aligned across observers via linear transformations ( 13 – 16 ).”
A dynamic sequence of visual processing initiated by gaze shifts
Parker, P. R. L., Martins, D. M., Leonard, E. S. P., Casey, N. M., Sharp, S. L., Abe, E. T. T., Smear, M. C., Yates, J. L., Mitchell, J. F., & Niell, C. M. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01481-7 · Cited by 51
Lu, K.-H., Hung, S.-C., Wen, H., Marussich, L., & Liu, Z. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161797 · Cited by 44 · cited 2×
“This aligns with studies in humans and primates, showing enhanced neural responses to gaze shifts updating the visual input ( 7 , 9 , 18 ).”
Individual differences in looking at persons in scenes
Broda, M. D., & de Haas, B. (2022) · Journal of Vision · doi:10.1167/jov.22.12.9 · Cited by 36
Feature-selective responses in macaque visual cortex follow eye movements during natural vision
Xiao, W., Sharma, S., Kreiman, G., & Livingstone, M. S. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01631-5 · Cited by 36 · cited 1×
“This aligns with studies in humans and primates, showing enhanced neural responses to gaze shifts updating the visual input ( 7 , 9 , 18 ).”
Individual differences in human gaze behavior generalize from faces to objects
Broda, M. D., & de Haas, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322149121 · Cited by 26
Free viewing biases for complex scenes in preschoolers and adults
Linka, M., Şensoy, Ö., Karimpur, H., Schwarzer, G., & de Haas, B. (2023) · Scientific Reports · doi:10.1038/s41598-023-38854-8 · Cited by 24
Direct comparison of contralateral bias and face/scene selectivity in human occipitotemporal cortex
Silson, E. H., Groen, I. I. A., & Baker, C. I. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02411-8 · Cited by 22
Immersive scene representation in human visual cortex with ultra-wide-angle neuroimaging
Park, J., Soucy, E. R., Segawa, J. A., Mair, R. W., & Konkle, T. (2024) · Nature Communications · doi:10.1038/s41467-024-49669-0 · Cited by 20
Eye movement-invariant representations in the human visual system
Nishimoto, S., Huth, A. G., Bilenko, N. Y., & Gallant, J. L. (2017) · Journal of Vision · doi:10.1167/17.1.11 · Cited by 19 · cited 2×
“Neuroimaging studies found that visually evoked brain activation in the ventral stream is only weakly modulated by eye movements ( 9 ) and may reflect broader visual field coverage ( 10 ) than previously assumed ( 1 , 11 , 12 ) and that individual representations of movie stimuli can be aligned…”
Individual fixation tendencies in person viewing generalize from images to videos
Broda, M. D., & de Haas, B. (2022) · i-Perception · doi:10.1177/20416695221128844 · Cited by 18
Individual fixation tendencies in person viewing generalize from images to videosPreprint
Broda, M. D., & de Haas, B. (2022) · doi:10.31234/osf.io/nfkr4 · Cited by 6
Individual gaze predicts individual scene descriptionsPreprint
Kollenda, D., Reher, A.-S. V., & de Haas, B. (2024) · doi:10.31234/osf.io/nx7jy · Cited by 4
Individual gaze shapes diverging neural representationsPreprint
Borovska, P., & de Haas, B. (2024) · doi:10.31234/osf.io/ju5cd · Cited by 2
Self-citation
Research works printed but not linked: 2
- J. V. Haxby, A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 72, 404– 416 (2011). 22017997 PMC3201764 · DOI · Paper page
- B. de Haas, A. L. Iakovidis, D. S. Schwarzkopf, K. R. Gegenfurtner, Individual differences in visual salience vary along semantic dimensions. Proc. Natl. Acad. Sci. U.S.A. 116, 11687– 11692 (2019). 31138705 PMC6576124 · DOI
Cited by
Rethinking category-selectivity in human visual cortex
Ritchie, J. B., Wardle, S. G., Vaziri-Pashkam, M., Kravitz, D. J., & Baker, C. I. (2025) · Cognitive Neuroscience · doi:10.1080/17588928.2025.2543890 · Cited by 47
“This has sometimes been investigated within the context of category-selectivity, but ideally requires behaviorally relevant stimuli and task selection (Charest et al., 2014; Haxby et al., 2020; McGugin et al., 2023) or direct links to natural behaviors like eye movements (Borovska & de Haas, 2024).”
Neural and behavioral reinstatement jointly reflect retrieval of narrative events
Nau, M., Greene, A., Tarder-Stoll, H., Lossio-Ventura, J. A., Pereira, F., Chen, J., Baldassano, C. A., & Baker, C. I. (2025) · Nature Communications · doi:10.1038/s41467-025-62375-9 · Cited by 18
“This consistency in gaze patterns may also have contributed to the replicability of brain activity patterns across participants (36, 80).”
The Umwelt Representation Hypothesis: rethinking Universality
Bosch, V., Sommers, R. P., Doerig, A., & Kietzmann, T. C. (2026) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2026.07.004 · Cited by 2
Active vision is linked to category selectivity in the individual brain
Kollenda, D., Akbari, E., Broda, M. D., & de Haas, B. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02494-5 · Cited by 1
“Specifically, the authors showed that the interindividual similarity of neural representations during movie watching is determined by the similarity of gaze 16 .”
Visuospatial computations vary by category and stream and continue to develop in adolescencePreprint
Yao, J. K., Choo, J., Finzi, D., & Grill-Spector, K. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.14.633067
“Stream Theory 35 Indeed, several studies have shown a link between the population code spanned by pRFs tiling a region and behavior 12,23,24,27,30,47,58,59 .”
Metadata
- Authors
- Borovska, P., & de Haas, B.
- Affiliations
- Justus-Liebig-Universität Gießen (DE)
- Department of Experimental Psychology, Justus Liebig University
- Corresponding author
- Borovska, Petra
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2024-08-30
- Volume
- 121
- Issue
- 36
- Pages
- e2405602121-e2405602121
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC11388360
- OpenAlex
- W4402042280
- Cited by
- 11
- References
- 33
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 1
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Update notices
- correction (2025-06-13)
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- EC | European Research Council (852885)
- Deutsche Forschungsgemeinschaft (222641018-SFB/TRR 135 TP C9)
- Hessisches Ministerium für Wissenschaft und Kunst (The Adaptive Mind)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- hyperalignment, visual cortex, primary visual cortex, inferior temporal cortex, eye movements, semantic salience, individual differences, visual perception, neural representations
- MeSH terms
- Adult, Eye Movements, Female, Fixation, Ocular, Humans, Male, Photic Stimulation, Temporal Lobe, Visual Cortex, Visual Perception, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.