CoChat

Individual gaze shapes diverging neural representations

Open access
Borovska, Petra, de Haas, Benjamin · 2024 · Proceedings of the National Academy of Sciences

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.

Abstract

Complex visual stimuli evoke diverse patterns of gaze, but previous research suggests that their neural representations are shared across brains. Here, we used hyperalignment to compare visual responses between observers viewing identical stimuli. We find that individual eye movements enhance cortical visual responses but also lead to representational divergence. Pairwise differences in the spatial distribution of gaze and in semantic salience predict pairwise representational divergence in V1 and inferior temporal cortex, respectively. This suggests that individual gaze sculpts individual visual worlds.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1073/pnas.2405602121

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1. Results. (A) Cross-brain decoding accuracy in the fixation and free-viewing conditions for IT and V1. Each dot represents one pair of observers (N = 171 pairs), the chance level of 0.24 % is indicated by red lines, and P-values correspond to a GLMEs testing the effects of the conditions on cross-brain decoding accuracy. The Top (green) and Bottom (purple) plots show data from IT and V1 and the corresponding ROIs. The shades of dots correspond to decoding accuracy in the fixation condition. (B) Fitted weights of individual differences in low- and high-level gaze parameters predicting pairwise neural divergence in IT and V1. Simple main effects are shown for IT in green (Top) and V1 in purple (Bottom). Rate and Ampl: individual difference in the saccadic rate and amplitude; GazeDist: average Euclidean distance between gaze positions of two observers; Face and Text: individual difference in the tendency to fixate faces and text, respectively. Asterisks indicate significant simple main effects that survived Bonferroni correction. (C) Effects of free-viewing on neural alignment between observers. The heatmap shows the average difference in cross-brain decoding accuracy (in %) between free-viewing and fixation conditions across all pairs of observers on the inflated cortical surface. The color-coding indicates the magnitude of the difference for each region of interest (ROI), extracted using the Destrieux atlas parcellation and the Benson retinotopy atlas for V1, V2, and V3. Only differences that were significant at P < 0.001 according to the GLME are shown (SI Appendix, Supporting Methods). Values are color-coded as shown in the inset bar, with cool colors indicating a drop of decoding accuracy in the free-viewing condition. (D) Amplitude effects of free-viewing. The heatmap shows vertex-wise t-values for the contrast between free-viewing and fixation on the inflated cortical surface of an example observer. t values are color-coded as shown in the inset bar. Inflated hemispheres are shown in inferior (Top Left), medial (Top Right), lateral (Bottom Left), and posterior views (Bottom Right).
Fig. 1. Results. (A) Cross-brain decoding accuracy in the fixation and free-viewing conditions for IT and V1. Each dot represents one pair of observers (N = 171 pairs), the chance level of 0.24 % is indicated by red lines, and P-values correspond to a GLMEs testing the effects of the conditions on cross-brain decoding accuracy. The Top (green) and Bottom (purple) plots show data from IT and V1 and the corresponding ROIs. The shades of dots correspond to decoding accuracy in the fixation condition. (B) Fitted weights of individual differences in low- and high-level gaze parameters predicting pairwise neural divergence in IT and V1. Simple main effects are shown for IT in green (Top) and V1 in purple (Bottom). Rate and Ampl: individual difference in the saccadic rate and amplitude; GazeDist: average Euclidean distance between gaze positions of two observers; Face and Text: individual difference in the tendency to fixate faces and text, respectively. Asterisks indicate significant simple main effects that survived Bonferroni correction. (C) Effects of free-viewing on neural alignment between observers. The heatmap shows the average difference in cross-brain decoding accuracy (in %) between free-viewing and fixation conditions across all pairs of observers on the inflated cortical surface. The color-coding indicates the magnitude of the difference for each region of interest (ROI), extracted using the Destrieux atlas parcellation and the Benson retinotopy atlas for V1, V2, and V3. Only differences that were significant at P < 0.001 according to the GLME are shown (SI Appendix, Supporting Methods). Values are color-coded as shown in the inset bar, with cool colors indicating a drop of decoding accuracy in the free-viewing condition. (D) Amplitude effects of free-viewing. The heatmap shows vertex-wise t-values for the contrast between free-viewing and fixation on the inflated cortical surface of an example observer. t values are color-coded as shown in the inset bar. Inflated hemispheres are shown in inferior (Top Left), medial (Top Right), lateral (Bottom Left), and posterior views (Bottom Right).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 36 references

Research works printed but not linked: 2

  1. 10.1016/j.neuron.2011.08.026 · DOI · Paper page
  2. 10.1073/pnas.1820553116 · DOI

Cited by

See all 11

Metadata

Authors
Borovska, P., & de Haas, B.
Affiliations
  • Justus-Liebig-Universität Gießen (DE)
  • Department of Experimental Psychology, Justus Liebig University
Corresponding author
Borovska, Petra
Venue
Proceedings of the National Academy of Sciences
Published
2024-08-30
Volume
121
Issue
36
Pages
e2405602121-e2405602121
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W4402042280
Cited by
11
References
33
Citations by year
2026: 6 · 2025: 4 · 2024: 1
FWCI
2.67
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
Funders
  • EC | European Research Council (852885)
  • Deutsche Forschungsgemeinschaft (222641018-SFB/TRR 135 TP C9)
  • Hessisches Ministerium für Wissenschaft und Kunst (The Adaptive Mind)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
hyperalignment, visual cortex, primary visual cortex, inferior temporal cortex, eye movements, semantic salience, individual differences, visual perception, neural representations
MeSH terms
Adult, Eye Movements, Female, Fixation, Ocular, Humans, Male, Photic Stimulation, Temporal Lobe, Visual Cortex, Visual Perception, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Individual gaze shapes diverging neural representations. https://app.cochat.ai/papers/10.1073/pnas.2405602121
The paper
Borovska, P., & de Haas, B. (2024). Individual gaze shapes diverging neural representations. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2405602121

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.