Superior colliculus neurons encode a visual saliency map during free viewing of natural dynamic video
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Models of visual attention postulate the existence of a saliency map whose function is to guide attention and gaze to the most conspicuous regions in a visual scene. Although cortical representations of saliency have been reported, there is mounting evidence for a subcortical saliency mechanism, which pre-dates the evolution of neocortex. Here, we conduct a strong test of the saliency hypothesis by comparing the output of a well-established computational saliency model with the activation of neurons in the primate superior colliculus (SC), a midbrain structure associated with attention and gaze, while monkeys watched video of natural scenes. We find that the activity of SC superficial visual-layer neurons (SCs), specifically, is well-predicted by the model. This saliency representation is unlikely to be inherited from fronto-parietal cortices, which do not project to SCs, but may be computed in SCs and relayed to other areas via tectothalamic pathways.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Located in the tectal region of the midbrain, it is known to be involved in the detection of visually salient stimuli to drive oculomotor responses (Wurtz and Albano 1980; Gandhi and Katnani 2011; White et al. 2017).”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as White et al. 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Self-citationConvergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
Lagarias, J. C., Reeds, J. A., Wright, M. H., & Wright, P. E. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496303470 · Cited by 7,447
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Self-citationShifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
The estimation of the gradient of a density function, with applications in pattern recognition
Fukunaga, K., & Hostetler, L. (1975) · IEEE Transactions on Information Theory · doi:10.1109/tit.1975.1055330 · Cited by 3,043
A Method of Measuring Eye Movemnent Using a Scieral Search Coil in a Magnetic Field
(1963) · IEEE Transactions on Bio-medical Electronics · doi:10.1109/tbmel.1963.4322822 · Cited by 1,838
State-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817 · cited 2×
“(2) The dependent variable (neuronal discharge rate) was continuous.”
BackgroundSelf-citationA method of measuring eye movements using a scleral search coil in a magnetic field
Robinson, D. A. (1963) · Medical Entomology and Zoology · Cited by 1,709
Chromatic mechanisms in lateral geniculate nucleus of macaque.
Derrington, A. M., Krauskopf, J., & Lennie, P. (1984) · The Journal of Physiology · doi:10.1113/jphysiol.1984.sp015499 · Cited by 1,608
The representation of visual salience in monkey parietal cortex
Gottlieb, J. P., Kusunoki, M., & Goldberg, M. E. (1998) · Nature · doi:10.1038/35135 · Cited by 1,078
A change of the leading player in flow Visualization technique
Mizuno, A., & Ohta, Y. (2006) · Journal of Visualization · doi:10.1007/bf03181556 · Cited by 1,042
Salience, relevance, and firing: a priority map for target selection
FECTEAU, J., & MUNOZ, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.011 · Cited by 918
Visual-Motor Function of the Primate Superior Colliculus
Wurtz, R. H., & Albano, J. E. (1980) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.03.030180.001201 · Cited by 904
Superior Colliculus and Visual Spatial Attention
Krauzlis, R. J., Lovejoy, L. P., & Zénon, A. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170249 · Cited by 660
A saliency map in primary visual cortex
Li, Z. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01817-9 · Cited by 660
Thompson, K. G., Hanes, D. P., Bichot, N. P., & Schall, J. D. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.6.4040 · Cited by 617
Receptive-field organization of monkey superior colliculus.
Cynader, M., & Berman, N. (1972) · Journal of Neurophysiology · doi:10.1152/jn.1972.35.2.187 · Cited by 520
Discharge characteristics of single units in superior colliculus of the alert rhesus monkey.
Schiller, P. H., & Koerner, F. (1971) · Journal of Neurophysiology · doi:10.1152/jn.1971.34.5.920 · Cited by 501
Selective visual attention and perceptual coherence
Serences, J. T., & Yantis, S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.008 · Cited by 500 · cited 2×
“(3) The data across all conditions met the normality assumption based on Kolmogorov– Smirnov test (Po0.”
BackgroundMethodReceptive fields of P and M ganglion cells across the primate retina
Croner, L. J., & Kaplan, E. (1995) · Vision Research · doi:10.1016/0042-6989(94)e0066-t · Cited by 492
Unix-based multiple-process system, for real-time data acquisition and control
Hays, A. V., Richmond, B. J., & Optican, L. M. (1982) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 488
Feature combination strategies for saliency-based visual attention systems
Itti, L. (2001) · Journal of Electronic Imaging · doi:10.1117/1.1333677 · Cited by 441
Self-citationA visual salience map in the primate frontal eye field
Thompson, K. G., & Bichot, N. P. (2005) · Progress in Brain Research · doi:10.1016/s0079-6123(04)47019-8 · Cited by 431
Cavanaugh, J. R., Bair, W., & Movshon, J. A. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00693.2001 · Cited by 420
Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention
Ignashchenkova, A., Dicke, P. W., Haarmeier, T., & Thier, P. (2004) · Nature Neuroscience · doi:10.1038/nn1169 · Cited by 385
Saccade Target Selection in the Superior Colliculus During a Visual Search Task
McPeek, R. M., & Keller, E. L. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.4.2019 · Cited by 355
Visual cortical neurons as localized spatial frequency filters
Pollen, D. A., & Ronner, S. F. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313086 · Cited by 314
Contour Saliency in Primary Visual Cortex
Li, W., Piëch, V., & Gilbert, C. D. (2006) · Neuron · doi:10.1016/j.neuron.2006.04.035 · Cited by 281
Goal-Related Activity in V4 during Free Viewing Visual Search
Mazer, J. A., & Gallant, J. L. (2003) · Neuron · doi:10.1016/s0896-6273(03)00764-5 · Cited by 262
Visuomotor fields of the superior colliculus: A quantitative model
Ottes, F. P., Van Gisbergen, J. A. M., & Eggermont, J. J. (1986) · Vision Research · doi:10.1016/0042-6989(86)90144-6 · Cited by 251
Neural Activities in V1 Create a Bottom-Up Saliency Map
Zhang, X., Zhaoping, L., Zhou, T., & Fang, F. (2012) · Neuron · doi:10.1016/j.neuron.2011.10.035 · Cited by 212
Functional Identification of a Pulvinar Path from Superior Colliculus to Cortical Area MT
Berman, R. A., & Wurtz, R. H. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.6176-09.2010 · Cited by 202
Monkey superior colliculus: properties of single cells and their afferent inputs
Marrocco, R. T., & Li, R. H. (1977) · Journal of Neurophysiology · doi:10.1152/jn.1977.40.4.844 · Cited by 192
Free viewing of dynamic stimuli by humans and monkeys
Berg, D. J., Boehnke, S. E., Marino, R. A., Munoz, D. P., & Itti, L. (2009) · Journal of Vision · doi:10.1167/9.5.19 · Cited by 161
Self-citationSignals Conveyed in the Pulvinar Pathway from Superior Colliculus to Cortical Area MT
Berman, R. A., & Wurtz, R. H. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4738-10.2011 · Cited by 150
Control from below: the role of a midbrain network in spatial attention
Knudsen, E. I. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07696.x · Cited by 148
Early involvement of prefrontal cortex in visual bottom-up attention
Katsuki, F., & Constantinidis, C. (2012) · Nature Neuroscience · doi:10.1038/nn.3164 · Cited by 137
In Monkeys Making Value-Based Decisions, LIP Neurons Encode Cue Salience and Not Action Value
Leathers, M. L., & Olson, C. R. (2012) · Science · doi:10.1126/science.1226405 · Cited by 130
Color-Related Signals in the Primate Superior Colliculus
White, B. J., Boehnke, S. E., Marino, R. A., Itti, L., & Munoz, D. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1986-09.2009 · Cited by 104
Self-citationLinking visual response properties in the superior colliculus to saccade behavior
Marino, R. A., Levy, R., Boehnke, S. E., White, B. J., Itti, L., & Munoz, D. P. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08079.x · Cited by 98
Self-citationA pure salience response in posterior parietal cortex
Arcizet, F., Mirpour, K., & Bisley, J. W. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr035 · Cited by 90
Signaling of the Strongest Stimulus in the Owl Optic Tectum
Mysore, S. P., Asadollahi, A., & Knudsen, E. I. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4592-10.2011 · Cited by 86
Influence and limitations of popout in the selection of salient visual stimuli by area V4 neurons
Burrows, B. E., & Moore, T. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3710-09.2009 · Cited by 85
Spatial Relationships of Visuomotor Transformations in the Superior Colliculus Map
Marino, R. A., Rodgers, C. K., Levy, R., & Munoz, D. P. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90688.2008 · Cited by 80
Self-citationThree-dimensional nth derivative of Gaussian separable steerable filters
Derpanis, K. G., & Gryn, J. M. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530451 · Cited by 78
Phongphanphanee, P., Marino, R. A., Kaneda, K., Yanagawa, Y., Munoz, D. P., & Isa, T. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12579 · Cited by 77 · cited 8×
“55), whereas the saccade-goal in condition was significant with Bonferroni correction (t(25)1⁄4 3.”
BackgroundInfluentialSelf-citationResidual Attention Guidance in Blindsight Monkeys Watching Complex Natural Scenes
Yoshida, M., Itti, L., Berg, D. J. V. D., Ikeda, T., Kato, R., Takaura, K., White, B. J., Munoz, D. P., & Isa, T. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.046 · Cited by 74
Self-citationDischarge Properties of Monkey Tectoreticular Neurons
Rodgers, C. K., Munoz, D. P., Scott, S. H., & Paré, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00908.2005 · Cited by 72
Self-citationStimulus-driven competition in a cholinergic midbrain nucleus
Asadollahi, A., Mysore, S. P., & Knudsen, E. I. (2010) · Nature Neuroscience · doi:10.1038/nn.2573 · Cited by 64
Saliency and Saccade Encoding in the Frontal Eye Field During Natural Scene Search
Fernandes, H. L., Stevenson, I. H., Phillips, A. N., Segraves, M. A., & Kording, K. P. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht179 · Cited by 59 · cited 7×
“0e 07), and a significant main effect of saccade-goal (F(1, 33)1⁄4 12.”
BackgroundInfluentialSelectivity for relative motion in the monkey superior colliculus
Davidson, R. M., & Bender, D. B. (1991) · Journal of Neurophysiology · doi:10.1152/jn.1991.65.5.1115 · Cited by 55
Real-time data collection in Linux: A case study
Finney, S. A. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195362 · Cited by 47
Fast Computation of Scale Normalised Gaussian Receptive Fields
Crowley, J. L., & Riff, O. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44935-3_41 · Cited by 44
White, B. J., & Munoz, D. P. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5349-10.2011 · Cited by 40
Self-citationModulation of Presaccadic Activity in the Frontal Eye Field by the Superior Colliculus
Berman, R. A., Joiner, W. M., Cavanaugh, J., & Wurtz, R. H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00053.2009 · Cited by 35
Modelling ecologically specialized biological visual systems
Wiebe, K. J., & Basu, A. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00160-4 · Cited by 14
Research works printed but not linked: 2
- White, B. J. & Munoz, D. P. Oxford Handbook of Eye Movements 195–213Oxford University Press (2011).
- Itti, L. The ilab neuromorphic vision c++ toolkit: free tools for the next generation of vision algorithms. Neuromorphic Eng. 1, 10 (2004).
Cited by
Inferring Salient Objects from Human Fixations
Wang, W., Shen, J., Dong, X., Borji, A., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2905607 · Cited by 216
“, [14], [15], [16]), here we do not aim to mimic low-level mechanisms of attention in the brain or use them in our model.”
BackgroundThe tectum/superior colliculus as the vertebrate solution for spatial sensory integration and action
Isa, T., Marquez-Legorreta, E., Grillner, S., & Scott, E. K. (2021) · Current Biology · doi:10.1016/j.cub.2021.04.001 · Cited by 206
Neurocognitive Mechanisms: Explaining Biological Cognition
Piccinini, G. (2020) · doi:10.1093/oso/9780198866282.001.0001 · Cited by 162
How is visual salience computed in the brain? Insights from behaviour, neurobiology and modelling
Veale, R., Hafed, Z. M., & Yoshida, M. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0113 · Cited by 173
Atom Probe Tomography: Development and Application to the Geosciences
Reddy, S. M., Saxey, D. W., Rickard, W. D. A., Fougerouse, D., Montalvo, S. D., Verberne, R., & van Riessen, A. (2020) · Geostandards and Geoanalytical Research · doi:10.1111/ggr.12313 · Cited by 161
“…the mechanisms that can affect the distribution of radiogenic 207Pb/206Pb ratios in zircon (Figure 18; Valley et al. 2014, 2015, Peterman et al. 2016, Blum et al. 2018), baddeleyite (White et al. 2017, Moser et al. 2019) and monazite (Fougerouse et al. 2018, Seydoux-Guillaume et al. 2019).”
Background
Metadata
- Authors
- White, B. J., Berg, D. J., Kan, J. Y., Marino, R. A., Itti, L., & Munoz, D. P.
- Affiliations
- Queen's University (CA)
- IBM Research - Almaden (US)
- University of Southern California (US)
- Corresponding author
- White, Brian J.
- Venue
- Nature Communications
- Published
- 2017-01-24
- Volume
- 8
- Issue
- 1
- Pages
- 14263-14263
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC5286207
- OpenAlex
- W2580778720
- Cited by
- 191
- References
- 56
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 16 · 2023: 13 · 2022: 14 · 2021: 16 · 2020: 47 · 2019: 22 · 2018: 18 · 2017: 8
- FWCI
- 10.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (1317433, 0827764, 1545089)
- Canadian Institutes of Health Research (90910_1, 136972_1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- superior colliculus, visual saliency, saliency maps, visual attention, gaze control, primate vision, frontoparietal cortex
- MeSH terms
- Animals, Attention, Computer Simulation, Macaca mulatta, Male, Models, Neurological, Neural Pathways, Neurons, Photic Stimulation, Saccades, Software, Superior Colliculi, Thalamus, Visual Perception, Models, Animal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.