The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
What stands out in a scene? A study of human explicit saliency judgment
Open accessAbstract
Eye tracking has become the de facto standard measure of visual attention in tasks that range from free viewing to complex daily activities. In particular, saliency models are often evaluated by their ability to predict human gaze patterns. However, fixations are not only influenced by bottom-up saliency (computed by the models), but also by many top-down factors. Thus, comparing bottom-up saliency maps to eye fixations is challenging and has required that one tries to minimize top-down influences, for example by focusing on early fixations on a stimulus. Here we propose two complementary procedures to evaluate visual saliency. We seek whether humans have explicit and conscious access to the saliency computations believed to contribute to guiding attention and eye movements. In the first experiment, 70 observers were asked to choose which object stands out the most based on its low-level features in 100 images each containing only two objects. Using several state-of-the-art bottom-up visual saliency models that measure local and global spatial image outliers, we show that maximum saliency inside the selected object is significantly higher than inside the non-selected object and the background. Thus spatial outliers are a predictor of human judgments. Performance of this predictor is boosted by including object size as an additional feature. In the second experiment, observers were asked to draw a polygon circumscribing the most salient object in cluttered scenes. For each of 120 images, we show that a map built from annotations of 70 observers explains eye fixations of another 20 observers freely viewing the images, significantly above chance (dataset by Bruce and Tsotsos (2009); shuffled AUC score 0.62±0.07, chance 0.50, t-test p<0.05). We conclude that fixations agree with saliency judgments, and classic bottom-up saliency models explain both. We further find that computational models specifically designed for fixation prediction slightly outperform models designed for salient object detection over both types of data (i.e., fixations and objects).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Posner, M. I. (1980) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335558008248231 · Cited by 9,670 · cited 3×
“cognitive phenomena such as knowledge, expectations, reward, memory, goals, and task demands (Yarbus, 1967; Posner, 1980; Duncan, 1984; Ballard et al., 1995; Navalpakkam & Itti, 2005; Land & Hayhoe, 2001; Navalpakkam et al., 2010).”
Neural Mechanisms of Selective Visual Attention
Desimone, R., & Duncan, J. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001205 · Cited by 8,388
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Self-citationYarbus, A. L. (1967) · doi:10.1007/978-1-4899-5379-7 · Cited by 3,304
What attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766 · cited 1×
“As a feature, size has been suggested to guide visual attention (e.g., Treisman & Gelade, 1980; Wolfe & Horowitz, 2004).”
Memory Representations in Natural Tasks
Ballard, D. H., Hayhoe, M. M., & Pelz, J. B. (1995) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1995.7.1.66 · Cited by 817
Eye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775
Long-lasting modulation of feature integrationby transcranial magnetic stimulation
Scharnowski, F., Ruter, J., Jolij, J., Hermens, F., Kammer, T., & Herzog, M. H. (2009) · Journal of Vision · doi:10.1167/9.6.1 · Cited by 305
Spatial attention increases performance but not subjective confidence in a discrimination task
Wilimzig, C., Tsuchiya, N., Fahle, M., Einhäuser, W., & Koch, C. (2008) · Journal of Vision · doi:10.1167/8.5.7 · Cited by 196
Cited by
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
Self-citationRecurring the Transformer for Video Action Recognition
Yang, J., Dong, X., Liu, L., Zhang, C., Shen, J., & Yu, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01367 · Cited by 137
Metadata
- Authors
- Borji, A., Sihite, D. N., & Itti, L.
- Venue
- Vision Research
- Publisher
- Elsevier BV
- Published
- 2013-10
- Volume
- 91
- Pages
- 62-77
- ISSN
- 0042-6989 (ISSN-L)
- OpenAlex
- W2125446738
- Cited by
- 167
- References
- 9
- FWCI
- 11.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What stands out in a scene? A study of human explicit saliency judgment. https://app.cochat.ai/papers/10.1016/j.visres.2013.07.016
- The paper
- Borji, A., Sihite, D. N., & Itti, L. (2013). What stands out in a scene? A study of human explicit saliency judgment. Vision Research. https://doi.org/10.1016/j.visres.2013.07.016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.