The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Learning a saliency map using fixated locations in natural scenes
Open accessAbstract
Inspired by the primate visual system, computational saliency models decompose visual input into a set of feature maps across spatial scales in a number of pre-specified channels. The outputs of these feature maps are summed to yield the final saliency map. Here we use a least square technique to learn the weights associated with these maps from subjects freely fixating natural scenes drawn from four recent eye-tracking data sets. Depending on the data set, the weights can be quite different, with the face and orientation channels usually more important than color and intensity channels. Inter-subject differences are negligible. We also model a bias toward fixating at the center of images and consider both time-varying and constant factors that contribute to this bias. To compensate for the inadequacy of the standard method to judge performance (area under the ROC curve), we use two other metrics to comprehensively assess performance. Although our model retains the basic structure of the standard saliency model, it outperforms several state-of-the-art saliency algorithms. Furthermore, the simple structure makes the results applicable to numerous studies in psychophysics and physiology and leads to an extremely easy implementation for real-world applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Self-citation(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
The Earth Mover's Distance as a Metric for Image Retrieval
Rubner, Y., Tomasi, C., & Guibas, L. J. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026543900054 · Cited by 4,568
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Self-citationHarel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Self-citationA saliency-based search mechanism for overt and covert shifts of visual attention
Itti, L., & Koch, C. (2000) · Vision Research · doi:10.1016/s0042-6989(99)00163-7 · Cited by 3,156
Self-citation(2007) · Springer eBooks · doi:10.1007/978-0-387-71107-2 · Cited by 2,687
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
Gill, P. E., Murray, W., & Wright, M. H. (2019) · doi:10.1137/1.9781611975604 · Cited by 1,737
Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.766 · Cited by 1,639
Modeling the role of salience in the allocation of overt visual attention
Parkhurst, D., Law, K., & Niebur, E. (2002) · Vision Research · doi:10.1016/s0042-6989(01)00250-4 · Cited by 1,388
SUN: A Bayesian framework for saliency using natural statistics
Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008) · Journal of Vision · doi:10.1167/8.7.32 · Cited by 1,227
Tatler, B. W. (2007) · Journal of Vision · doi:10.1167/7.14.4 · Cited by 1,028
Saliency, attention, and visual search: An information theoretic approach
Bruce, N. D. B., & Tsotsos, J. K. (2009) · Journal of Vision · doi:10.1167/9.3.5 · Cited by 855
Components of bottom-up gaze allocation in natural images
Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005) · Vision Research · doi:10.1016/j.visres.2005.03.019 · Cited by 739
Self-citationVisual correlates of fixation selection: effects of scale and time
Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005) · Vision Research · doi:10.1016/j.visres.2004.09.017 · Cited by 700
A saliency map in primary visual cortex
Li, Z. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01817-9 · Cited by 660
A coherent computational approach to model bottom-up visual attention
Le Meur, O., Le Callet, P., Barba, D., & Thoreau, D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.86 · Cited by 642
Modeling the influence of task on attention
Navalpakkam, V., & Itti, L. (2005) · Vision Research · doi:10.1016/j.visres.2004.07.042 · Cited by 625
SPIE - The International Society for Optical Engineering
Allen, R., Culley, S. J., & Hicks, B. J. (2001) · Cited by 553
Spontaneous eye movements during visual imagery reflect the content of the visual scene.
Brandt, S. A., & Stark, L. W. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.1.27 · Cited by 522
Top-down control of visual attention in object detection
Oliva, A., Torralba, A., Castelhano, M. S., & Henderson, J. M. (2004) · Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429) · doi:10.1109/icip.2003.1246946 · Cited by 467
Objects predict fixations better than early saliency
Einhauser, W., Spain, M., & Perona, P. (2008) · Journal of Vision · doi:10.1167/8.14.18 · Cited by 451
Natural scene statistics at the centre of gaze
Reinagel, P., & Zador, A. M. (1999) · Network Computation in Neural Systems · doi:10.1088/0954-898x/10/4/304 · Cited by 434
Dynamic visual attention: searching for coding length increments
Hou, X., & Zhang, L. (2008) · CaltechAUTHORS (California Institute of Technology) · Cited by 431
Visual saliency does not account for eye movements during visual search in real-world scenes
Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007) · Eye Movements · doi:10.1016/b978-008044980-7/50027-6 · Cited by 429
Most naturally occurring human saccades have magnitudes of 15 degrees or less.
Bahill, A. T., Adler, D. C., & STARK, L. W. (1975) · PubMed · Cited by 421
Foulsham, T., & Underwood, G. (2008) · Journal of Vision · doi:10.1167/8.2.6 · Cited by 395
Faces and text attract gaze independent of the task: Experimental data and computer model
Cerf, M., Frady, E. P., & Koch, C. (2009) · Journal of Vision · doi:10.1167/9.12.10 · Cited by 377
Self-citationBayesian Surprise Attracts Human Attention
Itti, L., & Baldi, P. (2005) · neural information processing systems · Cited by 362
Oculomotor behavior and perceptual strategies in complex tasks
Pelz, J. B., & Canosa, R. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00245-0 · Cited by 338
Modelling search for people in 900 scenes: A combined source model of eye guidance
Ehinger, K. A., Hidalgo-Sotelo, B., Torralba, A., & Oliva, A. (2009) · Visual Cognition · doi:10.1080/13506280902834720 · Cited by 290
Visual saliency and semantic incongruency influence eye movements when inspecting pictures
Underwood, G., & Foulsham, T. (2006) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210500416342 · Cited by 257
Eye movements in iconic visual search
Rao, R. P. N., Zelinsky, G. J., Hayhoe, M. M., & Ballard, D. H. (2002) · Vision Research · doi:10.1016/s0042-6989(02)00040-8 · Cited by 253
The guidance of eye movements during active visual search
Motter, B. C., & Belky, E. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00349-0 · Cited by 250
Salience from feature contrast: additivity across dimensions
Nothdurft, H.-C. (2000) · Vision Research · doi:10.1016/s0042-6989(00)00031-6 · Cited by 243
The effect of target specification on objects fixated during visual search
Williams, L. G. (1966) · Perception & Psychophysics · doi:10.3758/bf03207398 · Cited by 209
An Eye Fixation Database for Saliency Detection in Images
Ramanathan, S., Katti, H., Sebe, N., Kankanhalli, M., & Chua, T.-S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_3 · Cited by 209
What and where: A Bayesian inference theory of attention
Chikkerur, S., Serre, T., Tan, C., & Poggio, T. (2010) · Vision Research · doi:10.1016/j.visres.2010.05.013 · Cited by 197
The discriminant center-surround hypothesis for bottom-up saliency
Gao, D., Mahadevan, V., & Vasconcelos, N. M. (2007) · neural information processing systems · Cited by 195
Comparison of feature combination strategies for saliency-based visual attention systems:
Itti, L., & Koch, C. (1999) · SPIE Proceedings · doi:10.1117/12.348467 · Cited by 191
Self-citationObject and scene analysis by saccadic eye-movements: an investigation with higher-order statistics
Zetzsche, C., Schill, K., Krieger, G., Hauske, G., & Rentschler, I. (2000) · Spatial Vision · doi:10.1163/156856800741216 · Cited by 189
Effects of Salience Are Short-Lived
Donk, M., & van Zoest, W. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02149.x · Cited by 178
Using Eye Saccades to Assess the Selectivity of Search Movements
ZELINSKY, G. J. (1996) · Vision Research · doi:10.1016/0042-6989(95)00300-2 · Cited by 178
GAFFE: A Gaze-Attentive Fixation Finding Engine
Rajashekar, U., van der Linde, I., Bovik, A. C., & Cormack, L. K. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.917218 · Cited by 170
Models of Bottom-up Attention and Saliency
Itti, L. (2005) · Elsevier eBooks · doi:10.1016/b978-012375731-9/50098-7 · Cited by 163
Koene, A. R., & Zhaoping, L. (2007) · Journal of Vision · doi:10.1167/7.7.6 · Cited by 134
Visual perception and sequences of eye movement fixations: a stochastic modeling approach
Hacısalihzade, S. S., STARK, L. W., & Allen, J. S. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.155948 · Cited by 129
The role of visual salience in directing eye movements in visual object agnosia
Mannan, S. K., Kennard, C., & Husain, M. (2009) · Current Biology · doi:10.1016/j.cub.2009.02.020 · Cited by 109
Probabilistic modeling of eye movement data during conjunction search via feature-based attention
Rutishauser, U., & Koch, C. (2007) · Journal of Vision · doi:10.1167/7.6.5 · Cited by 108
Self-citationFixation Patterns Made during Brief Examination of Two-Dimensional Images
Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1997) · Perception · doi:10.1068/p261059 · Cited by 106
Visual signal detection I Ability to use phase information
Burgess, A. E., & Ghandeharian, H. (1984) · Journal of the Optical Society of America A · doi:10.1364/josaa.1.000900 · Cited by 102
Fixation sequences made during visual examination of briefly presented 2D images
Mannan, S., Ruddock, K. H., & Wooding, D. S. (1997) · Spatial Vision · doi:10.1163/156856897x00177 · Cited by 98
Williams, D. E., & Reingold, E. M. (2001) · Psychonomic Bulletin & Review · doi:10.3758/bf03196182 · Cited by 96
Everyone knows what is interesting: Salient locations which should be fixated
Masciocchi, C. M., Mihalaş, Ş., Parkhurst, D. J., & Niebur, E. (2009) · Journal of Vision · doi:10.1167/9.11.25 · Cited by 93
Rajashekar, U., Bovik, A. C., & Cormack, L. K. (2006) · Journal of Vision · doi:10.1167/6.4.7 · Cited by 80
Kollmorgen, S., Nortmann, N., Schröder, S., & Peter König, B. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000791 · Cited by 69
Eye movements in reading isolated words: evidence for strong biases towards the center of the screen
Vitu, F., Kapoula, Z., Lancelin, D., & Lavigne, F. (2003) · Vision Research · doi:10.1016/j.visres.2003.06.002 · Cited by 65
“Starkfest” Vision and Clinic Science Special Issue
Choi, Y., Mosley, A. D., & STARK, L. W. (1995) · Optometry and Vision Science · doi:10.1002/j.1538-9235.1995.tb03906.x · Cited by 53
Expression of a re-centering bias in saccade regulation by superior colliculus neurons
Par�, M., & Munoz, D. P. (2001) · Experimental Brain Research · doi:10.1007/s002210000647 · Cited by 51
Human Gaze Control in Real World Search
Gajewski, D. A., Pearson, A. M., Mack, M. L., Bartlett, F. N., & Henderson, J. M. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-30572-9_7 · Cited by 23
Cited by
What Do Different Evaluation Metrics Tell Us About Saliency Models?
Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., & Durand, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2815601 · Cited by 802
Eye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775
Jiang, M., Huang, S., Duan, J., & Zhao, Q. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298710 · Cited by 729
Self-citationDeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations
Kruthiventi, S. S. S., Ayush, K., & Babu, R. V. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2710620 · Cited by 478
Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 474
Metadata
- Authors
- Zhao, Q., & Koch, C.
- Venue
- Journal of Vision
- Published
- 2011-03-10
- Volume
- 11
- Issue
- 3
- Pages
- 9-9
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W2151900481
- Cited by
- 256
- References
- 64
- FWCI
- 35.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.