The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Exploiting local and global patch rarities for saliency detection
Abstract
We introduce a saliency model based on two key ideas. The first one is considering local and global image patch rarities as two complementary processes. The second one is based on our observation that for different images, one of the RGB and Lab color spaces outperforms the other in saliency detection. We propose a framework that measures patch rarities in each color space and combines them in a final map. For each color channel, first, the input image is partitioned into non-overlapping patches and then each patch is represented by a vector of coefficients that linearly reconstruct it from a learned dictionary of patches from natural scenes. Next, two measures of saliency (Local and Global) are calculated and fused to indicate saliency of each patch. Local saliency is distinctiveness of a patch from its surrounding patches. Global saliency is the inverse of a patch's probability of happening over the entire image. The final saliency map is built by normalizing and fusing local and global saliency maps of all channels from both color systems. Extensive evaluation over four benchmark eye-tracking datasets shows the significant advantage of our approach over 10 state-of-the-art saliency models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Self-citationEmergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 2×
“As a supporting evidence for this theory, it has been shown that receptive fields (RF) of some neurons in V1 cortex resemble those RFs that are learned by sparse coding algorithms [27].”
BackgroundImage Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383267 · Cited by 3,422
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“It is well known that natural images can be sparsely represented by a set of localized and oriented filters [27][28].”
BackgroundOnline Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
What attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766 · cited 1×
“A majority of computational models of attention follow the structure adapted from the Feature Integration Theory (FIT) [15] and the Guided Search model [1].”
MethodTorralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.766 · Cited by 1,639
Modeling the role of salience in the allocation of overt visual attention
Parkhurst, D., Law, K., & Niebur, E. (2002) · Vision Research · doi:10.1016/s0042-6989(01)00250-4 · Cited by 1,388
Saliency Based on Information Maximization
Bruce, N. D. B., & Tsotsos, J. K. (2005) · neural information processing systems · Cited by 1,307
Modeling attention to salient proto-objects
Walther, D., & Koch, C. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.10.001 · Cited by 1,249
SUN: A Bayesian framework for saliency using natural statistics
Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008) · Journal of Vision · doi:10.1167/8.7.32 · Cited by 1,227
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Self-citationGuo, C., & Zhang, L. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2030969 · Cited by 934
Image Signature: Highlighting Sparse Salient Regions
Hou, X., Harel, J., & Koch, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.146 · Cited by 834
Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention
Itti, L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834657 · Cited by 759
Self-citationComponents of bottom-up gaze allocation in natural images
Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005) · Vision Research · doi:10.1016/j.visres.2005.03.019 · Cited by 739
Self-citationA coherent computational approach to model bottom-up visual attention
Le Meur, O., Le Callet, P., Barba, D., & Thoreau, D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.86 · Cited by 642
Static and space-time visual saliency detection by self-resemblance
Seo, H. J., & Milanfar, P. (2009) · Journal of Vision · doi:10.1167/9.12.15 · Cited by 633
Dynamic visual attention: searching for coding length increments
Hou, X., & Zhang, L. (2008) · CaltechAUTHORS (California Institute of Technology) · Cited by 484
Objects predict fixations better than early saliency
Einhauser, W., Spain, M., & Perona, P. (2008) · Journal of Vision · doi:10.1167/8.14.18 · Cited by 451
Stylization and abstraction of photographs
DeCarlo, D., & Santella, A. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566650 · Cited by 432
Center-surround divergence of feature statistics for salient object detection
Klein, D. A., & Frintrop, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126499 · Cited by 369
An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed
Navalpakkam, V., & Itti, L. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.54 · Cited by 369
Self-citationVisual saliency detection by spatially weighted dissimilarity
Duan, L., Wu, C., Miao, J., Qing, L., & Fu, Y. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995676 · Cited by 291
Realistic avatar eye and head animation using a neurobiological model of visual attention
Itti, L., Dhavale, N., & Pighin, F. (2004) · SPIE Proceedings · doi:10.1117/12.512618 · Cited by 289
Self-citationInteresting objects are visually salient
Elazary, L., & Itti, L. (2008) · Journal of Vision · doi:10.1167/8.3.3 · Cited by 283
Self-citationLearning a saliency map using fixated locations in natural scenes
Zhao, Q., & Koch, C. (2011) · Journal of Vision · doi:10.1167/11.3.9 · Cited by 256
Computational versus Psychophysical Bottom-Up Image Saliency: A Comparative Evaluation Study
Toet, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.53 · Cited by 214
An Eye Fixation Database for Saliency Detection in Images
Ramanathan, S., Katti, H., Sebe, N., Kankanhalli, M., & Chua, T.-S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_3 · Cited by 209
The discriminant center-surround hypothesis for bottom-up saliency
Gao, D., Mahadevan, V., & Vasconcelos, N. M. (2007) · neural information processing systems · Cited by 195
A Nonparametric Approach to Bottom-Up Visual Saliency
Kienzle, W., Wichmann, F. A., Schölkopf, B., & Franz, M. O. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0091 · Cited by 187
Robust classification of objects, faces, and flowers using natural image statistics
Kanan, C., & Cottrell, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539947 · Cited by 185
Image saliency by isocentric curvedness and color
Valenti, R., Sebe, N., & Gevers, T. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459240 · Cited by 179
Empirical Validation of the Saliency-based Model of Visual Attention
Ouerhani, N., von Wartburg, R., Hügli, H., & Müri, R. M. (2003) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.66 · Cited by 165
Esaliency (Extended Saliency): Meaningful Attention Using Stochastic Image Modeling
Avraham, T., & Lindenbaum, M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.53 · Cited by 158
Kootstra, G., Nederveen, A., & de Boer, B. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.111 · Cited by 131
A Review of Fast L(1)-Minimization Algorithms for Robust Face Recognition
Yang, A. Y., Genesh, A., Zhou, Z., Sastry, S., & Ma, Y. (2010) · Defense Technical Information Center (DTIC) · doi:10.21236/ada525384 · Cited by 128
Do predictions of visual perception aid design?
Rosenholtz, R. E., Dorai, A. K., & Freeman, R. (2011) · ACM Transactions on Applied Perception · doi:10.1145/1870076.1870080 · Cited by 111
Saliency-based image processing for retinal prostheses
Parikh, N., Itti, L., & Weiland, J. D. (2010) · Journal of Neural Engineering · doi:10.1088/1741-2560/7/1/016006 · Cited by 73
Self-citationDecorrelation and Distinctiveness Provide with Human-Like Saliency
García-Díaz, A., Fdez-Vidal, X. R., Pardo, X. M., & Dosil, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04697-1_32 · Cited by 70
Cited by
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
Self-citationSalient Object Detection: A Discriminative Regional Feature Integration Approach
Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., & Li, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.271 · Cited by 1,147
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
Self-citationHow to Evaluate Foreground Maps
Margolin, R., Zelnik-Manor, L., & Tal, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.39 · Cited by 1,106
A Simple Pooling-Based Design for Real-Time Salient Object Detection
Liu, J.-J., Hou, Q., Cheng, M.-M., Feng, J., & Jiang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00404 · Cited by 1,100
Metadata
- Authors
- Borji, A., & Itti, L.
- Venue
- 2012 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 478-485
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2169632643
- Cited by
- 376
- References
- 46
- FWCI
- 29.40
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.