The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Visual saliency estimation by nonlinearly integrating features using region covariances
Open accessAbstract
To detect visually salient elements of complex natural scenes, computational bottom-up saliency models commonly examine several feature channels such as color and orientation in parallel. They compute a separate feature map for each channel and then linearly combine these maps to produce a master saliency map. However, only a few studies have investigated how different feature dimensions contribute to the overall visual saliency. We address this integration issue and propose to use covariance matrices of simple image features (known as region covariance descriptors in the computer vision community; Tuzel, Porikli, & Meer, 2006) as meta-features for saliency estimation. As low-dimensional representations of image patches, region covariances capture local image structures better than standard linear filters, but more importantly, they naturally provide nonlinear integration of different features by modeling their correlations. We also show that first-order statistics of features could be easily incorporated to the proposed approach to improve the performance. Our experimental evaluation on several benchmark data sets demonstrate that the proposed approach outperforms the state-of-art models on various tasks including prediction of human eye fixations, salient object detection, and image-retargeting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
(1966) · Medical Entomology and Zoology · Cited by 10,293
The Earth Mover's Distance as a Metric for Image Retrieval
Rubner, Y., Tomasi, C., & Guibas, L. J. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026543900054 · Cited by 4,568
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Texture features for browsing and retrieval of image data
Manjunath, B. S., & Ma, W. Y. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531803 · Cited by 3,727
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Guided Search 2.0 A revised model of visual search
Wolfe, J. M. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03200774 · Cited by 3,504
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383267 · Cited by 3,422
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Guided search: An alternative to the feature integration model for visual search.
Wolfe, J. M., Cave, K. R., & Franzel, S. L. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.15.3.419 · Cited by 2,147
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806
Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.766 · Cited by 1,639
Synthesis and evaluation of linear motion transitions
Wang, J., & Bodenheimer, B. (2008) · ACM Transactions on Graphics · doi:10.1145/1330511.1330512 · Cited by 1,534
Modeling the role of salience in the allocation of overt visual attention
Parkhurst, D., Law, K., & Niebur, E. (2002) · Vision Research · doi:10.1016/s0042-6989(01)00250-4 · Cited by 1,388
Seam carving for content-aware image resizing
Avidan, S., & Shamir, A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276390 · Cited by 1,362
SUN: A Bayesian framework for saliency using natural statistics
Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008) · Journal of Vision · doi:10.1167/8.7.32 · Cited by 1,227
Saliency Based on Information Maximization
Bruce, N. D. B., & Tsotsos, J. K. (2005) · neural information processing systems · Cited by 1,134
Region Covariance: A Fast Descriptor for Detection and Classification
Tuzel, O., Porikli, F., & Meer, P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744047_45 · Cited by 1,115
Tatler, B. W. (2007) · Journal of Vision · doi:10.1167/7.14.4 · Cited by 1,028
Pedestrian Detection via Classification on Riemannian Manifolds
Tuzel, O., Porikli, F., & Meer, P. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.75 · Cited by 975
Learning to Detect A Salient Object
Liu, T., Sun, J., Zheng, N.-N., Tang, X., & Shum, H.-Y. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383047 · Cited by 946
Saliency, attention, and visual search: An information theoretic approach
Bruce, N. D. B., & Tsotsos, J. K. (2009) · Journal of Vision · doi:10.1167/9.3.5 · Cited by 855
Context-aware saliency detection
Goferman, S., Zelnik-Manor, L., & Tal, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539929 · Cited by 753
Components of bottom-up gaze allocation in natural images
Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005) · Vision Research · doi:10.1016/j.visres.2005.03.019 · Cited by 739
Visual correlates of fixation selection: effects of scale and time
Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005) · Vision Research · doi:10.1016/j.visres.2004.09.017 · Cited by 700
Static and space-time visual saliency detection by self-resemblance
Seo, H. J., & Milanfar, P. (2009) · Journal of Vision · doi:10.1167/9.12.15 · Cited by 633
Is bottom-up attention useful for object recognition?
Rutishauser, U., Walther, D., Koch, C., & Perona, P. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315142 · Cited by 592
Visual Saliency Based on Scale-Space Analysis in the Frequency Domain
Li, J., Levine, M. D., An, X., Xu, X., & He, H. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.147 · Cited by 574
Covariance Tracking using Model Update Based on Lie Algebra
Porikli, F., Tuzel, O., & Meer, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.94 · Cited by 562
Rapid Biologically-Inspired Scene Classification Using Features Shared with Visual Attention
Siagian, C., & Itti, L. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.40 · Cited by 526
Segmenting Salient Objects from Images and Videos
Rahtu, E., Kannala, J., Salo, M., & Heikkilä, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_27 · Cited by 520
A Benchmark of Computational Models of Saliency to Predict Human Fixations
Judd, T., Durand, F., & Torralba, A. B. (2012) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 511
Predicting human gaze using low-level saliency combined with face detection
Cerf, M., Harel, J., Einhäuser, W., & Koch, C. (2008) · CaltechAUTHORS (California Institute of Technology) · Cited by 465
Faces and text attract gaze independent of the task: Experimental data and computer model
Cerf, M., Frady, E. P., & Koch, C. (2009) · Journal of Vision · doi:10.1167/9.12.10 · Cited by 377
Exploiting local and global patch rarities for saliency detection
Borji, A., & Itti, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247711 · Cited by 376
Quantifying center bias of observers in free viewing of dynamic natural scenes
Tseng, P. H., Carmi, R., Cameron, I. G. M., Munoz, D. P., & Itti, L. (2009) · Journal of Vision · doi:10.1167/9.7.4 · Cited by 362
A comparative study of image retargeting
Rubinstein, M., Gutiérrez, D., Sorkine‐Hornung, O., & Shamir, A. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866186 · Cited by 343
Gao, D., Han, S., & Vasconcelos, N. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.27 · Cited by 294
Visual saliency detection by spatially weighted dissimilarity
Duan, L., Wu, C., Miao, J., Qing, L., & Fu, Y. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995676 · Cited by 291
Eckstein, M. P., Thomas, J. P., Palmer, J., & Shimozaki, S. S. (2000) · Perception & Psychophysics · doi:10.3758/bf03212096 · Cited by 274
Learning a saliency map using fixated locations in natural scenes
Zhao, Q., & Koch, C. (2011) · Journal of Vision · doi:10.1167/11.3.9 · Cited by 256
Non-parametric similarity measures for unsupervised texture segmentation and image retrieval
Puzicha, J., Hofmann, T., & Buhmann, J. M. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609331 · Cited by 254
Modeling global scene factors in attention
Torralba, A. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001407 · Cited by 247
A simple saliency model predicts a number of motion popout phenomena
Rosenholtz, R. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00077-2 · Cited by 235
Jain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866174 · Cited by 219
Emergence of complex cell properties by learning to generalize in natural scenes
Karklin, Y., & Lewicki, M. S. (2009) · Nature · doi:10.1038/nature07481 · Cited by 218
Bottom-up saliency is a discriminant process
Gao, D., & Vasconcelos, N. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408851 · Cited by 214
Saliency detection for content-aware image resizing
Achanta, R., & Susstrunk, S. E. (2009) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2009.5413815 · Cited by 205
Foveation scalable video coding with automatic fixation selection
Wang, Z., Lu, L., & Bovik, A. C. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.809015 · Cited by 196
Computing texture boundaries from images
Voorhees, H., & Poggio, T. (1988) · Nature · doi:10.1038/333364a0 · Cited by 167
Search asymmetries? What search asymmetries?
Rosenholtz, R. E. (2001) · Perception & Psychophysics · doi:10.3758/bf03194414 · Cited by 117
Learning visual saliency by combining feature maps in a nonlinear manner using AdaBoost
Zhao, Q., & Koch, C. (2012) · Journal of Vision · doi:10.1167/12.6.22 · Cited by 111
Sigma Set: A small second order statistical region descriptor
Hong, X., Chang, H., Shan, S., Chen, X., & Gao, W. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206742 · Cited by 63
The effect of background color on asymmetries in color search
Rosenholtz, R. E., Nagy, A. L., & Bell, N. R. (2004) · Journal of Vision · doi:10.1167/4.3.9 · Cited by 54
Significantly Different Textures: A Computational Model of Pre-attentive Texture Segmentation
Rosenholtz, R. E. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45053-x_13 · Cited by 27
Cited by
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
What Do Different Evaluation Metrics Tell Us About Saliency Models?
Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., & Durand, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2815601 · Cited by 802
SALICON: Reducing the Semantic Gap in Saliency Prediction by Adapting Deep Neural Networks
Huang, X., Shen, C., Boix, X., & Zhao, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.38 · Cited by 597
DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations
Kruthiventi, S. S. S., Ayush, K., & Babu, R. V. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2710620 · Cited by 478
Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 474
Metadata
- Authors
- Erdem, E., & Erdem, A.
- Venue
- Journal of Vision
- Published
- 2013-03-18
- Volume
- 13
- Issue
- 4
- Pages
- 11-11
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W2008066834
- Cited by
- 396
- References
- 59
- FWCI
- 47.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.