CoChat
Cited by 524

The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.

Salient object detection: A survey

Open access
Borji, Ali, Cheng, Ming-Ming, Hou, Qibin, Jiang, Huaizu, Li, Jia · 2019 · Computational Visual Media

Abstract

Detecting and segmenting salient objects from natural scenes, often referred to as salient object detection, has attracted great interest in computer vision. While many models have been proposed and several applications have emerged, a deep understanding of achievements and issues remains lacking. We aim to provide a comprehensive review of recent progress in salient object detection and situate this field among other closely related areas such as generic scene segmentation, object proposal generation, and saliency for fixation prediction. Covering 228 publications, we survey i) roots, key concepts, and tasks, ii) core techniques and main modeling trends, and iii) datasets and evaluation metrics for salient object detection. We also discuss open problems such as evaluation metrics and dataset bias in model performance, and suggest future research directions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s41095-019-0149-9

Cites

87 of 87 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 148

  1. Bylinskii, Z.; Judd, T.; Borji, A.; Itti, L.; Durand, F.; Oliva, A.; Torralba, A. MIT saliency benchmark. 2015. Available at https://doi.org/saliency.mit.edu/results_mit300.html .
  2. Bylinskii, Z.; Recasens, A.; Borji, A.; Oliva, A.; Torralba, A.; Durand, F. Where should saliency models look next? In: Computer Vision — ECCV 2016. Lecture Notes in Computer Science, Vol. 9909. Leibe, B.; Matas, J.; Sebe, N.; Welling, M. Eds. Springer Cham, 809–824, 2016.
  3. Berg, A. C.; Berg, T. L.; Daume, H.; Dodge, J.; Goyal, A.; Han, X.; Mensch, A.; Mitchell, M.; Sood, A.; Stratos, K. et al. Understanding and predicting importance in images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3562–3569, 2012.
  4. M’t Hart, B. M.; Schmidt, H. C. E. F.; Roth, C.; Einhäuser, W. Fixations on objects in natural scenes: Dissociating importance from salience. Frontiers in Psychology Vol. 4, 455, 2013.
  5. Isola, P.; Xiao, J.; Torralba, A.; Oliva, A. What makes an image memorable? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 145–152, 2011.
  6. Katti, H.; Bin, K. Y.; Chua, T. S.; Kankanhalli, M. Preattentive discrimination of interestingness in images. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 1433–1436, 2008.
  7. Gygli, M.; Grabner, H.; Riemenschneider, H.; Nater, F.; Van Gool, L. The interestingness of images. In: Proceedings of the IEEE International Conference on Computer Vision, 1633–1640, 2013.
  8. Dhar, S.; Ordonez, V.; Berg, T. L. High level describable attributes for predicting aesthetics and interestingness. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1657–1664, 2011.
  9. Jiang, Y.-G.; Wang, Y.; Feng, R.; Xue, X.; Zheng, Y.; Yang, H. Understanding and predicting interestingness of videos. In: Proceedings of the 27th AAAI Conference on Artificial Intelligence, 2013.
  10. Itti, L.; Baldi, P. Bayesian surprise attracts human attention. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, 547–554, 2005.
  11. Vogel, J.; Schiele, B. A semantic typicality measure for natural scene categorization. In: Pattern Recognition. Lecture Notes in Computer Science, Vol. 3175. Rasmussen, C. E.; Bülthoff, H. H.; Schölkopf, B.; Giese, M. A. Eds. Springer Berlin Heidelberg, 195–203, 2004.
  12. Ehinger, K. A.; Xiao, J.; Torralba, A.; Oliva, A. Estimating scene typicality from human ratings and image features. In: Proceedings of the Annual Cognitive Science Conference, 2011.
  13. Farhadi, A.; Endres, I.; Hoiem, D.; Forsyth, D. Describing objects by their attributes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1778–1785, 2009.
  14. Li, Y.; Hou, X.; Koch, C.; Rehg, J. M.; Yuille, A. L. The secrets of salient object segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 280–287, 2014.
  15. Liu, T.; Sun, J.; Zheng, N.; Tang, X.; Shum, H.-Y. Learning to detect a salient object. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2007.
  16. Perazzi, F.; Krahenbuhl, P.; Pritch, Y.; Hornung, A. Saliency filters: Contrast based filtering for salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 733–740, 2012.
  17. Cheng, M.-M.; Zhang, Z.; Lin, W.-Y.; Torr, P. H. S. BING: Binarized normed gradients for objectness estimation at 300fps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3286–3293, 2014.
  18. Borji, A.; Tavakoli, H. R.; Sihite, D. N.; Itti, L. Analysis of scores, datasets, and models in visual saliency prediction. In: Proceedings of the IEEE International Conference on Computer Vision, 921–928, 2013.
  19. Alexe, B.; Deselaers T.; Ferrari, V. What is an object? In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 73–80, 2010.
  20. Siva, P.; Russell, C.; Xiang, T.; Agapito, L. Looking beyond the image: Unsupervised learning for object saliency and detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3238–3245, 2013.
  21. Cheng, M.-M.; Zhang, G.-X.; Mitra, N. J.; Huang, X.; Hu, S.-M. Global contrast based salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 409–416, 2011.
  22. Jiang, H. Z.; Wang, J. D.; Yuan, Z. J.; Wu, Y.; Zheng, N. N.; Li, S. P. Salient object detection: A discriminative regional feature integration approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2083–2090, 2013.
  23. Margolin, R.; Zelnik-Manor, L.; Tal, A. Saliency for image manipulation. The Visual Computer Vol. 29, No. 5, 381–392, 2013. · doi:10.1007/s00371-012-0740-x
  24. Yan, Q.; Xu, L.; Shi, J.; Jia, J. Hierarchical saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1155–1162, 2013.
  25. Yang, C.; Zhang, L. H.; Lu, H. C. Graph-regularized saliency detection with convex-hull-based center prior. IEEE Signal Processing Letters Vol. 20, No. 7, 637–640, 2013. · DOI
  26. Wang, L.; Lu, H.; Ruan, X.; Yang, M.-H. Deep networks for saliency detection via local estimation and global search. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3183–3192, 2015.
  27. Zhao, R.; Ouyang, W.; Li, H.; Wang, X. Saliency detection by multi-context deep learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1265–1274, 2015.
  28. Li, G.; Yu, Y. Visual saliency based on multiscale deep features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 5455–5463, 2015.
  29. Zou, W.; Komodakis, N. HARF: Hierarchy-associated rich features for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, 406–414, 2015.
  30. Hou, Q.; Cheng, M.-M.; Hu, X.; Borji, A.; Tu, Z.; Torr, P. H. S. Deeply supervised salient object detection with short connections. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3203–3212, 2017.
  31. Wolfe, J. M.; Cave, K. R.; Franzel, S. L. Guided search: An alternative to the feature integration model for visual search. Journal of Experimental Psychology: Human Perception and Performance Vol. 15, No. 3, 419–433, 1989.
  32. Koch, C.; Ullman, S. Shifts in selective visual attention: Towards the underlying neural circuitry. In: Matters of Intelligence. Synthese Library (Studies in Epistemology, Logic, Methodology, and Philosophy of Science), Vol. 188. Vaina, L. M. Ed. Springer Dordrecht, 115–141, 1987.
  33. Bruce, N. D. B.; Tsotsos, J. K. Saliency based on information maximization. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, 155–162, 2005.
  34. Achanta, R.; Estrada, F.; Wils, P.; Süsstrunk, S. Salient region detection and segmentation. In:Computer Vision Systems. Lecture Notes in Computer Science, Vol. 5008. Gasteratos, A.; Vincze, M.; Tsotsos, J. K. Eds. Springer Berlin Heidelberg, 66–75, 2008.
  35. Ma, Y.-F.; Zhang, H.-J. Contrast-based image attention analysis by using fuzzy growing. In: Proceedings of the 11th ACM International Conference on Multimedia, 374–381, 2003.
  36. Endres, I.; Hoiem, D. Category independent object proposals. In: Computer Vision — ECCV 2010. Lecture Notes in Computer Science, Vol. 6315 Daniilidis, K.; Maragos, P.; Paragios, N. Eds. Springer Berlin Heidelberg, 575–588, 2010.
  37. Judd, T.; Ehinger, K.; Durand, F.; Torralba, A. Learning to predict where humans look. In: Proceedings of the IEEE 12th International Conference on Computer Vision, 2106–2113, 2009.
  38. Hou, X.; Zhang, L. Saliency detection: A spectral residual approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2007.
  39. Borji, A.; Itti, L. Exploiting local and global patch rarities for saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 478–485, 2012.
  40. Borji, A. Boosting bottom-up and top-down visual features for saliency estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 438–445, 2012.
  41. Long, J.; Shelhamer, E.; Darrell, T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440, 2015.
  42. Hua, G.; Liu, Z. C.; Zhang, Z. Y.; Wu, Y. Iterative local-global energy minimization for automatic extraction of objects of interest. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 28, No. 10, 1701–1706, 2006. · doi:10.1109/tpami.2006.209
  43. Allili, M. S.; Ziou, D. Object of interest segmentation and tracking by using feature selection and active contours. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2007.
  44. Hu, Y.; Rajan, D.; Chia, L.-T. Robust subspace analysis for detecting visual attention regions in images. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, 716–724, 2005. · doi:10.1145/1101149.1101306
  45. Valenti, R.; Sebe, N.; Gevers, T. Image saliency by isocentric curvedness and color. In: Proceedings of the IEEE 12th International Conference on Computer Vision, 2185–2192, 2009.
  46. Klein, D. A.; Frintrop, S. Center-surround divergence of feature statistics for salient object detection. In: Proceedings of the International Conference on Computer Vision, 2214–2219, 2011.
  47. Li, X.; Li, Y.; Shen, C.; Dick, A. R.; van den Hengel, A. Contextual hypergraph modeling for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, 3328–3335, 2013.
  48. Margolin, R.; Tal, A.; Zelnik-Manor, L. What makes a patch distinct? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1139–1146, 2013.
  49. Cheng, M. M.; Mitra, N. J.; Huang, X. L.; Torr, P. H. S.; Hu, S. M. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 37, No. 3, 569–582, 2015. · DOI · Paper page
  50. Scharfenberger, C.; Wong, A.; Fergani, K.; Zelek, J. S.; Clausi, D. A. Statistical textural distinctiveness for salient region detection in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 979–986, 2013.
  51. Cheng, M.-M.; Warrell, J.; Lin, W.-Y.; Zheng, S.; Vineet, V.; Crook, N. Efficient salient region detection with soft image abstraction. In: Proceedings of the IEEE International Conference on Computer Vision, 1529–1536, 2013.
  52. Jiang, Z.; Davis, L. S. Submodular salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2043–2050, 2013.
  53. Shi, K. Y.; Wang, K. Z.; Lu, J. B.; Lin, L. PISA: Pixelwise image saliency by aggregating complementary appearance contrast measures with spatial priors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2115–2122, 2013.
  54. Yu, H. N.; Li, J.; Tian, Y. H.; Huang, T. J. Automatic interesting object extraction from images using complementary saliency maps. In: Proceedings of the International Conference on Multimedia, 891–894, 2010.
  55. Lu, Y.; Zhang, W.; Lu, H.; Xue, X. Salient object detection using concavity context. In: Proceedings of the International Conference on Computer Vision, 233–240, 2011.
  56. Chang, K.-Y.; Liu, T.-L.; Chen, H.-T.; Lai, S.-H. Fusing generic objectness and visual saliency for salient object detection. In: Proceedings of the International Conference on Computer Vision, 914–921, 2011.
  57. Jiang, H.; Wang, J.; Yuan, Z.; Liu, T.; Zheng, N. Automatic salient object segmentation based on context and shape prior. In: Proceedings of the British Machine Vision Conference, 2011.
  58. Shen, X.; Wu, Y. A unified approach to salient object detection via low rank matrix recovery. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 853–860, 2012.
  59. Wei, Y. C.; Wen, F.; Zhu, W. J.; Sun, J. Geodesic saliency using background priors. In: Computer Vision — ECCV 2012. Lecture Notes in Computer Science, Vol. 7574. Fitzgibbon, A.; Lazebnik, S.; Perona, P.; Sato, Y.; Schmid, C. Eds. Springer Berlin Heidelberg, 29–42, 2012.
  60. Yang, C.; Zhang, L.; Lu, H.; Ruan, X.; Yang, M.-H. Saliency detection via graph-based manifold ranking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3166–3173, 2013.
  61. Li, X.; Lu, H.; Zhang, L.; Ruan, X.; Yang, M.-H. Saliency detection via dense and sparse reconstruction. In: Proceedings of the IEEE International Conference on Computer Vision, 2976–2983, 2013.
  62. Jiang, B.; Zhang, L.; Lu, H.; Yang, C.; Yang, M.-H. Saliency detection via absorbing Markov chain. In: Proceedings of the IEEE International Conference on Computer Vision, 1665–1672, 2013.
  63. Jiang, P.; Ling, H.; Yu, J.; Peng, J. Salient region detection by UFO: Uniqueness, focusness and objectness. In: Proceedings of the IEEE International Conference on Computer Vision, 1976–1983, 2013.
  64. Jia, Y.; Han, M. Category-independent object-level saliency detection. In: Proceedings of the IEEE International Conference on Computer Vision, 1761–1768, 2013.
  65. Peng, H.; Li, B.; Ji, R.; Hu, W.; Xiong, W.; Lang, C. Salient object detection via low-rank and structured sparse matrix decomposition. In: Proceedings of the 27th AAAI Conference on Artificial Intelligence, 796–802, 2013.
  66. Liu, R.; Cao, J.; Lin, Z.; Shan, S. Adaptive partial differential equation learning for visual saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3866–3873, 2014.
  67. Zhu, W.; Liang, S.; Wei, Y.; Sun, J. Saliency optimization from robust background detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2814–2821, 2014.
  68. Zhang, J.; Sclaroff, S. Saliency detection: A Boolean map approach. In: Proceedings of the IEEE International Conference on Computer Vision, 153–160, 2013.
  69. Li, N.; Ye, J.; Ji, Y.; Ling, H.; Yu, J. Saliency detection on light field. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2806–2813, 2014.
  70. Rahtu, E.; Kannala, J.; Salo, M.; Heikkilä, J. Segmenting salient objects from images and videos. In: Computer Vision - ECCV 2010. Lecture Notes in Computer Science, Vol. 6315. Daniilidis, K.; Maragos, P.; Paragios, N. Eds. Springer Berlin Heidelberg, 366–379, 2010.
  71. Khuwuthyakorn, P.; Robles-Kelly, A.; Zhou, J. Object of interest detection by saliency learning. In: Computer Vision — ECCV 2010. Lecture Notes in Computer Science, Vol. 6312. Daniilidis, K.; Maragos, P.; Paragios, N. Eds. Springer Berlin Heidelberg, 636–649, 2010.
  72. Lu, S.; Mahadevan, V.; Vasconcelos, N. Learning optimal seeds for diffusion-based salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2790–2797, 2014.
  73. Kim, J.; Han, D.; Tai, Y.-W.; Kim, J. Salient region detection via high-dimensional color transform. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 883–890, 2014.
  74. Marchesotti, L.; Cifarelli, C.; Csurka, G. A framework for visual saliency detection with applications to image thumbnailing. In: Proceedings of the IEEE 12th International Conference on Computer Vision, 2232–2239, 2009.
  75. Wang, M.; Konrad, J.; Ishwar, P.; Jing, K.; Rowley, H. Image saliency: From intrinsic to extrinsic context. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 417–424, 2011.
  76. Mai, L.; Niu, Y.; Liu, F. Saliency aggregation: A datadriven approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1131–1138, 2013.
  77. Liu, T.; Zheng, N.; Ding, W.; Yuan, Z. Video attention: Learning to detect a salient object sequence. In: Proceedings of the 19th International Conference on Pattern Recognition, 1–4, 2008.
  78. Li, Y.; Sheng, B.; Ma, L. Z.; Wu, W.; Xie, Z. F. Temporally coherent video saliency using regional dynamic contrast. IEEE Transactions on Circuits and Systems for Video Technology Vol. 23, No. 12, 2067–2076, 2013. · doi:10.1109/tcsvt.2013.2270367
  79. Chang, K.; Liu, T.; Lai, S. From co-saliency to cosegmentation: An efficient and fully unsupervised energy minimization model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2129–2136, 2011.
  80. Niu, Y.; Geng, Y.; Li, X.; Liu, F. Leveraging stereopsis for saliency analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 454–461, 2012.
  81. Desingh, K.; Krishna, K. M.; Rajan, D.; Jawahar, C. V. Depth really matters: Improving visual salient region detection with depth. In: Proceedings of the British Machine Vision Conference, 2013.
  82. Batra, D.; Kowdle, A.; Parikh, D.; Luo J.; Chen, T. iCoseg: Interactive co-segmentation with intelligent scribble guidance. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 3169–3176, 2010.
  83. Mukherjee, L.; Singh, V.; Peng, J. Scale invariant cosegmentation for image groups. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1881–1888, 2011.
  84. Kim, G.; Xing, E. P.; Li, F. F.; Kanade, T. Distributed cosegmentation via submodular optimization on anisotropic diffusion. In: Proceedings of the International Conference on Computer Vision Barcelona, 169–176, 2011.
  85. Feng, J.; Wei, Y.; Tao, L.; Zhang, C.; Sun, J. Salient object detection by composition. In: Proceedings of the International Conference on Computer Vision, 1028–1035, 2011.
  86. Wang, P.; Wang, J.; Zeng, G.; Feng, J.; Zha, H.; Li, S. Salient object detection for searched web images via global saliency. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, 3194–3201, 2012.
  87. Wang, L.; Xue, J.; Zheng, N.; Hua, G. Automatic salient object extraction with contextual cue. In: Proceedings of the International Conference on Computer Vision, 105–112, 2011.
  88. Tian, Y. H.; Li, J.; Yu, S.; Huang, T. J. Learning complementary saliency priors for foreground object segmentation in complex scenes. International Journal of Computer Vision Vol. 111, No. 2, 153–170, 2015. · DOI
  89. Li, J.; Tian, Y. H.; Duan, L. Y.; Huang, T. J. Estimating visual saliency through single image optimization. IEEE Signal Processing Letters Vol. 20, No. 9, 845–848, 2013. · doi:10.1109/lsp.2013.2268868
  90. Qin, Y.; Lu, H. C.; Xu, Y. Q.; Wang, H. Saliency detection via cellular automata. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 110–119, 2015.
  91. Lang, C. Y.; Nguyen, T. V.; Katti, H.; Yadati, K.; Kankanhalli, M.; Yan, S. C. Depth matters: Influence of depth cues on visual saliency. In: Computer Vision — ECCV 2012. Lecture Notes in Computer Science, Vol. 7573. Fitzgibbon, A.; Lazebnik, S.; Perona, P.; Sato, Y.; Schmid, C. Eds. Springer Berlin Heidelberg, 101–115, 2012.
  92. Xie, S.; Tu, Z. Holistically-nested edge detection. In: Proceedings of the IEEE International Conference on Computer Vision, 1395–1403, 2015.
  93. Szegedy, C.; Liu, W.; Jia, Y.; Sermanet, P.; Reed, S.; Anguelov, D.; Erhan, D.; Vanhoucke, V.; Rabinovich, A. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–9, 2015.
  94. Lee, G.; Tai, Y.-W.; Kim, J. Deep saliency with encoded low level distance map and high level features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 660–668, 2016.
  95. Kim, J.; Pavlovic, V. A shape preserving approach for salient object detection using convolutional neural networks. In: Proceedings of the 23rd International Conference on Pattern Recognition, 609–614, 2016.
  96. Wang, X.; Ma, H. M.; Chen, X. Z. Salient object detection via fast R-CNN and low-level cues. In: Proceedings of the IEEE International Conference on Image Processing, 1042–1046, 2016.
  97. Kim, J.; Pavlovic, V. A shape preserving approach for salient object detection using convolutional neural networks. In: Proceedings of the 23rd International Conference on Pattern Recognition, 609–614, 2016.
  98. Liu, N.; Han, J. DHSNet: Deep hierarchical saliency network for salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 678–686, 2016.
  99. Li, G. B.; Yu, Y. Z. Deep contrast learning for salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 478–487, 2016.
  100. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. · arXiv
  101. Kuen, J.; Wang, Z. H.; Wang, G. Recurrent attentional networks for saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3668–3677, 2016.
  102. Kruthiventi, S. S. S.; Gudisa, V.; Dholakiya, J. H.; Babu, R. V. Saliency unified: A deep architecture for simultaneous eye fixation prediction and salient object segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 5781–5790, 2016.
  103. Tang, Y. B.; Wu, X. Q. Saliency detection via combining region-level and pixel-level predictions with CNNs. In: Computer Vision — ECCV 2016. Lecture Notes in Computer Science, Vol. 9912. Leibe, B.; Matas, J.; Sebe, N.; Welling, M. Eds. Springer Cham, 809–825 2016.
  104. Tang, Y. B.; Wu, X. Q.; Bu, W. Deeply-supervised recurrent convolutional neural network for saliency detection. In: Proceedings of the ACM on Multimedia Conference, 397–401, 2016.
  105. Zhang, J.; Dai, Y. C.; Porikli, F. Deep salient object detection by integrating multi-level cues. In: Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 1–10, 2017.
  106. Li, G.; Xie, Y.; Lin, L.; Yu, Y. Instance-level salient object segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2386–2395, 2017.
  107. Wang, L. J.; Lu, H. C.; Ruan, X.; Yang, M. H. Deep networks for saliency detection via local estimation and global search. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3183–3192, 2015.
  108. Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 580–587, 2014.
  109. Jaderberg, M.; Simonyan, K.; Zisserman, A.; Kavukcuoglu, K. Spatial transformer networks. In: Proceedings of the 28th International Conference onNeural Information Processing Systems, Vol. 2, 2017–2025, 2015.
  110. Achanta, R.; Shaji, A.; Smith, K.; Lucchi, A.; Fua, P.; Süsstrunk, S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 34, No. 11, 2274–2282, 2012. · DOI · Paper page
  111. Arbelaez, P.; PontTuset, J.; Barron, J. T.; Marques, F.; Malik, J. Multiscale combinatorial grouping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 328–335, 2014.
  112. Oquab, M.; Bottou, L.; Laptev, I.; Sivic, J. Learning and transferring mid-level image representations using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1717–1724, 2014.
  113. Jiang, H.; Wang, J.; Yuan, Z.; Wu, Y.; Zheng, N.; Li, S. Salient object detection: A discriminative regional feature integration approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2083–2090, 2013.
  114. Huang, H.; Zhang, L.; Zhang, H. C. Arcimboldo-like collage using Internet images. ACM Transactions on Graphics Vol. 30, No. 6, Article No. 155, 2011.
  115. Liu, H.; Zhang, L.; Huang, H. Web-image driven best views of 3D shapes. The Visual Computer Vol. 28, No. 3, 279–287, 2012. · doi:10.1007/s00371-011-0638-z
  116. Zhu, J.; Wu, J.; Wei, Y.; Chang, E.; Tu, Z. Unsupervised object class discovery via saliency-guided multiple class learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3218–3225, 2012.
  117. Chen, T.; Cheng, M.-M.; Tan, P.; Shamir, A.; Hu, S.-M. Sketch2Photo: Internet image montage. ACM Transactions on Graphics Vol. 28, No. 5, Article No. 124, 2009.
  118. Chia, A. Y.-S.; Zhuo, S.; Gupta, R. K.; Tai, Y.-W.; Cho, S.-Y.; Tan, P.; Lin, S. Semantic colorization with internet images. ACM Transactions on Graphics Vol. 30, No. 6, Article No. 156, 2011.
  119. Rutishauser, U.; Walther, D.; Koch, C.; Perona P. Is bottom-up attention useful for object recognition? In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, II, 2004.
  120. Kanan, C.; Cottrell, G. Robust classification of objects, faces, and flowers using natural image statistics. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2472–2479, 2010.
  121. Moosmann, F.; Larlus, D.; Jurie, F. Learning saliency maps for object categorization. In: Proceedings of the International Workshop on the Representation and Use of Prior Knowledge in Vision, 2006.
  122. Borji, A.; Itti, L. Scene classification with a sparse set of salient regions. In: Proceedings of the IEEE International Conference on Robotics and Automation, 1902–1908, 2011.
  123. Shen, H.; Li, S. X.; Zhu, C. F.; Chang, H. X.; Zhang, J. L. Moving object detection in aerial video based on spatiotemporal saliency. Chinese Journal of Aeronautics Vol. 26, No. 5, 1211–1217, 2013. · doi:10.1016/j.cja.2013.07.038
  124. Lee, Y. J.; Ghosh, J.; Grauman, K. Discovering important people and objects for egocentric video summarization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1346–1353, 2012.
  125. Ji, Q. G.; Fang, Z. D.; Xie, Z. H.; Lu, Z. M. Video abstraction based on the visual attention model and online clustering. Signal Processing: Image Communication Vol. 28, No. 3, 241–253, 2013.
  126. Wang, J.; Quan, L.; Sun, J.; Tang, X.; Shum, H.-Y. Picture collage. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 347–354, 2006.
  127. Ninassi, A.; Le Meur, O.; Le Callet, P.; Barba, D. Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric. In: Proceedings of the IEEE International Conference on Image Processing, II169–II172, 2007.
  128. Li, A.; She, X.; Sun, Q. Color image quality assessment combining saliency and FSIM. In: Proceedings of the SPIE 8878, 5th International Conference on Digital Image Processing, 88780I, 2013.
  129. Donoser, M.; Urschler, M.; Hirzer, M.; Bischof, H. Saliency driven total variation segmentation. In: Proceedings of the IEEE 12th International Conference on Computer Vision, 817–824, 2009.
  130. Li, Q.; Zhou, Y.; Yang, J. Saliency based image segmentation. In: Proceedings of the International Conference on Multimedia Technology, 5068–5071, 2011.
  131. Stalder, S.; Grabner, H.; Van Gool, L. Dynamic objectness for adaptive tracking. In: Computer Vision — ACCV 2012. Lecture Notes in Computer Science, Vol. 7726. Lee, K. M.; Matsushita, Y.; Rehg, J. M.; Hu, Z. Eds. Springer Berlin Heidelberg, 43–56, 2013.
  132. García, G. M.; Klein, D. A.; Stückler, J.; Frintrop, S.; Cremers, A. B. Adaptive multi-cue 3D tracking of arbitrary objects. In: Pattern Recognition. Lecture Notes in Computer Science, Vol. 7476. Pinz, A.; Pock, T.; Bischof, H.; Leberl, F. Eds. Springer Berlin Heidelberg, 357–366, 2012.
  133. Borji, A.; Frintrop, S.; Sihite, D. N.; Itti, L. Adaptive object tracking by learning background context. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 23–30, 2012.
  134. Klein, D. A.; Schulz, D.; Frintrop, S.; Cremers, A. B. Adaptive real-time video-tracking for arbitrary objects. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 772–777, 2010.
  135. Zhang, G.; Yuan, Z.; Zheng, N.; Sheng, X.; Liu, T. Visual saliency based object tracking. In: Computer Vision — ACCV 2009. Lecture Notes in Computer Science, Vol. 5995. Zha, H.; Taniguchi, R.; Maybank, S. Eds. Springer Berlin Heidelberg, 193–203, 2010.
  136. Karpathy, A.; Miller, S.; Li, F-F. Object discovery in 3D scenes via shape analysis. In: Proceedings of the IEEE International Conference on Robotics and Automation, 2088–2095, 2013.
  137. Frintrop, S.; García, G. M.; Cremers, A. B. A cognitive approach for object discovery. In: Proceedings of the 22nd International Conference on Pattern Recognition, Stockholm, 2329–2334, 2014.
  138. Sugano, Y.; Matsushita, Y.; Sato, Y. Calibration-free gaze sensing using saliency maps. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2667–2674, 2010.
  139. Msra dataset. Available at https://doi.org/research.microsoft.com/en-us/um/people/jiansun/ .
  140. Alpert, S.; Galun, M.; Basri, R.; Brandt, A. Image segmentation by probabilistic bottom-up aggregation and cue integration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2007.
  141. Msra10k dataset. Available at https://doi.org/www.cse.cuhk.edu.hk/leojia/projects/hsaliency/ .
  142. Thur15k dataset. Available at https://doi.org/mmcheng.net/gsal/ .
  143. Judd dataset. Available at https://doi.org/ilab.usc.edu/borji/Resources.html .
  144. Li, J.; Tian, Y.; Huang, T.; Gao, W. A dataset and evaluation methodology for visual saliency in video. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 442–445, 2009.
  145. Wu, Y.; Zheng, N. N.; Yuan, Z. J.; Jiang, H. Z.; Liu, T. Detection of salient objects with focused attention based on spatial and temporal coherence. Chinese Science Bulletin Vol. 56, No. 10, 1055–1062, 2011. · DOI
  146. Borji, A.; Cheng, M. M.; Jiang, H. Z.; Li, J. Salient object detection: A benchmark. IEEE Transactions on Image Processing Vol. 24, No. 12, 5706–5722, 2015. · DOI · Paper page
  147. He, K.; Zhang, X.; Ren, S.; Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778, 2016.
  148. Torralba A.; Efros, A. A. Unbiased look at dataset bias. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1521–1528, 2011.

Cited by

See all 524

Metadata

Authors
Borji, A., Cheng, M.-M., Hou, Q., Jiang, H., & Li, J.
Venue
Computational Visual Media
Published
2019-06
Volume
5
Issue
2
Pages
117-150
ISSN
  • 2096-0433 (ISSN-L)
  • 2096-0662
OpenAlex
W2160613239
Cited by
524
References
87
FWCI
27.93
Type
journal article
Language
en
Open access
diamond
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.