The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework
Abstract
As an interesting and emerging topic, co-saliency detection aims at simultaneously extracting common salient objects from a group of images. On one hand, traditional co-saliency detection approaches rely heavily on human knowledge for designing hand-crafted metrics to possibly reflect the faithful properties of the co-salient regions. Such strategies, however, always suffer from poor generalization capability to flexibly adapt various scenarios in real applications. On the other hand, most current methods pursue co-saliency detection in unsupervised fashions. This, however, tends to weaken their performance in real complex scenarios because they are lack of robust learning mechanism to make full use of the weak labels of each image. To alleviate these two problems, this paper proposes a new SP-MIL framework for co-saliency detection, which integrates both multiple instance learning (MIL) and self-paced learning (SPL) into a unified learning framework. Specifically, for the first problem, we formulate the co-saliency detection problem as a MIL paradigm to learn the discriminative classifiers to detect the co-saliency object in the "instance-level". The formulated MIL component facilitates our method capable of automatically producing the proper metrics to measure the intra-image contrast and the inter-image consistency for detecting co-saliency in a purely self-learning way. For the second problem, the embedded SPL paradigm is able to alleviate the data ambiguity under the weak supervision of co-saliency detection and guide a robust learning manner in complex scenarios. Experiments on benchmark datasets together with multiple extended computer vision applications demonstrate the superiority of the proposed framework beyond the state-of-the-arts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 4×
“In addition, this regularizer conducts either 1 or 0 (i.e., selected in training or not) for the weight v ðkÞ i imposed on instance x ðkÞ i , by judging whether its loss value is smaller than the pace parameter or not [17], [38].”
BackgroundMethodInfluentialFrequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Solving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Hierarchical Convolutional Features for Visual Tracking
Ma, C., Huang, J.-B., Yang, X., & Yang, M.-H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.352 · Cited by 1,776
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Support Vector Machines for Multiple-Instance Learning
Andrews, S. J., Tsochantaridis, I., & Hofmann, T. (2002) · Cited by 1,404
Saliency Optimization from Robust Background Detection
Zhu, W., Liang, S., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.360 · Cited by 1,330
Action MACH a spatio-temporal Maximum Average Correlation Height filter for action recognition
Rodriguez, M. D., Ahmed, J., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587727 · Cited by 1,223
Self-Paced Learning for Latent Variable Models
Kumar, M., Packer, B., & Koller, D. (2010) · neural information processing systems · Cited by 1,204
Object categorization by learned universal visual dictionary
Winn, J., Criminisi, A., & Minka, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.171 · Cited by 838
MILES: Multiple-Instance Learning via Embedded Instance Selection
Chen, Y., Bi, J., & Wang, J. Z. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.248 · Cited by 752
Learning to Segment Object Candidates
Pinheiro, P. O., Collobert, R., & Dollár, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06204 · Cited by 648
Computer Vision (ICCV), 2011 IEEE International Conference on
Vezhnevets, A. S., Ferrari, V., & Buhmann, J. M. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 477
iCoseg: Interactive co-segmentation with intelligent scribble guidance
Batra, D., Kowdle, A., Parikh, D., Luo, J., & Chen, T. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540080 · Cited by 468
Background Prior-Based Salient Object Detection via Deep Reconstruction Residual
Han, J., Zhang, D., Hu, X., Guo, L., Ren, J., & Wu, F. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2381471 · Cited by 444
Self-citationKey-segments for video object segmentation
Lee, Y. J., Kim, J., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126471 · Cited by 443
Cluster-Based Co-Saliency Detection
Fu, H., Cao, X., & Tu, Z. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2260166 · Cited by 427
Self-Paced Learning with Diversity
Jiang, L., Meng, D., Yu, S.-I., Lan, Z., Shan, S., & Hauptmann, A. G. (2014) · Cited by 326
Self-citationA Co-Saliency Model of Image Pairs
Li, H., & Ngan, K. N. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2156803 · Cited by 319
Self-Paced Learning for Long-Term Tracking
Supancic III, J. S., & Ramanan, D. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.308 · Cited by 290
Joulin, A., Bach, F., & Ponce, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247719 · Cited by 279
Salient Region Detection via High-Dimensional Color Transform
Kim, J., Han, D., Tai, Y.-W., & Kim, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.118 · Cited by 273
Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search
Jiang, L., Meng, D., Mitamura, T., & Hauptmann, A. G. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654918 · Cited by 271
Self-citationDistributed cosegmentation via submodular optimization on anisotropic diffusion
Kim, G., Xing, E. P., Fei-Fei, L., & Kanade, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126239 · Cited by 270
Motion Coherent Tracking Using Multi-label MRF Optimization
Tsai, D., Flagg, M., Nakazawa, A., & Rehg, J. M. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0512-5 · Cited by 216
A WEIGHTED SUPPORT VECTOR MACHINE FOR DATA CLASSIFICATION
YANG, X., SONG, Q., & WANG, Y. (2007) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001407005703 · Cited by 208
Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on
Prest, A., Leistner, C., Civera, J., et al. (2012) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 187
Co-localization in Real-World Images
Tang, K., Joulin, A., Li, L.-J., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.190 · Cited by 184
MILIS: Multiple Instance Learning with Instance Selection
Fu, Z., Robles-Kelly, A., & Zhou, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.155 · Cited by 181
Saliency Detection by Multiple-Instance Learning
Wang, Q., Yuan, Y., Yan, P., & Li, X. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2214210 · Cited by 173
Efficient Image and Video Co-localization with Frank-Wolfe Algorithm
Joulin, A., Tang, K., & Fei-Fei, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_17 · Cited by 169
Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning
Vezhnevets, A., & Buhmann, J. M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540060 · Cited by 161
Saliency Aggregation: A Data-Driven Approach
Mai, L., Niu, Y., & Liu, F. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.150 · Cited by 152
Weakly supervised semantic segmentation with a multi-image model
Vezhnevets, A. S., Ferrari, V., & Buhmann, J. M. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126299 · Cited by 152
Looking Beyond the Image: Unsupervised Learning for Object Saliency and Detection
Siva, P., Russell, C., Xiang, T., & Agapito, L. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.416 · Cited by 151
Self-Paced Learning for Matrix Factorization
Zhao, Q., Meng, D., Jiang, L., Xie, Q., Xu, Z., & Hauptmann, A. G. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9584 · Cited by 149
Self-citationWeakly supervised structured output learning for semantic segmentation
Vezhnevets, A. S., Ferrari, V., & Buhmann, J. M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247757 · Cited by 146
Weakly supervised object detector learning with model drift detection
Siva, P., & Xiang, T. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126261 · Cited by 138
Unsupervised Object Class Discovery via Saliency-Guided Multiple Class Learning
Zhu, J.-Y., Wu, J., Xu, Y. L., Chang, E., & Tu, Z. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2353617 · Cited by 135
Category-Independent Object-Level Saliency Detection
Jia, Y., & Han, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.221 · Cited by 130
A Self-Paced Multiple-Instance Learning Framework for Co-Saliency Detection
Zhang, D., Meng, D., Li, C., Jiang, L., Zhao, Q., & Han, J. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.75 · Cited by 130
Self-citationCo-saliency detection via looking deep and wide
Zhang, D., Han, J., Li, C., & Wang, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298918 · Cited by 119
Self-citationEfficient Saliency-Model-Guided Visual Co-Saliency Detection
Li, Y., Fu, K., Liu, Z., & Yang, J. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2364896 · Cited by 110
Jacobs, D. E., Goldman, D. B., & Shechtman, E. (2010) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1866029.1866066 · Cited by 88
Deterministic Annealing for Multiple-Instance Learning
Gehler, P., & Chapelle, O. (2007) · Cited by 86
Preattentive co-saliency detection
Chen, H.-T. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5650014 · Cited by 82
Object-Based Multiple Foreground Video Co-segmentation
Fu, H., Xu, D., Zhang, B., et al. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.405 · Cited by 79
Automatic Object Segmentation by Quantum Cuts
Aytekin, Ç., Serkan Kiranyaz, B., & Gabbouj, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.29 · Cited by 60
Max-Margin Structured Output Regression for Spatio-Temporal Action Localization
Tran, D., & Yuan, J. (2012) · DR-NTU (Nanyang Technological University) · Cited by 59
Self-paced dictionary learning for image classification
Tang, Y., Yang, Y.-B., & Gao, Y. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396324 · Cited by 56
Weakly supervised semantic segmentation for social images
Zhang, W., Zeng, S., Wang, D., & Xue, X. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298888 · Cited by 54
Optimal spatio-temporal path discovery for video event detection
Tran, D., & Yuan, J. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995416 · Cited by 54
Video Saliency Map Detection by Dominant Camera Motion Removal
Huang, C.-R., Chang, Y.-J., Yang, Z.-X., & Lin, Y. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2308652 · Cited by 54
Sparse reconstruction for weakly supervised semantic segmentation
Zhang, K., Zhang, W., Zheng, Y., et al. (2013) · International Joint Conference on Artificial Intelligence · Cited by 25
Semi-supervised Learning for Large Scale Image Cosegmentation
Wang, Z., & Liu, R. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.56 · Cited by 23
Robust manifold-preserving diffusion-based saliency detection by adaptive weight construction
Fu, K., Gu, I. Y., Gong, C., et al. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.10.066 · Cited by 13
Luo, Y., Jiang, M. X., Wong, Y., & Zhao, Q. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2392783 · Cited by 13
Yao, X., Han, J., Cheng, G., & Guo, L. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806319 · Cited by 10
Self-citation
Cited by
Learning to Detect Salient Objects with Image-Level Supervision
Wang, L., Lu, H., Wang, Y., Feng, M., Wang, D., Yin, B., & Ruan, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.404 · Cited by 1,265
Cheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
Self-citationFoveaBox: Beyound Anchor-Based Object Detection
Kong, T., Sun, F., Liu, H., Jiang, Y., Li, L., & Shi, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3002345 · Cited by 1,016
Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey
Han, J., Zhang, D., Cheng, G., Liu, N., & Xu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2749125 · Cited by 621
Self-citationRotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images
Li, K., Cheng, G., Bu, S., & You, X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2778300 · Cited by 439
Metadata
- Authors
- Zhang, D., Meng, D., & Han, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-05-01
- Volume
- 39
- Issue
- 5
- Pages
- 865-878
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2358876993
- Cited by
- 508
- References
- 63
- FWCI
- 61.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.