The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Superpixel Segmentation With Fully Convolutional Networks
Open accessAbstract
In computer vision, superpixels have been widely used as an effective way to reduce the number of image primitives for subsequent processing. But only a few attempts have been made to incorporate them into deep neural networks. One main reason is that the standard convolution operation is defined on regular grids and becomes inefficient when applied to superpixels. Inspired by an initialization strategy commonly adopted by traditional superpixel algorithms, we present a novel method that employs a simple fully convolutional network to predict superpixels on a regular image grid. Experimental results on benchmark datasets show that our method achieves state-of-the-art superpixel segmentation performance while running at about 50fps. Based on the predicted superpixels, we further develop a downsampling/upsampling scheme for deep networks with the goal of generating high-resolution outputs for dense prediction tasks. Specifically, we modify a popular network architecture for stereo matching to simultaneously predict superpixels and disparities. We show that improved disparity estimation accuracy can be obtained on public datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 3×
“Besides, our method is also similar to the deformable convolutional network (DCN) [9, 47] in that both can real-”
MethodIndoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Deformable ConvNets V2: More Deformable, Better Results
Zhu, X., Hu, H., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00953 · Cited by 2,943
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
Mayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Pyramid Stereo Matching Network
Chang, J.-R., & Chen, Y.-S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00567 · Cited by 1,807
End-to-End Learning of Geometry and Context for Deep Stereo Regression
Kendall, A., Martirosyan, H., Dasgupta, S., Henry, P., Kennedy, R., Bachrach, A., & Bry, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.17 · Cited by 1,470
High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth
Scharstein, D., Hirschmüller, H., Kitajima, Y., Krathwohl, G., Nešić, N., Wang, X., & Westling, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11752-2_3 · Cited by 1,305
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
TurboPixels: Fast Superpixels Using Geometric Flows
Levinshtein, A., Stere, A., Kutulakos, K. N., Fleet, D. J., Dickinson, S. J., & Siddiqi, K. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.96 · Cited by 1,146
Entropy rate superpixel segmentation
Liu, M.-Y., Tuzel, O., Ramalingam, S., & Chellappa, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995323 · Cited by 1,026
Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches
Žbontar, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.05970 · Cited by 931
Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure
Klaus, A., Sormann, M., & Karner, K. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.1033 · Cited by 837
GA-Net: Guided Aggregation Net for End-To-End Stereo Matching
Zhang, F., Prisacariu, V., Yang, R., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00027 · Cited by 811
Efficient Deep Learning for Stereo Matching
Luo, W., Schwing, A. G., & Urtasun, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.614 · Cited by 741
Superpixels and Polygons Using Simple Non-iterative Clustering
Achanta, R., & Susstrunk, S. E. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.520 · Cited by 602
Superpixels: An evaluation of the state-of-the-art
Stutz, D., Hermans, A., & Leibe, B. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.03.007 · Cited by 538
Cascade Residual Learning: A Two-Stage Convolutional Neural Network for Stereo Matching
Pang, J., Sun, W., Ren, J. S., Yang, C., & Yan, Q. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.108 · Cited by 491
Superpixel segmentation using Linear Spectral Clustering
Li, Z., & Chen, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298741 · Cited by 479
Wang, S., Lu, H., Yang, F., & Yang, M.-H. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126385 · Cited by 479
Self-citationStereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Prediction
Khamis, S., Fanello, S., Rhemann, C., Kowdle, A., Valentin, J., & Izadi, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_35 · Cited by 401
Multi-Class Segmentation with Relative Location Prior
Gould, S., Rodgers, J., Cohen, D., Elidan, G., & Koller, D. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0140-x · Cited by 400
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1810.02695 · Cited by 345 · cited 11×
“In this paper, we take stereo matching as an example and show how the popular network PSMNet [7], upon which many of the newest methods such as CSPN [8] and HSM [42] are built, can be adapted into our framework.”
BackgroundMethodInfluentialLearning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2947374 · Cited by 341
Segment-based stereo matching using graph cuts
Hong, L., & Chen, G. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315016 · Cited by 329
Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation
Yamaguchi, K., McAllester, D., & Urtasun, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_49 · Cited by 297
Jampani, V., Sun, D., Liu, M.-Y., Yang, M.-H., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_22 · Cited by 293
SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection
He, S., Lau, R. W. H., Liu, W., Huang, Z., & Yang, Q. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0822-0 · Cited by 289
A region based stereo matching algorithm using cooperative optimization
Wang, Z.-F., & Zheng, Z.-G. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587456 · Cited by 276
Hierarchical Deep Stereo Matching on High-Resolution Images
Yang, G., Manela, J., Happold, M., & Ramanan, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00566 · Cited by 261
SEEDS: Superpixels Extracted Via Energy-Driven Sampling
Van den Bergh, M., Boix, X., Roig, G., & Van Gool, L. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0744-2 · Cited by 253
Multiway cut for stereo and motion with slanted surfaces
Birchfield, S., & Tomasi, C. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791261 · Cited by 239
Displets: Resolving stereo ambiguities using object knowledge
Guney, F., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299044 · Cited by 215
Improved Stereo Matching with Constant Highway Networks and Reflective Confidence Learning
Shaked, A., & Wolf, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.730 · Cited by 185
Real-time coarse-to-fine topologically preserving segmentation
Yao, J., Boben, M., Fidler, S., & Urtasun, R. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298913 · Cited by 169
Structure-Sensitive Superpixels via Geodesic Distance
Wang, P., Zeng, G., Gan, R., Wang, J., & Zha, H. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0588-6 · Cited by 157
Weakly Supervised Semantic Segmentation Using Superpixel Pooling Network
Kwak, S., Hong, S., & Han, B. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11213 · Cited by 156
Superpixel Convolutional Networks Using Bilateral Inceptions
Gadde, R., Jampani, V., Kiefel, M., Kappler, D., & Gehler, P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_36 · Cited by 145
Learning Superpixels with Segmentation-Aware Affinity Loss
Tu, W.-C., Liu, M.-Y., Jampani, V., Sun, D., Chien, S.-Y., Yang, M.-H., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00066 · Cited by 142
Surface stereo with soft segmentation
Ble, M., Rother, C., & Kohli, P. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539783 · Cited by 136
Continuous Markov Random Fields for Robust Stereo Estimation
Yamaguchi, K., Hazan, T., McAllester, D., & Urtasun, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_4 · Cited by 123
A layered stereo algorithm using image segmentation and global visibility constraints
Bleyer, M., & Gelautz, M. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2004.1421743 · Cited by 115
Improving an Object Detector and Extracting Regions Using Superpixels
Shu, G., Dehghan, A., & Shah, M. A. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.477 · Cited by 83
Deep Stereo Matching With Explicit Cost Aggregation Sub-Architecture
Yu, L., Wang, Y., Wu, Y., & Jia, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12267 · Cited by 60
Superpixel Convolution for Segmentation
Suzuki, T., Akizuki, S., Kato, N., et al. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451721 · Cited by 7
Cited by
Smart Watermark to Defend against Deepfake Image Manipulation
Lv, L. (2021) · 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs52626.2021.9449287 · Cited by 24
Metadata
- Authors
- Yang, F., Sun, Q., Jin, H., & Zhou, Z.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 13961-13970
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035241330
- Cited by
- 257
- References
- 47
- FWCI
- 10.46
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.