The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
CASENet: Deep Category-Aware Semantic Edge Detection
Abstract
Boundary and edge cues are highly beneficial in improving a wide variety of vision tasks such as semantic segmentation, object recognition, stereo, and object proposal generation. Recently, the problem of edge detection has been revisited and significant progress has been made with deep learning. While classical edge detection is a challenging binary problem in itself, the category-aware semantic edge detection by nature is an even more challenging multi-label problem. We model the problem such that each edge pixel can be associated with more than one class as they appear in contours or junctions belonging to two or more semantic classes. To this end, we propose a novel end-to-end deep semantic edge learning architecture based on ResNet and a new skip-layer architecture where category-wise edge activations at the top convolution layer share and are fused with the same set of bottom layer features. We then propose a multi-label loss function to supervise the fused activations. We show that our proposed architecture benefits this problem with better performance, and we outperform the current state-of-the-art semantic edge detection methods by a large margin on standard data sets such as SBD and Cityscapes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Learning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
The PASCAL visual object classes challenge 2006 (VOC2006) results
Everingham, M., Zisserman, A., Williams, C. K. I., & Gool, L. V. (2006) · Cited by 2,079
Semantic contours from inverse detectors
Hariharan, B., Arbelaez, P., Bourdev, L., Maji, S., & Malik, J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126343 · Cited by 1,624
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Zhuowen Tu, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 993
Structured Forests for Fast Edge Detection
Dollar, P., & Zitnick, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.231 · Cited by 899
Deeplysupervised netsPreprint
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2015) · Cited by 849
Holistically-nested edge detection
Xie, S., & Tu, Z. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1004-z · Cited by 682
Geometric context from a single image
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.107 · Cited by 662
Recurrent Convolutional Neural Networks for Scene Labeling
Pinheiro, P. O., & Collobert, R. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 621
Perceptual Organization and Recognition of Indoor Scenes from RGB-D Images
Gupta, S., Arbelaez, P., & Malik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.79 · Cited by 595
DeepEdge: A multi-scale bifurcated deep network for top-down contour detection
Bertasius, G., Shi, J., & Torresani, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299067 · Cited by 525
DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection
Shen, W., Wang, X., Wang, Y., Bai, X., & Zhang, Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299024 · Cited by 515
Recovering the spatial layout of cluttered rooms
Hedau, V., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459411 · Cited by 487
Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection
Lim, J. J., Zitnick, C. L., & Dollar, P. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.406 · Cited by 427
Supervised Learning of Edges and Object Boundaries
Dollar, P., Tu, Z., & Belongie, S. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.298 · Cited by 424
Object Contour Detection with a Fully Convolutional Encoder-Decoder Network
Yang, J., Price, B., Cohen, S., Lee, H., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.28 · Cited by 383
Chen, L.-C., Barron, J. T., Papandreou, G., Murphy, K., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.492 · Cited by 364
Statistical edge detection: learning and evaluating edge cues
Konishi, S., Yuille, A. L., Coughlan, J. M., & Zhu, S. C. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1159946 · Cited by 338
On the accuracy of the Sobel edge detector
Kittler, J. (1983) · Image and Vision Computing · doi:10.1016/0262-8856(83)90006-9 · Cited by 331
Interpreting line drawings of curved objects
Malik, J. (1987) · International Journal of Computer Vision · doi:10.1007/bf00128527 · Cited by 322
From Images to Shape Models for Object Detection
Ferrari, V., Jurie, F., & Schmid, C. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0270-9 · Cited by 295
$$N^4$$-Fields: Neural Network Nearest Neighbor Fields for Image Transforms
Ganin, Y., & Lempitsky, V. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_36 · Cited by 261
Object Detection Combining Recognition and Segmentation
Wang, L., Shi, J., Song, G., & Shen, I.-F. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-76386-4_17 · Cited by 212
Crisp Boundary Detection Using Pointwise Mutual Information
Isola, P., Zoran, D., Krishnan, D., & Adelson, E. H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_52 · Cited by 199
Semantic Segmentation with Boundary Neural Fields
Bertasius, G., Shi, J., & Torresani, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.392 · Cited by 197
Bertasius, G., Shi, J., & Torresani, L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.65 · Cited by 189
Multi-scale Improves Boundary Detection in Natural Images
Ren, X. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88690-7_40 · Cited by 187
Recovering Occlusion Boundaries from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0400-4 · Cited by 176
Gaussian Conditional Random Field Network for Semantic Segmentation
Vemulapalli, R., Tuzel, O., Liu, M.-Y., & Chellappa, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.351 · Cited by 150
Self-citationConvolutional Oriented Boundaries
Maninis, K.-K., Pont-Tuset, J., Arbeláez, P., & Gool, L. V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_35 · Cited by 140
Pixel-wise Deep Learning for Contour DetectionPreprint
Hwang, J.-J., & Liu, T.-L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.01989 · Cited by 107
Unfolding an Indoor Origami World
Fouhey, D. F., Gupta, A., & Hebert, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_44 · Cited by 85
Weakly Supervised Object Boundaries
Khoreva, A., Benenson, R., Omran, M., Hein, M., & Schiele, B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.27 · Cited by 51
Learning Class-Specific Edges for Object Detection and Segmentation
Prasad, M., Zisserman, A., Fitzgibbon, A. W., Kumar, M. P. P., & Torr, P. H. S. (2006) · Lecture notes in computer science · doi:10.1007/11949619_9 · Cited by 41
Reconstructive Sparse Code Transfer for Contour Detection and Semantic Labeling
Maire, M., Yu, S. X., & Perona, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_18 · Cited by 35
Boundary Cues for 3D Object Shape Recovery
Karsch, K., Liao, Z., Rock, J., Barron, J. T., & Hoiem, D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.281 · Cited by 25
Layered Interpretation of Street View Images
Liu, M.-Y., Lin, S., Ramalingam, S., & Tuzel, O. (2015) · Robotics: Science and Systems · doi:10.15607/rss.2015.xi.025 · Cited by 16
Self-citation
Cited by
Learning a Discriminative Feature Network for Semantic Segmentation
Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., & Sang, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00199 · Cited by 870
Gated-SCNN: Gated Shape CNNs for Semantic Segmentation
Takikawa, T., Acuna, D., Jampani, V., & Fidler, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00533 · Cited by 813
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M.-M., Hu, X., Bian, J.-W., Zhang, L., Bai, X., & Tang, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2878849 · Cited by 751
Look at Boundary: A Boundary-Aware Face Alignment Algorithm
Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., & Zhou, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00227 · Cited by 511
Learning to Predict Crisp Boundaries
Deng, R., Shen, C., Liu, S., Wang, H., & Liu, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_35 · Cited by 273
Metadata
- Authors
- Yu, Z., Feng, C., Liu, M.-Y., & Ramalingam, S.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 1761-1770
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963307106
- Cited by
- 300
- References
- 49
- FWCI
- 6.63
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.