The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Contour Detection and Hierarchical Image Segmentation
Abstract
This paper investigates two fundamental problems in computer vision: contour detection and image segmentation. We present state-of-the-art algorithms for both of these tasks. Our contour detector combines multiple local cues into a globalization framework based on spectral clustering. Our segmentation algorithm consists of generic machinery for transforming the output of any contour detector into a hierarchical region tree. In this manner, we reduce the problem of image segmentation to that of contour detection. Extensive experimental evaluation demonstrates that both our contour detection and segmentation methods significantly outperform competing algorithms. The automatically generated hierarchical segmentations can be interactively refined by user-specified annotations. Computation at multiple image resolutions provides a means of coupling our system to recognition applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Smoothing and Differentiation of Data by Simplified Least Squares Procedures.
Savitzky, A., & Golay, M. J. E. (1964) · Analytical Chemistry · doi:10.1021/ac60214a047 · Cited by 21,904
Marr, D., & Hildreth, E. (1980) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1980.0020 · Cited by 6,510
Feature detection with automatic scale selection
Lindeberg, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008045108935 · Cited by 2,541
Tu, Z. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.194 · Cited by 397
Research works printed but not linked: 73
- 10.1109/ICCV.2001.937655 · DOI · Paper page
- 10.1109/TPAMI.2004.1273918 · DOI · Paper page
- 10.1109/CVPR.2008.4587420 · DOI · Paper page
- 10.1109/CVPR.2009.5206707 · DOI · Paper page
- 10.1109/TPAMI.2007.1046 · DOI · Paper page
- 10.1145/1102351.1102424 · DOI · Paper page
- 10.1016/j.cviu.2007.07.005 · DOI · Paper page
- Everingham, 2008, PASCAL 2008 Results
- 10.1109/ICCV.2005.107 · DOI · Paper page
- 10.1109/ICCV.2007.4408986 · DOI · Paper page
- 10.5244/C.21.55 · DOI · Paper page
- 10.1109/CVPR.2008.4587626 · doi:10.1109/cvpr.2008.4587626
- 10.1007/s11263-007-0071-y · DOI · Paper page
- 10.1109/CVPR.2009.5206697 · DOI · Paper page
- 10.1109/CVPR.2009.5206727 · DOI · Paper page
- 10.1109/ICCV.2009.5459436 · DOI
- Roberts, 1965, Machine Perception of Three-Dimensional Solids
- Duda, 1973, Pattern Classification and Scene Analysis
- Prewitt, 1970, Object Enhancement and Extraction
- 10.1109/ICCV.1990.139492 · DOI · Paper page
- 10.1109/ICCV.2005.213 · DOI
- 10.1109/ICCV.2007.4408929 · doi:10.1109/iccv.2007.4408929
- 10.1109/CVPRW.2006.18 · DOI
- 10.1007/978-3-540-88690-7_4 · DOI · Paper page
- 10.1109/CVPR.2006.298 · DOI · Paper page
- 10.1007/978-3-540-88690-7_40 · DOI
- 10.1109/ICCV.2009.5459296 · doi:10.1109/iccv.2009.5459296
- 10.1109/TPAMI.2007.70785 · doi:10.1109/tpami.2007.70785
- 10.1038/nature04977 · DOI · Paper page
- 10.1023/B:VISI.0000022288.19776.77 · DOI · Paper page
- 10.1109/CVPR.2005.332 · DOI · Paper page
- 10.1109/34.1000236 · DOI · Paper page
- 10.1109/CVPRW.2006.48 · DOI
- 10.1016/0167-8655(87)90013-4 · DOI · Paper page
- 10.1109/34.93808 · DOI · Paper page
- 10.1023/A:1008097225773 · DOI · Paper page
- 10.1109/34.31445 · DOI · Paper page
- 10.1109/ICCV.1995.466910 · DOI
- 10.1007/BFb0015553 · DOI · Paper page
- 10.1162/089976600300015880 · DOI · Paper page
- 10.1109/ICCV.1998.710790 · DOI · Paper page
- 10.1109/34.868688 · DOI · Paper page
- 10.1023/A:1011174803800 · DOI · Paper page
- 10.1109/CVPR.2006.129 · doi:10.1109/cvpr.2006.129
- 10.1090/cbms/092 · DOI · Paper page
- Fowlkes, 2004, How Much Does Globalization Help Segmentation?
- 10.1109/TPAMI.2005.84 · DOI
- 10.1109/CVPR.2005.312 · DOI
- 10.1109/CVPR.2007.383017 · DOI
- 10.1002/cpa.3160420503 · DOI · Paper page
- 10.1007/978-1-4684-0567-5 · DOI · Paper page
- 10.1137/0731015 · doi:10.1137/0731015
- 10.1109/83.902291 · DOI · Paper page
- 10.1023/A:1020874308076 · DOI · Paper page
- 10.1016/0021-9991(88)90002-2 · DOI · Paper page
- Sethian, 1999, Level Set Methods and Fast Marching Methods
- 10.1109/iccv.2009.5459348 · DOI · Paper page
- 10.1007/s11263-009-0251-z · DOI · Paper page
- 10.2307/2284239 · DOI
- 10.1109/CVPR.2003.1211452 · DOI
- 10.1007/BFb0055689 · doi:10.1007/bfb0055689
- 10.1007/BFb0055702 · DOI
- 10.1109/ICCV.2003.1238308 · DOI · Paper page
- Beucher, 1992, Mathematical Morphology in Image Processing
- 10.1109/34.546254 · DOI · Paper page
- 10.1007/978-3-642-12307-8_13 · doi:10.1007/978-3-642-12307-8_13
- 10.1007/11744023_1 · DOI · Paper page
- 10.1109/ICCV.2001.937505 · DOI · Paper page
- 10.1145/1015706.1015720 · DOI · Paper page
- 10.1145/1015706.1015719 · DOI · Paper page
- 10.1007/978-3-540-88693-8_3 · DOI
- 10.1109/CVPR.2008.4587492 · doi:10.1109/cvpr.2008.4587492
- 10.1109/ICCV.2009.5459410 · DOI
Cited by
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Self-citationImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Cellpose: a generalist algorithm for cellular segmentation
Stringer, C., Wang, T., Michaelos, M., & Pachitariu, M. (2021) · Nature Methods · doi:10.1038/s41592-020-01018-x · Cited by 4,369
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579
Self-citationConditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386
“BerkeleyRC [3] n/a 39.”
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
Bousmalis, K., Silberman, N., Dohan, D., Erhan, D., & Krishnan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.18 · Cited by 1,603
Learning Rich Features from RGB-D Images for Object Detection and Segmentation
Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528
Self-citationSynthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
The Role of Context for Object Detection and Semantic Segmentation in the Wild
Mottaghi, R., Chen, X., Liu, X., Cho, N.-G., Lee, S.-W., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.119 · Cited by 1,438
Multiscale Combinatorial Grouping
Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.49 · Cited by 1,155
Self-citationBousmalis, K., Trigeorgis, G., Silberman, N., Krishnan, D., & Erhan, D. (2016) · arXiv · doi:10.48550/arxiv.1608.06019 · Cited by 1,208
“The background images are random crops uniformly sampled from the Berkeley Segmentation Data Set (BSDS500) [3].”
MethodAutonomous concrete crack detection using deep fully convolutional neural network
Dung, C. V., & Anh, L. D. (2019) · Automation in Construction · doi:10.1016/j.autcon.2018.11.028 · Cited by 1,170
Visual saliency based on multiscale deep features
Li, G., & Yu, Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299184 · Cited by 1,163
Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Fu, X., Huang, J., Ding, X., Liao, Y., & Paisley, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2691802 · Cited by 940
One-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927
A review of semantic segmentation using deep neural networks
Guo, Y., Liu, Y., Georgiou, T., & Lew, M. S. (2018) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-017-0141-z · Cited by 882
Rep ViT: Revisiting Mobile CNN From ViT Perspective
Wang, A., Chen, H., Lin, Z., Han, J., & Ding, G. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01506 · Cited by 752
Segmentation as selective search for object recognition
van de Sande, K. E. A., Uijlings, J. R. R., Gevers, T., & Smeulders, A. W. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126456 · Cited by 739
Cheng, J.-Z., Ni, D., Chou, Y.-H., Qin, J., Tiu, C.-M., Chang, Y.-C., Huang, C.-S., Shen, D., & Chen, C.-M. (2016) · Scientific Reports · doi:10.1038/srep24454 · Cited by 755
“…image segmentation 4,6,14,15,22–24 for the morphological feature computing 4,6,7,14,15,22 , which unfortunately remains quite difficult to address 25 , and 2) image decomposition 12,19 followed with statistical summarizations and presentations 12,19,20,26 for the textural feature calculation 27 .”
BackgroundWhat Makes for Effective Detection Proposals?
Hosang, J., Benenson, R., Dollar, P., & Schiele, B. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2465908 · Cited by 727
Holistically-nested edge detection
Xie, S., & Tu, Z. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1004-z · Cited by 682
Semantic Image Segmentation via Deep Parsing Network
Liu, Z., Li, X., Luo, P., Loy, C.-C., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.162 · Cited by 675
Kokkinos, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.579 · Cited by 657
Zhang, Q., Shen, X., Xu, L., & Jia, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_53 · Cited by 580
A deep learning framework for supporting the classification of breast lesions in ultrasound images
Han, S., Kang, H.-K., Jeong, J.-Y., Park, M.-H., Kim, W., Bang, W.-C., & Seong, Y.-K. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa82ec · Cited by 358
Video Object Segmentation without Temporal Information
Maninis, K.-K., Caelles, S., Chen, Y., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2838670 · Cited by 354
Pixel convolutional neural network for multi-focus image fusion
Tang, H., Xiao, B., Li, W., & Wang, G. (2018) · Information Sciences · doi:10.1016/j.ins.2017.12.043 · Cited by 298
Automatic Shadow Detection and Removal from a Single Image
Khan, S. H., Bennamoun, M., Sohel, F., & Togneri, R. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462355 · Cited by 283
Holistic Scene Understanding for 3D Object Detection with RGBD Cameras
Lin, D., Fidler, S., & Urtasun, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.179 · Cited by 253
Automatic Photo Adjustment Using Deep Neural Networks
Yan, Z., Zhang, H., Wang, B., Paris, S., & Yu, Y. (2016) · ACM Transactions on Graphics · doi:10.1145/2790296 · Cited by 271
SEEDS: Superpixels Extracted Via Energy-Driven Sampling
Van den Bergh, M., Boix, X., Roig, G., & Van Gool, L. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0744-2 · Cited by 253
Constrained deep weak supervision for histopathology image segmentation
Jia, Z., Huang, X., Chang, E. I.-C., & Xu, Y. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2724070 · Cited by 242
Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals
Van Gansbeke, W., Vandenhende, S., Georgoulis, S., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00990 · Cited by 231
Interactive perception: Leveraging action in perception and perception in action
Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2721939 · Cited by 227
Robust guided image filtering using Nonconvex potentials
Ham, B., Cho, M., & Ponce, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2669034 · Cited by 219
CLIPasso: semantically-aware object sketching
Vinker, Y., Pajouheshgar, E., Bo, J. Y., Bachmann, R. C., Bermano, A. H., Cohen-Or, D., Zamir, A., & Shamir, A. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530068 · Cited by 217
Crisp Boundary Detection Using Pointwise Mutual Information
Isola, P., Zoran, D., Krishnan, D., & Adelson, E. H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_52 · Cited by 199
An active contour model based on local fitted images for image segmentation
Wang, L., Chang, Y., Wang, H., Wu, Z., Pu, J., & Yang, X. (2017) · Information Sciences · doi:10.1016/j.ins.2017.06.042 · Cited by 127
SegSort: Segmentation by Discriminative Sorting of Segments
Hwang, J.-J., Yu, S., Shi, J., Collins, M., Yang, T.-J., Zhang, X., & Chen, L.-C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00743 · Cited by 124
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
Learning visual groups from co-occurrences in space and time
Isola, P., Zoran, D., Krishnan, D., & Adelson, E. H. (2015) · arXiv · doi:10.48550/arxiv.1511.06811 · Cited by 90
Breast mass classification via deeply integrating the contextual information from multi-view data
Wang, H., Feng, J., Zhang, Z., Su, H., Cui, L., He, H., & Liu, L. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.02.026 · Cited by 68
Deep Learning for Handling Kernel/model Uncertainty in Image Deconvolution
Nan, Y., & Ji, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00246 · Cited by 66
Lee, K., Turner, N., Macrina, T., Wu, J., Lu, R., & Seung, H. S. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.04.001 · Cited by 52
Decentralised Image Sharing and Copyright Protection using Blockchain and Perceptual Hashes
Mehta, R., Kapoor, N., Sourav, S., & Shorey, R. (2019) · 2019 11th International Conference on Communication Systems & Networks (COMSNETS) · doi:10.1109/comsnets.2019.8711440 · Cited by 55
Multi-modal Unsupervised Feature Learning for RGB-D Scene Labeling
Wang, A., Lu, J., Wang, G., Cai, J., & Cham, T.-J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_30 · Cited by 50
Zhang, L., Ye, X., Lambrou, T., Duan, W., Allinson, N., & Dudley, N. J. (2016) · Physics in Medicine & Biology · doi:10.1088/0031-9155/61/3/1095 · Cited by 34
Automatic Segmentation of Unknown Objects, with Application to Baggage Security
Grady, L., Singh, V., Kohlberger, T., Alvino, C., & Bahlmann, C. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_31 · Cited by 18
Ma, T., & Tian, W. (2021) · The Visual Computer · doi:10.1007/s00371-020-01843-3 · Cited by 16
Pagnutti, G., Minto, L., & Zanuttigh, P. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0502 · Cited by 14
Nainar, M., Sankaranarayanan, S., & Veeramani, K. (2026) · Scientific Reports · doi:10.1038/s41598-026-54102-1
“The datasets used in this study are publicly available in the following links: PCBI dataset 31 : https://github.com/Gct96/images BSDS500 dataset 32 : https://www. kaggle.com/d atasets/balr aj98/berkel ey-segmentation-dataset-500-bsds500 DTD dataset 33 : https: //w ww.kag gle .com/dat asets/jm…”
Metadata
- Authors
- Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-05
- Volume
- 33
- Issue
- 5
- Pages
- 898-916
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2110158442
- Cited by
- 5,454
- References
- 5
- FWCI
- 151.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.