Layered Object Models for Image Segmentation
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
We formulate a layered model for object detection and image segmentation. We describe a generative probabilistic model that composites the output of a bank of object detectors in order to define shape masks and explain the appearance, depth ordering, and labels of all pixels in an image. Notably, our system estimates both class labels and object instance labels. Building on previous benchmark criteria for object detection and image segmentation, we define a novel score that evaluates both class and instance segmentation. We evaluate our system on the PASCAL 2009 and 2010 segmentation challenge data sets and show good test results with state-of-the-art performance in several categories, including segmenting humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Self-citationRecovering Occlusion Boundaries from a Single Image
Hoiem, D., Stein, A. N., Efros, A. A., & Hebert, M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408985 · Cited by 206
Cited by
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Self-citationMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579
Self-citationKirillov, A., He, K., Girshick, R., Rother, C., & Dollár, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00963 · Cited by 1,659
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
“[42] use figure ground masks associated with DPM detectors [16] to segment out detected objects and reason about depth orderings.”
BackgroundSimultaneous Detection and Segmentation
Hariharan, B., Arbeláez, P., Girshick, R., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_20 · Cited by 1,085
Attribute2Image: Conditional Image Generation from Visual Attributes
Yan, X., Yang, J., Sohn, K., & Lee, H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_47 · Cited by 688
Semantic Instance Segmentation with a Discriminative Loss Function
Brabandere, B. D., Neven, D., & Gool, L. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02551 · Cited by 392
Recurrent Instance Segmentation
Romera-Paredes, B., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_19 · Cited by 311
End-to-End Instance Segmentation with Recurrent Attention
Ren, M., & Zemel, R. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.39 · Cited by 309
Li, H., Qiu, K., Chen, L., Mei, X., Hong, L., & Tao, C. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2988294 · Cited by 295
A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D Images
Ulku, I., & Akagündüz, E. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2032924 · Cited by 237
“Another group of studies, sometimes referred to as the ‘Layered models’ [46, 47, 48], used a composition of pretrained and separate object detectors so as to extract the semantic information from the image.”
Pixelwise Instance Segmentation with a Dynamically Instantiated Network
Arnab, A., & Torr, P. H. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.100 · Cited by 222
“This measure was originally proposed in [47], but has not been used since in evaluating instance segmentation systems.”
MethodHigher Order Conditional Random Fields in Deep Neural Networks
Arnab, A., Jayasumana, S., Zheng, S., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_33 · Cited by 201
“Unlike other approaches that refine a bounding-box detection to produce a segmentation [17, 50], this method used detector outputs as a soft constraint and can thus recover from object detection errors.”
MethodWeakly- and Semi-supervised Panoptic Segmentation
Li, Q., Arnab, A., & Torr, P. H. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_7 · Cited by 171
SeGAN: Segmenting and Generating the Invisible
Ehsani, K., Mottaghi, R., & Farhadi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00643 · Cited by 170
Simultaneous Detection and Segmentation
Hariharan, B., Arbeláez, P., Girshick, R., & Malik, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.1808 · Cited by 161
“[32] use object detections from the deformable parts model [13] to segment the image, pasting figure-ground masks and reasoning about their relative depth ordering.”
MethodIterative Instance Segmentation
Li, K., Hariharan, B., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.398 · Cited by 152
Object Instance Segmentation and Fine-Grained Localization Using Hypercolumns
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2578328 · Cited by 102
“[37] use figure groundmasks associated with DPM detectors [38] to segment out detected objects and reason about depth orderings.”
Towards Unified Object Detection and Semantic Segmentation
Dong, J., Chen, Q., Yan, S., & Yuille, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_20 · Cited by 70
Metadata
- Authors
- Yang, Y., Hallman, S., Ramanan, D., & Fowlkes, C. C.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2012-09
- Volume
- 34
- Issue
- 9
- Pages
- 1731-1743
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2083542343
- Cited by
- 140
- References
- 4
- FWCI
- 8.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.