Scene recognition and weakly supervised object localization with deformable part-based models
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Weakly supervised discovery of common visual structure in highly variable, cluttered images is a key problem in recognition. We address this problem using deformable part-based models (DPM's) with latent SVM training [6]. These models have been introduced for fully supervised training of object detectors, but we demonstrate that they are also capable of more open-ended learning of latent structure for such tasks as scene recognition and weakly supervised object localization. For scene recognition, DPM's can capture recurring visual elements and salient objects; in combination with standard global image features, they obtain state-of-the-art results on the MIT 67-category indoor scene dataset. For weakly supervised object localization, optimization over latent DPM parameters can discover the spatial extent of objects in cluttered training images without ground-truth bounding boxes. The resulting method outperforms a recent state-of-the-art weakly supervised object localization approach on the PASCAL-07 dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Self-citationModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
Quattoni, A., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206537 · Cited by 1,463
Li, L.-J., Su, H., Fei-Fei, L., & Xing, E. P. (2018) · KiltHub Repository · doi:10.1184/r1/6475985 · Cited by 827
CENTRIST: A Visual Descriptor for Scene Categorization
Wu, J., & Rehg, J. M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.224 · Cited by 709
Indoor-outdoor image classification
Szummer, M., & Picard, R. W. (2002) · Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database · doi:10.1109/caivd.1998.646032 · Cited by 639
The Design of High-Level Features for Photo Quality Assessment
Ke, Y., Tang, X., & Jing, F. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.303 · Cited by 630
Using Multiple Segmentations to Discover Objects and their Extent in Image Collections
Russell, B. C., Freeman, W. T., Efros, A. A., Sivic, J., & Zisserman, A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.326 · Cited by 617
Cited by
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Multi-scale Orderless Pooling of Deep Convolutional Activation Features
Gong, Y., Wang, L., Guo, R., & Lazebnik, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_26 · Cited by 1,030
Self-citationObject Detectors Emerge in Deep Scene CNNs
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2014) · arXiv · doi:10.48550/arxiv.1412.6856 · Cited by 971
Is object localization for free? - Weakly-supervised learning with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298668 · Cited by 886
CNN Features off-the-shelf: an Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · arXiv · doi:10.48550/arxiv.1403.6382 · Cited by 607
Unsupervised Discovery of Mid-Level Discriminative Patches
Singh, S., Gupta, A., & Efros, A. A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_6 · Cited by 491
InLoc: Indoor Visual Localization with Dense Matching and View Synthesis
Taira, H., Okutomi, M., Sattler, T., Cimpoi, M., Pollefeys, M., Sivic, J., Pajdla, T., & Torii, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00752 · Cited by 449
Active Object Localization with Deep Reinforcement Learning
Caicedo, J. C., & Lazebnik, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.286 · Cited by 447
Self-citationLearning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248065 · Cited by 443
Weakly Supervised Object Localization with Multi-Fold Multiple Instance Learning
Cinbis, R. G., Verbeek, J., & Schmid, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2535231 · Cited by 420
PCL: Proposal Cluster Learning for Weakly Supervised Object Detection
Tang, P., Wang, X., Bai, S., Shen, W., Bai, X., Liu, W., & Yuille, A. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2876304 · Cited by 406
“Pandey and Lazebnik [35] train a DPM model [42] under weak super-visions for WSOD.”
BackgroundDeep multiple instance learning for image classification and auto-annotation
Wu, J., Yu, Y., Huang, C., & Yu, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298968 · Cited by 386
Blocks That Shout: Distinctive Parts for Scene Classification
Juneja, M., Vedaldi, A., Jawahar, C. V., & Zisserman, A. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.124 · Cited by 368
Unsupervised Feature Learning for RGB-D Based Object Recognition
Bo, L., Ren, X., & Fox, D. (2013) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-00065-7_27 · Cited by 360
Webly Supervised Learning of Convolutional Networks
Chen, X., & Gupta, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.168 · Cited by 351
Visual attention methods in deep learning: An in-depth survey
Hassanin, M., Anwar, S., Radwan, I., Khan, F. S., & Mian, A. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102417 · Cited by 317
Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern
Qi, X., Xiao, R., Li, C.-G., Qiao, Y., Guo, J., & Tang, X. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2316826 · Cited by 296
Weakly Supervised Cascaded Convolutional Networks
Diba, A., Sharma, V., Pazandeh, A., Pirsiavash, H., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.545 · Cited by 287
Weakly Supervised Object Localization and Detection: A Survey
Zhang, D., Han, J., Cheng, G., & Yang, M.-H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3074313 · Cited by 277
Learning Everything about Anything: Webly-Supervised Visual Concept Learning
Divvala, S. K., Farhadi, A., & Guestrin, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.412 · Cited by 267
“Weakly-supervised object localization: The idea of training detection models from images and videos without bounding boxes has received renewed attention [2, 36, 39, 45] due to the recent success of the DPM detector [18].”
BackgroundMethodInfluentialG-MS2F: GoogLeNet based multi-stage feature fusion of deep CNN for scene recognition
Tang, P., Wang, H., & Kwong, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.11.023 · Cited by 259
Multi-fold MIL Training for Weakly Supervised Object Localization
Cinbis, R. G., Verbeek, J., & Schmid, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.309 · Cited by 219
“Following [11, 20, 25], during training we discard any images that only contain object instances marked as “difficult” or “truncated”.”
InfluentialWang, Q., Huang, W., Xiong, Z., & Li, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3042276 · Cited by 185
“Pandey et. al [39] achieve weakly-supervised object detection based on the handcrafted feature of deformable part models (DPM).”
BackgroundObject-Centric Spatial Pooling for Image Classification
Russakovsky, O., Lin, Y., Yu, K., & Fei-Fei, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_1 · Cited by 174
“The current state of the art is the work of Pandey and Lazebnik [17] which uses deformable partsbased models [24] trained discriminatively in a weakly supervised fashion for object localization.”
BackgroundMethodInfluentialZhang, D., Han, J., Zhao, L., & Meng, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1112-4 · Cited by 164
“In this section, we evaluate the proposed approach by comparing the object annotation/localization performance with a number of other state-of-the-art methods, including Pandey and Lazebnik (2011), Siva et al. (2012), Siva”
MethodInfluentialWeakly Supervised Object Detection Using Proposal- and Semantic-Level Relationships
Zhang, D., Zeng, W., Yao, J., & Han, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3046647 · Cited by 132
Growing random forest on deep convolutional neural networks for scene categorization
Bai, S. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.10.038 · Cited by 81
Gao, J., Yang, J., Wang, G., & Li, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.055 · Cited by 44
“And the proposed CCDBN with four layers performs better than most counterparts, such as ROI [2], DPM [32], and Hybrid-Parts.”
MethodInfluential
Metadata
- Authors
- Pandey, M., & Lazebnik, S.
- Venue
- 2011 International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2011-11
- Pages
- 1307-1314
- OpenAlex
- W2099528205
- Cited by
- 408
- References
- 20
- FWCI
- 28.46
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.