The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Unsupervised Discovery of Mid-Level Discriminative Patches
Abstract
The goal of this paper is to discover a set of discriminative patches which can serve as a fully unsupervised mid-level visual representation. The desired patches need to satisfy two requirements: 1) to be representative, they need to occur frequently enough in the visual world; 2) to be discriminative, they need to be different enough from the rest of the visual world. The patches could correspond to parts, objects, "visual phrases", etc. but are not restricted to be any one of them. We pose this as an unsupervised discriminative clustering problem on a huge dataset of image patches. We use an iterative procedure which alternates between clustering and training discriminative classifiers, while applying careful cross-validation at each step to prevent overfitting. The paper experimentally demonstrates the effectiveness of discriminative patches as an unsupervised mid-level visual representation, suggesting that it could be used in place of visual words for many tasks. Furthermore, discriminative patches can also be used in a supervised regime, such as scene classification, where they demonstrate state-of-the-art performance on the MIT Indoor-67 dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 4×
“We compare our approach with Visual Words [1] and Russell et. al [24] baseline, plus a number of intermediate results of our method: 1) HOG K-Means (visual word analog for HOG features), 2) Initial Clustering (SVMs trained on the K-Means clusters without discriminative re-clustering), and 3) No…”
BackgroundMethodInfluentialA discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
Object class recognition by unsupervised scale-invariant learning
Fergus, R., Perona, P., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211479 · Cited by 2,023
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 2×
“At a slightly higher level, combining such patches together, typically by clustering and histogramming, allows one to represent texture information (e.g., textons [9], dense bag-of-words [2], etc).”
BackgroundQuattoni, A., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206537 · Cited by 1,463
Shotton, J., Winn, J., Rother, C., & Criminisi, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_1 · Cited by 1,132
Poselets: Body part detectors trained using 3D human pose annotations
Bourdev, L., & Malik, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459303 · Cited by 961
IM2GPS: estimating geographic information from a single image
Hays, J., & Efros, A. A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587784 · Cited by 877
Self-citationLi, L.-J., Su, H., Fei-Fei, L., & Xing, E. P. (2018) · KiltHub Repository · doi:10.1184/r1/6475985 · Cited by 827
What makes Paris look like Paris?
Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185597 · Cited by 663
Self-citationUsing Multiple Segmentations to Discover Objects and their Extent in Image Collections
Russell, B. C., Freeman, W. T., Efros, A. A., Sivic, J., & Zisserman, A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.326 · Cited by 617
Self-citationVisual features of intermediate complexity and their use in classification
Ullman, S., Vidal-Naquet, M., & Sali, E. (2002) · Nature Neuroscience · doi:10.1038/nn870 · Cited by 600
Discovering object categories in image collections
Šivic, J., Russell, B. C., Efros, A. A., Zisserman, A., & Freeman, W. T. (2005) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 470
Self-citationRecognition using visual phrases
Sadeghi, M. A., & Farhadi, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995711 · Cited by 417
Efficient Object Category Recognition Using Classemes
Torresani, L., Szummer, M., & Fitzgibbon, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_56 · Cited by 409
Scene recognition and weakly supervised object localization with deformable part-based models
Pandey, M., & Lazebnik, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126383 · Cited by 408
Multi-Image Matching Using Multi-Scale Oriented Patches
Brown, M., Szeliski, R., & Winder, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.235 · Cited by 401
Grouplet: A structured image representation for recognizing human and object interactions
Yao, B., & Fei-Fei, L. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540234 · Cited by 328
Exploiting hierarchical context on a large database of object categories
Choi, M. J., Lim, J. J., Torralba, A., & Willsky, A. S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540221 · Cited by 304
Geometric blur for template matching
Berg, A. C., & Malik, J. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990529 · Cited by 277
Data-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A., & Efros, A. A. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024188 · Cited by 209
Self-citationDiscriminative K-means for Clustering
Ye, J., Zhao, Z., & Wu, M. (2007) · Cited by 199
Attribute-centric recognition for cross-category generalization
Farhadi, A., Endres, I., & Hoiem, D. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539924 · Cited by 188
Learning the easy things first: Self-paced visual category discovery
Lee, Y. J., & Grauman, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995523 · Cited by 168
Foreground Focus: Unsupervised Learning from Partially Matching Images
Lee, Y. J., & Grauman, K. L. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0252-y · Cited by 131
Unsupervised Detection of Regions of Interest Using Iterative Link Analysis
Kim, G., & Torralba, A. B. (2009) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 116
Unsupervised modeling of object categories using link analysis techniques
Kim, G.-H., Faloutsos, C., & Hebert, M. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587502 · Cited by 112
Unsupervised Category Modeling, Recognition, and Segmentation in Images
Todorović, S., & Ahuja, N. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.24 · Cited by 103
Object-graphs for context-aware category discovery
Lee, Y. J., & Grauman, K. L. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540237 · Cited by 99
Large Margin Learning of Upstream Scene Understanding Models
Zhu, J., Li, L.-J., Fei-Fei, L., & Xing, E. P. (2018) · doi:10.1184/r1/6475841 · Cited by 58
Using Multiple Segmentations to Discover Objects and their Extent in Image Collections
Tang, K., Guillory, D., & Ma, S. (2013) · Cited by 58
Discovering object instances from scenes of Daily Living
Kang, H., Hebert, M., & Kanade, T. (2011) · International Conference on Computer Vision · doi:10.1109/iccv.2011.6126314 · Cited by 44
Scene shape from texture of objects
Payet, N., & Todorović, S. (2011) · doi:10.1109/cvpr.2011.5995326 · Cited by 17
Cited by
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
“pects of a given domain through discovery of salient clusters, parts, mid-level features, and/or hidden units (Hinton & Salakhutdinov, 2006; Fidler & Leonardis, 2007; Zhu et al., 2007; Singh et al., 2012; Krizhevsky et al., 2012).”
BackgroundLearning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
“The idea of dataset boot-strapping [25, 30], typically called hard negative mining in recent work [12], appears in the training of most successful object detectors [7, 9, 12, 13, 15, 16, 23, 25, 29].”
BackgroundSelf-citationUnsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Self-citation
Metadata
- Authors
- Singh, S., Gupta, A., & Efros, A. A.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Berlin Heidelberg
- Published
- 2012
- Pages
- 73-86
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W1590510366
- Cited by
- 491
- References
- 38
- FWCI
- 49.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.