The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Visual Word Ambiguity
Open accessAbstract
This paper studies automatic image classification by modeling soft assignment in the popular codebook model. The codebook model describes an image as a bag of discrete visual words selected from a vocabulary, where the frequency distributions of visual words in an image allow classification. One inherent component of the codebook model is the assignment of discrete visual words to continuous image features. Despite the clear mismatch of this hard assignment with the nature of continuous features, the approach has been successfully applied for some years. In this paper, we investigate four types of soft assignment of visual words to image features. We demonstrate that explicitly modeling visual word assignment ambiguity improves classification performance compared to the hard assignment of the traditional codebook model. The traditional codebook model is compared against our method for five well-known data sets: 15 natural scenes, Caltech-101, Caltech-256, and Pascal VOC 2007/2008. We demonstrate that large codebook vocabulary sizes completely deteriorate the performance of the traditional model, whereas the proposed model performs consistently. Moreover, we show that our method profits in high-dimensional feature spaces and reaps higher benefits when increasing the number of image categories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 2×
“Typically, a vocabulary is constructed by applying k-means clustering on image features [4], [14]– [16], [20], [23]–[26], [30], [31].”
BackgroundMethodModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Density Estimation for Statistics and Data Analysis
Dehnad, K. (1987) · Technometrics · doi:10.1080/00401706.1987.10488295 · Cited by 5,302
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Cited by
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
“approaches is to have multiple combinations of patch detectors, descriptors and spatial pyramids (where a combination is often referred to as a “channel”), to train one classifier per channel and then to combine the output of the classifiers [5,6,7,3].”
BackgroundMethodInfluentialEvaluating Color Descriptors for Object and Scene Recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.154 · Cited by 1,783
Aggregating Local Image Descriptors into Compact Codes
Jegou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., & Schmid, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.235 · Cited by 1,503
Image Classification with the Fisher Vector: Theory and Practice
Sánchez, J., Perronnin, F., Mensink, T., & Verbeek, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0636-x · Cited by 1,498
“Several systems are based on the combination of multiple channels corresponding to many different features including (Bergamo and Torresani, 2012, Boiman et al, 2008, Gehler and Nowozin, 2009, VanGemert et al, 2010).”
InfluentialLearning mid-level features for recognition
Boureau, Y.-L., Bach, F., LeCun, Y., & Ponce, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539963 · Cited by 1,052
Towards better exploiting convolutional neural networks for remote sensing scene classification
Nogueira, K., Penatti, O. A. B., & dos Santos, J. A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.001 · Cited by 902
Enhanced Performance of Brain Tumor Classification via Tumor Region Augmentation and Partition
Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., Wang, Z., & Feng, Q. (2015) · PLOS ONE · doi:10.1371/journal.pone.0140381 · Cited by 879
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 705
Bag of visual words and fusion methods for action recognition: Comprehensive study and good practice
Peng, X., Wang, L., Wang, X., & Qiao, Y. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.03.013 · Cited by 677
Huang, B., Zhao, B., & Song, Y. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.04.050 · Cited by 591
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571
“retrieval. The extensive experiments demonstrate the superiority of BOVW over these global features. In [31], BOVW is compared with VLAD and its more compact version, product quantized VLAD (VLAD-PQ) [87], for the purpose of geographic image retrieval from satellite imagery. The results show that VLAD-based representa…”
MethodMultiple instance classification: Review, taxonomy and comparative study
Amores, J. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2013.06.003 · Cited by 557
Content-based image retrieval using color difference histogram
Liu, G.-H., & Yang, J.-Y. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.06.001 · Cited by 507
InLoc: Indoor Visual Localization with Dense Matching and View Synthesis
Taira, H., Okutomi, M., Sattler, T., Cimpoi, M., Pollefeys, M., Sivic, J., Pajdla, T., & Torii, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00752 · Cited by 449
In defense of soft-assignment coding
Liu, L., Wang, L., & Liu, X. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126534 · Cited by 443
From BoW to CNN: Two Decades of Texture Representation for Texture Classification
Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., & Pietikäinen, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1125-z · Cited by 375
Visual Place Recognition with Repetitive Structures
Torii, A., Sivic, J., Pajdla, T., & Okutomi, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.119 · Cited by 359
New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative
Huiskes, M. J., Thomee, B., & Lew, M. S. (2010) · Proceedings of the international conference on Multimedia information retrieval · doi:10.1145/1743384.1743475 · Cited by 336
A Review on Human Activity Recognition Using Vision-Based Method
Zhang, S., Wei, Z., Nie, J., Huang, L., Wang, S., & Li, Z. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/3090343 · Cited by 328
Sparse Modeling for Image and Vision Processing
Mairal, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781680830095 · Cited by 322
A Robust and Efficient Video Representation for Action Recognition
Wang, H., Oneata, D., Verbeek, J., & Schmid, C. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0846-5 · Cited by 317
Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern
Qi, X., Xiao, R., Li, C.-G., Qiao, Y., Guo, J., & Tang, X. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2316826 · Cited by 296
Retrieval of Brain Tumors by Adaptive Spatial Pooling and Fisher Vector Representation
Cheng, J., Yang, W., Huang, M., Huang, W., Jiang, J., Zhou, Y., Yang, R., Zhao, J., Feng, Y., Feng, Q., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157112 · Cited by 293
Ask the locals: Multi-way local pooling for image recognition
Boureau, Y.-L., Le Roux, N., Bach, F., Ponce, J., & LeCun, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126555 · Cited by 277
Nearest neighbors distance ratio open-set classifier
Mendes Júnior, P. R., de Souza, R. M., Werneck, R. D. O., Stein, B. V., Pazinato, D. V., de Almeida, W. R., Penatti, O. A. B., Torres, R. D. S., & Rocha, A. (2017) · Machine Learning · doi:10.1007/s10994-016-5610-8 · Cited by 276
Representations of Keypoint-Based Semantic Concept Detection: A Comprehensive Study
Jiang, Y.-G., Yang, J., Ngo, C.-W., & Hauptmann, A. G. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2036235 · Cited by 260
A Survey of Fingerprint-Based Outdoor Localization
Vo, Q. D., & De, P. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2448632 · Cited by 259
Content-based image retrieval using computational visual attention model
Liu, G.-H., Yang, J.-Y., & Li, Z. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.005 · Cited by 257
Super Normal Vector for Human Activity Recognition with Depth Cameras
Yang, X., & Tian, Y. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2565479 · Cited by 162
On the Generality of Codebook Approach for Sensor-Based Human Activity Recognition
Shirahama, K., & Grzegorzek, M. (2017) · Electronics · doi:10.3390/electronics6020044 · Cited by 29
Metadata
- Authors
- van Gemert, J. C., Veenman, C. J., Smeulders, A. W. M., & Geusebroek, J.-M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2010-07
- Volume
- 32
- Issue
- 7
- Pages
- 1271-1283
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2155490028
- Cited by
- 737
- References
- 41
- FWCI
- 63.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.