Towards optimal bag-of-features for object categorization and semantic video retrieval
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Bag-of-features (BoF) deriving from local keypoints has recently appeared promising for object and scene classification. Whether BoF can naturally survive the challenges such as reliability and scalability of visual classification, nevertheless, remains uncertain due to various implementation choices. In this paper, we evaluate various factors which govern the performance of BoF. The factors include the choices of detector, kernel, vocabulary size and weighting scheme. We offer some practical insights in how to optimize the performance by choosing good keypoint detector and kernel. For the weighting scheme, we propose a novel soft-weighting method to assess the significance of a visual word to an image. We experimentally show that the proposed soft-weighting scheme can consistently offer better performance than other popular weighting methods. On both PASCAL-2005 and TRECVID-2006 datasets, our BoF setting generates competitive performance compared to the state-of-the-art techniques. We also show that the BoF is highly complementary to global features. By incorporating the BoF with color and texture features, an improvement of 50% is reported on TRECVID-2006 dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 2×
“CIVR 07, July 9 11, 2007, Amsterdam, The Netherlands Copyright 2007 ACM 978-1-59593-733-9/07/0007 ...$5.00.”
MethodInfluentialScale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
A comparison of affine region detectors
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-3848-x · Cited by 2,939
Feature detection with automatic scale selection
Lindeberg, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008045108935 · Cited by 2,541 · cited 1×
“Here we evaluate six popular keypoint detectors, including Laplacian of Gaussian (LoG) [12], Difference of Gaussian (DoG) [13], Harris Laplace [15], Hessian Laplace [14], Harris Affine [15], and Hessian Affine [14].”
MethodSupport vector machines for histogram-based image classification
Chapelle, O., Haffner, P., & Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788646 · Cited by 1,468
Cited by
Evaluating Color Descriptors for Object and Scene Recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.154 · Cited by 1,783
An Efficient Dense and Scale-Invariant Spatio-Temporal Interest Point Detector
Willems, G., Tuytelaars, T., & Van Gool, L. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_48 · Cited by 869
Evaluating bag-of-visual-words representations in scene classification
Yang, J., Jiang, Y.-G., Hauptmann, A. G., & Ngo, C.-W. (2007) · Proceedings of the international workshop on Workshop on multimedia information retrieval · doi:10.1145/1290082.1290111 · Cited by 825
Self-citationSemi-Supervised Hashing for Large-Scale Search
Wang, J., Kumar, S., & Chang, S.-F. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.48 · Cited by 810
van Gemert, J. C., Veenman, C. J., Smeulders, A. W. M., & Geusebroek, J.-M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.132 · Cited by 737
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chen, C., Li, O., Tao, C., Barnett, A. J., Su, J., & Rudin, C. (2018) · arXiv · doi:10.48550/arxiv.1806.10574 · Cited by 702
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571
Dardas, N. H., & Georganas, N. D. (2011) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2011.2161140 · Cited by 481
Unified Video Annotation via Multigraph Learning
Wang, M., Hua, X.-S., Hong, R., Tang, J., Qi, G.-J., & Song, Y. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2017400 · Cited by 441
Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search
Gao, Y., Wang, M., Zha, Z.-J., Shen, J., Li, X., & Wu, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2202676 · Cited by 438
Jiang, Y.-G., Ye, G., Chang, S.-F., Ellis, D., & Loui, A. C. (2011) · Proceedings of the 1st ACM International Conference on Multimedia Retrieval · doi:10.1145/1991996.1992025 · Cited by 324
Self-citationIndonesian Journal of Electrical Engineering and Computer Science
(2025) · doi:10.11591/ijeecs · Cited by 317
Snoek, C. G. M., & Worring, M. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601982353 · Cited by 317
Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search
Jiang, L., Meng, D., Mitamura, T., & Hauptmann, A. G. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654918 · Cited by 271
Representations of Keypoint-Based Semantic Concept Detection: A Comprehensive Study
Jiang, Y.-G., Yang, J., Ngo, C.-W., & Hauptmann, A. G. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2036235 · Cited by 260
Self-citationA novel multivariate filter method for feature selection in text classification problems
Labani, M., Moradi, P., Ahmadizar, F., & Jalili, M. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.12.014 · Cited by 219
Image Matching Using Generalized Scale-Space Interest Points
Lindeberg, T. (2015) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-014-0541-0 · Cited by 208
Context-Aware Activity Recognition and Anomaly Detection in Video
Zhu, Y., Nayak, N. M., & Roy-Chowdhury, A. K. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2234722 · Cited by 121
“The average recognition accuracies, measured by average precision are 40%, 59%, 51% and 68% respectively for the four methods - BOW+SVM [32], BOW+SVM+Context model, SFG [10] and SFG+Context model.”
MethodInfluentialFIVR: Fine-Grained Incident Video Retrieval
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, I. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2905741 · Cited by 79
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [51] [25], [37], [42], [50], fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
Method
Metadata
- Authors
- Jiang, Y.-G., Ngo, C.-W., & Yang, J.
- Venue
- Proceedings of the 6th ACM international conference on Image and video retrieval
- Publisher
- ACM
- Published
- 2007-07-09
- Pages
- 494-501
- OpenAlex
- W1986482242
- Cited by
- 637
- References
- 24
- FWCI
- 41.60
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.