The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Evaluating Color Descriptors for Object and Scene Recognition
Abstract
Image category recognition is important to access visual information on the level of objects and scene types. So far, intensity-based descriptors have been widely used for feature extraction at salient points. To increase illumination invariance and discriminative power, color descriptors have been proposed. Because many different descriptors exist, a structured overview is required of color invariant descriptors in the context of image category recognition. Therefore, this paper studies the invariance properties and the distinctiveness of color descriptors (software to compute the color descriptors from this paper is available from http://www.colordescriptors.com) in a structured way. The analytical invariance properties of color descriptors are explored, using a taxonomy based on invariance properties with respect to photometric transformations, and tested experimentally using a data set with known illumination conditions. In addition, the distinctiveness of color descriptors is assessed experimentally using two benchmarks, one from the image domain and one from the video domain. From the theoretical and experimental results, it can be derived that invariance to light intensity changes and light color changes affects category recognition. The results further reveal that, for light intensity shifts, the usefulness of invariance is category-specific. Overall, when choosing a single descriptor and no prior knowledge about the data set and object and scene categories is available, the OpponentSIFT is recommended. Furthermore, a combined set of color descriptors outperforms intensity-based SIFT and improves category recognition by 8 percent on the PASCAL VOC 2007 and by 7 percent on the Mediamill Challenge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
Image retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
A comparison of affine region detectors
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-3848-x · Cited by 2,939
The PASCAL visual object classes challenge 2006 (VOC2006) results
Everingham, M., Zisserman, A., Williams, C. K. I., & Gool, L. V. (2006) · Cited by 2,079
Object class recognition by unsupervised scale-invariant learning
Fergus, R., Perona, P., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211479 · Cited by 2,023
Zhang, J., Marszałek, M., Lazebnik, S., & Schmid, C. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-9794-4 · Cited by 1,923
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 1×
“The bag-of-words model is also known as “textons” [30], “object parts” [31], and “codebooks” [32], [33].”
Using color to separate reflection components
Shafer, S. A. (1985) · Color Research & Application · doi:10.1002/col.5080100409 · Cited by 1,275
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
Local Invariant Feature Detectors: A Survey
Tuytelaars, T., & Mikolajczyk, K. (2007) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000017 · Cited by 1,186
The Amsterdam Library of Object Images
Geusebroek, J.-M., Burghouts, G. J., & Smeulders, A. W. M. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042993.50813.60 · Cited by 906
van Gemert, J. C., Veenman, C. J., Smeulders, A. W. M., & Geusebroek, J.-M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.132 · Cited by 737
Creating efficient codebooks for visual recognition
Jurie, F., & Triggs, B. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.66 · Cited by 713
Learning object categories from Google's image search
Fergus, R., Fei-Fei, L., Perona, P., & Zisserman, A. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.142 · Cited by 700
Scene Classification Using a Hybrid Generative/Discriminative Approach
Bosch, A., Zisserman, A., & Munoz, X. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70716 · Cited by 690
Large-Scale Concept Ontology for Multimedia
Naphade, M., Smith, J. R., Tesic, J., Chang, S.-F., Hsu, W., Kennedy, L., Hauptmann, A., & Curtis, J. (2006) · IEEE Multimedia · doi:10.1109/mmul.2006.63 · Cited by 648
Towards optimal bag-of-features for object categorization and semantic video retrieval
Jiang, Y.-G., Ngo, C.-W., & Yang, J. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282352 · Cited by 637
The challenge problem for automated detection of 101 semantic concepts in multimedia
Snoek, C. G. M., Worring, M., van Gemert, J. C., Geusebroek, J.-M., & Smeulders, A. W. M. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180727 · Cited by 620
Self-citationCSIFT: A SIFT Descriptor with Color Invariant Characteristics
Abdel-Hakim, A. E., & Farag, A. A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.95 · Cited by 570
Geusebroek, J.-M., van den Boomgaard, R., Smeulders, A. W. M., & Geerts, H. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.977559 · Cited by 553
Semantic Modeling of Natural Scenes for Content-Based Image Retrieval
Vogel, J., & Schiele, B. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-8614-1 · Cited by 384
Spectral sharpening: sensor transformations for improved color constancy
Finlayson, G. D., Drew, M. S., & Funt, B. V. (1994) · Journal of the Optical Society of America A · doi:10.1364/josaa.11.001553 · Cited by 330
Boosting color saliency in image feature detection
van de Weijer, J., Gevers, T., & Bagdanov, A. D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.3 · Cited by 301
Self-citationPerformance evaluation of local colour invariants
Burghouts, G. J., & Geusebroek, J.-M. (2009) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2008.07.003 · Cited by 295
Maximally Stable Colour Regions for Recognition and Matching
Forssen, P.-E. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383120 · Cited by 257
Moment invariants for recognition under changing viewpoint and illumination
Mindru, F., Tuytelaars, T., Gool, L. V., & Moons, T. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2003.10.011 · Cited by 245
Evaluation of color descriptors for object and scene recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587658 · Cited by 235
Self-citationInterleaving Object Categorization and Segmentation
Leibe, B., & Schiele, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11414353_10 · Cited by 223
Interleaved Object Categorization and Segmentation
Leibe, B., & Schiele, B. (2003) · Procedings of the British Machine Vision Conference 2003 · doi:10.5244/c.17.78 · Cited by 172
Learning Object Representations for Visual Object Class Recognition
Marszałek, M., Schmid, C., Harzallah, H., & van de Weijer, J. (2007) · HAL · Cited by 130
The MediaMill TRECVID 2004 Semantic Video Search Engine
Snoek, C. G. M., van de Sande, K. E. A., de Rooij, O., Huurnink, B., van Gemert, J. C., Uijlings, J., He, J., Li, X., Everts, I., Nedović, V., et al. (2004) · UvA-DARE (University of Amsterdam) · Cited by 117
Self-citationLarge-scale multimodal semantic concept detection for consumer video
Chang, S., Ellis, D. P. W., Jiang, W., Lee, K., Yanagawa, A., Loui, A. C. P., & Luo, J. (2007) · Multimedia Information Retrieval · doi:10.1145/1290082.1290118 · Cited by 116
Robust Scene Categorization by Learning Image Statistics in Context
van Gemert, J. C., Geusebroek, J., Veenman, C. J., Snoek, C. G. M., & Smeulders, A. W. M. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.177 · Cited by 92
Self-citation
Cited by
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Self-citationOn Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
Image Classification with the Fisher Vector: Theory and Practice
Sánchez, J., Perronnin, F., Mensink, T., & Verbeek, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0636-x · Cited by 1,498
Metadata
- Authors
- van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2010-09
- Volume
- 32
- Issue
- 9
- Pages
- 1582-1596
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2162762921
- Cited by
- 1,783
- References
- 40
- FWCI
- 160.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.