The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition
Abstract
We consider visual category recognition in the framework of measuring similarities, or equivalently perceptual distances, to prototype examples of categories. This approach is quite flexible, and permits recognition based on color, texture, and particularly shape, in a homogeneous framework. While nearest neighbor classifiers are natural in this setting, they suffer from the problem of high variance (in bias-variance decomposition) in the case of limited sampling. Alternatively, one could use support vector machines but they involve time-consuming optimization and computation of pairwise distances. We propose a hybrid of these two methods which deals naturally with the multiclass setting, has reasonable computational complexity both in training and at run time, and yields excellent results in practice. The basic idea is to find close neighbors to a query sample and train a local support vector machine that preserves the distance function on the collection of neighbors. Our method can be applied to large, multiclass data sets for which it outperforms nearest neighbor and support vector machines, and remains efficient when the problem becomes intractable for support vector machines. A wide variety of distance functions can be used and our experiments show state-of-the-art performance on a number of benchmark data sets for shape and texture classification (MNIST, USPS, CUReT) and object recognition (Caltech- 101). On Caltech-101 we achieved a correct classification rate of 59.05%(±0.56%) at 15 training images per class, and 66.23%(±0.48%) at 30 training images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Self-citationThompson, D. W. (2019) · Stripped Bare · doi:10.1515/9780691183978-018 · Cited by 4,177
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Rosch, E. H. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90017-0 · Cited by 2,401
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359
On the algorithmic implementation of multiclass kernel-based vector machines
Crammer, K., & Singer, Y. (2002) · Cited by 1,887
Large Margin DAG's for Multiclass Classification
Platt, J. C., Cristianini, N., & Shawe-Taylor, J. S. (1999) · Cited by 1,674
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 7×
“In our previous work on Caltech-101 (Berg, Berg and Malik [3]), we sought to find shape correspondence in a deformable template paradigm.”
BackgroundMethodInfluentialSelf-citationThe pyramid match kernel: discriminative classification with sets of image features
Grauman, K., & Darrell, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.239 · Cited by 1,481
Reflectance and texture of real-world surfaces
Dana, K. J., van Ginneken, B., Nayar, S. K., & Koenderink, J. J. (1999) · ACM Transactions on Graphics · doi:10.1145/300776.300778 · Cited by 1,324
A Statistical Approach to Texture Classification from Single Images
Varma, M., & Zisserman, A. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-4635-4 · Cited by 1,142
On the algorithmic implementation of multiclass kernel-based vector machines
CrammerKoby, & SingerYoram (2002) · Journal of Machine Learning Research · doi:10.5555/944790.944813 · Cited by 874
Shape Matching and Object Recognition Using Low Distortion Correspondences
Berg, A. C., Berg, T. L., & Malik, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.320 · Cited by 845
Self-citationDiscriminant adaptive nearest neighbor classification
Hastie, T., & Tibshirani, R. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506411 · Cited by 833
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.254 · Cited by 821
Lee, Y., Lin, Y., & Wahba, G. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000098 · Cited by 741
Sharing features: efficient boosting procedures for multiclass object detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315241 · Cited by 577
Bottou, L., & Vapnik, V. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.888 · Cited by 542
The Kernel Trick for Distances
Schölkopf, B. (2000) · Cited by 505
(1992) · neural information processing systems · Cited by 460
Multiclass Object Recognition with Sparse, Localized Features
Mutch, J., & Lowe, D. G. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.200 · Cited by 453
Estimation by the nearest neighbor rule
Cover, T. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054098 · Cited by 365
Estimating Human Body Configurations Using Shape Context Matching
Mori, G., & Malik, J. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_44 · Cited by 353
Self-citationA generalized kernel approach to dissimilarity-based classification
Pękalska, E., Paclı́k, P., & Duin, R. P. W. (2002) · doi:10.5555/944790.944810 · Cited by 350
Transformation Invariance in Pattern Recognition – Tangent Distance and Tangent Propagation
Simard, P. Y., LeCun, Y. A., Denker, J. S., & Victorri, B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_17 · Cited by 341
Geometric blur for template matching
Berg, A. C., & Malik, J. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990529 · Cited by 277
Self-citationUsing Analytic QP and Sparseness to Speed Training of Support Vector Machines
Platt, J. C. (1998) · Cited by 270
Transformation Invariance in Pattern Recognition — Tangent Distance and Tangent Propagation
Simard, P. Y., LeCun, Y. A., Denker, J. S., & Victorri, B. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8_13 · Cited by 229
K-Local Hyperplane and Convex Distance Nearest Neighbor Algorithms
Vincent, P., & Bengio, Y. (2001) · Cited by 182
Similarity in visually perceived forms.
Goldmeier, E. (1972) · PubMed · Cited by 163
Shape contexts enable efficient retrieval of similar shapes
Mori, G., Belongie, S., & Malik, J. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990547 · Cited by 152
Self-citationUsing Dependent Regions for Object Categorization in a Generative Framework
Wang, G., Zhang, Y., & Fei-Fei, L. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.324 · Cited by 141
Combining generative models and Fisher kernels for object recognition
Holub, A. D., Welling, M., & Perona, P. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.56 · Cited by 91
Adaptive Nearest Neighbor Classification using Support Vector Machines
Domeniconi, C., & Gunopulos, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0090 · Cited by 90
Shape Matching and Object Recognition
Berg, A. C., & Malik, J. (2006) · Lecture notes in computer science · doi:10.1007/11957959_25 · Cited by 83
Self-citationLearning Compositional Categorization Models
Ommer, B., & Buhmann, J. M. (2006) · Lecture notes in computer science · doi:10.1007/11744078_25 · Cited by 40
Neural-Network and k-Nearest-neighbor Classifiers
Bromley, J. M., & Säckinger, E. (1991) · Open Research Online (The Open University) · Cited by 31
Pyramid Match Kernels: Discriminative Classification with Sets of Image Features (version 2)
Grauman, K. L., & Darrell, T. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 20
Cited by
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
Automated Flower Classification over a Large Number of Classes
Nilsback, M.-E., & Zisserman, A. (2008) · 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing · doi:10.1109/icvgip.2008.47 · Cited by 3,442
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Metadata
- Authors
- Zhang, H., Berg, A. C., Maire, M., & Malik, J.
- Venue
- 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06)
- Publisher
- IEEE
- Published
- 2006-07-10
- Volume
- 2
- Pages
- 2126-2136
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2165828254
- Cited by
- 1,114
- References
- 42
- FWCI
- 48.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.