CoChat
Sign Up
PreprintCited by 245Domain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsAdvanced Image and Video Retrieval Techniques

SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning

Open access
Wang, Yan, Chao, Wei-Lun, Weinberger, Kilian Q., van der Maaten, Laurens·2019·arXiv
DOI 10.48550/arxiv.1911.04623arXiv 1911.04623
Open this paper in CoChat — free accountOpen PDF

Abstract

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform classification using a nearest-neighbor classifier. This paper studies the accuracy of nearest-neighbor baselines without meta-learning. Surprisingly, we find simple feature transformations suffice to obtain competitive few-shot learning accuracies. For example, we find that a nearest-neighbor classifier used in combination with mean-subtraction and L2-normalization outperforms prior results in three out of five settings on the miniImageNet dataset.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1911.04623

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • TITAN and TITANV maintain superior performance in nonparametric evaluations with prototyping and 20 nearest-neighbor evaluation.

    “Even with other nonparametric evaluations with prototyping105,106 and 20 nearest-neighbor evaluation, which predicts each WSI’s label based on the proximity to other WSI embeddings in the embedding space, we observe that TITAN and TITANV maintain superior performance Supplementary Tables 22–33.”

    From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [105]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 33

  1. [1][1] M. Bauer, M. Rojas-Carulla, J. B. Swiatkowski, B. Scholkopf, and R. E. Turner. Discriminative k-shot learning using probabilistic models. arXiv preprint arXiv:1706.00326 , 2017. 1, 3, 4 - · arXiv
  2. [2][2] W.-Y. Chen, Y.-C. Liu, Z. Kira, Y.-C. F. Wang, and J.-B. Huang. A closer look at few-shot classification. In ICLR , 2019. 4 -
  3. [3][3] L. Fei-Fei, R. Fergus, and P. Perona. One-shot learning of object categories. PAMI , 28(4):594-611, 2006. 1 -
  4. [4][4] C. Finn, P. Abbeel, and S. Levine. Model-agnostic metalearning for fast adaptation of deep networks. In ICML , 2017. 1, 3, 4 -
  5. [5][5] C. Finn, K. Xu, and S. Levine. Probabilistic model-agnostic meta-learning. In NeurIPS , 2018. 1, 3, 4 -
  6. [6][6] V. Garcia and J. Bruna. Few-shot learning with graph neural networks. In ICLR , 2018. 1, 3, 4 -
  7. [7][7] I. Gauthier. Dissecting face recognition: The role of expertise and level of categorization in object recognition . PhD thesis, Yale University, 1998. 1 -
  8. [8][8] S. Gidaris and N. Komodakis. Dynamic few-shot visual learning without forgetting. In CVPR , 2018. 1, 3, 4 -
  9. [9][9] J. Gordon, J. Bronskill, M. Bauer, S. Nowozin, and R. Turner. Meta-learning probabilistic inference for prediction. In ICLR , 2019. 1 -
  10. [10][10] E. Grant, C. Finn, S. Levine, T. Darrell, and T. Griffiths. Recasting gradient-based meta-learning as hierarchical bayes. In ICLR , 2018. 1, 3, 4 -
  11. [12][12] G. V. Horn and P. Perona. The devil is in the tails: Finegrained classification in the wild. In arXiv 1709.01450 , 2017. 1 - · arXiv
  12. [13][13] A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 , 2017. 1, 3 - · arXiv
  13. [14][14] G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. Densely connected convolutional networks. In CVPR , 2017. 1, 3 -
  14. [15][15] X. Jiang, M. Havaei, F. Varno, G. Chartrand, N. Chapados, and S. Matwin. Learning to learn with conditional class dependencies. In ICLR , 2019. 1, 3, 4 -
  15. [17][17] Y. Lee and S. Choi. Gradient-based meta-learning with learned layerwise metric and subspace. In ICML , 2018. 1, 3, 4 -
  16. [18][18] Z. Li, F. Zhou, F. Chen, and H. Li. Meta-sgd: Learning to learn quickly for few shot learning. arXiv preprint arXiv:1707.09835 , 2017. 4 - · arXiv
  17. [19][19] Y. Liu, J. Lee, M. Park, S. Kim, E. Yang, S. J. Hwang, and Y. Yang. Learning to propagate labels: Transductive propagation network for few-shot learning. In Proceedings of the Annual Meeting of the Cognitive Science Society , 2019. 4 -
  18. [21][21] N. Mishra, M. Rohaninejad, X. Chen, and P. Abbeel. A simple neural attentive meta-learner. In ICLR , 2018. 1, 3, 4 -
  19. [22][22] T. Munkhdalai, X. Yuan, S. Mehri, and A. Trischler. Rapid adaptation with conditionally shifted neurons. In ICML , 2018. 1, 3, 4 -
  20. [23][23] A. Nichol, J. Achiam, and J. Schulman. On first-order metalearning algorithms. CoRR, abs/1803.02999 , 2018. 1, 3, 4 - · arXiv
  21. [24][24] B. N. Oreshkin, A. Lacoste, and P. Rodriguez. Tadam: Task dependent adaptive metric for improved few-shot learning. In NeurIPS , 2018. 1, 2, 3, 4 -
  22. [25][25] S. Qiao, C. Liu, W. Shen, and A. L. Yuille. Few-shot image recognition by predicting parameters from activations. In CVPR , 2018. 1, 3, 4 -
  23. [26][26] S. Ravi and H. Larochelle. Optimization as a model for fewshot learning. In ICLR , 2017. 1, 2, 3, 4 -
  24. [27][27] M. Ren, E. Triantafillou, S. Ravi, J. Snell, K. Swersky, J. B. Tenenbaum, H. Larochelle, and R. S. Zemel. Meta-learning for semi-supervised few-shot classification. In ICLR , 2018. 1, 2 -
  25. [28][28] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. S. Bernstein, A. C. Berg, and F.-F. Li. Imagenet large scale visual recognition challenge. IJCV , 115(3):211-252, 2015. 2, 3 -
  26. [29][29] A. A. Rusu, D. Rao, J. Sygnowski, O. Vinyals, R. Pascanu, S. Osindero, and R. Hadsell. Meta-learning with latent embedding optimization. In ICLR , 2019. 1, 2, 3, 4 -
  27. [30][30] J. Snell, K. Swersky, and R. Zemel. Prototypical networks for few-shot learning. In NeurIPS , 2017. 1, 3, 4 -
  28. [31][31] F. Sung, Y. Yang, L. Zhang, T. Xiang, P. H. Torr, and T. M. Hospedales. Learning to compare: Relation network for fewshot learning. In CVPR , 2018. 1, 3, 4 -
  29. [32][32] E. Triantafillou, R. Zemel, and R. Urtasun. Few-shot learning through an information retrieval lens. In CVPR , 2017. 1, 3, 4 -
  30. [34][34] O. Vinyals, C. Blundell, T. Lillicrap, D. Wierstra, et al. Matching networks for one shot learning. In NIPS , 2016. 1, 2, 3, 4 -
  31. [35][35] D. Wertheimer and B. Hariharan. Few-shot learning with localization in realistic settings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 6558-6567, 2019. 6 -
  32. [36][36] H.-J. Ye, H. Hu, D.-C. Zhan, and F. Sha. Learning embedding adaptation for few-shot learning. arXiv preprint arXiv:1812.03664 , 2018. 1, 3, 4 - · arXiv
  33. [37][37] J. Yoon, T. Kim, O. Dia, S. Kim, Y. Bengio, and S. Ahn. Bayesian model-agnostic meta-learning. In NeurIPS , 2018. 1 -

Cited by

Sorted by citations

Authors
Wang, Y., Chao, W.-L., Weinberger, K. Q., & van der Maaten, L.
Affiliations
  • Cornell University (US)
  • The Ohio State University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1911.04623
arXiv
1911.04623
OpenAlex
W2986604550
Cited by
245
References
4
Citations by year
2026: 4 · 2025: 18 · 2024: 46 · 2023: 51 · 2022: 39 · 2021: 62 · 2020: 23 · 2019: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
few-shot learning, nearest neighbor classification, meta-learning, feature transformation, L2 normalization, overfitting, miniImageNet, object recognition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review