Cited by 544Domain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsAdvanced Image and Video Retrieval Techniques

Low-Shot Learning with Imprinted Weights

Open access
Qi, Hang, Brown, Matthew, Lowe, David G.·2018·2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition

Abstract

Human vision is able to immediately recognize novel visual categories after seeing just one or a few training examples. We describe how to add a similar capability to ConvNet classifiers by directly setting the final layer weights from novel training examples during low-shot learning. We call this process weight imprinting as it directly sets weights for a new category based on an appropriately scaled copy of the embedding layer activations for that training example. The imprinting process provides a valuable complement to training with stochastic gradient descent, as it provides immediate good classification performance and an initialization for any further fine-tuning in the future. We show how this imprinting process is related to proxy-based embeddings. However, it differs in that only a single imprinted weight vector is learned for each novel category, rather than relying on a nearest-neighbor distance to training instances as typically used with embedding methods. Our experiments show that using averaging of imprinted weights provides better generalization than using nearest-neighbor instance embeddings.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvpr.2018.00610

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The practical need for learning new classes from limited samples without compromising performance on previous classes has led to the development of gFSL.

    “This practical need has led to the development of a novel setting, gFSL [15], aimed at enabling learning of new classes with limited samples without compromising performance on previous classes [15, 55, 56].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 26 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

  1. J. L. Ba, J. R. Kiros, and G. E. Hinton. Layer normalization. arXiv preprint arXiv:1607.06450, 2016. 4 · arXiv
  2. H. O. Song, S. Jegelka, V. Rathod, and K. Murphy. Learn- able structured clustering framework for deep metric learn- ing. arXiv preprint arXiv:1612.01213, 2016. 2 · arXiv
  3. F. Wang, X. Xiang, J. Cheng, and A. L. Yuille. NormFace: L2 hypersphere embedding for face verification. In Pro- ceedings of the 2017 ACM on Multimedia Conference, pages 1041-1049, 2017. 1, 2, 4

Cited by

Sorted by citations

Authors
Qi, H., Brown, M., & Lowe, D. G.
Affiliations
  • University of California, Los Angeles (US)
  • Google (United States) (US)
Venue
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Publisher
IEEE
Published
2018-06
Volume
2018
Pages
5822-5830
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2796346823
Cited by
539
References
26
Citations by year
2026: 12 · 2025: 31 · 2024: 58 · 2023: 78 · 2022: 97 · 2021: 119 · 2020: 99 · 2019: 42 · 2018: 3
FWCI
26.74
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • IEEE Conference Proceedings
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
few-shot learning, novel category recognition, generalization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review