The DOI matches its OpenAlex record; 151 of the 151 references it cites were found in a registry or an index.
Generalizing from a Few Examples: A Survey on Few-Shot Learning
Open accessAbstract
Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-Shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly generalize to new tasks containing only a few samples with supervised information. In this paper, we conduct a thorough survey to fully understand FSL. Starting from a formal definition of FSL, we distinguish FSL from several relevant machine learning problems. We then point out that the core issue in FSL is that the empirical risk minimized is unreliable. Based on how prior knowledge can be used to handle this core issue, we categorize FSL methods from three perspectives: (i) data, which uses prior knowledge to augment the supervised experience; (ii) model, which uses prior knowledge to reduce the size of the hypothesis space; and (iii) algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space. With this taxonomy, we review and discuss the pros and cons of each category. Promising directions, in the aspects of the FSL problem setups, techniques, applications and theories, are also proposed to provide insights for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“…(e.g., GPU and distributed platforms), large data sets (e.g., ImageNet data with 1000 classes [30]), advanced models and algorithms (e.g., convolutional neural networks (CNN) [73] and long short-term memory (LSTM) [58]), AI speeds up its pace to be like humans and defeats humans in many fields.”
BackgroundImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“• Transfer learning [101] transfers knowledge from the source domain/task, where training data is abundant, to the target domain/task, where training data is scarce.”
BackgroundBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
(2016) · Cited by 11,679
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 9×
“Many related machine learning approaches have been proposed, such as meta-learning [37, 106, 114], embedding learning [14, 126, 138] and generative modeling [34, 35, 113].”
BackgroundMethodInfluentialOvercoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,505
Optimization as a Model for Few-Shot Learning
Ravi, S., & Larochelle, H. (2017) · International Conference on Learning Representations · Cited by 4,067
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“with some regularization. Fine-tuning is popularly used in practice which adapts the value of a (deep) model trained on large scale data such as ImageNet to smaller data sets through back-propagation [25]. The single θ0 which contain generic knowledge is usually parameter of deep models, hence contains large number of…”
BackgroundNeural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Siamese Neural Networks for One-shot Image Recognition
Koch, G. E., Zemel, R. S., & Salakhutdinov, R. (2015) · Cited by 3,740
A Comprehensive Introduction to Differential Geometry.
Kramer, A. D., & Spivak, M. (1973) · The American Mathematical Monthly · doi:10.2307/2319112 · Cited by 3,445
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
Optimization Methods for Large-Scale Machine Learning
Bottou, L., Curtis, F. E., & Nocedal, J. (2018) · SIAM Review · doi:10.1137/16m1080173 · Cited by 3,128
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3070203 · Cited by 2,878
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Salakhutdinov, R., & Hinton, G. E. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 2,605
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORK
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1994) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789812797926_0003 · Cited by 2,350
An Overview of Multi-Task Learning in Deep Neural Networks
Ruder, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05098 · Cited by 2,265
Analysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 2×
“rt from that, as FSL sometimes becomes domain adaptation problems, such as those mentioned in multitask learning methods in Section 4.1. Existing bounds on estimation error E est(H,I)may be inspiring [10, 15]. Finally, convergence for methods in algorithms are not fully understood. Indeed, search using few-shot and pr…”
BackgroundInfluentialEDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
Wei, J., & Zou, K. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1670 · Cited by 1,911
A brief introduction to weakly supervised learning
Zhou, Z.-H. (2018) · National Science Review · doi:10.1093/nsr/nwx106 · Cited by 1,899
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly
Xian, Y., Lampert, C. H., Schiele, B., & Akata, Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2857768 · Cited by 1,678
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296 · cited 1×
“in E to make the learning of the supervised targetT feasible. Existing FSL methods use prior knowledge from a single modality, which is the output of a sensor for observing some phenomena or systems [61], such as images, texts, and videos. However, multi-modality prior knowledge can be used to provide a prior knowledg…”
MethodSrivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,246
The Tradeoffs of Large-Scale Learning
Bottou, L., & Bousquet, O. (2011) · Optimization for Machine Learning · doi:10.7551/mitpress/8996.003.0015 · Cited by 1,128
Dynamic Few-Shot Visual Learning Without Forgetting
Gidaris, S., & Komodakis, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00459 · Cited by 1,128
Foundations of Machine Learning
Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018) · doi:10.7551/mitpress/10290.001.0001 · Cited by 1,122
AutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106
(2016) · doi:10.18653/v1/d16-1147 · Cited by 1,035
One-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927 · cited 2×
“FSL has also been successfully used in video applications, including motion prediction [50], video classification [164], action localization [152], person re-identification [148], event detection [151], and object segmentation [21].”
MethodRidge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
A Simple Neural Attentive Meta-Learner
Mishra, N., Rohaninejad, M., Chen, X., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03141 · Cited by 802
Low Data Drug Discovery with One-Shot Learning
Altae-Tran, H., Ramsundar, B., Pappu, A. S., & Pande, V. (2017) · ACS Central Science · doi:10.1021/acscentsci.6b00367 · Cited by 799 · cited 5×
“resLSTM [3] GCN, then LSTM with attention GCN, then LSTM with attention yes cosine similarity combined”
BackgroundMethodInfluentialLow-Shot Visual Recognition by Shrinking and Hallucinating Features
Hariharan, B., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.328 · Cited by 792
Zero-Shot Learning with Semantic Output Codes
Palatucci, M., Pomerleau, D., Hinton, G. E., & Mitchell, T. M. (2018) · Figshare · doi:10.1184/r1/6476456 · Cited by 752
Low-Shot Learning from Imaginary Data
Wang, Y.-X., Girshick, R., Hebert, M., & Hariharan, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00760 · Cited by 744
Self-citationMeta NetworksPreprint
Munkhdalai, T., & Yu, H. Q. (2017) · arXiv (Cornell University) · Cited by 718
Meta-Learning for Semi-Supervised Few-Shot Classification
Ren, M., Triantafillou, E., Ravi, S., Snell, J., Swersky, K., Tenenbaum, J. B., Larochelle, H., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00676 · Cited by 694
Principles of Risk Minimization for Learning Theory
Vapnik, V. N. (1991) · neural information processing systems · Cited by 692
Advances in Variational Inference
Zhang, C., Butepage, J., Kjellstrom, H., & Mandt, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889774 · Cited by 671
Auto-WEKA: Automatic Model Selection and Hyperparameter Optimization in WEKA
Kotthoff, L., Thornton, C., Hoos, H. H., Hutter, F., & Leyton-Brown, K. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_4 · Cited by 650
Zero-Shot Recognition via Semantic Embeddings and Knowledge Graphs
Wang, X., Ye, Y., & Gupta, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00717 · Cited by 648
Label-Embedding for Attribute-Based Classification
Akata, Z., Perronnin, F., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.111 · Cited by 618
Han, X., Zhu, H., Yu, P., Wang, Z., Yao, Y., Liu, Z., & Sun, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1514 · Cited by 613
Learning to Learn Using Gradient Descent
Hochreiter, S., Younger, A. S., & Conwell, P. R. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44668-0_13 · Cited by 553
Few-Shot Image Recognition by Predicting Parameters from Activations
Qiao, S., Liu, C., Shen, W., & Yuille, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00755 · Cited by 546
Low-Shot Learning with Imprinted Weights
Qi, H., Brown, M., & Lowe, D. G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00610 · Cited by 539 · cited 2×
“ses by similar features taken from the novel class and reusing their classifier parameters. Only the threshold for classification is adjusted to avoid confusion with those similar classes. Similar to [89] and [90], a pre-trained CNN is adapted to deal with new class in [40]. But instead of solely using embedding of x(…”
MethodInfluentialMcCorduck, P. (1979) · Medical Entomology and Zoology · Cited by 510
Sharper Bounds for Gaussian and Empirical Processes
Talagrand, M. (1994) · The Annals of Probability · doi:10.1214/aop/1176988847 · Cited by 480
Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
Liu, Y., Lee, J., Park, M., Kim, S., Yang, E., Hwang, S. J., & Yang, Y. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10002 · Cited by 468
Deep feature synthesis: Towards automating data science endeavors
Kanter, J. M., & Veeramachaneni, K. (2015) · 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344858 · Cited by 421
AI: the tumultuous history of the search for artificial intelligence
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1555 · Cited by 420
Thrun, S. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_8 · Cited by 413
Learning from one example through shared densities on transforms
Miller, M. G., Matsakis, N. E., & Viola, P. A. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855856 · Cited by 413
Learning Bounds for Domain Adaptation
Blitzer, J. C., Crammer, K., Kulesza, A., Pereira, F. M. B., & Wortman, J. R. (2007) · Cited by 393
Exploit the Unknown Gradually: One-Shot Video-Based Person Re-identification by Stepwise Learning
Wu, Y., Lin, Y., Dong, X., Yan, Y., Ouyang, W., & Yang, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00543 · Cited by 383
Taking Human out of Learning Applications: A Survey on Automated Machine LearningPreprint
Yao, Q., Wang, M., Escalante, H. J., Guyon, I., Hu, Y.-Q., Li, Y., Tu, W.-W., Yang, Q., & Yang, Y. (2018) · arXiv (Cornell University) · Cited by 353
Self-citationMulti-content GAN for Few-Shot Font Style Transfer
Azadi, S., Fisher, M., Kim, V., Wang, Z., Shechtman, E., & Darrell, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00789 · Cited by 333
MetaGAN: an adversarial approach to few-shot learning
Zhang, R., Che, T., Ghahramani, Z., Bengio, Y., & Song, Y. (2018) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 313
Memory Matching Networks for One-Shot Image Recognition
Cai, Q., Pan, Y., Yao, T., Yan, C., & Mei, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00429 · Cited by 310
Continuous Adaptation via Meta-Learning in Nonstationary and Competitive EnvironmentsPreprint
Al-Shedivat, M., Bansal, T., Burda, Y., Sutskever, I., Mordatch, I., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03641 · Cited by 304
A Meta-Learning Perspective on Cold-Start Recommendations for Items
Vartak, M., Thiagarajan, A., Miranda, C. S., Bratman, J., & Larochelle, H. (2017) · neural information processing systems · Cited by 299
Boosting with Early Stopping: Convergence and Consistency
Zhang, T., Yu, B., & Becomes An, L. (2003) · Cited by 294
Learning to Learn: Model Regression Networks for Easy Small Sample Learning
Wang, Y.-X., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_37 · Cited by 282
Self-citationLabel Efficient Learning of Transferable Representations across Domains and TasksPreprint
Luo, Z., Zou, Y., Hoffman, J., & Fei-Fei, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00123 · Cited by 274
Delta-encoder: an effective sample synthesis method for few-shot object recognition
Schwartz, E., Karlinsky, L., Shtok, J., Harary, S., Marder, M., Feris, R., Kumar, A., Giryes, R., & Bronstein, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04734 · Cited by 266
One-Shot Generalization in Deep Generative ModelsPreprint
Rezende, D. J., Mohamed, S., Danihelka, I., Gregor, K., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.05106 · Cited by 255
Compound Memory Networks for Few-Shot Video Classification
Zhu, L., & Yang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_46 · Cited by 239
Learning feed-forward one-shot learners
Bertinetto, L., Henriques, J. F., Valmadre, J., Torr, P. H. S., & Vedaldi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05233 · Cited by 226
Diverse Few-Shot Text Classification with Multiple Metrics
Yu, M., Guo, X., Yi, J., Chang, S., Potdar, S., Cheng, Y., Tesauro, G., Wang, H., & Zhou, B. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1109 · Cited by 225
Learning to Remember Rare Events
Kaiser, Ł., Nachum, O., Roy, A., & Bengio, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03129 · Cited by 218
SMASH: One-Shot Model Architecture Search through HyperNetworks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. J. (2018) · International Conference on Learning Representations · Cited by 217
Unlabeled data: Now it helps, now it doesn't
Singh, A., Nowak, R. D., & Zhu, X. (2008) · Cited by 210
Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RLPreprint
Nagabandi, A., Finn, C., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07671 · Cited by 209
Duan, Y., Andrychowicz, M., Stadie, B. C., Ho, J., Schneider, J., Sutskever, I., Abbeel, P., & Zaremba, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07326 · Cited by 208
Object Classification from a Single Example Utilizing Class Relevance Metrics
Fink, M. (2004) · Cited by 206
Rapid Adaptation with Conditionally Shifted Neurons.
Munkhdalai, T., Yuan, X., Mehri, S., & Trischler, A. (2018) · International Conference on Machine Learning · Cited by 204
Cross-Generalization: Learning Novel Classes from a Single Example by Feature Replacement
Bart, E., & Ullman, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.117 · Cited by 196
Few-Shot Adversarial Domain Adaptation
Motiian, S., Jones, Q., Iranmanesh, S. M., & Doretto, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02536 · Cited by 196
COSTA: Co-Occurrence Statistics for Zero-Shot Classification
Mensink, T., Gavves, E., & Snoek, C. G. M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.313 · Cited by 193
Learning Robust Visual-Semantic Embeddings
Tsai, Y.-H. H., Huang, L.-K., & Salakhutdinov, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.386 · Cited by 185
Few-Shot and Zero-Shot Multi-Label Learning for Structured Label Spaces
Rios, A., & Kavuluru, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1352 · Cited by 181
Few-Shot Charge Prediction with Discriminative Legal Attributes
Hu, Z., Li, X., Tu, C., Liu, Z., & Sun, M. (2018) · International Conference on Computational Linguistics · Cited by 172
Neural Voice Cloning with a Few Samples
Arık, S. Ö., Chen, J., Peng, K., Ping, W., & Zhou, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06006 · Cited by 172
Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes TheoryPreprint
Amit, R., & Meir, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01244 · Cited by 170
Attentive Recurrent Comparators
Shyam, P., Gupta, S., & Dukkipati, A. (2017) · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · doi:10.48550/arxiv.1703.00767 · Cited by 138
One-Shot Unsupervised Cross Domain TranslationPreprint
Benaim, S., & Wolf, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06029 · Cited by 137
Low-Shot Learning with Large-Scale Diffusion
Douze, M., Szlam, A. D., Hariharan, B., & Jeǵou, H. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00353 · Cited by 130
Few-Shot Human Motion Prediction via Meta-learning
Gui, L.-Y., Wang, Y.-X., Ramanan, D., & Moura, J. M. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_27 · Cited by 126
Self-citationEfficient Neural Architecture Search via Proximal Iterations
Yao, Q., Xu, J., Tu, W.-W., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6143 · Cited by 122
Self-citationActive One-shot LearningPreprint
Woodward, M. P., & Finn, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06559 · Cited by 121
Meta-Learning Probabilistic Inference For Prediction
Gordon, J., Bronskill, J., Bauer, M., Nowozin, S., & Turner, R. E. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.47572 · Cited by 121
Positive Unlabeled Learning for Data Stream Classification
Li, X., Yu, P. S., Liu, B., & Ng, S. (2009) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972795.23 · Cited by 120
Learning Algorithms for Active LearningPreprint
Bachman, P., Sordoni, A., & Trischler, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.00088 · Cited by 120
Few-shot learning for short text classification
Yan, L., Zheng, Y., & Cao, J. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5772-4 · Cited by 116
Learning Structure and Strength of CNN Filters for Small Sample Size Training
Keshari, R., Vatsa, M., Singh, R., & Noore, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00974 · Cited by 115
Zhang, Y., Tang, H., & Jia, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_15 · Cited by 115
Feature Space Transfer for Data Augmentation
Liu, B., Wang, X., Dixit, M., Kwitt, R., & Vasconcelos, N. M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00947 · Cited by 113
Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examples
Joshi, V., Peters, M. E., & Hopkins, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1110 · Cited by 109
Small Sample Learning in Big Data EraPreprint
Shu, J., Xu, Z., & Meng, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04572 · Cited by 108
Domain-Adaptive Discriminative One-Shot Learning of Gestures
Pfister, T., Charles, J., & Zisserman, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_52 · Cited by 107
Multi-attention Network for One Shot Learning
Wang, P., Liu, L., Shen, C., Huang, Z., Van Den Hengel, A., & Shen, H. T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.658 · Cited by 91 · cited 2×
“owledge in complementary views. The idea of using multi-modality is used in zero-shot learning frequently. They consider prior knowledge including attributes [1, 54], WordNet [1, 54], word embeddings [121, 128] , co-occurrence statistics [77], and knowledge graphs [129]. Recently, there are some works trying to adapt…”
MethodDynamic Conditional Networks for Few-Shot Learning
Zhao, F., Zhao, J. C., Yan, S., & Feng, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_2 · Cited by 84
(2018) · International Conference on Learning Representations · Cited by 83
One-Shot Adaptation of Supervised Deep Convolutional ModelsPreprint
Hoffman, J., Tzeng, E., Donahue, J., Jia, Y., Saenko, K., & Darrell, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6204 · Cited by 82
Few-shot Generative Modelling with Generative Matching Networks
Bartunov, S., & Vetrov, D. (2018) · International Conference on Artificial Intelligence and Statistics · Cited by 75
Few-Shot Object Recognition from Machine-Labeled Web Images
Xu, Z., Zhu, L., & Yang, Y. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.569 · Cited by 73
Simple Principles of Metalearning
Schmidhuber, J., Zhao, J., & Wiering, M. (1996) · doi:10.71910/supsi.7463 · Cited by 69
Learning from small sample sets by combining unsupervised meta-training with CNNs
Wang, Y.-X., & Hebert, M. (2016) · neural information processing systems · Cited by 69
Self-citationRisk Bounds for Transferring Representations With and Without Fine-Tuning
McNamara, D., & Balcan, M.-F. (2017) · International Conference on Machine Learning · Cited by 69
One-Shot Learning of Scene Locations via Feature Trajectory Transfer
Kwitt, R., Hegenbart, S., & Niethammer, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.16 · Cited by 61
Fast Parameter Adaptation for Few-shot Image Captioning and Visual Question Answering
Dong, X., Zhu, L., Zhang, D., Yang, Y., & Wu, F. Q. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240527 · Cited by 56
Machine Speech Chain with One-shot Speaker Adaptation
Tjandra, A., Sakti, S., & Nakamura, S. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1558 · Cited by 56
Towards One Shot Learning by imitation for humanoid robots
Wu, Y. J., & Demiris, Y. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509429 · Cited by 55
Improving One-Shot Learning through Fusing Side InformationPreprint
Tsai, Y.-H. H., & Salakhutdinov, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.08347 · Cited by 54
Learning manipulation actions from a few demonstrations
Abdo, N., Kretzschmar, H., Spinello, L., & Stachniss, C. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630734 · Cited by 52
A Unified Semantic Embedding: Relating Taxonomies and AttributesPreprint
Hwang, S. J., & Sigal, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.5879 · Cited by 52
One-Shot Action Localization by Learning Sequence Matching Network
Yang, H., He, X., & Porikli, F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00157 · Cited by 52
One-shot learning of generative speech concepts
Lake, B. M., Lee, C.-Y., Glass, J. R., & Tenenbaum, J. B. (2014) · eScholarship (California Digital Library) · Cited by 50
CLEAR: Cumulative LEARning for One-Shot One-Class Image Recognition
Kozerawski, J., & Turk, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00363 · Cited by 47
Learning To Learn Around A Common Mean
Denevi, G., Ciliberto, C., Stamos, D., & Pontil, M. (2018) · UCL Discovery (University College London) · Cited by 47
Optimizing one-shot recognition with micro-set learning
Tang, K. D., Tappen, M. F., Sukthankar, R., & Lampert, C. H. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540053 · Cited by 37
Structured Set Matching Networks for One-Shot Part Labeling
Choi, J., Krishnamurthy, J., Kembhavi, A., & Farhadi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00382 · Cited by 33
Multi-Task Transfer Methods to Improve One-Shot Learning for Multimedia Event Detection
Wang, Y., Yap, J., & Mori, G. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.37 · Cited by 27
Self-citationHamaya, M., Matsubara, T., Noda, T., Teramae, T., & Morimoto, J. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487509 · Cited by 26
Memory, Show the Way: Memory Based Few Shot Word Representation Learning
Sun, J., Wang, S., & Zong, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1173 · Cited by 16
The effects of negative adaptation in Model-Agnostic Meta-LearningPreprint
Deleu, T., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02159 · Cited by 15
Mohammadi, S. H., & Kim, T.-H. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2525 · Cited by 15
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
“This scenarios is fundamentally different from the general few-shot learning [159], in which the limited examples are class-specific and assumed to share the same manifold/class structure.”
BackgroundCOVID-19 Image Data Collection: Prospective Predictions are the Future
Cohen, J. P., Morrison, P., Dao, L., Roth, K., Duong, T., & Ghassem, M. (2020) · Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2020-48g7 · Cited by 927
Zhao, Z., Li, T., Wu, J., Sun, C., Wang, S., Yan, R., & Chen, X. (2020) · ISA Transactions · doi:10.1016/j.isatra.2020.08.010 · Cited by 688
A Survey on In-context Learning
Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Chang, B., et al. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.64 · Cited by 649
Jusup, M., Holme, P., Kanazawa, K., Takayasu, M., Romić, I., Wang, Z., Geček, S., Lipić, T., Podobnik, B., Wang, L., et al. (2022) · Physics Reports · doi:10.1016/j.physrep.2021.10.005 · Cited by 643
Metadata
- Authors
- Wang, Y., Yao, Q., Kwok, J. T.-Y., & Ni, L. M.-S.
- Venue
- arXiv (Cornell University)
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1904.05046
- OpenAlex
- W2944378183
- Cited by
- 772
- References
- 151
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.