Small Sample Learning in Big Data Era
Open accessThe DOI matches its OpenAlex record; 53 of the 53 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 14×
“…on different fashions of such cross-domain synthesis, benefitting from various generative models (as introduced in Section 4.2.2), like CNN (LeCun et al., 1998), RNN with the Long Short-Term Memory (LSTM) (Hochreiter and Schmidhuber, 1997), GAN, VAE, and other techniques including text to…”
MethodInfluentialHe, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 4×
“Firstly, a performance measure is generally required to be defined, and then useful information are exploited from the pre-collected historical experience (training data) and pre-known prior knowledge under the criterion of maximizing the performance measure to train a good learner to help analyze future data (Jordan…”
BackgroundMethodInfluentialConvolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709 · cited 1×
“Thus Convolutional LSTM (ConvLSTM) model becomes popular (Xingjian et al., 2015; Lotter et al., 2017; Villegas et al., 2017; Wang et al., 2017d).”
MethodImage Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Learning to Compare: Relation Network for Few-Shot Learning
Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P. H. S., & Hospedales, T. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00131 · Cited by 5,816
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 4×
“…are learning regimes inspired by the learning process of humans and animals that implements learning through gradually including samples into training process from easy to complex so as to increase the entropy of training samples (Bengio et al., 2009; Kumar et al., 2010; Jiang et al., 2014a,b).”
BackgroundMethodInfluentialAdversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154 · cited 2×
“Along this line, some works were released like (Taigman et al., 2017; Tzeng et al., 2017; Murez et al., 2018; Volpi et al., 2018), and boosted the performance in object recognition (Hu et al.”
BackgroundEpisodic memory: from mind to brain
Tulving, E. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135114 · Cited by 4,950 · cited 2×
“Human intelligence is related to multiple memory systems (Tulving, 1985), including procedural, semantic, episodic memory (Tulving, 2002) and so on.”
BackgroundWaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505 · cited 2×
“Long et al. (2015) extended (Tzeng et al., 2015)’s domain confusion loss by incorporating an MMD loss for all of the fully connected layers (fc6, fc7 and fc8) of the AlexNet.”
BackgroundLearning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 2×
“In this scheme, the small sample set is used to update or finetune the existing model (e.g., a trained deep network) (Yosinski et al., 2014; Oquab et al., 2014; Hinton and Salakhutdinov, 2006; Krizhevsky et al., 2012).”
MethodAdapting visual category models to new domains
Saenko, K., Kulis, B., Fritz, M., & Darrell, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_16 · Cited by 2,847 · cited 1×
“For example, (Saenko et al., 2010) learned a liner transformation between two domains by minimizing the effect of domaininduced changes in the feature distribution.”
BackgroundHuman-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775 · cited 2×
“re. Recent methods mainly employ context information. For example, Doersch et al. (2015) explored the spatial consistency of image as context prediction task to learn feature representation. Further, Noroozi and Favaro (2016) created an extension by solving the jigsaw conguration. Alternatively, Temporal ordering of p…”
BackgroundUnsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Building Machines That Learn and Think Like People
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2016) · arXiv · doi:10.48550/arxiv.1604.00289 · Cited by 2,550
Generative Adversarial Text to Image Synthesis
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., & Lee, H. (2016) · arXiv · doi:10.48550/arxiv.1605.05396 · Cited by 2,494
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
How many memory systems are there?
Tulving, E. (1985) · American Psychologist · doi:10.1037/0003-066x.40.4.385 · Cited by 1,909
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849 · cited 4×
“After that, zero-shot classification is performed directly by measuring similarity using nearest neighbour (NN) or its probabilistic variants such as direct attribute prediction (Lampert et al., 2009, 2014).”
MethodInfluentialHow to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · cited 2×
“Figure 13: Illustration for Curiosity-Driven Exploration (image is reproduced from (Pathak et al., 2017)).”
BackgroundIntegrating structured biological data by Kernel Maximum Mean Discrepancy
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl242 · Cited by 1,674
The future of memory: remembering, imagining, and the brain
Schacter, D. L., Addis, D. R., Hassabis, D., Martin, V. C., Spreng, R. N., & Szpunar, K. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.11.001 · Cited by 1,398
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139 · cited 2×
“, the lack of visual instances can be compensated by semantic descriptions on the same object (Srivastava and Salakhutdinov, 2012; Ramachandram and Taylor, 2017) (see Fig.”
BackgroundAutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058 · cited 2×
“Memory Neural Networks: Inspired by episodic memory (see Section 2.2.1), researchers try to endow neural networks with memory (Sukhbaatar et al., 2015; Graves et al., 2014).”
BackgroundInfluentialZero-Shot Learning Through Cross-Modal Transfer
Socher, R., Ganjoo, M., Sridhar, H., Bastani, O., Manning, C. D., & Ng, A. Y. (2013) · arXiv · doi:10.48550/arxiv.1301.3666 · Cited by 997
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Zero-Shot Learning — The Good, the Bad and the Ugly
Xian, Y., Schiele, B., & Akata, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.328 · Cited by 891 · cited 5×
“Especially, using generated examples of unseen classes and given examples of seen classes to train a classification model provides an easy manner to handel the GZSL problem.”
BackgroundInfluentialA new learning paradigm: Learning using privileged information
Vapnik, V., & Vashist, A. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.042 · Cited by 774
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Kumaran, D., Hassabis, D., & McClelland, J. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.004 · Cited by 759
Simulation as an engine of physical scene understanding
Battaglia, P. W., Hamrick, J. B., & Tenenbaum, J. B. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1306572110 · Cited by 681
An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild
Chao, W.-L., Changpinyo, S., Gong, B., & Sha, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_4 · Cited by 616
Learning to reinforcement learn
Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579 · cited 6×
“…intelligence (Lake et al., 2017), and recent researches include learning to learn (Santoro et al., 2016), learning to reinforcement learn (Wang et al., 2016; Duan et al., 2016; Xu et al., 2018), learning to transfer (Ying et al., 2018), learning to optimize (Li and Malik, 2017; Nir et…”
BackgroundMethodInfluentialIncremental Learning of Object Detectors without Catastrophic Forgetting
Shmelkov, K., Schmid, C., & Alahari, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.368 · Cited by 559
Task Agnostic Meta-Learning for Few-Shot Learning
Jamal, M. A., & Qi, G.-J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01199 · Cited by 519
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488 · cited 1×
“Thus Convolutional LSTM (ConvLSTM) model becomes popular (Xingjian et al., 2015; Lotter et al., 2017; Villegas et al., 2017; Wang et al., 2017d).”
MethodLearning to Adapt in Dynamic, Real-World Environments through Meta-Reinforcement Learning
Nagabandi, A., Clavera, I., Liu, S., Fearing, R. S., Abbeel, P., Levine, S., & Finn, C. (2018) · arXiv · doi:10.48550/arxiv.1803.11347 · Cited by 370 · cited 1×
“Unlike model-free RL (Wang et al., 2016; Duan et al., 2016; Sung et al., 2018; Al-Shedivat et al., 2018), Clavera et al. (2018) considered to learn online adaptation in the context of model-based reinforcement learning.”
MethodProbabilistic Model-Agnostic Meta-Learning
Finn, C., Xu, K., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1806.02817 · Cited by 327
An Empirical Comparison of Domain Adaptation Methods for Neural Machine Translation
Chu, C., Dabre, R., & Kurohashi, S. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2061 · Cited by 215 · cited 2×
“, 2016), neural machine translation (Chu et al., 2017), remote sensing scene classification (Fang et al.”
BackgroundBlundell, C., Uria, B., Pritzel, A., Li, Y., Ruderman, A., Leibo, J. Z., Rae, J., Wierstra, D., & Hassabis, D. (2016) · arXiv · doi:10.48550/arxiv.1606.04460 · Cited by 162
Growing a Brain: Fine-Tuning by Increasing Model Capacity
Wang, Y.-X., Ramanan, D., & Hebert, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.323 · Cited by 154 · cited 7×
“The former manner tends to generate sample redundancy and encounters the problem of over-fitting to the rare classes, whereas the latter inclines to lose critical feature knowledge within the classes with more samples (Wang et al., 2017c).”
BackgroundMethodInfluentialScaling Memory-Augmented Neural Networks with Sparse Reads and Writes
Rae, J. W., Hunt, J. J., Harley, T., Danihelka, I., Senior, A., Wayne, G., Graves, A., & Lillicrap, T. P. (2016) · arXiv · doi:10.48550/arxiv.1610.09027 · Cited by 89
Generative Models of Visually Grounded Imagination
Vedantam, R., Fischer, I., Huang, J., & Murphy, K. (2017) · arXiv · doi:10.48550/arxiv.1705.10762 · Cited by 81
Chung, Y.-A., & Weng, W.-H. (2017) · arXiv · doi:10.48550/arxiv.1711.08490 · Cited by 58
Cited by
Generalizing from a Few Examples: A Survey on Few-Shot Learning
Wang, Y., Yao, Q., Kwok, J. T.-Y., & Ni, L. M.-S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05046 · Cited by 772
A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities
Song, Y., Wang, T., Cai, P., Mondal, S. K., & Sahoo, J. P. (2023) · ACM Computing Surveys · doi:10.1145/3582688 · Cited by 721
“In many previous papers [4], [5], [3], [118], metric learning is always introduced separately.”
BackgroundA Very Brief Introduction to Machine Learning With Applications to Communication Systems
Simeone, O. (2018) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2018.2881442 · Cited by 516
Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting
Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., & Meng, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07379 · Cited by 385
Self-citationDeep metric learning for few-shot image classification: A Review of recent developments
Li, X., Yang, X., Ma, Z., & Xue, J.-H. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109381 · Cited by 243
Metadata
- Authors
- Shu, J., Xu, Z., & Meng, D.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-08-14
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.04572
- OpenAlex
- W2886219088
- Cited by
- 50
- References
- 53
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.