Human-level concept learning through probabilistic program induction
Abstract
Handwritten characters drawn by a model: Not only do children learn effortlessly, they do so quickly and with a remarkable ability to use what they have learned as the raw material for creating new stuff. Lake et al. describe a computational model that learns in a similar fashion and does so better than current deep learning algorithms. The model classifies, parses, and recreates handwritten characters, and can generate new letters of the alphabet that look “right” as judged by Turing-like tests of the model's output in comparison to what real humans produce. Science , this issue p. 1332
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Object detection algorithms are unable, in general, to recognize object categories outside of their training dataset.
“Object detection algorithms are unable, in general, to recognize object categories outside of their training dataset, although ideally there should be the ability to recognize novel object categories (Lake et al. 2015;Hariharan and Girshick 2017).”
From Deep Learning for Generic Object Detection: A Survey (2020) · cites this paper as Lake et al. 2015
Humans (even children) can learn a visual concept quickly from very few given examples and can often generalize well.
“In contrast, humans (even children) can learn a visual concept quickly from very few given examples and can often generalize well (Biederman 1987b;Lake et al. 2015;FeiFei et al. 2006).”
From Deep Learning for Generic Object Detection: A Survey (2020) · cites this paper as Lake et al. 2015
Higher-level systems in the brain may be able to implement Bayesian learning of sequential programs, which is a powerful means of one-shot learning.
“Finally, higher-level systems in the brain may be able to implement Bayesian learning of sequential programs, which is a powerful means of one-shot learning (Lake et al., 2015).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Lake et al., 2015
Sequential programs enable one-shot learning of new geometric/visual concepts.
“In particular, sequential programs were found to enable one-shot learning of new geometric/visual concepts (Lake et al., 2015).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Lake et al., 2015
Structured, serial, hierarchical probabilistic programs have recently been shown to model aspects of human conceptual representation and compositional learning.
“Structured, serial, hierarchical probabilistic programs have recently been shown to model aspects of human conceptual representation and compositional learning (Lake et al., 2015).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Lake et al., 2015
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
(2014) · Cited by 33,419 · see citing works
Self-citationHuman-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · see citing works
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891 · see citing works
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · see citing works
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · see citing works
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · see citing works
An overview of statistical learning theory
Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788640 · Cited by 6,305 · see citing works
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621 · see citing works
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,814 · see citing works
Valiant, L. G. (1984) · ACM eBooks · doi:10.1145/3749740.3749746 · Cited by 4,211 · see citing works
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036 · see citing works
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · see citing works
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279 · see citing works
Miller, G. A., & Johnson-Laird, P. N. (1976) · Harvard University Press eBooks · doi:10.4159/harvard.9780674421288 · Cited by 2,661 · see citing works
The psychology of computer vision
Winston, P. H. (1976) · Pattern Recognition · doi:10.1016/0031-3203(76)90020-0 · Cited by 2,576 · see citing works
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995 · see citing works
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959 · see citing works
Barsalou, L. W. (1983) · Memory & Cognition · doi:10.3758/bf03196968 · Cited by 1,879 · see citing works
Thinning methodologies-a comprehensive survey
Lam, L., Lee, S.-W., & Suen, C. Y. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.161346 · Cited by 1,801 · see citing works
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617 · see citing works
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,605 · see citing works
Hoffman, D. D., & Richards, W. A. (1984) · Cognition · doi:10.1016/0010-0277(84)90022-2 · Cited by 1,352 · see citing works
The importance of shape in early lexical learning
Landau, B., Smith, L. B., & Jones, S. S. (1988) · Cognitive Development · doi:10.1016/0885-2014(88)90014-7 · Cited by 1,174 · see citing works
Word learning as Bayesian inference.
Xu, F., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.245 · Cited by 1,034 · see citing works
Self-citationA Large-Scale Model of the Functioning Brain
Eliasmith, C., Stewart, T. C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., & Rasmussen, D. (2012) · Science · doi:10.1126/science.1225266 · Cited by 934 · see citing works
Structured Imagination: the Role of Category Structure in Exemplar Generation
Ward, T. B. (1994) · Cognitive Psychology · doi:10.1006/cogp.1994.1010 · Cited by 843 · see citing works
On the adequacy of prototype theory as a theory of concepts
Osherson, D. N., & Smith, E. E. (1981) · Cognition · doi:10.1016/0010-0277(81)90013-5 · Cited by 837 · see citing works
A Model of Inductive Bias Learning
Baxter, J. (2000) · Cited by 730 · see citing works
Object name Learning Provides On-the-Job Training for Attention
Smith, L. B., Jones, S. S., Landau, B., Gershkoff‐Stowe, L., & Samuelson, L. K. (2002) · Psychological Science · doi:10.1111/1467-9280.00403 · Cited by 633 · see citing works
A model of inductive bias learning
Baxter, J. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.731 · Cited by 582 · see citing works
Church: a language for generative models
Goodman, N., Mansinghka, V., Roy, D. M., Bonawitz, K., & Tenenbaum, J. B. (2012) · arXiv · doi:10.48550/arxiv.1206.3255 · Cited by 577 · see citing works
Self-citationImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2014) · arXiv · doi:10.48550/arxiv.1409.0575 · Cited by 567 · see citing works
McAllester, D. (1998) · doi:10.1145/279943.279989 · Cited by 474 · see citing works
A rational analysis of rule-based concept learning
Goodman, N. D., Tenenbaum, J. B., Feldman, J., & Griffiths, T. L. (2008) · Cognitive Science · doi:10.1080/03640210701802071 · Cited by 469 · see citing works
Learning overhypotheses with hierarchical Bayesian models
Kemp, C., Perfors, A., & Tenenbaum, J. B. (2007) · Developmental Science · doi:10.1111/j.1467-7687.2007.00585.x · Cited by 416 · see citing works
Self-citationA Stochastic Grammar of Images
Zhu, S. C., & Mumford, D. B. (2006) · now publishers, Inc. eBooks · doi:10.1561/9781601980618 · Cited by 398 · see citing works
Categorization in 3- and 4-Month-Old Infants: An Advantage of Words Over Tones
Ferry, A. L., Hespos, S. J., & Waxman, S. R. (2010) · Child Development · doi:10.1111/j.1467-8624.2009.01408.x · Cited by 368 · see citing works
Visual presentation of single letters activates a premotor area involved in writing
Longcamp, M., Anton, J., Roth, M., & Velay, J. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00088-0 · Cited by 332 · see citing works
A Stochastic Grammar of Images
Zhu, S., & Mumford, D. B. (2007) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000018 · Cited by 332 · see citing works
How Children Learn to Write Words
Treiman, R., & Kessler, B. (2014) · doi:10.1093/acprof:oso/9780199907977.001.0001 · Cited by 259 · see citing works
Learning a theory of causality.
Goodman, N. D., Ullman, T. D., & Tenenbaum, J. B. (2011) · Psychological Review · doi:10.1037/a0021336 · Cited by 247 · see citing works
Self-citationLearning with Hierarchical-Deep Models
Salakhutdinov, R., Tenenbaum, J. B., & Torralba, A. B. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.269 · Cited by 232 · see citing works
Self-citationBraun, D. A., Mehring, C., & Wolpert, D. M. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.031 · Cited by 210 · see citing works
Letter processing automatically recruits a sensory–motor brain network
James, K. H., & Gauthier, L. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.06.026 · Cited by 203 · see citing works
Using generative models for handwritten digit recognition
Revow, M., Williams, C. K. I., & Hinton, G. E. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506410 · Cited by 192 · see citing works
The Role of Explanation in Discovery and Generalization: Evidence From Category Learning
Williams, J. J., & Lombrozo, T. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01113.x · Cited by 190 · see citing works
Wenger, A., & Gilbert, F. (2010) · Archive ouverte UNIGE (University of Geneva) · Cited by 188 · see citing works
Bootstrapping in a language of thought: A formal model of numerical concept learning
Piantadosi, S. T., Tenenbaum, J. B., & Goodman, N. D. (2012) · Cognition · doi:10.1016/j.cognition.2011.11.005 · Cited by 183 · see citing works
Self-citationAnalysis by Synthesis: A (Re-)Emerging Program of Research for Language and Vision
Bever, T. G., & Poeppel, D. (2010) · Biolinguistics · doi:10.5964/bioling.8783 · Cited by 175 · see citing works
“The grammar of action”: Sequence and syntax in children's copying
Goodnow, J. J., & Levine, R. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90005-4 · Cited by 168 · see citing works
Perceptual Organization in Vision
(2003) · Psychology Press eBooks · doi:10.4324/9781410608918 · Cited by 138 · see citing works
Picture: A probabilistic programming language for scene perception
Kulkarni, T. D., Kohli, P., Tenenbaum, J. B., & Mansinghka, V. K. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299068 · Cited by 133 · see citing works
Self-citationReferential communication and category acquisition.
Markman, A. B., & Makin, V. S. (1998) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.127.4.331 · Cited by 131 · see citing works
The Structure of Perceptual Categories
Feldman, J. (1997) · Journal of Mathematical Psychology · doi:10.1006/jmps.1997.1154 · Cited by 103 · see citing works
Perception of Dynamic Information in Static Handwritten Forms
Babcock, M. K., & Freyd, J. J. (1988) · The American Journal of Psychology · doi:10.2307/1422797 · Cited by 99 · see citing works
Stroke segmentation by bernstein-bezier curve fitting
Liao, C.-W., & Huang, J. (1990) · Pattern Recognition · doi:10.1016/0031-3203(90)90068-v · Cited by 76 · see citing works
Identification of fork points on the skeletons of handwritten Chinese characters
Liu, K., Huang, Y., & Suen, C. Y. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799914 · Cited by 76 · see citing works
When writing impairs reading: Letter perception’s susceptibility to motor interference.
James, K. H., & Gauthier, L. (2009) · Journal of Experimental Psychology General · doi:10.1037/a0015836 · Cited by 34 · see citing works
A probabilistic account of exemplar and category generation
Jern, A., & Kemp, C. (2012) · Cognitive Psychology · doi:10.1016/j.cogpsych.2012.09.003 · Cited by 29 · see citing works
The shared views of four research groups )
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384 · see citing works
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968 · see citing works
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · see citing works
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · see citing works
Generalizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165 · see citing works
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550 · see citing works
Self-citationDeeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning
Li, Q., Han, Z., & Wu, X.-M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11604 · Cited by 2,872 · see citing works
Relational Knowledge Distillation
Park, W., Kim, D., Lu, Y., & Cho, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00409 · Cited by 1,783 · see citing works
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557 · see citing works
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504 · see citing works
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438 · see citing works
Do Better ImageNet Models Transfer Better?
Kornblith, S., Shlens, J., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00277 · Cited by 1,325 · see citing works
Machine learning on big data: Opportunities and challenges
Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.026 · Cited by 1,235 · see citing works
What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior
Behrens, T. E. J., Muller, T. H., Whittington, J. C. R., Mark, S., Baram, A. B., Stachenfeld, K. L., & Kurth-Nelson, Z. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.002 · Cited by 1,055 · see citing works
Large-Scale Long-Tailed Recognition in an Open World
Liu, Z., Miao, Z., Zhan, X., Wang, J., Gong, B., & Yu, S. X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00264 · Cited by 1,169 · see citing works
Taskonomy: Disentangling Task Transfer Learning
Zamir, A. R., Sax, A., Shen, W., Guibas, L., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00391 · Cited by 1,128 · see citing works
Xiong, Z., Wang, D., Liu, X., Zhong, F., Wan, X., Li, X., Li, Z. S., Luo, X., Chen, K., Jiang, H., et al. (2019) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.9b00959 · Cited by 1,083 · see citing works
Drug discovery with explainable artificial intelligence
Jiménez-Luna, J., Grisoni, F., & Schneider, G. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00236-4 · Cited by 1,063 · see citing works
TADAM: Task dependent adaptive metric for improved few-shot learningPreprint
Oreshkin, B. N., Rodríguez, P., & Lacoste, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10123 · Cited by 1,094 · see citing works
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047 · see citing works
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014 · see citing works
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412 · see citing works
Enhancing The Reliability of Out-of-distribution Image Detection in Neural NetworksPreprint
Liang, S., Li, Y., & Srikant, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02690 · Cited by 1,117 · see citing works
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10561 · Cited by 956 · see citing works
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906 · see citing works
Few-Shot Learning with Graph Neural NetworksPreprint
García, V., & Bruna, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04043 · Cited by 863 · see citing works
Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions
Ye, H.-J., Hu, H., Zhan, D., & Sha, F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00883 · Cited by 864 · see citing works
Deep Learning: A Critical Appraisal
Marcus, G. (2018) · arXiv · doi:10.48550/arxiv.1801.00631 · Cited by 853 · see citing works
One-Shot Learning for Semantic Segmentation
Shaban, A., Bansal, S., Liu, Z., Essa, I. A., & Boots, B. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.167 · Cited by 851 · see citing works
Meta-SGD: Learning to Learn Quickly for Few-Shot LearningPreprint
Li, Z., Zhou, F., Chen, F., & Li, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09835 · Cited by 1,026 · see citing works
Low-Shot Visual Recognition by Shrinking and Hallucinating Features
Hariharan, B., & Girshick, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.328 · Cited by 824 · see citing works
Data Augmentation Generative Adversarial NetworksPreprint
Antoniou, A., Storkey, A., & Edwards, H. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04340 · Cited by 797 · see citing works
Low Data Drug Discovery with One-Shot Learning
Altae-Tran, H., Ramsundar, B., Pappu, A. S., & Pande, V. (2017) · ACS Central Science · doi:10.1021/acscentsci.6b00367 · Cited by 799 · see citing works
Generalizing from a Few Examples: A Survey on Few-Shot LearningPreprint
Wang, Y., Yao, Q., Kwok, J. T.-Y., & Ni, L. M.-S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05046 · Cited by 773 · see citing works
Low-Shot Learning from Imaginary Data
Wang, Y.-X., Girshick, R., Hebert, M., & Hariharan, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00760 · Cited by 770 · see citing works
Deep Learning for Finance: Deep Portfolios
Heaton, J. B., Polson, N., & Witte, J. H. (2016) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.2209 · Cited by 766 · see citing works
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · see citing works
Meta NetworksPreprint
Munkhdalai, T., & Yu, H. Q. (2017) · arXiv (Cornell University) · Cited by 694 · see citing works
Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
Lee, J., Lee, Y., Kim, J., Kosiorek, A. R., Choi, S., & Teh, Y. W. (2018) · arXiv · doi:10.48550/arxiv.1810.00825 · Cited by 691 · see citing works
Siamese Neural Networks: An Overview
Chicco, D. (2020) · Methods in molecular biology · doi:10.1007/978-1-0716-0826-5_3 · Cited by 681 · see citing works
Few-Shot Object Detection With Attention-RPN and Multi-Relation Detector
Fan, Q., Zhuo, W., Tang, C., & Tai, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00407 · Cited by 680 · see citing works
The seven tools of causal inference, with reflections on machine learning
Pearl, J. (2019) · Communications of the ACM · doi:10.1145/3241036 · Cited by 659 · see citing works
Reinforcement learning, fast and slow
Botvinick, M., Ritter, S., Wang, J. X., Kurth-Nelson, Z., Blundell, C., & Hassabis, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.006 · Cited by 667 · see citing works
Meta R-CNN: Towards General Solver for Instance-Level Low-Shot Learning
Yan, X., Chen, Z., Xu, A., Wang, X., Liang, X., & Lin, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00967 · Cited by 662 · see citing works
Meta-learning with differentiable closed-form solversPreprint
Bertinetto, L., Henriques, J. F., Torr, P. H. S., & Vedaldi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08136 · Cited by 656 · see citing works
Han, X., Zhu, H., Yu, P., Wang, Z., Yao, Y., Liu, Z., & Sun, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1514 · Cited by 651 · see citing works
What do we need to build explainable AI systems for the medical domain?
Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636 · see citing works
Rethinking Few-Shot Image Classification: A Good Embedding is All You Need?
Tian, Y., Wang, Y., Krishnan, D., Tenenbaum, J. B., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_16 · Cited by 952 · see citing works
Self-citationBig-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 636 · see citing works
Few-Shot Image Recognition by Predicting Parameters from Activations
Qiao, S., Liu, C., Shen, W., & Yuille, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00755 · Cited by 565 · see citing works
Can deep learning beat numerical weather prediction?
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0097 · Cited by 599 · see citing works
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review
Poggio, T., Mhaskar, H., Rosasco, L., Miranda, B., & Liao, Q. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1054-2 · Cited by 559 · see citing works
Edge-Labeling Graph Neural Network for Few-Shot Learning
Kim, J., Kim, T., Kim, S., & Yoo, C. D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00010 · Cited by 562 · see citing works
Harnessing Deep Neural Networks with Logic Rules
Hu, Z., Ma, X., Liu, Z., Hovy, E. H., & Xing, E. P. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1228 · Cited by 569 · see citing works
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580 · see citing works
Reptile: a Scalable Metalearning AlgorithmPreprint
Nichol, A., & Schulman, J. (2018) · arXiv (Cornell University) · Cited by 548 · see citing works
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535 · see citing works
Machine learning for perovskite materials design and discovery
Tao, Q., Xu, P., Li, M., & Lu, W. (2021) · npj Computational Materials · doi:10.1038/s41524-021-00495-8 · Cited by 542 · see citing works
Meta-Weight-Net: Learning an Explicit Mapping For Sample WeightingPreprint
Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., & Meng, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07379 · Cited by 626 · see citing works
Low-Shot Learning with Imprinted Weights
Qi, H., Brown, M., & Lowe, D. G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00610 · Cited by 539 · see citing works
The limits and potentials of deep learning for robotics
Sünderhauf, N., Brock, O., Scheirer, W. J., Hadsell, R. T., Fox, D., Leitner, J., Upcroft, B., Abbeel, P., Burgard, W., Milford, M. J., et al. (2018) · QUT ePrints (Queensland University of Technology) · Cited by 519 · see citing works
Calibrate Before Use: Improving Few-Shot Performance of Language Models
Zhao, T. Z., Wallace, E., Feng, S., Klein, D., & Singh, S. (2021) · arXiv · doi:10.48550/arxiv.2102.09690 · Cited by 513 · see citing works
Lesort, T., Lomonaco, V., Stoian, A., Maltoni, D., Filliat, D., & Díaz-Rodríguez, N. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.12.004 · Cited by 531 · see citing works
Neural scene representation and rendering
Eslami, S. M. A., Rezende, D. J., Besse, F., Viola, F., Morcos, A. S., Garnelo, M., Ruderman, A., Rusu, A. A., Danihelka, I., Gregor, K., et al. (2018) · Science · doi:10.1126/science.aar6170 · Cited by 511 · see citing works
Adaptive Subspaces for Few-Shot Learning
Simon, C., Koniusz, P., Nock, R., & Harandi, M. T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00419 · Cited by 483 · see citing works
Wang, Y.-X., Ramanan, D., & Hebert, M. (2017) · neural information processing systems · Cited by 468 · see citing works
Predictive Uncertainty Estimation via Prior NetworksPreprint
Malinin, A., & Gales, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10501 · Cited by 488 · see citing works
Adversarial uncertainty quantification in physics-informed neural networks
Yang, Y., & Perdikaris, P. G. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.027 · Cited by 412 · see citing works
Autonomous experimentation systems for materials development: A community perspective
Stach, E. A., DeCost, B., Kusne, A. G., Hattrick-Simpers, J. R., Brown, K. A., Reyes, K. G., Schrier, J., Billinge, S. J. L., Buonassisi, T., Foster, I. T., et al. (2021) · Matter · doi:10.1016/j.matt.2021.06.036 · Cited by 412 · see citing works
Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification
Gao, T., Han, X., Liu, Z., & Sun, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016407 · Cited by 396 · see citing works
Towards better analysis of machine learning models: A visual analytics perspective
Liu, S., Wang, X., Liu, M., & Zhu, J. (2017) · Visual Informatics · doi:10.1016/j.visinf.2017.01.006 · Cited by 397 · see citing works
LSTD: A Low-Shot Transfer Detector for Object Detection
Chen, H., Wang, Y., Wang, G., & Qiao, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11716 · Cited by 401 · see citing works
Differentiable Augmentation for Data-Efficient GAN TrainingPreprint
Zhao, S., Liu, Z., Lin, J., Zhu, J.-Y., & Han, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10738 · Cited by 417 · see citing works
How to train your MAMLPreprint
Antoniou, A., Edwards, H. S., & Storkey, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09502 · Cited by 394 · see citing works
Hybrid-augmented intelligence: collaboration and cognition
Zheng, N., Liu, Z.-Y., Ren, P.-J., Ma, Y.-Q., Chen, S.-T., Yu, S.-Y., Xue, J.-R., Chen, B.-D., & Wang, F.-Y. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700053 · Cited by 303 · see citing works
Ferroelectric ternary content-addressable memory for one-shot learning
Ni, K., Yin, X., Laguna, A. F., Joshi, S., Dünkel, S., Trentzsch, M., Müller, J., Beyer, S., Niemier, M. T., Hu, X. S., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0321-3 · Cited by 385 · see citing works
One-shot Learning with Memory-Augmented Neural NetworksPreprint
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06065 · Cited by 435 · see citing works
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381 · see citing works
“We recognize that some MAML datasets (Lake et al., 2015) do not admit a good notion of initial accuracy.”
BackgroundMeta-Learning to Detect Rare Objects
Wang, Y.-X., Ramanan, D., & Hebert, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01002 · Cited by 376 · see citing works
Machine learning: Accelerating materials development for energy storage and conversion
Chen, A., Zhang, X., & Zhou, Z. P. (2020) · InfoMat · doi:10.1002/inf2.12094 · Cited by 373 · see citing works
Learning to Adapt in Dynamic, Real-World Environments through Meta-Reinforcement Learning
Nagabandi, A., Clavera, I., Liu, S., Fearing, R. S., Abbeel, P., Levine, S., & Finn, C. (2018) · arXiv · doi:10.48550/arxiv.1803.11347 · Cited by 370 · see citing works
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesPreprint
Triantafillou, E., Zhu, T., Dumoulin, V., Lamblin, P., Evci, U., Xu, K., Goroshin, R., Gelada, C., Swersky, K., Manzagol, P.-A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03096 · Cited by 428 · see citing works
A Broader Study of Cross-Domain Few-Shot Learning
Guo, Y., Codella, N., Karlinsky, L., Codella, J., Smith, J. R., Saenko, K., Rosing, T., & Feris, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_8 · Cited by 358 · see citing works
Günther, F., Rinaldi, L., & Marelli, M. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619861372 · Cited by 336 · see citing works
Meta-Learning for Low-Resource Neural Machine Translation
Gu, J., Wang, Y., Chen, Y., Li, V. O. K., & Cho, K. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1398 · Cited by 359 · see citing works
Inverting the Generator of a Generative Adversarial Network
Creswell, A., & Bharath, A. A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2875194 · Cited by 332 · see citing works
A Survey of Transfer Learning for Convolutional Neural Networks
Ribani, R., & Marengoni, M. (2019) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi-t.2019.00010 · Cited by 330 · see citing works
Counterfactual Visual ExplanationsPreprint
Goyal, Y., Wu, Z., Ernst, J., Batra, D., Parikh, D., & Lee, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07451 · Cited by 326 · see citing works
Memory Matching Networks for One-Shot Image Recognition
Cai, Q., Pan, Y., Yao, T., Yan, C. C., & Mei, T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00429 · Cited by 318 · see citing works
Learning to Discover Novel Visual Categories via Deep Transfer Clustering
Han, K., Vedaldi, A., & Zisserman, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00849 · Cited by 314 · see citing works
Semantic memory: A review of methods, models, and current challenges
Kumar, A. A. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01792-x · Cited by 311 · see citing works
Cross-Domain Few-Shot Classification via Learned Feature-Wise TransformationPreprint
Tseng, H.-Y., Lee, H.-Y., Huang, J., & Yang, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08735 · Cited by 314 · see citing works
Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence
Xu, Z., Zhou, T., Ma, M., Deng, C., Dai, Q., & Fang, L. (2024) · Science · doi:10.1126/science.adl1203 · Cited by 320 · see citing works
Shukla, K., Leoni, P. C. D., Blackshire, J. L., Sparkman, D. M., & Karniadakis, G. E. (2020) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-020-00705-1 · Cited by 304 · see citing works
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301 · see citing works
One-Shot Relational Learning for Knowledge Graphs
Xiong, W., Yu, M., Chang, S., Guo, X., & Wang, W. Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1223 · Cited by 297 · see citing works
Learning to Learn: Model Regression Networks for Easy Small Sample Learning
Wang, Y.-X., & Hebert, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_37 · Cited by 296 · see citing works
Compositional Visual Generation with Composable Diffusion Models
Liu, N., Li, S., Du, Y., Torralba, A. B., & Tenenbaum, J. B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_26 · Cited by 302 · see citing works
Self-citationFrom Machine Learning to Explainable AI
Holzinger, A. (2018) · 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA) · doi:10.1109/disa.2018.8490530 · Cited by 306 · see citing works
- Authors
- Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B.
- Affiliations
- New York University (US)
- University of Toronto (CA)
- Massachusetts Institute of Technology (US)
- Corresponding author
- Lake, Brenden M.
- Venue
- Science
- Published
- 2015-12-11
- Volume
- 350
- Issue
- 6266
- Pages
- 1332-1338
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2194321275
- Cited by
- 2,817
- References
- 62
- Citations by year
- 2026: 137 · 2025: 186 · 2024: 256 · 2023: 281 · 2022: 300 · 2021: 415 · 2020: 400 · 2019: 393 · 2018: 223 · 2017: 145 · 2016: 79 · 2015: 1
- FWCI
- 146.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Office of Naval Research (W911NF-08-1-0242, W911NF-13-1-2012, N000141310333)
- Army Research Office
- Canadian Institute for Advanced Research
- Natural Sciences and Engineering Research Council of Canada
- NSF Science and Technology Center (CCF-1231216)
- Moore-Sloan Data Science Environment at NYU
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- concept learning, one-shot classification, handwritten character recognition, alphabet, visual concepts, visual Turing test
- MeSH terms
- Machine Learning, Algorithms, Bayes Theorem, Computer Simulation, Concept Formation, Generalization, Psychological, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
