CoChat
Sign Up
PreprintCited by 327Domain Adaptation and Few-Shot LearningMachine Learning and AlgorithmsMachine Learning and Data Classification

Probabilistic Model-Agnostic Meta-Learning

Open access
Finn, Chelsea, Xu, Kelvin, Levine, Sergey·2018·arXiv
DOI 10.48550/arxiv.1806.02817arXiv 1806.02817
Open this paper in CoChat — free accountOpen PDF

Abstract

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a powerful prior can be meta-learned from a large number of prior tasks, a small dataset for a new task can simply be too ambiguous to acquire a single model (e.g., a classifier) for that task that is accurate. In this paper, we propose a probabilistic meta-learning algorithm that can sample models for a new task from a model distribution. Our approach extends model-agnostic meta-learning, which adapts to new tasks via gradient descent, to incorporate a parameter distribution that is trained via a variational lower bound. At meta-test time, our algorithm adapts via a simple procedure that injects noise into gradient descent, and at meta-training time, the model is trained such that this stochastic adaptation procedure produces samples from the approximate model posterior. Our experimental results show that our method can sample plausible classifiers and regressors in ambiguous few-shot learning problems. We also show how reasoning about ambiguity can also be used for downstream active learning problems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1806.02817

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The true posterior distribution p(z|X) is intractable, so it is approximated by an amortized distribution q(z|X;ψ).

    “However, solving it involves the true posterior p ( z | X ) , which is intractable. Instead, we approximate the true posterior distribution by an amortized distribution q ( z | X ; ψ ) (Finn, Xu, and Levine 2018; Gordon et al. 2019; Lee et al. 2020a).”

    From SMIL: Multimodal Learning with Severely Missing Modality (2021) · cites this paper as Finn, Xu, and Levine 2018

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 38

  1. [1][1] D. Barber and C. M. Bishop. Ensemble learning for multi-layer networks. In neural information processing systems (NIPS) , 1998. -
  2. [4][4] H. Daumé III. Bayesian multitask learning with latent hierarchies. In Conference on Uncertainty in Artificial Intelligence (UAI) , 2009. -
  3. [5][5] Y. Duan, J. Schulman, X. Chen, P. L. Bartlett, I. Sutskever, and P. Abbeel. Rl2: Fast reinforcement learning via slow reinforcement learning. arXiv preprint arXiv:1611.02779 , 2016. - · arXiv
  4. [6][6] H. Edwards and A. Storkey. Towards a neural statistician. In International Conference on Learning Representations (ICLR) , 2017. -
  5. [7][7] L. Fei-Fei et al. A Bayesian approach to unsupervised one-shot learning of object categories. In Conference on Computer Vision and Pattern Recognition (CVPR) , 2003. -
  6. [8][8] C. Finn and S. Levine. Meta-learning and universality: Deep representations and gradient descent can approximate any learning algorithm. arXiv preprint arXiv:1710.11622 , 2017. - · arXiv
  7. [9][9] C. Finn, P. Abbeel, and S. Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning (ICML) , 2017. -
  8. [10][10] C. Finn, T. Yu, T. Zhang, P. Abbeel, and S. Levine. One-shot visual imitation learning via meta-learning. arXiv preprint arXiv:1709.04905 , 2017. - · arXiv
  9. [11][11] M. Fortunato, C. Blundell, and O. Vinyals. Bayesian recurrent neural networks. arXiv preprint arXiv:1704.02798 , 2017. - · arXiv
  10. [12][12] J. Gao, W. Fan, J. Jiang, and J. Han. Knowledge transfer via multiple model local structure mapping. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) . ACM, 2008. -
  11. [13][13] V. Garcia and J. Bruna. Few-shot learning with graph neural networks. arXiv preprint arXiv:1711.04043 , 2017. - · arXiv
  12. [14][14] E. Grant, C. Finn, J. Peterson, J. Abbott, S. Levine, T. Darrell, and T. Griffiths. Concept acquisition through meta-learning. In NIPS Workshop on Cognitively Informed Artificial Intelligence , 2017. -
  13. [15][15] E. Grant, C. Finn, S. Levine, T. Darrell, and T. Griffiths. Recasting gradient-based meta-learning as hierarchical bayes. In International Conference on Learning Representations (ICLR) , 2018. -
  14. [16][16] A. Graves. Practical variational inference for neural networks. In Neural Information Processing Systems (NIPS) , 2011. -
  15. [17][17] I. Higgins, L. Matthey, X. Glorot, A. Pal, B. Uria, C. Blundell, S. Mohamed, and A. Lerchner. Early visual concept learning with unsupervised deep learning. International Conference on Learning Representations (ICLR) , 2017. -
  16. [18][18] G. E. Hinton and D. Van Camp. Keeping the neural networks simple by minimizing the description length of the weights. In Conference on Computational learning theory , 1993. -
  17. [19][19] S. Hochreiter, A. Younger, and P. Conwell. Learning to learn using gradient descent. International Conference on Artificial Neural Networks (ICANN) , 2001. -
  18. [20][20] M. D. Hoffman, D. M. Blei, C. Wang, and J. Paisley. Stochastic variational inference. The Journal of Machine Learning Research , 2013. -
  19. [21][21] M. Johnson, D. K. Duvenaud, A. Wiltschko, R. P. Adams, and S. R. Datta. Composing graphical models with neural networks for structured representations and fast inference. In Neural Information Processing Systems (NIPS) , 2016. -
  20. [22][22] D. P. Kingma and M. Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 , 2013. - · arXiv
  21. [23][23] A. Lacoste, T. Boquet, N. Rostamzadeh, B. Oreshki, W. Chung, and D. Krueger. Deep prior. arXiv preprint arXiv:1712.05016 , 2017. - · arXiv
  22. [25][25] N. D. Lawrence and J. C. Platt. Learning to learn with the informative vector machine. In International Conference on Machine Learning (ICML) , page 65, 2004. -
  23. [26][26] Z. Li, F. Zhou, F. Chen, and H. Li. Meta-sgd: Learning to learn quickly for few shot learning. arXiv preprint arXiv:1707.09835 , 2017. - · arXiv
  24. [28][28] N. Mishra, M. Rohaninejad, X. Chen, and P. Abbeel. A simple neural attentive meta-learner. International Conference on Learning Representations , 2018. -
  25. [29][29] R. M. Neal. Bayesian learning for neural networks . PhD thesis, University of Toronto, 1995. -
  26. [30][30] A. Nichol and J. Schulman. Reptile: a scalable metalearning algorithm. arXiv preprint arXiv:1803.02999 , 2018. - · arXiv
  27. [31][31] S. Ravi and H. Larochelle. Optimization as a model for few-shot learning. In International Conference on Learning Representations (ICLR) , 2017. -
  28. [32][32] D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. arXiv preprint arXiv:1401.4082 , 2014. - · arXiv
  29. [33][33] A. Santoro, S. Bartunov, M. Botvinick, D. Wierstra, and T. Lillicrap. Meta-learning with memory-augmented neural networks. In International Conference on Machine Learning (ICML) , 2016. -
  30. [35][35] J. Schmidhuber. Evolutionary principles in self-referential learning . PhD thesis, Institut für Informatik, Technische Universität München, 1987. -
  31. [36][36] R. Shu, H. H. Bui, S. Zhao, M. J. Kochenderfer, and S. Ermon. Amortized inference regularization. arXiv preprint arXiv:1805.08913 , 2018. - · arXiv
  32. [37][37] J. Snell, K. Swersky, and R. S. Zemel. Prototypical networks for few-shot learning. In Neural Information Processing Systems (NIPS) , 2017. -
  33. [38][38] F. Sung, Y. Yang, L. Zhang, T. Xiang, P. H. S. Torr, and T. M. Hospedales. Learning to compare: Relation network for few-shot learning. CoRR , abs/1711.06025, 2017. URL http://arxiv.org/abs/1711.06025 . - · arXiv
  34. [39][39] J. B. Tenenbaum. A Bayesian framework for concept learning . PhD thesis, Massachusetts Institute of Technology, 1999. -
  35. [40][40] O. Vinyals, C. Blundell, T. Lillicrap, D. Wierstra, et al. Matching networks for one shot learning. In Neural Information Processing Systems (NIPS) , 2016. -
  36. [41][41] J. Wan, Z. Zhang, J. Yan, T. Li, B. D. Rao, S. Fang, S. Kim, S. L. Risacher, A. J. Saykin, and L. Shen. Sparse Bayesian multi-task learning for predicting cognitive outcomes from neuroimaging measures in Alzheimer's disease. In Conference on Computer Vision and Pattern Recognition (CVPR) , 2012. -
  37. [42][42] Y.-X. Wang and M. Hebert. Learning to learn: Model regression networks for easy small sample learning. In European Conference on Computer Vision (ECCV) , 2016. -
  38. [43][43] K. Yu, V. Tresp, and A. Schwaighofer. Learning Gaussian processes from multiple tasks. In International Conference on Machine Learning (ICML) , 2005.

Cited by

Sorted by citations

Authors
Finn, C., Xu, K., & Levine, S.
Affiliations
University of California, Berkeley (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2018
Volume
31
Pages
9516-9527
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1806.02817
arXiv
1806.02817
OpenAlex
W2807352135
Cited by
327
References
2
Citations by year
2026: 2 · 2025: 31 · 2024: 34 · 2023: 46 · 2022: 68 · 2021: 85 · 2020: 42 · 2019: 17 · 2018: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • neural information processing systems
Funders
  • National Science Foundation (1651843)
  • Nvidia
  • Office of Naval Research
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
meta-learning, few-shot learning, model-agnostic meta-learning, task ambiguity, variational lower bound, stochastic gradient descent, active learning (machine learning)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review