The DOI matches its Crossref record; 106 of the 106 references it cites were found in a registry or an index.
Advances and Challenges in Meta-Learning: A Technical Review
Open accessAbstract
Meta-learning empowers learning systems with the ability to acquire knowledge from multiple tasks, enabling faster adaptation and generalization to new tasks. This review provides a comprehensive technical overview of meta-learning, emphasizing its importance in real-world applications where data may be scarce or expensive to obtain. The article covers the state-of-the-art meta-learning approaches and explores the relationship between meta-learning and multi-task learning, transfer learning, domain adaptation and generalization, self-supervised learning, personalized federated learning, and continual learning. By highlighting the synergies between these topics and the field of meta-learning, the article demonstrates how advancements in one area can benefit the field as a whole, while avoiding unnecessary duplication of efforts. Additionally, the article delves into advanced meta-learning topics such as learning from complex multi-modal task distributions, unsupervised meta-learning, learning to efficiently adapt to data distribution shifts, and continual meta-learning. Lastly, the article highlights open problems and challenges for future research in the field. By synthesizing the latest research developments, this article provides a thorough understanding of meta-learning and its potential impact on various machine learning applications. We believe that this technical overview will contribute to the advancement of meta-learning and its practical implications in addressing real-world problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 3×
“For example, in image recognition, different tasks can involve recognizing handwritten digits or alphabets from different languages [7, 8], while in natural language processing, tasks can include sentiment analysis [9, 10], machine translation [11], and chatbot response generation [12, 13, 14].”
BackgroundMethodOvercoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 1×
“Contrastive learning [116, 113] is commonly used in this context, aiming to learn features by bringing similar examples closer together while pushing differing examples apart.”
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · cited 1×
“In [40], it was demonstrated that transfer learning via fine-tuning may not always be effective, particularly when the target task dataset is very small or very different from the source tasks.”
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988
Deep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2017) · arXiv · doi:10.48550/arxiv.1707.08114 · Cited by 2,910
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3070203 · Cited by 2,878
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2019) · arXiv · doi:10.48550/arxiv.1910.06378 · Cited by 1,734
Flamingo: a Visual Language Model for Few-Shot Learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.14198 · Cited by 1,555
Model-Contrastive Federated Learning
Li, Q., He, B., & Song, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01057 · Cited by 1,534
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438 · cited 1×
“To overcome this challenge, first-order alternatives to MAML such as FOMAML and Reptile have been introduced [68].”
Gradient Episodic Memory for Continual Learning
Lopez-Paz, D., & Ranzato, M. (2017) · arXiv · doi:10.48550/arxiv.1706.08840 · Cited by 1,403
Cross-Stitch Networks for Multi-task Learning
Misra, I., Shrivastava, A., Gupta, A., & Hebert, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.433 · Cited by 1,397
Sattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1606.04671 · Cited by 1,307
Meta-Learning With Differentiable Convex Optimization
Lee, K., Maji, S., Ravichandran, A., & Soatto, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01091 · Cited by 1,260
Learning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
End-To-End Multi-Task Learning With Attention
Liu, S., Johns, E., & Davison, A. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00197 · Cited by 1,202
Domain-adversarial training of neural networks
GaninYaroslav, UstinovaEvgeniya, AjakanHana, GermainPascal, LarochelleHugo, LavioletteFrançois, MarchandMario, & LempitskyVictor (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946704 · Cited by 1,201
Taskonomy: Disentangling Task Transfer Learning
Zamir, A. R., Sax, A., Shen, W., Guibas, L., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00391 · Cited by 1,128
A perspective view and survey of meta-learning
Vilalta, R., & Drissi, Y. (2002) · Artificial Intelligence Review · doi:10.1023/a:1019956318069 · Cited by 1,108
AutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106
Rethinking Few-Shot Image Classification: A Good Embedding is All You Need?
Tian, Y., Wang, Y., Krishnan, D., Tenenbaum, J. B., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_16 · Cited by 952
Meta-Learning in Neural Networks: A Survey
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05439 · Cited by 886
Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
Li, Z., Zhou, F., Chen, F., & Li, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09835 · Cited by 763
Three types of incremental learning
van de Ven, G. M., Tuytelaars, T., & Tolias, A. S. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00568-3 · Cited by 665
A Large-scale Study of Representation Learning with the Visual Task Adaptation BenchmarkPreprint
Zhai, X., Puigcerver, J., Kolesnikov, A., Ruyssen, P., Riquelme, C., Lučić, M., Djolonga, J., Pinto, A. S., Neumann, M., Dosovitskiy, A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04867 · Cited by 645
An Efficient Framework for Clustered Federated Learning
Ghosh, A., Chung, J., Yin, D., & Ramchandran, K. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3192506 · Cited by 623
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learning
Chen, Y., Liu, Z., Xu, H., Darrell, T., & Wang, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00893 · Cited by 503
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning
Yu, T., Quillen, D., He, Z., Julian, R., Narayan, A., Shively, H., Bellathur, A., Hausman, K., Finn, C., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1910.10897 · Cited by 450
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Multi-Task Learning with Deep Neural Networks: A Survey
Crawshaw, M. (2020) · arXiv · doi:10.48550/arxiv.2009.09796 · Cited by 428 · cited 1×
“Interested readers can find a more comprehensive discussion of multitask learning in [30, 31].”
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381 · cited 2×
“In contrast, meta-learning-based methods interpret PFL as a meta-learning algorithm, where personalization to a client aligns with adaptation to a task [118].”
A survey of deep meta-learning
Huisman, M., van Rijn, J. N., & Plaat, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10004-4 · Cited by 376
Zhang, X. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_79-1 · Cited by 350
One-Shot Visual Imitation Learning via Meta-Learning
Finn, C., Yu, T., Zhang, T., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1709.04905 · Cited by 341 · cited 1×
“Tasks in robotics can involve training robots to achieve different goals [17], while in automated feedback generation, tasks can include providing feedback to students on different exams [18].”
Vanschoren, J. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_2 · Cited by 328
Self-citationA Tutorial on Meta-Reinforcement Learning
Beck, J., Vuorio, R., Liu, E. Z., Xiong, Z., Zintgraf, L., Finn, C., & Whiteson, S. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000080 · Cited by 327
Meta-Learning for Low-Resource Neural Machine Translation
Gu, J., Wang, Y., Chen, Y., Li, V. O. K., & Cho, K. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1398 · Cited by 325
A Broader Study of Cross-Domain Few-Shot Learning
Guo, Y., Codella, N. C., Karlinsky, L., Codella, J. V., Smith, J. R., Saenko, K., Rosing, T., & Feris, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58583-9_8 · Cited by 320
A survey of deep meta-learning
Huisman, M., van Rijn, J. N., & Plaat, A. (2021) · Data Archiving and Networked Services (DANS) · doi:10.1007/s10462-021-10004-4#rightslink · Cited by 316
AutoML to Date and Beyond: Challenges and Opportunities
Karmaker (“Santu”), S. K., Hassan, M. M., Smith, M. J., Xu, L., Zhai, C., & Veeramachaneni, K. (2022) · ACM Computing Surveys · doi:10.1145/3470918 · Cited by 292
Garnelo, M., Rosenbaum, D., Maddison, C. J., Ramalho, T., Saxton, D., Shanahan, M., Teh, Y. W., Rezende, D. J., & Eslami, S. M. A. (2018) · arXiv · doi:10.48550/arxiv.1807.01613 · Cited by 287 · cited 2×
“A series of related works (but outside of the meta-learning field) aim to build a “universal representation” that encompasses a robust set of features capable of achieving strong performance across multiple datasets (or modes) [96, 97, 98, 44, 99, 99, 100].”
Gao, Y., Ma, J., Zhao, M., Liu, W., & Yuille, A. L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00332 · Cited by 284
One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning
Yu, T., Finn, C., Dasari, S., Xie, A., Zhang, T., Abbeel, P., & Levine, S. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.002 · Cited by 275
Federated Meta-Learning with Fast Convergence and Efficient Communication
Chen, F., Luo, M., Dong, Z., Li, Z., & He, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07876 · Cited by 254
Federated Learning of a Mixture of Global and Local Models
Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05516 · Cited by 230
Induction Networks for Few-Shot Text Classification
Geng, R., Li, B., Li, Y., Zhu, X., Jian, P., & Sun, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1403 · Cited by 199
Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach
Gholami, B., Sahu, P., Rudovic, O., Bousmalis, K., & Pavlovic, V. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2963389 · Cited by 196
Flexible Clustered Federated Learning for Client-Level Data Distribution Shift
Duan, M., Liu, D., Ji, X., Wu, Y., Liang, L., Chen, X., Tan, Y., & Ren, A. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3134263 · Cited by 193
Personalized Federated Learning on Non-IID Data via Group-based Meta-learning
Yang, L., Huang, J., Lin, W., & Cao, J. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3558005 · Cited by 187
Personalizing Dialogue Agents via Meta-Learning
Madotto, A., Lin, Z., Wu, C.-S., & Fung, P. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1542 · Cited by 183
Open Domain Generalization with Domain-Augmented Meta-Learning
Yang, S., Cao, Z., Wang, C., Wang, J., & Long, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00950 · Cited by 177
Dumoulin, V., Perez, E., Schucher, N., Strub, F., Vries, H., Courville, A., & Bengio, Y. (2018) · Distill · doi:10.23915/distill.00011 · Cited by 160
RL-CycleGAN: Reinforcement Learning Aware Simulation-to-Real
Rao, K., Harris, C., Irpan, A., Levine, S., Ibarz, J., & Khansari, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01117 · Cited by 160
Selecting Relevant Features from a Multi-domain Representation for Few-Shot Classification
Dvornik, N., Schmid, C., & Mairal, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_45 · Cited by 157
Domain adversarial neural networks for domain generalization: when it works and how to improve
Sicilia, A., Zhao, X., & Hwang, S. J. (2023) · Machine Learning · doi:10.1007/s10994-023-06324-x · Cited by 156
Universal Representation Learning from Multiple Domains for Few-shot Classification
Li, W., Liu, X., & Bilen, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00939 · Cited by 151
Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks
Bansal, T., Jha, R., & McCallum, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.448 · Cited by 147
Deep Meta-Learning: Learning to Learn in the Concept SpacePreprint
Zhou, F., Wu, B., & Li, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.03596 · Cited by 141
Few-Shot Classification with Contrastive Learning
Yang, Z., Wang, J., & Zhu, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20044-1_17 · Cited by 138
Domain Adaptive Dialog Generation via Meta Learning
Qian, K., & Yu, Z. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1253 · Cited by 135
Few-Shot Human Motion Prediction via Meta-learning
Gui, L.-Y., Wang, Y.-X., Ramanan, D., & Moura, J. M. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_27 · Cited by 126
Efficiently Identifying Task Groupings for Multi-Task Learning
Fifty, C., Amid, E., Zhao, Z., Yu, T., Anil, R., & Finn, C. (2021) · arXiv · doi:10.48550/arxiv.2109.04617 · Cited by 125
Meta-Learning for Few-Shot Land Cover Classification
Ruswurm, M., Wang, S., Körner, M., & Lobell, D. B. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00108 · Cited by 121
Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks
Bansal, T., Jha, R., Munkhdalai, T., & McCallum, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.38 · Cited by 118
Blending-Target Domain Adaptation by Adversarial Meta-Adaptation Networks
Chen, Z., Zhuang, J., Liang, X., & Lin, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00235 · Cited by 117
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation
Nguyen-Meidine, L. T., Belal, A., Kiran, M., Dolz, J., Blais-Morin, L.-A., & Granger, É. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00138 · Cited by 113
What Can Transformers Learn In-Context? A Case Study of Simple Function Classes
Garg, S., Tsipras, D., Liang, P., & Valiant, G. (2022) · arXiv · doi:10.48550/arxiv.2208.01066 · Cited by 110
Feng, Y., Chen, J., Yang, Z., Song, X., Chang, Y., He, S., Xu, E., & Zhou, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106829 · Cited by 106
AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videos
Smith, L., Dhawan, N., Zhang, M., Abbeel, P., & Levine, S. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.024 · Cited by 102
Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systems
Mi, F., Huang, M., Zhang, J., & Faltings, B. V. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/437 · Cited by 99
One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers
Wu, C., Wu, F., & Huang, Y. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.387 · Cited by 87
What learning algorithm is in-context learning? Investigations with linear models
Akyürek, E., Schuurmans, D., Andreas, J., Ma, T., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2211.15661 · Cited by 86
A hybrid approach with optimization-based and metric-based meta-learner for few-shot learning
Wang, D., Cheng, Y., Yu, M., Guo, X., & Zhang, T. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.085 · Cited by 82
Discriminative adversarial domain generalization with meta-learning based cross-domain validation
Chen, K., Zhuang, D., & Chang, J. M. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.046 · Cited by 80
What Can Transformers Learn In-Context? a Case Study of Simple Function Classes
Garg, S., Tsipras, D., Liang, P., & Valiant, G. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2217 · Cited by 65
Few-shot Aspect Category Sentiment Analysis via Meta-learning
Liang, B., Li, X., Gui, L., Fu, Y., He, Y., Yang, M., & Xu, R. (2022) · ACM Transactions on Information Systems · doi:10.1145/3529954 · Cited by 64
Energy-Based Models for Sparse Overcomplete Representations
Teh, Y. W., Welling, M., Osindero, S., Hinton, G. E., Lee, T.-W., Cardoso, J.-F., Erkki Oja, A., & Амари, Ш.-И. (2003) · Cited by 47
Few-shot learning for dermatological disease diagnosis
Prabhu, V., Kannan, A., Ravuri, M., Chablani, M., Sontag, D. A., & Amatriain, X. (2022) · Elsevier eBooks · doi:10.1016/b978-0-32-399851-2.00022-3 · Cited by 46
ProtoTransformer: A Meta-Learning Approach to Providing Student FeedbackPreprint
Wu, M., Goodman, N. D., Piech, C., & Finn, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.14035 · Cited by 32
NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision ResearchPreprint
Bornschein, J., Galashov, A., Hemsley, R., Rannen-Triki, A., Chen, Y., Chaudhry, A., He, X., Douillard, A., Caccia, M., Feng, Q., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2211.11747 · Cited by 23
Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Liang, P. P., Wu, P., Ziyin, L., Morency, L.-P., & Salakhutdinov, R. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475247 · Cited by 22
Task-Level Self-Supervision for Cross-Domain Few-Shot Learning
Yuan, W., Zhang, Z., Wang, C., Song, H., Xie, Y., & Ma, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20230 · Cited by 16
Latent Multi-Task Architecture Learning
Ruder, S., Bingel, J., Augenstein, I., & Søgaard, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014822 · Cited by 14
Few-Shot Unsupervised Domain Adaptation via Meta Learning
Yang, W., Yang, C., Huang, S., Wang, L., & Yang, M. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859804 · Cited by 12
Semi-supervised Meta-learning for Cross-domain Few-shot Intent Classification
Li, Y., & Zhang, J. (2021) · doi:10.18653/v1/2021.metanlp-1.8 · Cited by 11
Meta-learning basics and background
Zou, L. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-89931-4.00010-9 · Cited by 8
Domain-Agnostic Meta-Learning for Cross-Domain Few-Shot Classification
Lee, W., Wang, J.-Y., & Wang, Y.-C. F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746025 · Cited by 6
Cited by
Liu, X.-Y., Li, G., Zhou, X.-H., Liang, X., & Hou, Z.-G. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3565754 · Cited by 36
“However, the performance of these methods would be limited if data in source domain is insufficient [51].”
Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
Liu, P., Tao, Q., & Zhou, J. T. (2024) · arXiv · doi:10.48550/arxiv.2406.06965 · Cited by 6
A meta learning and task adaptive approach for drug target affinity prediction
Wan, M., Zhao, Y., Zhang, Y., Xu, H., Yi, D., Zan, P., He, S., & Bo, X. (2026) · Nature Communications · doi:10.1038/s41467-026-70554-5 · Cited by 4
Metadata
- Authors
- Vettoruzzo, A., Bouguelia, M.-R., Vanschoren, J., Rögnvaldsson, T., & Santosh, K.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-07
- Volume
- 46
- Issue
- 7
- Pages
- 4763-4779
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4391164176
- Cited by
- 314
- References
- 106
- FWCI
- 46.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.