Meta Learning Backpropagation And Improving It
Open accessAbstract
Many concepts have been proposed for meta learning with neural networks (NNs), e.g., NNs that learn to reprogram fast weights, Hebbian plasticity, learned learning rules, and meta recurrent NNs. Our Variable Shared Meta Learning (VSML) unifies the above and demonstrates that simple weight-sharing and sparsity in an NN is sufficient to express powerful learning algorithms (LAs) in a reusable fashion. A simple implementation of VSML where the weights of a neural network are replaced by tiny LSTMs allows for implementing the backpropagation LA solely by running in forward-mode. It can even meta learn new LAs that differ from online backpropagation and generalize to datasets outside of the meta training distribution without explicit gradient calculation. Introspection reveals that our meta learned LAs learn through fast association in a way that is qualitatively different from gradient descent.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Our method can be viewed as a special case of fast weight programmers.
“Therefore, our method can be viewed as a special case of FWPs [58].”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Self-citationLearning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · see citing works
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · see citing works
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108 · see citing works
Learning to Forget: Continual Prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 5,869 · see citing works
Self-citationA Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174 · see citing works
Optimization as a Model for Few-Shot Learning
Ravi, S., & Larochelle, H. (2017) · International Conference on Learning Representations · Cited by 2,766 · see citing works
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 1,782 · see citing works
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504 · see citing works
Learning to learn by gradient descent by gradient descent
Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., Shillingford, B., & de Freitas, N. (2016) · arXiv · doi:10.48550/arxiv.1606.04474 · Cited by 1,486 · see citing works
Codd, E. F. (1968) · Cited by 1,350 · see citing works
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027 · see citing works
Sims, K. (1994) · Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94 · doi:10.1145/192161.192167 · Cited by 1,005 · see citing works
A Simple Neural Attentive Meta-LearnerPreprint
Mishra, N., Rohaninejad, M., Chen, X., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03141 · Cited by 961 · see citing works
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv · doi:10.48550/arxiv.1701.06538 · Cited by 933 · see citing works
Learning to reinforcement learn
Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579 · see citing works
Learning to Learn Using Gradient Descent
Hochreiter, S., Younger, A. S., & Conwell, P. R. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44668-0_13 · Cited by 575 · see citing works
RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503 · see citing works
Deep Learning for Classical Japanese LiteraturePreprint
Clanuwat, T., Bober-Irizar, M., Kitamoto, A., Lamb, A., Yamamoto, K., & Ha, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01718 · Cited by 444 · see citing works
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesPreprint
Triantafillou, E., Zhu, T., Dumoulin, V., Lamblin, P., Evci, U., Xu, K., Goroshin, R., Gelada, C., Swersky, K., Manzagol, P.-A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03096 · Cited by 428 · see citing works
Learning a synaptic learning rule
Bengio, Y., Bengio, S., & Cloutier, J. (1991) · IJCNN-91-Seattle International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.155621 · Cited by 402 · see citing works
Using Fast Weights to Attend to the Recent PastPreprint
Ba, J., Hinton, G. E., Mnih, V., Leibo, J., & Ionescu, C. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1610.06258 · Cited by 386 · see citing works
Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks
Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.131 · Cited by 357 · see citing works
Self-citationGlasmachers, T., Wierstra, D., Schaul, T., Schmidhuber, J., & Yi, S. (2008) · Cited by 330 · see citing works
Self-citationCross-Domain Few-Shot Classification via Learned Feature-Wise TransformationPreprint
Tseng, H.-Y., Lee, H.-Y., Huang, J., & Yang, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08735 · Cited by 314 · see citing works
Wierstra, D., Schaul, T., Peters, J., & Schmidhuber, J. (2008) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2008.4631255 · Cited by 282 · see citing works
Self-citationGrowing Neural Cellular Automata
Mordvintsev, A., Randazzo, E., Niklasson, E., & Levin, M. G. (2020) · Distill · doi:10.23915/distill.00023 · Cited by 201 · see citing works
On the Optimization of a Synaptic Learning Rule
Samy Bengio, A., Bengio, Y., Cloutier, J., & Gescei, J. (2013) · doi:10.4324/9780203773833-22 · Cited by 181 · see citing works
Evolved Policy GradientsPreprint
Houthooft, R., Chen, R. Y., Isola, P., Stadie, B. C., Wolski, F., Ho, J., & Abbeel, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04821 · Cited by 160 · see citing works
Learning to OptimizePreprint
Li, K., & Malik, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01885 · Cited by 159 · see citing works
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
Real, E., Liang, C., So, D. R., & Le, Q. V. (2020) · arXiv · doi:10.48550/arxiv.2003.03384 · Cited by 143 · see citing works
Differentiable plasticity: training plastic neural networks with backpropagationPreprint
Miconi, T., Clune, J., & Stanley, K. O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02464 · Cited by 103 · see citing works
Learning to Optimize Neural NetsPreprint
Li, K., & Malik, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00441 · Cited by 77 · see citing works
Discovering Reinforcement Learning AlgorithmsPreprint
Oh, J., Hessel, M., Czarnecki, W. M., Xu, Z., van Hasselt, H. P., Singh, S. P., & Silver, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08794 · Cited by 71 · see citing works
Improving Generalization in Meta Reinforcement Learning using Learned ObjectivesPreprint
Kirsch, L., van Steenkiste, S., & Schmidhuber, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04098 · Cited by 69 · see citing works
Self-citationLearning to Control Self-Assembling Morphologies: A Study of Generalization via ModularityPreprint
Pathak, D., Lu, C., Darrell, T., Isola, P., & Efros, A. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.05546 · Cited by 65 · see citing works
One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic ControlPreprint
Huang, W., Mordatch, I., & Pathak, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04976 · Cited by 64 · see citing works
Modular Networks: Learning to Decompose Neural ComputationPreprint
Kirsch, L., Kunze, J., & Barber, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05249 · Cited by 58 · see citing works
Self-citationA ‘Self-Referential’ Weight Matrix
Schmidhuber, J. (1993) · Springer eBooks · doi:10.1007/978-1-4471-2063-6_107 · Cited by 56 · see citing works
Self-citationBackpropamine: training self-modifying neural networks with differentiable neuromodulated plasticityPreprint
Miconi, T., Rawal, A., Clune, J., & Stanley, K. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10585 · Cited by 47 · see citing works
Meta-learning curiosity algorithmsPreprint
Alet, F., Schneider, M. F., Lozano‐Pérez, T., & Kaelbling, L. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05325 · Cited by 45 · see citing works
Growing 3D Artefacts and Functional Machines with Neural Cellular Automata
Sudhakaran, S., Grbic, D., Li, S., Katona, Á., Najarro, E., Glanois, C., & Risi, S. (2021) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00451 · Cited by 39 · see citing works
Schmidhuber, J. (1993) · ICANN ’93 · doi:10.1007/978-1-4471-2063-6_110 · Cited by 34 · see citing works
Self-citationA Connectionist Symbol Manipulator That Discovers the Structure of Context-Free Languages
Mozer, M. C., & Das, S. (1993) · Cited by 28 · see citing works
Metz, L., Maheswaranathan, N., Freeman, C. D., Poole, B., & Sohl‐Dickstein, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11243 · Cited by 26 · see citing works
Encoding Labeled Graphs by Labeling RAAM
Sperduti, A. (1993) · Padua Research Archive (University of Padova) · Cited by 25 · see citing works
Improving Generalization in Meta Reinforcement Learning using Neural ObjectivesPreprint
Kirsch, L., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv (Cornell University) · Cited by 14 · see citing works
Self-citationBADGER: Learning to (Learn [Learning Algorithms] through Multi-Agent Communication)Preprint
Rosa, M., Afanasjeva, O., Andersson, S., Davidson, J., Guttenberg, N., Hlubuček, P., Poliak, M., Vítků, J., & Feyereisl, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01513 · Cited by 6 · see citing works
Finding online neural update rules by learning to rememberPreprint
Gregor, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03124 · Cited by 5 · see citing works
Meta-Learning Bidirectional Update RulesPreprint
Sandler, M., Vladymyrov, M., Zhmoginov, A., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04657 · Cited by 5 · see citing works
MPLP: Learning a Message Passing Learning ProtocolPreprint
Randazzo, E., Niklasson, E., & Mordvintsev, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00970 · Cited by 4 · see citing works
Growing 3D Artefacts and Functional Machines with Neural Cellular Automata
Sudhakaran, S., Grbic, D., Li, S., Katona, A., Najarro, E., Glanois, C., & Risi, S. (2021) · arXiv · doi:10.48550/arxiv.2103.08737
Flagged first, then by citations
Research works printed but not linked: 8
- [14][14] D. Ha, A. Dai, and Q. V. Le. HyperNetworks. In International Conference on Learning Representations , 2016. -
- [23][23] S. Linnainmaa. The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors . PhD thesis, Univ. Helsinki, 1970. -
- [30][30] E. Najarro and S. Risi. Meta-Learning through Hebbian Plasticity in Random Networks. Advances in Neural Information Processing Systems , 2020. -
- [37][37] C. Rosenbaum, T. Klinger, and M. Riemer. Routing Networks: Adaptive Selection of NonLinear Functions for Multi-Task Learning. In International Conference on Learning Representations , 2018. -
- [41][41] I. Schlag and J. Schmidhuber. Gated Fast Weights for On-The-Fly Neural Program Generation. In NIPS Metalearning Workshop , 2017. -
- [42][42] I. Schlag, T. Munkhdalai, and J. Schmidhuber. Learning Associative Inference Using Fast Weight Memory. In International Conference on Learning Representations , 2021. -
- [43][43] J. Schmidhuber. Evolutionary principles in self-referential learning. Diploma thesis, Institut für Informatik, Technische Universität München, 1987. -
- [53][53] G. Z. Sun. Neural networks with external memeory stack that learn context-free grammars from examples. In Proceedings of the Conference on Information Science and Systems, 1991 , pages 649-653. Princeton University, 1991. -
Cited by
Sorted by citations
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., & Wei, F. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.247 · Cited by 154 · see citing works
Brain-inspired learning in artificial neural networks: A review
Schmidgall, S., Ziaei, R., Achterberg, J., Kirsch, L., Hajiseyedrazi, S. P., & Eshraghian, J. K. (2024) · APL Machine Learning · doi:10.1063/5.0186054 · Cited by 143 · see citing works
Self-citationDeep language models for interpretative and predictive materials science
Hu, Y., & Buehler, M. J. (2023) · APL Machine Learning · doi:10.1063/5.0134317 · Cited by 80 · see citing works
Meta-learned models of cognition
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23003266 · Cited by 38 · see citing works
Tang, Y., & Ha, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02869 · Cited by 41 · see citing works
“Recently works [44, 61] combine ideas of self-organization with meta-learning RNNs, and have demonstrated that modular meta-learning RNN systems not only can learn to perform SGD-like learning rules, but can also discover more general learning rules that transfer to classification tasks on unseen datasets.”
BackgroundSafron, A., Çatal, O., & Verbelen, T. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.787659 · Cited by 33 · see citing works
“…in the form of “unlimited associative learning” (Birch et al., 2020), in which knowledge may be flexibly aggregated across experiences (Mack et al., 2018, 2020; Mok and Love, 2019)—cf. transfer and meta-learning (Wang J. X. et al., 2018; Dasgupta et al., 2019; Kirsch and Schmidhuber, 2020).”
BackgroundAdapt to Environment Sudden Changes by Learning a Context Sensitive Policy
Luo, F.-M., Jiang, S., Yu, Y., Zhang, Z., & Zhang, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20730 · Cited by 28 · see citing works
“2016) or adopt RNN architectures to facilitate the policies (Duan et al. 2016; Wang et al. 2016; Kirsch and Schmidhuber 2020) or help construct the optimization objective of the policies (Houthooft et al.”
BackgroundDiscovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimization
Lange, R. T., Schaul, T., Chen, Y., Lu, C. J. J., Zahavy, T., Dalibard, V., & Flennerhag, S. (2023) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3583131.3590496 · Cited by 23 · see citing works
Parameter Prediction for Unseen Deep ArchitecturesPreprint
Knyazev, B. A., Drozdzal, M., Taylor, G. W., & Romero, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13100 · Cited by 19 · see citing works
“Meta-optimizers [17, 18, 71, 91, 92] define a problem similar to our task, but where HD is an RNN-based model predicting the gradients ∇w, mimicking the behavior of iterative optimizers.”
MethodIntroducing Symmetries to Black Box Meta Reinforcement Learning
Kirsch, L., Flennerhag, S., van Hasselt, H. P., Friesen, A. L., Oh, J., & Chen, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20681 · Cited by 16 · see citing works
“Prior work on variable shared meta learning (VSML) (Kirsch and Schmidhuber 2021) used similar principles to meta-learn supervised learning algorithms.”
BackgroundMethodInfluentialSelf-citationLearning to (Learn at Test Time): RNNs with Expressive Hidden States
Sun, Y., Li, X., Dalal, K., Xu, J., Vikram, A., Zhang, G., Dubois, Y., Chen, X., Wang, X., Koyejo, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.04620 · Cited by 18 · see citing works
“Therefore, networks containing TTT layers can be viewed as a special case of FWPs [46], similar to how TTT can be viewed as a special case of fast weights.”
Xu, X., Bao, X., Lu, X., et al. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103233 · Cited by 14 · see citing works
Karkehabadi, A., Homayoun, H., & Sasan, A. (2024) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3649476.3660391 · Cited by 13 · see citing works
Are LSTMs good few-shot learners?
Huisman, M., Moerland, T. M., Plaat, A., et al. (2023) · Machine Learning · doi:10.1007/s10994-023-06394-x · Cited by 12 · see citing works
“Kirsch and Schmidhuber (2021) proposed to replace every weight in a neural network with a recurrent neural network that communicates through forward and backward messages.”
BackgroundLinear Transformers Are Secretly Fast Weight Memory SystemsPreprint
Schlag, I., Irie, K., & Schmidhuber, J. (2021) · arXiv (Cornell University) · Cited by 14 · see citing works
Self-citationBrain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit AssignmentPreprint
Ororbia, A. G. (2023) · doi:10.31219/osf.io/xukqf · Cited by 10 · see citing works
Meta-Learning Bidirectional Update RulesPreprint
Sandler, M., Vladymyrov, M., Zhmoginov, A., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04657 · Cited by 5 · see citing works
“Kirsch & Schmidhuber (2020) propose a generalized learning algorithm based on a sparsely connected set of RNNs that, similar to our framework, does not use any gradients or explicit loss function, yet is able to approximate forward pass and backpropagation solely from forward activations of RNNs.”
BackgroundGoal-Conditioned Generators of Deep Policies
Faccio, F., Herrmann, V., Ramesh, A., Kirsch, L., & Schmidhuber, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25912 · Cited by 4 · see citing works
Self-citationLanguage Agents as Optimizable Graphs
Zhuge, M., Wang, W., Kirsch, L., Faccio, F., Khizbullin, D., & Schmidhuber, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16823 · Cited by 3 · see citing works
“Meta-learning attempts to automate large parts of that process (Schmidhuber, 1987; Elsken et al., 2019; Kirsch & Schmidhuber, 2021).”
Self-citationFan, J., Gao, Y., Shi, Z., Li, P., & Sun, G. (2024) · IEEE Access · doi:10.1109/access.2024.3388564 · Cited by 1 · see citing works
“The loss function [52] is a crucial component in the training and validation process of deep learning semantic segmentation models [53], and is the core of backpropagation algorithms [54].”
BackgroundLearning to Optimize with Dynamic Mode Decomposition
Šimánek, P., Vašata, D., & Kordík, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892364 · Cited by 1 · see citing works
“A more general and ambitious approach is proposed in Badger [10] and VS-ML [11].”
BackgroundEnd-to-End Test-Time Training for Long Context
Tandon, A., Dalal, K., Li, X., Koceja, D., Rød, M., Buchanan, S., Wang, X., Leskovec, J., Koyejo, S., Hashimoto, T., et al. (2025) · arXiv
“Therefore, our method can be viewed as a special case of FWPs [58].”
Dynamic Model-Agnostic Meta-Learning for Incremental Few-Shot Learning
Domoguen, J. K. L., & Naval, P. C. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956522
“Meta-learning[11] or learning to learn addresses these problems as it directly trains a model to be adaptive with few data.”
Background
- Authors
- Kirsch, L., & Schmidhuber, J.
- Affiliations
- University of Applied Sciences and Arts of Southern Switzerland (CH)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- Volume
- 34
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2012.14905
- OpenAlex
- W3116353560
- Semantic Scholar
- 76e3ad12881e7ab1c36318d8f8818eca3f828349
- Cited by
- 19
- References
- 52
- Citations by year
- 2024: 3 · 2023: 6 · 2022: 6 · 2021: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Funders
- Nvidia
- Centro Svizzero di Calcolo Scientifico
- National Supercomputing Centre Singapore
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- meta-learning, backpropagation, parameter sharing, sparsity, neural network plasticity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
