CoChat
Sign Up
PreprintCited by 18Reinforcement Learning in RoboticsDomain Adaptation and Few-Shot LearningMachine Learning and Algorithms

General intelligence requires rethinking exploration

Open access
Jiang, Minqi, Rocktäschel, Tim, Grefenstette, Edward·2022·arXiv
DOI 10.48550/arxiv.2211.07819arXiv 2211.07819PMC PMC10282580
Open this paper in CoChat — free account

Abstract

We are at the cusp of a transition from "learning from data" to "learning what data to learn from" as a central focus of artificial intelligence (AI) research. While the first-order learning problem is not completely solved, large models under unified architectures, such as transformers, have shifted the learning bottleneck from how to effectively train our models to how to effectively acquire and use task-relevant data. This problem, which we frame as exploration, is a universal aspect of learning in open-ended domains, such as the real world. Although the study of exploration in AI is largely limited to the field of reinforcement learning, we argue that exploration is essential to all learning systems, including supervised learning. We propose the problem of generalized exploration to conceptually unify exploration-driven learning between supervised learning and reinforcement learning, allowing us to highlight key similarities across learning settings and open research challenges. Importantly, generalized exploration serves as a necessary objective for maintaining open-ended learning processes, which in continually learning to discover and solve new problems, provides a promising path to more general intelligence.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2211.07819

Cites

119 of 119 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Promptbreeder is an example of a system transitioning from

    “As Promptbreeder is proposing mutated prompts to itself, it is an example of a system transitioning from”

    From Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution (2023) · cites this paper as Jiang et al., 2022

    The cited paper discusses open-ended exploration and systems that generate learning challenges (Introduction, p. 4; §4.2.1, p. 10), but the passages do not address Promptbreeder or mutated prompts. Searches for those terms found no supporting passage. The citing sentence also ends at “transitioning from,” so the proposed transition cannot be assessed. (LLM, conf=0.74)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 121 references couldn’t be matched to a known paper.

Research works printed but not linked: 78

  1. [1][1] J.-B. Alayrac, J. Donahue, P. Luc, A. Miech, I. Barr, Y. Hasson, K. Lenc, A. Mensch, K. Millican, M. Reynolds, et al. Flamingo: a visual language model for few-shot learning. arXiv preprint arXiv:2204.14198 , 2022. - · arXiv
  2. [2][2] S. Amin, M. Gomrokchi, H. Satija, H. van Hoof, and D. Precup. A survey of exploration methods in reinforcement learning. arXiv preprint arXiv:2109.00157 , 2021. - · arXiv
  3. [5][5] B. Baker, I. Akkaya, P. Zhokhov, J. Huizinga, J. Tang, A. Ecoffet, B. Houghton, R. Sampedro, and J. Clune. Video pretraining (vpt): Learning to act by watching unlabeled online videos. arXiv preprint arXiv:2206.11795 , 2022. - · arXiv
  4. [6][6] D. Balduzzi, S. Racaniere, J. Martens, J. Foerster, K. Tuyls, and T. Graepel. The mechanics of n-player differentiable games. In International Conference on Machine Learning , pages 354-363. PMLR, 2018. -
  5. [10][10] M. A. Bedau, E. Snyder, and N. H. Packard. A classification of long-term evolutionary dynamics. In Artificial life VI , pages 228-237, 1998. -
  6. [14][14] V. Bhatt, B. Tjanaka, M. C. Fontaine, and S. Nikolaidis. Deep surrogate assisted generation of environments. arXiv preprint arXiv:2206.04199 , 2022. - · arXiv
  7. [20][20] Y. Burda, H. Edwards, A. J. Storkey, and O. Klimov. Exploration by random network distillation. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 . OpenReview.net, 2019. -
  8. [21][21] M. Carbin. Overparameterization: A Connection Between Software 1.0 and Software 2.0. In B. S. Lerner, R. Bod´ ık, and S. Krishnamurthi, editors, 3rd Summit on Advances in Programming Languages (SNAPL 2019) , volume 136 of Leibniz International Proceedings in Informatics (LIPIcs) , pages 1:1-1:13, Dagstuhl, Germany, 2019. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik. -
  9. [22][22] S. C. Chan, A. Santoro, A. K. Lampinen, J. X. Wang, A. Singh, P. H. Richemond, J. McClelland, S. DeepMind, and F. Hill. Data distributional properties drive emergent in-context learning in transformers. arXiv preprint arXiv:2205.05055 , 2022. - · arXiv
  10. [24][24] A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann, et al. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311 , 2022. - · arXiv
  11. [26][26] W. R. Clements, B. Van Delft, B.-M. Robaglia, R. B. Slaoui, and S. Toth. Estimating risk and uncertainty in deep reinforcement learning. arXiv preprint arXiv:1905.09638 , 2019. - · arXiv
  12. [27][27] J. Clune. AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence. arXiv preprint arXiv:1905.10985 , 2019. - · arXiv
  13. [28][28] K. Cobbe, O. Klimov, C. Hesse, T. Kim, and J. Schulman. Quantifying generalization in reinforcement learning. In International Conference on Machine Learning , pages 1282-1289. PMLR, 2019. -
  14. [37][37] L. Fan, G. Wang, Y. Jiang, A. Mandlekar, Y. Yang, H. Zhu, A. Tang, D.-A. Huang, Y. Zhu, and A. Anandkumar. Minedojo: Building open-ended embodied agents with internet-scale knowledge. arXiv preprint arXiv:2206.08853 , 2022. - · arXiv
  15. [38][38] S. Farquhar, Y. Gal, and T. Rainforth. On statistical bias in active learning: How and when to fix it. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021. -
  16. [39][39] C. D. Freeman, E. Frey, A. Raichuk, S. Girgin, I. Mordatch, and O. Bachem. Brax-a differentiable physics engine for large scale rigid body simulation. arXiv preprint arXiv:2106.13281 , 2021. - · arXiv
  17. [41][41] A. Gaier, A. Asteroth, and J.-B. Mouret. Data-efficient design exploration through surrogateassisted illumination. Evolutionary computation , 26(3):381-410, 2018. -
  18. [44][44] A. Graves, M. G. Bellemare, J. Menick, R. Munos, and K. Kavukcuoglu. Automated curriculum learning for neural networks. In international conference on machine learning , pages 1311-1320. PMLR, 2017. -
  19. [50][50] D. Hafner, T. P. Lillicrap, J. Ba, and M. Norouzi. Dream to control: Learning behaviors by latent imagination. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 . OpenReview.net, 2020. -
  20. [51][51] D. Hafner, T. P. Lillicrap, M. Norouzi, and J. Ba. Mastering atari with discrete world models. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021. -
  21. [55][55] J. Henrich. The secret of our success. In The Secret of Our Success . Princeton University Press, 2015. -
  22. [56][56] J. Ho, T. Salimans, A. Gritsenko, W. Chan, M. Norouzi, and D. J. Fleet. Video diffusion models. arXiv preprint arXiv:2204.03458 , 2022. - · arXiv
  23. [57][57] J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. d. L. Casas, L. A. Hendricks, J. Welbl, A. Clark, et al. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 , 2022. - · arXiv
  24. [59][59] N. Houlsby, F. Husz´ ar, Z. Ghahramani, and M. Lengyel. Bayesian active learning for classification and preference learning. arXiv preprint arXiv:1112.5745 , 2011. - · arXiv
  25. [60][60] X. Hu, T. Binaykiya, E. Frank, and O. Cirit. Deepreta: An eta post-processing system at scale. arXiv preprint arXiv:2206.02127 , 2022. - · arXiv
  26. [63][63] M. Ilse, J. M. Tomczak, and P. Forr´ e. Selecting data augmentation for simulating interventions. In International Conference on Machine Learning , pages 4555-4562. PMLR, 2021. -
  27. [64][64] M. Jaderberg, K. Simonyan, A. Vedaldi, and A. Zisserman. Synthetic data and artificial neural networks for natural scene text recognition. arXiv preprint arXiv:1406.2227 , 2014. - · arXiv
  28. [65][65] A. Jahanian, X. Puig, Y. Tian, and P. Isola. Generative models as a data source for multiview representation learning. arXiv preprint arXiv:2106.05258 , 2021. - · arXiv
  29. [66][66] H. Jiang, Q. Jiang, and A. Pacchiano. Learning the truth from only one side of the story. In International Conference on Artificial Intelligence and Statistics , pages 2413-2421. PMLR, 2021. -
  30. [67][67] M. Jiang, M. Dennis, J. Parker-Holder, J. Foerster, E. Grefenstette, and T. Rockt¨ aschel. Replayguided adversarial environment design. Advances in Neural Information Processing Systems , 35, 2021. -
  31. [69][69] M. Jiang, E. Grefenstette, and T. Rockt¨ aschel. Prioritized level replay. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event , volume 139 of Proceedings of Machine Learning Research , pages 4940-4950. PMLR, 2021. -
  32. [71][71] J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 , 2020. - · arXiv
  33. [72][72] A. Karpathy. AI for full self-driving. https://www.youtube.com/watch?v= g6bOwQdCJrc&ab\_channel=WADatCVPR . Conference on Computer Vision and Pattern Recognition, 2021. -
  34. [83][83] M. J. Kusner, B. Paige, and J. M. Hern´ andez-Lobato. Grammar variational autoencoder. In International conference on machine learning , pages 1945-1954. PMLR, 2017. -
  35. [90][90] A. Liˇ ska, T. Koˇ cisk` y, E. Gribovskaya, T. Terzi, E. Sezener, D. Agrawal, C. d. M. d'Autume, T. Scholtes, M. Zaheer, S. Young, et al. Streamingqa: A benchmark for adaptation to new knowledge over time in question answering models. arXiv preprint arXiv:2205.11388 , 2022. - · arXiv
  36. [91][91] X. Lu, J. Gonzalez, Z. Dai, and N. D. Lawrence. Structured variationally auto-encoded optimization. In International conference on machine learning , pages 3267-3275. PMLR, 2018. -
  37. [94][94] G. Marcus. The next decade in ai: four steps towards robust artificial intelligence. arXiv preprint arXiv:2002.06177 , 2020. - · arXiv
  38. [95][95] A. Mavor-Parker, K. Young, C. Barry, and L. Griffin. How to stay curious while avoiding noisy tvs using aleatoric uncertainty estimation. In International Conference on Machine Learning , pages 15220-15240. PMLR, 2022. -
  39. [96][96] E. Mazumdar, L. J. Ratliff, M. I. Jordan, and S. S. Sastry. Policy-gradient algorithms have no guarantees of convergence in linear quadratic games. arXiv preprint arXiv:1907.03712 , 2019. - · arXiv
  40. [97][97] E. V. Mazumdar, M. I. Jordan, and S. S. Sastry. On finding local nash equilibria (and only local nash equilibria) in zero-sum games. arXiv preprint arXiv:1901.00838 , 2019. - · arXiv
  41. [98][98] S. Mindermann, J. M. Brauner, M. T. Razzak, M. Sharma, A. Kirsch, W. Xu, B. H¨ oltgen, A. N. Gomez, A. Morisot, S. Farquhar, et al. Prioritized training on points that are learnable, worth learning, and not yet learnt. In International Conference on Machine Learning , pages 15630-15649. PMLR, 2022. -
  42. [101][101] G. Moore. Moore's law. Electronics Magazine , 38(8):114, 1965. -
  43. [103][103] R. Nakano, J. Hilton, S. Balaji, J. Wu, L. Ouyang, C. Kim, C. Hesse, S. Jain, V. Kosaraju, W. Saunders, X. Jiang, K. Cobbe, T. Eloundou, G. Krueger, K. Button, M. Knight, B. Chess, and J. Schulman. Webgpt: Browser-assisted question-answering with human feedback. CoRR , abs/2112.09332, 2021. - · arXiv
  44. [107][107] A. Q. Nichol, P. Dhariwal, A. Ramesh, P. Shyam, P. Mishkin, B. McGrew, I. Sutskever, and M. Chen. GLIDE: towards photorealistic image generation and editing with text-guided diffusion models. In K. Chaudhuri, S. Jegelka, L. Song, C. Szepesv´ ari, G. Niu, and S. Sabato, editors, International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA , volume 162 of Proceedings of Machine Learning Research , pages 16784-16804. PMLR, 2022. -
  45. [109][109] A. v. d. Oord, Y. Li, and O. Vinyals. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 , 2018. - · arXiv
  46. [110][110] P. A. Ortega, M. Kunesch, G. Del´ etang, T. Genewein, J. Grau-Moya, J. Veness, J. Buchli, J. Degrave, B. Piot, J. Perolat, et al. Shaking the foundations: delusions in sequence models for interaction and control. arXiv preprint arXiv:2110.10819 , 2021. - · arXiv
  47. [112][112] G. Ostrovski, M. G. Bellemare, A. Oord, and R. Munos. Count-based exploration with neural density models. In International conference on machine learning , pages 2721-2730. PMLR, 2017. -
  48. [114][114] L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. L. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155 , 2022. - · arXiv
  49. [116][116] J. Parker-Holder, M. Jiang, M. Dennis, M. Samvelyan, J. Foerster, E. Grefenstette, and T. Rockt¨ aschel. Evolving curricula with regret-based environment design. International Conference on Machine Learning , 2022. -
  50. [117][117] R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. In International conference on machine learning , pages 1310-1318. PMLR, 2013. -
  51. [118][118] D. Pathak, P. Agrawal, A. A. Efros, and T. Darrell. Curiosity-driven exploration by selfsupervised prediction. In International conference on machine learning , pages 2778-2787. PMLR, 2017. -
  52. [119][119] D. Pathak, D. Gandhi, and A. Gupta. Self-supervised exploration via disagreement. In International conference on machine learning , pages 5062-5071. PMLR, 2019. -
  53. [121][121] J. Pearl. Causality . Cambridge university press, 2009. -
  54. [122][122] J. Perdomo, T. Zrnic, C. Mendler-D¨ unner, and M. Hardt. Performative prediction. In International Conference on Machine Learning , pages 7599-7609. PMLR, 2020. -
  55. [123][123] J. Perolat, B. de Vylder, D. Hennes, E. Tarassov, F. Strub, V. de Boer, P. Muller, J. T. Connor, N. Burch, T. Anthony, et al. Mastering the game of stratego with model-free multiagent reinforcement learning. arXiv e-prints , pages arXiv-2206, 2022. -
  56. [125][125] A. Petrenko, Z. Huang, T. Kumar, G. Sukhatme, and V. Koltun. Sample factory: Egocentric 3d control from pixels at 100000 fps with asynchronous reinforcement learning. In International Conference on Machine Learning , pages 7652-7662. PMLR, 2020. -
  57. [126][126] A. Petrenko, E. Wijmans, B. Shacklett, and V. Koltun. Megaverse: Simulating embodied agents at one million experiences per second. In International Conference on Machine Learning , pages 8556-8566. PMLR, 2021. -
  58. [131][131] R. Raileanu and T. Rockt¨ aschel. RIDE: rewarding impact-driven exploration for procedurallygenerated environments. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 . OpenReview.net, 2020. -
  59. [132][132] A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 , 2022. - · arXiv
  60. [133][133] A. J. Ratner, S. H. Bach, H. R. Ehrenberg, and C. R´ e. Snorkel: Fast training set generation for information extraction. In Proceedings of the 2017 ACM international conference on management of data , pages 1683-1686, 2017. -
  61. [139][139] M. Samvelyan, R. Kirk, V. Kurin, J. Parker-Holder, M. Jiang, E. Hambro, F. Petroni, H. K¨ uttler, E. Grefenstette, and T. Rockt¨ aschel. Minihack the planet: A sandbox for open-ended reinforcement learning research. In J. Vanschoren and S. Yeung, editors, Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021, virtual , 2021. -
  62. [141][141] T. Schaul, J. Quan, I. Antonoglou, and D. Silver. Prioritized experience replay. In Y. Bengio and Y. LeCun, editors, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings , 2016. -
  63. [147][147] R. Sekar, O. Rybkin, K. Daniilidis, P. Abbeel, D. Hafner, and D. Pathak. Planning to explore via self-supervised world models. In International Conference on Machine Learning , pages 8583-8592. PMLR, 2020. -
  64. [151][151] T. Shi, A. Karpathy, L. Fan, J. Hernandez, and P. Liang. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning , pages 3135-3144. PMLR, 2017. -
  65. [153][153] D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al. Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv preprint arXiv:1712.01815 , 2017. - · arXiv
  66. [156][156] J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. In International Conference on Machine Learning , pages 2256-2265. PMLR, 2015. -
  67. [161][161] A. Srivastava, A. Rastogi, A. Rao, A. A. M. Shoeb, A. Abid, A. Fisch, A. R. Brown, A. Santoro, A. Gupta, A. Garriga-Alonso, et al. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv preprint arXiv:2206.04615 , 2022. - · arXiv
  68. [165][165] A. Stooke, A. Mahajan, C. Barros, C. Deck, J. Bauer, J. Sygnowski, M. Trebacz, M. Jaderberg, M. Mathieu, et al. Open-ended learning leads to generally capable agents. arXiv preprint arXiv:2107.12808 , 2021. - · arXiv
  69. [166][166] F. P. Such, A. Rawal, J. Lehman, K. Stanley, and J. Clune. Generative teaching networks: Accelerating neural architecture search by learning to generate synthetic training data. In International Conference on Machine Learning , pages 9206-9216. PMLR, 2020. -
  70. [170][170] R. Thoppilan, D. De Freitas, J. Hall, N. Shazeer, A. Kulshreshtha, H.-T. Cheng, A. Jin, T. Bos, L. Baker, Y. Du, et al. LaMDA: Language models for dialog applications. arXiv preprint arXiv:2201.08239 , 2022. - · arXiv
  71. [171][171] T. Tran, T.-T. Do, I. Reid, and G. Carneiro. Bayesian generative active deep learning. In International Conference on Machine Learning , pages 6295-6304. PMLR, 2019. -
  72. [175][175] A. van den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. W. Senior, and K. Kavukcuoglu. Wavenet: A generative model for raw audio. In The 9th ISCA Speech Synthesis Workshop, Sunnyvale, CA, USA, 13-15 September 2016 , page 125. ISCA, 2016. -
  73. [180][180] A. Wang, A. Singh, J. Michael, F. Hill, O. Levy, and S. R. Bowman. GLUE: A multi-task benchmark and analysis platform for natural language understanding. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 . OpenReview.net, 2019. -
  74. [181][181] R. Wang, J. Lehman, A. Rawal, J. Zhi, Y. Li, J. Clune, and K. Stanley. Enhanced poet: Open-ended reinforcement learning through unbounded invention of learning challenges and their solutions. In International Conference on Machine Learning , pages 9940-9951. PMLR, 2020. -
  75. [182][182] C. K. Williams and C. E. Rasmussen. Gaussian processes for machine learning , volume 2. MIT press Cambridge, MA, 2006. -
  76. [184][184] D. Yarats, D. Brandfonbrener, H. Liu, M. Laskin, P. Abbeel, A. Lazaric, and L. Pinto. Don't change the algorithm, change the data: Exploratory data for offline reinforcement learning. arXiv preprint arXiv:2201.13425 , 2022. - · arXiv
  77. [185][185] T. D. Yawkey and A. D. Pellegrini. Child's play: Developmental and applied , volume 20. Routledge, 2018. -
  78. [186][186] H. Zhang, M. Cisse, Y. N. Dauphin, and D. Lopez-Paz. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 , 2017. - · arXiv

Cited by

Sorted by citations

Related

Authors
Jiang, M., Rocktäschel, T., & Grefenstette, E.
Affiliations
University College London (GB)
Corresponding author
  • Jiang, Minqi
  • Grefenstette, Edward
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
Volume
10
Issue
6
Pages
230539-230539
ISSN
2054-5703 (ISSN-L)
DOI
10.48550/arxiv.2211.07819
arXiv
2211.07819
PMC
PMC10282580
OpenAlex
W4381664203
Cited by
17
References
121
Citations by year
2026: 1 · 2025: 5 · 2024: 5 · 2023: 6
FWCI
1.60
Type
journal article
Language
en
Open access
Licence
Locations
  • Royal Society Open Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Keywords
exploration, general intelligence, continual learning, supervised learning, reinforcement learning, open-ended learning, data acquisition, transformer models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review