CoChat
Sign Up
PreprintCited by 7Domain Adaptation and Few-Shot LearningReinforcement Learning in RoboticsMachine Learning and Algorithms

Learning Not to Learn: Nature versus Nurture in Silico

Open access
Lange, Robert Tjarko, Sprekeler, Henning·2020·arXiv
DOI 10.48550/arxiv.2010.04466arXiv 2010.04466
Open this paper in CoChat — free account

Abstract

Animals are equipped with a rich innate repertoire of sensory, behavioral and motor skills, which allows them to interact with the world immediately after birth. At the same time, many behaviors are highly adaptive and can be tailored to specific environments by means of learning. In this work, we use mathematical analysis and the framework of meta-learning (or 'learning to learn') to answer when it is beneficial to learn such an adaptive strategy and when to hard-code a heuristic behavior. We find that the interplay of ecological uncertainty, task complexity and the agents' lifetime has crucial effects on the meta-learned amortized Bayesian inference performed by an agent. There exist two regimes: One in which meta-learning yields a learning algorithm that implements task-dependent information-integration and a second regime in which meta-learning imprints a heuristic or 'hard-coded' behavior. Further analysis reveals that non-adaptive behaviors are not only optimal for aspects of the environment that are stable across individuals, but also in situations where an adaptation to the environment would in fact be highly beneficial, but could not be done quickly enough to be exploited within the remaining lifetime. Hard-coded behaviors should hence not only be those that always work, but also those that are too complex to be learned within a reasonable time frame.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.04466

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Meta-learning makes it conceptually easy to iterate over different environmental assumptions inside a rational analysis of cognition.

    “The study of Lange and Sprekeler (2020) clearly demonstrates that meta-learning makes it conceptually easy to iterate over different environmental assumptions inside a rational analysis of cognition.”

    From Meta-learned models of cognition (2024) · cites this paper as Lange and Sprekeler (2020)

    The Introduction (p. 1) says the study varies ecological uncertainty, task complexity, and lifetime; Learning Not To Learn (p. 3) describes testing meta-learning across a grid of those assumptions. This supports the idea that the framework permits comparison of environmental assumptions, but the paper does not establish that doing so is conceptually easy or frame the exercise as a general rational analysis of cognition. (LLM, conf=0.79)

    Experimental — accuracy not yet measured

  • Agents with a short lifetime should opt for small rewards that are easy to find, while agents with an extended lifetime should spend their time exploring the environment.

    “They showed, for instance, that agents with a short lifetime should opt for small rewards that are easy to find, while agents with an extended lifetime should spend their time exploring the environment.”

    From Meta-learned models of cognition (2024) · cites this paper as Lange and Sprekeler (2020)

  • Meta-learned agents can flexibly interpolate between implementing exploratory learning behaviors and hard-coded, non-learning strategies.

    “Their meta-learned agents are able to flexibly interpolate between implementing exploratory learning behaviors and hard-coded, non-learning strategies.”

    From Meta-learned models of cognition (2024) · cites this paper as Lange and Sprekeler (2020)

  • Which behavior a meta-learned agent realizes depends crucially on environmental properties such as the diversity of the task distribution, task complexity, and the agent's lifetime.

    “Importantly, which behavior was realized crucially depended on environmental properties, such as the diversity of the task distribution, the task complexity, and the agent's lifetime.”

    From Meta-learned models of cognition (2024) · cites this paper as Lange and Sprekeler (2020)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 39 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. Schmidhuber, J. 1987. Evolutionary principles in selfreferential learning, or on learning how to learn: the meta-meta-... hook . Ph.D. thesis, Technische Universit¨ at M¨ unchen.

Cited by

Sorted by citations

Related

Authors
Lange, R. T., & Sprekeler, H.
Affiliations
Technische Universität Berlin (DE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
36
Issue
7
Pages
7290-7299
ISSN
2159-5399 (ISSN-L)
DOI
10.48550/arxiv.2010.04466
arXiv
2010.04466
OpenAlex
W3092535550
Cited by
6
References
39
Citations by year
2025: 1 · 2024: 2 · 2023: 2 · 2022: 1
FWCI
0.83
Type
conference paper
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
  • arXiv (Cornell University)
Funders
Deutsche Forschungsgemeinschaft (EXC 2002/1, 390523135, EXC 2002)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Keywords
meta-learning, amortized Bayesian inference, innate behavior, ecological uncertainty, task complexity, information integration, nature versus nurture, adaptive behavior

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review