CoChat

Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010)

Schmidhuber, Jürgen · 2010 · IEEE Transactions on Autonomous Mental Development

The DOI matches its Crossref record; 125 of the 126 references it cites were found in a registry or an index.

Abstract

The simple, but general formal theory of fun and intrinsic motivation and creativity (1990-2010) is based on the concept of maximizing intrinsic reward for the active creation or discovery of novel, surprising patterns allowing for improved prediction or data compression. It generalizes the traditional field of active learning, and is related to old, but less formal ideas in aesthetics theory and developmental psychology. It has been argued that the theory explains many essential aspects of intelligence including autonomous development, science, art, music, and humor. This overview first describes theoretically optimal (but not necessarily practical) ways of implementing the basic computational principles on exploratory, intrinsically motivated agents or robots, encouraging them to provoke event sequences exhibiting previously unknown, but learnable algorithmic regularities. Emphasis is put on the importance of limited computational resources for online prediction and compression. Discrete and continuous time formulations are given. Previous practical, but nonoptimal implementations (1991, 1995, and 1997-2002) are reviewed, as well as several recent variants by others (2005-2010). A simplified typology addresses current confusion concerning the precise nature of intrinsic motivation.

Overview

Integrity signals

Registry

Crossref · 10.1109/tamd.2010.2056368

Cites

125 of 125 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 125 references

Research works printed but not linked: 24

  1. kullback, 1959, Statistics and Information Theory
  2. hutter, 2004, Universal Artificial Intelligence Sequential Decisions Based on Algorithmic Probability
  3. holland, 1975, Adaptation in Natural and Artificial Systems
  4. schmidhuber, 2010, How to Learn Programs with Artificial Recurrent Neural Networks
  5. harlow, 1950, novelty and curiosity as determinants of exploratory behavior, J Exp Psychol, 41, 68
  6. berlyne, 1950, novelty and curiosity as determinants of exploratory behavior, Brit J Psychol, 41, 68
  7. 10.1007/bf00993591 · doi:10.1007/bf00993591 · Paper page
  8. levin, 1973, universal sequential search problems, Problems Inform Trans, 9, 265
  9. schmidhuber, 1991, Advances in Neural Information Processing Systems 3, nips 3, 500
  10. schmidhuber, 1997, Femmes Fractales
  11. schmidhuber, 2002, Advances in Evolutionary Computing, 579
  12. ring, 1994, Continual Learning in Reinforcement Environments
  13. schmidhuber, 1990, Dynamische neuronale Netze und das fundamentale raumzeitliche Lernproblem
  14. schmidhuber, 1991, Adaptive Curiosity and Adaptive Confidence
  15. schmidhuber, 2009, Compression Progress The Algorithmic Principle Behind Curiosity and Creativity (With Applications of the Theory of Humor) 40 min Video of Invited Talk at Singularity Summit 2009
  16. schmidhuber, 2009, Multiple Ways to Design Research Research Cases that Reshape the Design Discipline, 98
  17. singh, 2005, Advances in neural information processing systems, 17
  18. schwefel, 1974, Numerische Optimierung von Computer-Modellen
  19. schmidhuber, 2007, alle berechenbaren universen (all computable universes), Spektrum der Wissenschaft, 75
  20. storck, 1995, reinforcement driven information acquisition in non-deterministic environments, Proc Int Conf Artif Neural Netw, 2, 159
  21. brafman, 2002, R-MAX—A general polynomial time algorithm for near-optimal reinforcement learning, J Mach Learn Res, 3, 213
  22. frank, 2002, sthetische Information Estetika informacio Eine Einfhrung in die Kybernetische sthetik
  23. franke, 1979, Kybernetische sthetik Phnomen Kunst
  24. schmidhuber, 2006, Artificial General Intelligence, 175

Cited by

Items 501–600 of 886

Metadata

Authors
Schmidhuber, J.
Affiliations
Dalle Molle Institute for Artificial Intelligence Research (CH)
Corresponding author
Schmidhuber, Jürgen
Venue
IEEE Transactions on Autonomous Mental Development
Published
2010-09
Volume
2
Issue
3
Pages
230-247
ISSN
  • 1943-0604 (ISSN-L)
  • 1943-0612
OpenAlex
W2034806191
Cited by
747
References
126
Citations by year
2026: 29 · 2025: 64 · 2024: 46 · 2023: 50 · 2022: 60 · 2021: 69 · 2020: 92 · 2019: 72 · 2018: 55 · 2017: 37 · 2016: 26 · 2015: 24 · 2014: 30 · 2013: 28 · 2012: 41
FWCI
31.09
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Autonomous Mental Development (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
Keywords
intrinsic motivation, creativity, fun, intrinsic rewards, active learning (machine learning), novelty seeking, surprise, pattern discovery, data compression, online prediction, autonomous agents, robots, aesthetics, humor, intelligence, limited computational resources, continuous-time formulation, discrete-time formulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.