The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Intrinsic motivation, curiosity, and learning
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Intrinsic Motivation and Self-Determination in Human Behavior
Deci, E. L., & Ryan, R. M. (1985) · doi:10.1007/978-1-4899-2271-7 · Cited by 26,772
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666
A Theory of Cognitive Dissonance
(2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,122
Intrinsic Motivation and Self-Determination in Human Behavior
Miller, K. A., Deci, E. L., & Ryan, R. M. (1988) · Contemporary Sociology · doi:10.2307/2070638 · Cited by 15,312
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,637
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787
Flow: The Psychology of Optimal Experience
Buchanan, R., & Csikszentmihalyi, M. (1991) · Design Issues · doi:10.2307/1511458 · Cited by 9,394
(1980) · Medical Entomology and Zoology · Cited by 7,534
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,342
Conflict, arousal, and curiosity.
Berlyne, D. E. (1960) · McGraw-Hill Book Company · doi:10.1037/11164-000 · Cited by 5,995
Motivation reconsidered: The concept of competence.
White, R. W. (1959) · Psychological Review · doi:10.1037/h0040934 · Cited by 5,681
Motivation reconsidered: The concept of competence.
White, R. W. (1963) · Perspectives in psychology. · doi:10.1037/14156-005 · Cited by 4,792
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
The psychology of curiosity: A review and reinterpretation.
Loewenstein, G. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.1.75 · Cited by 2,738 · cited 2×
“More recently, the related concept of “knowledge gap” was argued to be a driver for curiosity-driven exploration (Lowenstein, 1994).”
BackgroundDopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
(1968) · Medical Entomology and Zoology · Cited by 1,770
Principles of Behavior. An Introduction to Behavior Theory
N., E., & Hull, C. L. (1943) · The Journal of Philosophy · doi:10.2307/2019960 · Cited by 1,739
Extrinsic Rewards and Intrinsic Motivation in Education: Reconsidered Once Again
Deci, E. L., Koestner, R., & Ryan, R. M. (2001) · Review of Educational Research · doi:10.3102/00346543071001001 · Cited by 1,596
Cordova, D. I., & Lepper, M. R. (1996) · Journal of Educational Psychology · doi:10.1037/0022-0663.88.4.715 · Cited by 1,568
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450
Sutton, R. S. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,314
Conditioned place preference: what does it add to our preclinical understanding of drug reward?
Bardo, M. T., & Bevins, R. A. (2000) · Psychopharmacology · doi:10.1007/s002130000569 · Cited by 1,241
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
Self-citationMOOCs: A systematic study of the published literature 2008-2012
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v14i3.1455 · Cited by 1,092
The Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Abandoning Objectives: Evolution Through the Search for Novelty Alone
Lehman, J., & Stanley, K. O. (2011) · Evolutionary Computation · doi:10.1162/evco_a_00025 · Cited by 917
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882
What is intrinsic motivation? A typology of computational approaches
Oudeyer, P.-Y. (2007) · Frontiers in Neurorobotics · doi:10.3389/neuro.12.006.2007 · Cited by 811
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784
Self-citationKidd, C., Piantadosi, S. T., & Aslin, R. N. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036399 · Cited by 783
The Emergence of the Speech Capacity
Oller, D. K. (2000) · Psychology Press eBooks · doi:10.4324/9781410602565 · Cited by 756
States of Curiosity Modulate Hippocampus-Dependent Learning via the Dopaminergic Circuit
Gruber, M. J., Gelman, B. D., & Ranganath, C. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.060 · Cited by 734
Prioritizing spatial accuracy in high-resolution fMRI data using multivariate feature weight mapping
Stelzer, J., Buschmann, T., Lohmann, G., Margulies, D. S., Trampel, R., & Turner, R. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00066 · Cited by 634
Observing the unexpected enhances infants’ learning and exploration
Stahl, A. E., & Feigenson, L. (2015) · Science · doi:10.1126/science.aaa3799 · Cited by 617 · cited 3×
“In this view (Kang et al., 2009; Stahl and Feigenson, 2015), learning in itself does not have consequences on state curiosity and motivation.”
BackgroundIntrinsically Motivated Reinforcement Learning
Singh, S., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 610
Exploration–exploitation tradeoff using variance estimates in multi-armed bandits
Audibert, J.-Y., Munos, R., & Szepesvári, C. (2009) · Theoretical Computer Science · doi:10.1016/j.tcs.2009.01.016 · Cited by 569
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548
Curious model-building control systems
Schmidhuber, J. (1991) · [Proceedings] 1991 IEEE International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.170605 · Cited by 541
Analysis of exploratory, manipulatory, and curiosity behaviors.
Dember, W. N., & Earl, R. W. (1957) · Psychological Review · doi:10.1037/h0046861 · Cited by 468
Active learning of inverse models with intrinsically motivated goal exploration in robots
Baranes, A., & Oudeyer, P.-Y. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.05.008 · Cited by 455
Self-citationWhat Makes Things Fun to Learn? A Study of Intrinsically Motivating Computer Games.
Malone, T. W. (1981) · Cited by 430
Intrinsically Motivated Reinforcement Learning: An Evolutionary Perspective
Singh, S., Lewis, R. L., Barto, A. G., & Sorg, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2051031 · Cited by 417
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · cited 2×
“, 2013; Kidd and Hayden, 2015), states of curiosity are often associated to a psychological interest for activities or stimuli that are surprising, novel, of intermediate complexity, or characterized by a knowledge gap or by errors in prediction, which are features that can themselves be quantified mathematically (Oud…”
BackgroundIntrinsically Motivated Learning in Natural and Artificial Systems
(2013) · Springer eBooks · doi:10.1007/978-3-642-32375-1 · Cited by 379
Kagan, J. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0032356 · Cited by 365
Fröbel, F., & Hailmann, W. N. (1885) · University of Michigan Library Repository · Cited by 298
Blanchard, T. C., Hayden, B. Y., & Bromberg-Martin, E. S. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.050 · Cited by 295
Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys.
Harlow, H. F. (1950) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058114 · Cited by 287
Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., & Precup, D. (2011) · doi:10.5555/2031678.2031726 · Cited by 283
Reward modulates attention independently of action value in posterior parietal cortex
Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-09.2009 · Cited by 219
Self-citationThe Goldilocks Effect in Infant Auditory Attention
Kidd, C., Piantadosi, S. T., & Aslin, R. N. (2014) · Child Development · doi:10.1111/cdev.12263 · Cited by 212
Intrinsic Motivation and Reinforcement Learning
Barto, A. G. (2013) · Intrinsically Motivated Learning in Natural and Artificial Systems · doi:10.1007/978-3-642-32375-1_2 · Cited by 211
Montessori, M. (1948) · Internet Archive (Internet Archive) · Cited by 204
The role of the exploratory drive in learning.
Montgomery, K. C. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0054833 · Cited by 196
How Evolution May Work Through Curiosity‐Driven Developmental Process
Oudeyer, P., & Smith, L. B. (2016) · Topics in Cognitive Science · doi:10.1111/tops.12196 · Cited by 191
Self-citationNeotic preferences in laboratory rodents: Issues, assessment and substrates
Hughes, R. N. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.11.004 · Cited by 165
Moulin-Frier, C., Nguyen, S. M., & Oudeyer, P.-Y. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01006 · Cited by 162
Self-citationIn search of the neural circuits of intrinsic motivation
Kaplan, F., & Oudeyer, P. (2007) · Frontiers in Neuroscience · doi:10.3389/neuro.01.1.1.017.2007 · Cited by 153
Self-citationEye movements reveal epistemic curiosity in human observers
Baranès, A., Oudeyer, P., & Gottlieb, J. P. (2015) · Vision Research · doi:10.1016/j.visres.2015.10.009 · Cited by 146
Self-citationExploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress
Lopes, M. C., Lang, T., Toussaint, M., & Oudeyer, P. (2012) · Cited by 140
Self-citationMulti-Armed Bandits for Intelligent Tutoring SystemsPreprint
Clement, B., Roy, D., Oudeyer, P., & Lopes, M. C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.3174 · Cited by 127
Self-citationExploration Bonuses and Dual Control
Dayan, P., & B, T. J. S. A. (1996) · Machine Learning · doi:10.1023/a:1018357105171 · Cited by 120
Failure to find a learned drive based on hunger; evidence for learning motivated by "exploration."
Myers, A. K., & Miller, N. E. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0062664 · Cited by 120
Cardoso-Leite, P., & Bavelier, D. (2014) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000077 · Cited by 111
Hierarchical Reinforcement Learning Based on Subgoal Discovery and Subpolicy Specialization
Bakker, B., & Schmidhuber, J. (2004) · Cited by 111
Defensive reactions and exploratory behavior in rats.
Blanchard, R. J., Kelley, M. J., & Blanchard, D. C. (1974) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0037591 · Cited by 102
Novelty and Inductive Generalization in Human Reinforcement Learning
Gershman, S. J., & Niv, Y. (2015) · Topics in Cognitive Science · doi:10.1111/tops.12138 · Cited by 101
The emergence of the speech capacity
(2000) · Choice Reviews Online · doi:10.5860/choice.37-5483 · Cited by 99
Curiosity Killed the Cat, but Makes Crowdwork Better
Law, E., Yin, M., Goh, J., Chen, K., Terry, M. A., & Gajos, K. Z. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858144 · Cited by 95
Baranès, A., Oudeyer, P., & Gottlieb, J. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00317 · Cited by 93
Self-citationOudeyer, P., & Kaplan, F. (2006) · Connection Science · doi:10.1080/09540090600768567 · Cited by 80
Self-citationAn Adaptive Robot Motivational System
Konidaris, G., & Barto, A. G. (2006) · Lecture notes in computer science · doi:10.1007/11840541_29 · Cited by 75
Novelty, familiarity, and the development of infant attention.
Weizmann, F., Cohen, L. B., & Pratt, R. J. (1971) · Developmental Psychology · doi:10.1037/h0030432 · Cited by 72
Functions and Mechanisms of Intrinsic Motivations: The Knowledge Versus Competence Distinction
Mirolli, M., & Baldassarre, G. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_3 · Cited by 70
Novelty Enhances Visual Salience Independently of Reward in the Parietal Lobe
Foley, N. C., Jangraw, D. C., Peck, C., & Gottlieb, J. P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4171-13.2014 · Cited by 67
Self-citationMotivational principles for visual know-how development
Kaplan, F., & Oudeyer, P. (2003) · CogPrints (University of Southampton) · Cited by 63
Self-citationNovelty Seeking and Reward: Implications for the Study of High-Risk Behaviors
Bevins, R. A. (2001) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00146 · Cited by 61
Arkin, R. C. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195166194.003.0009 · Cited by 58
The strategic student approach for life-long exploration and learning
Lopes, M. C., & Oudeyer, P. (2012) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2012.6400807 · Cited by 56
Self-citationInformation search with situation-specific reward functions
Meder, B., & Nelson, J. D. (2012) · Judgment and Decision Making · doi:10.1017/s1930297500002977 · Cited by 55
The progress drive hypothesis: an interpretation of early imitation
Kaplan, F., & Oudeyer, P. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511489808.024 · Cited by 45
Self-citationSelf‐Directed Learning Favors Local, Rather Than Global, Uncertainty
Markant, D. B., Settles, B., & Gureckis, T. M. (2015) · Cognitive Science · doi:10.1111/cogs.12220 · Cited by 44
The aetiology of food reward in monkeys
Weiskrantz, L., & Cowey, A. (1963) · Animal Behaviour · doi:10.1016/s0003-3472(63)80104-9 · Cited by 35
Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience
Benureau, F., & Oudeyer, P. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00008 · Cited by 30
Self-citationTaffoni, F., Tamilia, E., Focaroli, V., Formica, D., Ricci, L., Pino, G. D., Baldassarre, G., Mirolli, M., Guglielmelli, E., & Keller, F. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-3907-z · Cited by 25
Curiosity-Driven Development of Tool Use Precursors: a Computational ModelPreprint
Forestier, S., & Oudeyer, P. (2016) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 22
Self-citationIniRobot : a pedagogical kit to initiate children to concepts of robotics and computer science
Roy, D., Gerber, G., Magnenat, S., Riedo, F., Chevalier, M., Oudeyer, P., & Francesco Mondada, C. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 13
Self-citationMoving Up the Food Chain: Motivation and Emotion in Behavior-Based Robots
Arkin, R. C. (2003) · SMARTech Repository (Georgia Institute of Technology) · Cited by 11
Luc, S. (2015) · IOS Press eBooks · doi:10.3233/978-1-61499-593-7-59 · Cited by 1
Cited by
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
A Metaverse: Taxonomy, Components, Applications, and Open Challenges
Park, S.-M., & Kim, Y.-G. (2022) · IEEE Access · doi:10.1109/access.2021.3140175 · Cited by 1,824
The Influences of Emotion on Learning and Memory
Tyng, C. M., Amin, H. U., Saad, M. N. M., & Malik, A. S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01454 · Cited by 1,530
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Winkler, R., & Soellner, M. (2018) · Academy of Management Proceedings · doi:10.5465/ambpp.2018.15903abstract · Cited by 581
Metadata
- Authors
- Oudeyer, P.-Y., Gottlieb, J., & Lopes, M.
- Venue
- Progress in Brain Research
- Publisher
- Elsevier
- Published
- 2016
- Volume
- 229
- Pages
- 257-284
- ISSN
- 0079-6123 (ISSN-L)
- OpenAlex
- W2484231675
- Cited by
- 387
- References
- 94
- FWCI
- 81.87
- Type
- book chapter
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.