The DOI matches its Crossref record; 109 of the 132 references it cites were found in a registry or an index; none of the 51 sources its claims cite is checked for support yet.
Information-seeking, curiosity, and attention: computational and neural mechanisms
Open accessAbstract
Summary Intelligent animals devote much time and energy to exploring and obtaining information, but the underlying mechanisms are poorly understood. We review recent developments on this topic that have emerged from the traditionally separate fields of machine learning, eye movements in natural behavior, and studies of curiosity in psychology and neuroscience. These studies show that exploration may be guided by a family of mechanisms that range from automatic biases toward novelty or surprise, to systematic search for learning progress and information gain in curiosity-driven behavior. In addition, eye movements reflect visual information search in multiple conditions and are amenable for cellular-level investigations, suggesting that the oculomotor system is an excellent model system for understanding information sampling mechanisms.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This review integrates machine learning, eye-movement, and curiosity research to argue that information seeking ranges from automatic novelty/surprise biases to targeted search for learning progress and information gain. It proposes the oculomotor system as a model for information sampling and highlights intrinsic rewards and uncertainty monitoring as key open questions.
Key findings
- Information seeking is defined as actions whose primary goal is to obtain information and reduce uncertainty; it can be extrinsically motivated, as when a driver glances at a traffic light, or intrinsically motivated, as in curiosity or interest.
- Task-related gaze is proactively guided by uncertainty: in visuo-manual tasks the eyes move ahead of the hand to collision or target points and wait there, and in a virtual-reality walking study subjects preferentially deployed gaze to oncoming pedestrians with a history of veering onto a collision course.
- Curiosity-like mechanisms include Lowenstein’s information gap hypothesis, illustrated by a mystery novel with 10 equally likely suspects where the reader moves from high entropy to a single culprit, and developmental robotics approaches that reward learning progress rather than absolute competence.
- Novelty, surprise, and uncertainty heuristics help discover new tasks but are inefficient in large open-ended spaces and risk trapping agents in unlearnable tasks; learning-progress systems may support efficient exploration but a quantitative neural response to learning progress has not been demonstrated empirically.
Methods
- Narrative review synthesizing three traditionally separate lines: active learning and exploration in machine learning and robotics, eye movements in natural behavior, and curiosity in psychology and neuroscience.
- No primary empirical sample or new data are reported; the paper uses conceptual and computational examples, including a POMDP traffic-light example, the information gap mystery-novel illustration, and developmental robotics simulations/robots.
- Main analysis is conceptual integration and comparison of mechanisms across fields, not statistical meta-analysis.
Limitations
- The paper states that understanding information-seeking mechanisms is in its infancy, that a quantitative response to learning progress distinct from phasic responses to novelty, surprise, or arousal has not been demonstrated empirically, and that the learning-progress approach entails a complex meta-cognitive architecture awaiting empirical verification.
- The paper also states that it has not been empirically explored to what extent task-related informational eye movements are habitual, immutable aspects of a task versus rapidly responsive to changing epistemic conditions.
- Evident from the text: as a review, it provides no new experimental data, and many claims about intrinsic rewards and their neural implementation remain speculative; the paper itself notes the question of active exploration is vast and cannot be exhaustively covered.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 51 cited sources checked · 0 supported · 0 flagged
In the paper
“In well-practiced tasks that involve visuo-manual coordination (such as moving an object to a target point) the eyes move ahead of the hand to critical locations such as potential collision or target points, and wait there until the hand has cleared those locations”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Johansson, Westling et al. 2001
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Singh et al. (Singh, Lewis et al. 2010) have shown with computer simulations that even if the objective fitness/reward function of an organism is to survive and reproduce, it may be more efficient to evolve a control architecture that encodes an innate surrogate reward function rewarding learning per se.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Singh, Lewis et al. 2010
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Finally, the eye movements patterns made while acquiring a task differ greatly from those made after learning”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Sailer, Flanagan et al. 2005
- Not checked yetcites Land 2006 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Subjects preferentially deployed gaze to oncoming pedestrians whose trajectory was expected to be uncertain (i.e., who had a history of veering onto a collision course) relative to those who had never shown such deviations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Jovancevic-Misic and Hayhoe 2009
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Sensory novelty, defined as a small number of stimulus exposures, is known to enhance neural responses throughout visual, frontal and temporal areas”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Ranganath and Rainer 2003 source
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“Sensory novelty, defined as a small number of stimulus exposures, is known to enhance neural responses throughout visual, frontal and temporal areas (Ranganath and Rainer 2003) and activate reward responsive dopamine-recipient areas.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Ranganath and Rainer 2003 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“information seeking in its many manifestations is related to the ability of an observer to estimate his or her uncertainty and to find strategies that reduce that uncertainty.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Converging evidence suggests that, when deployed in the service of a task, eye movements may be explained by the simple imperative to sample information in order to reduce uncertainty regarding future states”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Tatler, Hayhoe et al. 2011 source
- Not checked yetcites Friston and Ao 2012
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our focus here is on evaluating recent developments related to this question from three lines of investigation that have remained largely separate – namely, studies of active learning and exploration in the machine learning and robotics fields, studies of eye movements in natural behavior, and studies of curiosity in psychology and neuroscience.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking in machine learning, psychology and neuroscience
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“These observations, together with the fact that eye movements are well investigated at the single neuron level in experimental animals and use value-based decision mechanisms”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 12
- Probably not a substantial claim. 22
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notably, the eyes never track the hand, which relies on motor and proprioceptive guidance and, for short periods of time, follows a predictable path; instead, they are strategically deployed to acquire new information.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“One salient fact that emerges regarding this question is the sheer vastness of the learning space, especially given the scarce time and energy available for learning.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Deciding how to explore optimally when searching for strategy is a very difficult question, and is almost intractable in the general case.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“A number of processes for open-ended exploration have been described in the literature, which, as we describe below, have individual strengths and weaknesses and may act in complementary fashion to accomplish these goals.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Information gathering actions are a special type of intermediate step that obey the imperative to reduce uncertainty and adjudicate among competing interpretations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This suggests that the observers monitor the uncertainty or predictability of external items and use these quantities proactively to deploy gaze”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Strategies for solving a task, including those for generating informational actions, are not known in advance but must also be learnt.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is important to note that, while these processes require significant exploration, they are goal directed in the sense that they seek to maximize a separate, or extrinsic, reward”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the challenge of an information seeking mechanism is to learn efficiently a large repertoire of diverse skills given its limited resources, and avoid being trapped in unlearnable situations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Similarly in the cognitive domain, infants must acquire a vast amount of factual knowledge, rules and social skills.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“although using different terminology and methods, these three lines of research grapple with strikingly similar questions and propose overlapping mechanisms.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking in machine learning, psychology and neuroscience
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The benefits of such a system arise because of the limited cognitive capacities of the agent (i.e., its inability to solve the fitness function directly) (Sorg, Lewis et al. 2010; Lehman and Stanley 2011; Sequeira, Melo et al. 2011) or because information or skills that are not immediately useful may be re-used in the future.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Sorg, Lewis et al. 2010
- Not checked yetcites Lehman and Stanley 2011
- Not checked yetcites Sequeira, Melo et al. 2011
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although exploratory actions can involve physical acts, they are distinct from other motor acts in that their primary goal is not to exert force on the world, but to alter the observer’s epistemic state.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“eye movements reflect visual information search in multiple conditions and are amenable for cellular-level investigations”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In intrinsically motivated contexts, on the other hand, the search for information is a goal in itself – a process we would intuitively call “curiosity” or “interest”.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The fact that animals, and particularly humans, seem avidly to seek out information without an apparent ulterior motive suggests that the brain generates intrinsic rewards that assign value to information”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
- The authors state this as an assumption: The brain generates intrinsic rewards related to learning or acquiring information.
None of the sources cited for this claim have been checked yet.
In the paper
“This idea resonates with the free-energy principle, which states that the possession of a large array of skills can be useful to avoid future surprises by “anticipating a changing and itinerant world””
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Friston 2010 source
- Not checked yetcites Friston, Thornton et al. 2012
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A more complex form of “contextual novelty” (also called surprise) has been suggested to account for attentional attraction toward salient events”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Boehnke, Berg et al. 2011
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“may be quantified using Bayesian inference as a difference between a prior and posterior world model (Itti and Baldi 2009) or as a high prediction error for high-confidence states (Oudeyer and Kaplan 2007).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Itti and Baldi 2009 source
- Not checked yetcites Oudeyer and Kaplan 2007
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Just as animals seek to fill gaps in their physical resources (e.g., energy, sex or wealth) they seek to fill gaps in their knowledge by taking learning-oriented actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In neuroscience research, the most commonly considered exploration strategies are based on random action selection or automatic biases toward novel, surprising or uncertain events.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Defined in this way, curiosity can be viewed as a deprivation phenomenon that seeks to fill a need similar to other reference-point phenomena or biological drives.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This brings us back again to the imperative to minimize uncertainty about the state of the world, and suggests that this imperative is similar to a biological drive.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, to define an information gap one has to monitor one’s level of uncertainty, again similar to eye movement control.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, understanding information seeking requires that we understand how agents monitor their own competence and epistemic states, and specifically how they estimate their uncertainty and generate strategies for reducing that uncertainty.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, eye movements are natural indicators of the brain’s active information search.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“According to the information gap theory, this type of curiosity arises because of a discrepancy between what the observer knows and what he would like to know, where knowledge can be measured with traditional measures of information.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
What the sources say
- Not checked yetcites Lowenstein 1994 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, this question requires that we understand the nature of intrinsic rewards that motivate information seeking and learning.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By virtue of their amenability to neurophysiological investigations, may be an excellent model system for tackling this question, especially if studied in conjunction with computational approaches and the brain’s intrinsic reward and cognitive control mechanisms.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
- Rests on an assumption: The brain has intrinsic reward and cognitive control mechanisms.
- Rests on an assumption: Eye movements are amenable to neurophysiological investigations.
None of the sources cited for this claim have been checked yet.
In the paper
“or which respond selectively for behavioral change or the beginning of exploratory episodes (Isoda and Hikosaka 2007; Quilodran, Rothe et al. 2008).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites Isoda and Hikosaka 2007
- Not checked yetcites Quilodran, Rothe et al. 2008
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The authors state this as an assumption.
The brain generates intrinsic rewards related to learning or acquiring information.
“it seems necessary to assume that the brain generates intrinsic rewards related to learning or acquiring information (Berlyne 1960).”
The paper relies on this without support.
Biological drives are prompted by salient and easily recognizable signs.
“while biological drives are prompted by salient and easily recognizable signs (e.g., somatic signals for hunger or sex)”
The paper relies on this without support.
In scientific research, the results of an experiment typically open up new questions that had not been foreseen, and it is not possible to estimate in advance the current entropy and the final desired state.
“In scientific research for example, the results of an experiment typically open up new questions that had not been foreseen, and it is not possible to estimate in advance what is the current entropy and the final, desired, state.”
The paper relies on this without support.
The central objective of developmental robotics is to design agents that can explore in open-ended environments and develop autonomously without a pre-programmed trajectory, based on their intrinsic interest.
“The central objective of developmental robotics is to design agents that can explore in open-ended environments and develop autonomously without a pre-programmed trajectory, based on their intrinsic interest.”
The paper relies on this without support.
The brain has intrinsic reward and cognitive control mechanisms.
“the brain’s intrinsic reward and cognitive control mechanisms.”
The paper relies on this without support.
Eye movements are amenable to neurophysiological investigations.
“By virtue of their amenability to neurophysiological investigations”
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,178
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“The search may use approaches ranging from reinforcement learning (Kaelbling, Littman et al. 1998; Sutton and Barto 1998; Jens Kober 2012), to stochastic optimization (Spall 2005), evolutionary techniques (Goldberg 1989), or Bayesian optimization (Jones, Schonlau et al.”
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“This idea resonates with the free-energy principle, which states that the possession of a large array of skills can be useful to avoid future surprises by “anticipating a changing and itinerant world” (Friston 2010; Friston, Thornton et al. 2012).”
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Conflict, arousal, and curiosity.
Berlyne, D. E. (1960) · McGraw-Hill Book Company · doi:10.1037/11164-000 · Cited by 6,018 · cited 1×
“To explain such behaviors and the high degree of motivation associated with them, it seems necessary to assume that the brain generates intrinsic rewards related to learning or acquiring information (Berlyne 1960).”
Marr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Flagged first, then by citations
23 of the 132 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Nguyen, 2013, Socially guided intrinsic motivation for robot learning of motor skills, Auton Robots
Cited by
Sorted by citations
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
The Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
What is consciousness, and could machines have it?
Dehaene, S., Lau, H., & Kouider, S. (2017) · Science · doi:10.1126/science.aan8871 · Cited by 855
Electronic skins and machine learning for intelligent soft robots
Shih, B., Shah, D., Li, J., Thuruthel, T. G., Park, Y.-L., Iida, F., Bao, Z., Kramer-Bottiglio, R., & Tolley, M. T. (2020) · Science Robotics · doi:10.1126/scirobotics.aaz9239 · Cited by 715
Dweck, C. S. (2017) · Psychological Review · doi:10.1037/rev0000082 · Cited by 683
The Emerging Neuroscience of Intrinsic Motivation: A New Frontier in Self-Determination Research
Di Domenico, S. I., & Ryan, R. M. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00145 · Cited by 542
Towards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494
Self-citationIntrinsic motivation, curiosity, and learning
Oudeyer, P., Gottlieb, J. P., & Lopes, M. C. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.05.005 · Cited by 453
Self-citationProcess Account of Curiosity and Interest: A Reward-Learning Perspective
Murayama, K., FitzGibbon, L., & Sakaki, M. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09499-9 · Cited by 334
Attention in Psychology, Neuroscience, and Machine Learning
Lindsay, G. W. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00029 · Cited by 367
“An additional factor that drives biological attention but is perhaps underrepresented in artificial attention systems is curiosity (Gottlieb et al., 2013).”
Blanchard, T. C., Hayden, B. Y., & Bromberg-Martin, E. S. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.050 · Cited by 319
“This drive for information is poorly understood, but is relevant for understanding learning, decision making, and social interactions (Gottlieb et al., 2013).”
Gruber, M. J., & Ranganath, C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.10.003 · Cited by 302
Computational mechanisms of curiosity and goal-directed exploration
Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H. B., Kronbichler, M., & Friston, K. J. (2019) · eLife · doi:10.7554/elife.41703 · Cited by 278
Predictability and Uncertainty in the Pleasure of Music: A Reward for Learning?
Gold, B. P., Pearce, M. T., Herrero, E. M., Dagher, A., & Zatorre, R. J. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.0428-19.2019 · Cited by 260
Developmental process emerges from extended brain–body–behavior networks
Byrge, L. A., Sporns, O., & Smith, L. B. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.010 · Cited by 219
Brain adaptation and alternative developmental trajectories
Johnson, M. H., Jones, E. J. H., & Gliga, T. (2015) · Development and Psychopathology · doi:10.1017/s0954579415000073 · Cited by 213
Homo Curious: Curious or Interested?
Shin, D. D., & Kim, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09497-x · Cited by 214
How Evolution May Work Through Curiosity‐Driven Developmental Process
Oudeyer, P., & Smith, L. B. (2016) · Topics in Cognitive Science · doi:10.1111/tops.12196 · Cited by 210
Self-citationLevin, M. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.768201 · Cited by 195
Ha, D., & Schmidhuber, J. (2018) · Zenodo · doi:10.5281/zenodo.1207631 · Cited by 187
Infants’ preferences for native speakers are associated with an expectation of information
Begus, K., Gliga, T., & Southgate, V. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1603261113 · Cited by 186
Overconfidence among beginners: Is a little learning a dangerous thing?
Sanchez, C., & Dunning, D. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000102 · Cited by 177
Diverse motives for human curiosity
Kobayashi, K., Ravaioli, S., Baranès, A., Woodford, M., & Gottlieb, J. P. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0589-3 · Cited by 157
Self-citationInduction and Relief of Curiosity Elicit Parietal and Frontal Activity
van Lieshout, L. L. F., Vandenbroucke, A. R. E., Müller, N. C. J., Cools, R., & de Lange, F. P. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.2816-17.2018 · Cited by 151
Moulin-Frier, C., Nguyen, S. M., & Oudeyer, P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01006 · Cited by 182
Self-citationDuan, H., Fernández, G., van Dongen, E. V., & Kohn, N. (2020) · Brain Structure and Function · doi:10.1007/s00429-020-02074-x · Cited by 183
“Curiosity is then induced through individuals’ awareness of the discrepancy between their current informational and goal uncertainty states (Gottlieb et al. 2013).”
Common neural code for reward and information value
Kobayashi, K., & Hsu, M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820145116 · Cited by 158
The feeling of grip: novelty, error dynamics, and the predictive brain
Kiverstein, J., Miller, M., & Rietveld, E. (2019) · Synthese · doi:10.1007/s11229-017-1583-9 · Cited by 143
The rhythm of learning: Theta oscillations as an index of active learning in infancy
Begus, K., & Bonawitz, E. B. (2020) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2020.100810 · Cited by 163
Eye movements reveal epistemic curiosity in human observers
Baranès, A., Oudeyer, P., & Gottlieb, J. P. (2015) · Vision Research · doi:10.1016/j.visres.2015.10.009 · Cited by 136
Self-citationInterest Development and Its Relation to Curiosity: Needed Neuroscientific Research
Hidi, S. E., & Renninger, K. A. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09491-3 · Cited by 137
Fixation patterns in simple choice reflect optimal information sampling
Callaway, F., Rangel, A., & Griffiths, T. L. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008863 · Cited by 143
Curiosity in old age: A possible key to achieving adaptive aging
Sakaki, M., Yagi, A., & Murayama, K. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.03.007 · Cited by 147
Infants tailor their attention to maximize learning
Poli, F., Serino, G., Mars, R. B., & Hunnius, S. (2020) · Science Advances · doi:10.1126/sciadv.abb5053 · Cited by 120
Theoretical perspectives on active sensing
Yang, S. C., Wolpert, D. M., & Lengyel, M. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.06.009 · Cited by 119
Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks
Lau, J. K. L., Ozono, H., Kuratomi, K., Komiya, A., & Murayama, K. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0848-3 · Cited by 131
“Our results showed that (1) both curiosity for inconsequential knowledge (magic tricks or trivia questions) and hunger for food prompted participants to subject themselves to physical risks (that is, electric shocks), and (2) this motivated decision-making was supported by the striatal reward areas.”
InfluentialInterest Development and Learning
Renninger, K. A., & Hidi, S. E. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316823279.013 · Cited by 136
Development of directed and random exploration in children
Meder, B., Wu, C. M., Schulz, E., & Ruggeri, A. (2021) · Developmental Science · doi:10.1111/desc.13095 · Cited by 130
How Are Curiosity and Interest Different? Naïve Bayes Classification of People’s Beliefs
Donnellan, E., Aslan, S., Fastrich, G. M., & Murayama, K. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09622-9 · Cited by 125
Interest development, self-related information processing, and practice
Renninger, K. A., & Hidi, S. E. (2021) · Theory Into Practice · doi:10.1080/00405841.2021.1932159 · Cited by 125
The modulation of savouring by prediction error and its effects on choice
Iigaya, K., Story, G. W., Kurth-Nelson, Z. L., Dolan, R. J., & Dayan, P. (2016) · eLife · doi:10.7554/elife.13747 · Cited by 110
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118
Midcingulate Motor Map and Feedback Detection: Converging Data from Humans and Monkeys
Procyk, E., Wilson, C. R. E., Stoll, F. M., Faraut, M. C. M., Petrides, M., & Amiez, C. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu213 · Cited by 136
“Indeed, eye movements are major tools for information-seeking in primates (Gottlieb et al. 2013).”
Hunters, busybodies and the knowledge network building associated with deprivation curiosity
Lydon‐Staley, D. M., Zhou, D., Sizemore, A. E., Zurn, P., & Bassett, D. S. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00985-7 · Cited by 120
Play in predictive minds: A cognitive theory of play.
Andersen, M. M., Kiverstein, J., Miller, M., & Roepstorff, A. (2023) · Psychological Review · doi:10.1037/rev0000369 · Cited by 122
Spontaneous Metacognition in Rhesus Monkeys
Rosati, A. G., & Santos, L. R. (2016) · Psychological Science · doi:10.1177/0956797616653737 · Cited by 115
Individual differences in information-seeking
Kelly, C., & Sharot, T. (2021) · Nature Communications · doi:10.1038/s41467-021-27046-5 · Cited by 128
Cardoso-Leite, P., & Bavelier, D. (2014) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000077 · Cited by 111
From relief to surprise: Dual control of epistemic curiosity in the human brain
Ligneul, R., Mermillod, M., & Morisseau, T. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.07.038 · Cited by 105
Adaptive Robot Language Tutoring Based on Bayesian Knowledge Tracing and Predictive Decision-Making
Schodde, T., Bergmann, K., & Kopp, S. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020222 · Cited by 110
States of curiosity and interest enhance memory differently in adolescents and in children
Fandakova, Y., & Gruber, M. J. (2020) · Developmental Science · doi:10.1111/desc.13005 · Cited by 120
To Level the Playing Field, Develop Interest
Renninger, K. A., & Hidi, S. E. (2020) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732219864705 · Cited by 139
Multi-Armed Bandits for Intelligent Tutoring SystemsPreprint
Clement, B., Roy, D., Oudeyer, P., & Lopes, M. C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.3174 · Cited by 107
Self-citationThe Educational Benefits of Self-Related Information Processing
Hidi, S. E., Renninger, K. A., & Northoff, G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316823279.003 · Cited by 107
Relating Pupil Dilation and Metacognitive Confidence during Auditory Decision-Making
Lempert, K. M., Chen, Y. L., & Fleming, S. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0126588 · Cited by 94
Play, Curiosity, and Cognition
Chu, J., & Schulz, L. E. (2020) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-070120-014806 · Cited by 93
The Double-Edged Sword of Big Data in Organizational and Management Research
Wenzel, R., & Quaquebeke, N. V. (2017) · Organizational Research Methods · doi:10.1177/1094428117718627 · Cited by 107
“…affective arousal via physiological reactions in employees (e.g., pulse, skin conductance; Becker & Menges, 2013) and information-seeking via visuospatial attention on their computer screens (e.g., eye fixation, gaze patterns; Gottlieb, Oudeyer, Lopes, & Baranes, 2013; Hoffman & Subramaniam, 1995).”
Visual Saliency-Aware Receding Horizon Autonomous Exploration with Application to Aerial Robotics
Dang, T., Papachristos, C., & Alexis, K. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460992 · Cited by 97
The Demand for, and Avoidance of, Information
Golman, R., Loewenstein, G. F., Molnár, A., & Saccardo, S. (2021) · Management Science · doi:10.1287/mnsc.2021.4244 · Cited by 97
Curiosity‐based learning in infants: a neurocomputational approach
Twomey, K. E., & Westermann, G. (2017) · Developmental Science · doi:10.1111/desc.12629 · Cited by 103
Humans monitor learning progress in curiosity-driven exploration
Ten, A., Kaushik, P., Oudeyer, P. Y., & Gottlieb, J. P. (2021) · Nature Communications · doi:10.1038/s41467-021-26196-w · Cited by 97
“C uriosity, our desire to know, is a fundamental drive in human behavior and a topic of renewed interest in neuroscience and cognitive psychology 1,2 . of recent The vast majority research on curiosity has operationalized it as intrinsically motivated information demand, using tasks in which…”
Self-citationYoo, S. B. M., Hayden, B. Y., & Pearson, J. M. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0664 · Cited by 101
Managerial academic experience, external monitoring and financial reporting quality
Ma, Z., Novoselov, K. E., Zhou, K., & Zhou, Y. X. (2019) · Journal of Business Finance & Accounting · doi:10.1111/jbfa.12398 · Cited by 97
How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making
Monosov, I. E. (2020) · Trends in Neurosciences · doi:10.1016/j.tins.2020.06.009 · Cited by 95
Bazhydai, M., Westermann, G., & Parise, E. (2020) · Developmental Science · doi:10.1111/desc.12938 · Cited by 85
Daddaoua, N., Lopes, M. C., & Gottlieb, J. P. (2016) · Scientific Reports · doi:10.1038/srep20202 · Cited by 89
Self-citationRethinking employability: how students build on interest in a subject to plan a career
Quinlan, K. M., & Renninger, K. A. (2022) · Higher Education · doi:10.1007/s10734-021-00804-6 · Cited by 110
Curiosity as a Metacognitive Feeling
Goupil, L., & Proust, J. (2023) · Cognition · doi:10.1016/j.cognition.2022.105325 · Cited by 89
Energization and Direction Are Both Essential Parts of Motivation
Elliot, A. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197662359.003.0002 · Cited by 91
Baranès, A., Oudeyer, P., & Gottlieb, J. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00317 · Cited by 91
Self-citationState estimation in posterior parietal cortex: Distinct poles of environmental and bodily states
Medendorp, W. P., & Heed, T. (2019) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2019.101691 · Cited by 89
A functional approach to explanation-seeking curiosity
Liquin, E. G., & Lombrozo, T. (2020) · Cognitive Psychology · doi:10.1016/j.cogpsych.2020.101276 · Cited by 79
Specific frontal neural dynamics contribute to decisions to check
Stoll, F. M., Fontanier, V., & Procyk, E. (2016) · Nature Communications · doi:10.1038/ncomms11990 · Cited by 83
Asking the right questions about the psychology of human inquiry: Nine open challenges
Coenen, A., Nelson, J. D., & Gureckis, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1470-5 · Cited by 84
On educating, curiosity, and interest development
Hidi, S. E., & Renninger, K. A. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.08.002 · Cited by 85
Gaze entropy reflects surgical task load
Stasi, L. L. D., Díaz-Piedra, C., Rieiro, H., Sanchez-Carrion, J. M., Berrido, M. M., Granados, G. O., & Catena, A. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-4851-8 · Cited by 101
Curious to eat insects? Curiosity as a Key Predictor of Willingness to try novel food
Stone, H., FitzGibbon, L., Millan, E. S., & Murayama, K. (2021) · Appetite · doi:10.1016/j.appet.2021.105790 · Cited by 94
Parietal neurons encode expected gains in instrumental information
Foley, N. C., Kelly, S. P., Mhatre, H., Lopes, M. C., & Gottlieb, J. P. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1613844114 · Cited by 76
Self-citationWhy so curious? Quantifying mechanisms of information seeking
van Lieshout, L. L. F., de Lange, F. P., & Cools, R. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.08.005 · Cited by 79
Dissociating neural learning signals in human sign- and goal-trackers
Schad, D. J., Rapp, M. A., Garbusow, M., Nebe, S., Sebold, M., Obst, E., Sommer, C., Deserno, L., Rabovsky, M., Friedel, E., et al. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0765-5 · Cited by 92
Panitz, C., Endres, D., Buchholz, M., Khosrowtaj, Z., Sperl, M. F. J., Mueller, E. M., Schubö, A., Schütz, A. C., Teige‐Mocigemba, S., & Pinquart, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.726432 · Cited by 86
Monkeys are curious about counterfactual outcomes
Wang, M. Z., & Hayden, B. Y. (2019) · Cognition · doi:10.1016/j.cognition.2019.03.009 · Cited by 82
What Is Consciousness, and Could Machines Have It?
Dehaene, S., Lau, H. C., & Kouider, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-54173-6_4 · Cited by 80
Interest: A unique affective and cognitive motivational variable that develops
(2022) · Advances in Motivation Science · doi:10.1016/bs.adms.2021.12.004 · Cited by 81
A curious formulation robot enables the discovery of a novel protocell behavior
Grizou, J., Points, L. J., Sharma, A., & Cronin, L. (2020) · Science Advances · doi:10.1126/sciadv.aay4237 · Cited by 77
The Posterior Parietal Cortex in Adaptive Visual Processing
Xu, Y. (2018) · Trends in Neurosciences · doi:10.1016/j.tins.2018.07.012 · Cited by 75
“Perhaps for this reason, and because of our curiosity to continuously seek new information from the environment [92], it is advantageous and adaptive for the PPC to encode salient external visual events”
Intrinsically regulated learning is modulated by synaptic dopamine signaling
Ripollés, P., Ferreri, L., Herrero, E. M., Alicart, H., Gómez-Andrés, A., Marco‐Pallarés, J., Antonijoan, R. M., Noesselt, T., Valle, M., Riba, J., et al. (2018) · eLife · doi:10.7554/elife.38113 · Cited by 77
Costly curiosity: People pay a price to resolve an uncertain gamble early.
Cabrero, J. A. M. R., Zhu, J.-Q., & Ludvig, E. A. (2018) · Behavioural Processes · doi:10.1016/j.beproc.2018.12.015 · Cited by 63
The Embodied-Enactive-Interactive Brain: Bridging Neuroscience and Creative Arts Therapies
Vaisvaser, S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.634079 · Cited by 85
Dubourg, E., & Baumard, N. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000923 · Cited by 81
Curiosity and the dynamics of optimal exploration
Poli, F., O’Reilly, J. X., Mars, R. B., & Hunnius, S. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.02.001 · Cited by 83
Rule, J., Tenenbaum, J. B., & Piantadosi, S. T. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.07.005 · Cited by 86
On the automaticity of attentional orienting to threatening stimuli.
Anderson, B. A., & Britton, M. K. (2019) · Emotion · doi:10.1037/emo0000596 · Cited by 69
Schillaci, G., Hafner, V. V., & Lara, B. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00039 · Cited by 74
“Information seeking through exploration behaviors, according to Gottlieb et al. (2013), is “a process that obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated.” This is in line with what has been proposed by Litman (2005), as mentioned before in this section, that the drive o…”
InfluentialConscious agent networks: Formal analysis and application to cognition
Fields, C., Hoffman, D. D., Prakash, C., & Singh, M. (2017) · Cognitive Systems Research · doi:10.1016/j.cogsys.2017.10.003 · Cited by 67
“As Gottlieb et al. (2013) emphasize, however, rational agents do not exhibit unlimited curiosity, as this can lead to expending all available resources attempting to solve unsolvable problems or learn unlearnable information.”
Jezzini, A., Bromberg-Martin, E. S., Trambaiolli, L. R., Haber, S. N., & Monosov, I. E. (2021) · Neuron · doi:10.1016/j.neuron.2021.05.013 · Cited by 58
Early Word Segmentation in Naturalistic Environments: Limited Effects of Speech Register
Schreiner, M. S., Altvater‐Mackensen, N., & Mani, N. (2016) · Infancy · doi:10.1111/infa.12133 · Cited by 64
Begus, K., & Southgate, V. (2018) · Springer eBooks · doi:10.1007/978-3-319-77182-3_2 · Cited by 75
Contributions of expected learning progress and perceptual novelty to curiosity-driven exploration
Poli, F., Meyer, M., Mars, R. B., & Hunnius, S. (2022) · Cognition · doi:10.1016/j.cognition.2022.105119 · Cited by 65
Metadata
- Authors
- Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A.
- Affiliations
- Columbia University (US)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Corresponding author
- Gottlieb, Jacqueline
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2013-11
- Volume
- 17
- Issue
- 11
- Pages
- 585-593
- ISSN
- 1364-6613 (ISSN-L)
- PMC
- PMC4193662
- OpenAlex
- W2013830186
- Semantic Scholar
- 61667ccec10748b39e274f2a13fcf9b7c4a9b275
- Cited by
- 784
- References
- 132
- Citations by year
- 2026: 43 · 2025: 57 · 2024: 77 · 2023: 165 · 2022: 70 · 2021: 68 · 2020: 64 · 2019: 74 · 2018: 42 · 2017: 43 · 2016: 31 · 2015: 21 · 2014: 26 · 2013: 2
- FWCI
- 4.42
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- HAL (submittedVersion)
- Funders
- National Institutes of Health (4r01mh098039-05)
- National Institute of Mental Health (R01 MH-098039, R03MH091590)
- National Institute on Drug Abuse (R21DA030095)
- National Eye Institute (P30EY019007)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychological and Educational Research Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- information seeking, curiosity, attention, exploration, novelty bias, surprise, information gain, eye movements, oculomotor system
- MeSH terms
- Animals, Artificial Intelligence, Attention, Brain, Exploratory Behavior, Humans, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review