The DOI matches its Crossref record; 109 of the 132 references it cites were found in a registry or an index; none of the 51 sources its claims cite is checked for support yet.
Information-seeking, curiosity, and attention: computational and neural mechanisms
Open accessAbstract
Summary Intelligent animals devote much time and energy to exploring and obtaining information, but the underlying mechanisms are poorly understood. We review recent developments on this topic that have emerged from the traditionally separate fields of machine learning, eye movements in natural behavior, and studies of curiosity in psychology and neuroscience. These studies show that exploration may be guided by a family of mechanisms that range from automatic biases toward novelty or surprise, to systematic search for learning progress and information gain in curiosity-driven behavior. In addition, eye movements reflect visual information search in multiple conditions and are amenable for cellular-level investigations, suggesting that the oculomotor system is an excellent model system for understanding information sampling mechanisms.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This review integrates machine learning, eye-movement, and curiosity research to argue that information seeking ranges from automatic novelty/surprise biases to targeted search for learning progress and information gain. It proposes the oculomotor system as a model for information sampling and highlights intrinsic rewards and uncertainty monitoring as key open questions.
Key findings
- Information seeking is defined as actions whose primary goal is to obtain information and reduce uncertainty; it can be extrinsically motivated, as when a driver glances at a traffic light, or intrinsically motivated, as in curiosity or interest.
- Task-related gaze is proactively guided by uncertainty: in visuo-manual tasks the eyes move ahead of the hand to collision or target points and wait there, and in a virtual-reality walking study subjects preferentially deployed gaze to oncoming pedestrians with a history of veering onto a collision course.
- Curiosity-like mechanisms include Lowenstein’s information gap hypothesis, illustrated by a mystery novel with 10 equally likely suspects where the reader moves from high entropy to a single culprit, and developmental robotics approaches that reward learning progress rather than absolute competence.
- Novelty, surprise, and uncertainty heuristics help discover new tasks but are inefficient in large open-ended spaces and risk trapping agents in unlearnable tasks; learning-progress systems may support efficient exploration but a quantitative neural response to learning progress has not been demonstrated empirically.
Methods
- Narrative review synthesizing three traditionally separate lines: active learning and exploration in machine learning and robotics, eye movements in natural behavior, and curiosity in psychology and neuroscience.
- No primary empirical sample or new data are reported; the paper uses conceptual and computational examples, including a POMDP traffic-light example, the information gap mystery-novel illustration, and developmental robotics simulations/robots.
- Main analysis is conceptual integration and comparison of mechanisms across fields, not statistical meta-analysis.
Limitations
- The paper states that understanding information-seeking mechanisms is in its infancy, that a quantitative response to learning progress distinct from phasic responses to novelty, surprise, or arousal has not been demonstrated empirically, and that the learning-progress approach entails a complex meta-cognitive architecture awaiting empirical verification.
- The paper also states that it has not been empirically explored to what extent task-related informational eye movements are habitual, immutable aspects of a task versus rapidly responsive to changing epistemic conditions.
- Evident from the text: as a review, it provides no new experimental data, and many claims about intrinsic rewards and their neural implementation remain speculative; the paper itself notes the question of active exploration is vast and cannot be exhaustively covered.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 51 cited sources checked · 0 supported · 0 flagged
In the paper
“In well-practiced tasks that involve visuo-manual coordination (such as moving an object to a target point) the eyes move ahead of the hand to critical locations such as potential collision or target points, and wait there until the hand has cleared those locations”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Johansson, Westling et al. 2001
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Singh et al. (Singh, Lewis et al. 2010) have shown with computer simulations that even if the objective fitness/reward function of an organism is to survive and reproduce, it may be more efficient to evolve a control architecture that encodes an innate surrogate reward function rewarding learning per se.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Singh, Lewis et al. 2010
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Finally, the eye movements patterns made while acquiring a task differ greatly from those made after learning”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Sailer, Flanagan et al. 2005
- Not checked yetcites Land 2006 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Subjects preferentially deployed gaze to oncoming pedestrians whose trajectory was expected to be uncertain (i.e., who had a history of veering onto a collision course) relative to those who had never shown such deviations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Jovancevic-Misic and Hayhoe 2009
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Sensory novelty, defined as a small number of stimulus exposures, is known to enhance neural responses throughout visual, frontal and temporal areas”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Ranganath and Rainer 2003 source
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“Sensory novelty, defined as a small number of stimulus exposures, is known to enhance neural responses throughout visual, frontal and temporal areas (Ranganath and Rainer 2003) and activate reward responsive dopamine-recipient areas.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Ranganath and Rainer 2003 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“information seeking in its many manifestations is related to the ability of an observer to estimate his or her uncertainty and to find strategies that reduce that uncertainty.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Converging evidence suggests that, when deployed in the service of a task, eye movements may be explained by the simple imperative to sample information in order to reduce uncertainty regarding future states”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
- Not checked yetcites Tatler, Hayhoe et al. 2011 source
- Not checked yetcites Friston and Ao 2012
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our focus here is on evaluating recent developments related to this question from three lines of investigation that have remained largely separate – namely, studies of active learning and exploration in the machine learning and robotics fields, studies of eye movements in natural behavior, and studies of curiosity in psychology and neuroscience.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking in machine learning, psychology and neuroscience
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“These observations, together with the fact that eye movements are well investigated at the single neuron level in experimental animals and use value-based decision mechanisms”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is clear from this POMDP-based analysis that, as an intermediate step in a sequence, an observing action is only valuable if it increases the likelihood of reward of subsequent actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most likely answer to the first, why question is that, by having an intrinsic motivation to learn, agents can maximize their long-term evolutionary fitness in rapidly changing environmental conditions”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“suggesting that eye movements are also coupled with exploring for a task strategy.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“in real world environments many of the activities that an agent can choose are inherently unlearnable either because of the learner’s own limitations or because of irreducible uncertainty in the problem itself.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“suggesting that the oculomotor system is an excellent model system for understanding information sampling mechanisms.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Abstract
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the short term, the observing action delivers no reward but has a cost in terms of the time and effort needed to discriminate the information”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A second factor that determines information value is the observer’s momentary uncertainty.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Computational studies have shown that, when an agent knows a task, the controllers implementing that task can select actions that harvest immediate rewards, or actions that have indirect benefits by facilitating future actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Far from being a passive recipient, the brain actively selects and proactively seeks out the information it wishes to sample”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A second salient fact regarding this question is that, while sampling this very large space, the child must avoid becoming trapped in unlearnable situations, i.e. where it cannot detect regularities or improve.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This cost becomes worthwhile only if the observing action transitions the agent to a better state - i.e., if the cumulative future value of state xb exceeds that of state xa by a sufficient amount.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whether or not information sampling has positive value depends on two factors. First, the observer must know the significance of the information and use it to plan future actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“In fact, it is possible to show that making the environment predictable (through minimizing the dispersion of its hidden states) necessarily entails actions that decrease uncertainty about future states”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Friston, Thornton et al. 2012
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the active control of eye movements makes it clear that information sampling is a highly active process”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In extrinsically motivated contexts, information gathering is a means to an end – i.e., it is used to maximize the agent’s progress toward a separate goal.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In foveate animals such as humans and monkeys, visual information is sampled by means of eye movements, and in particular saccades”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This makes the strong computational point that uncertainty and information value are not defined unless observers have prior knowledge of the links between stimuli and actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“In the sensorimotor domain alone, and in spite of significant innate constraints, the child needs to learn to generate an enormous repertoire of movements by orchestrating multiple interdependent muscles and joints that can be accessed at many hierarchical levels and interact in a potentially infinite number of ways with a vast number of physical objects/situations”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Oudeyer, Baranes et al. 2013
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In one way or another, all these formulations are consistent with the idea that intrinsically motivated cognitive activities, including information seeking, acquired value through long-term evolutionary selection in dynamic conditions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These studies show that exploration may be guided by a family of mechanisms that range from automatic biases toward novelty or surprise, to systematic search for learning progress and information gain in curiosity-driven behavior.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Many of these methods can be seen as a POMDP whose uncertainty is not on the task-relevant state but on the task parameters themselves.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“This progress-based approach has been used most successfully in real-world situations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites L. Pape 2012 source
- Not checked yetcites Ngo, Luciw et al. 2012
- Not checked yetcites Baranes and Oudeyer 2013
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It must be noted however that, while computationally powerful, this approach entails a complex meta-cognitive architecture for monitoring learning progress that still awaits empirical verification.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“Therefore, heuristics based on novelty can guide efficient learning in small and closed spaces, where the number of tasks is small (Thrun 1995)”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Thrun 1995
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“An alternative mechanism for targeted learning has been proposed in the field of developmental robotics, which eschews this difficulty by tracking an agent’s local learning progress without setting an absolute goal (Oudeyer, Kaplan et al. 2007; Oudeyer, Baranes et al. 2013; Schmidhuber 2013)”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites Oudeyer, Kaplan et al. 2007
- Not checked yetcites Oudeyer, Baranes et al. 2013
- Not checked yetcites Schmidhuber 2013
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The central objective of developmental robotics is to design agents that can explore in open-ended environments and develop autonomously without a pre-programmed trajectory, based on their intrinsic interest.
In the paper
“This is consistent with the theoretical notion that novelty acts as an intrinsic reward for actions and states that had not been recently explored or that produce high empirical prediction errors”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Duzel, Bunzeck et al. 2010 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“but are very inefficient in large open ended spaces, where they only allow the agent to collect very sparse data and risk trapping him in unlearnable tasks (Oudeyer, Kaplan et al. 2007; Oudeyer, Baranes et al. 2013; Schmidhuber 2013).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Oudeyer, Kaplan et al. 2007
- Not checked yetcites Oudeyer, Baranes et al. 2013
- Not checked yetcites Schmidhuber 2013
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In other words, one cannot be curious about what one does not know, similar to the requirements for prior knowledge of stimulus-action links that arise in eye movement control (Fig. 1).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In sum, a system based on learning progress holds promise for achieving efficient, intrinsically motivated exploration in large open-ended spaces.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Initially applied to sensorimotor tasks such as object manipulation, the approach was also shown to spontaneously lead a robot to discover vocal communication with a peer (while traversing stages of babbling that resemble those of infants as a consequence of its drive to explore situations which the learner estimates to be learnable (Oudeyer and Kaplan 2006; Moulin-Frier and Oudeyer 2012)).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites Oudeyer and Kaplan 2006
- Not checked yetcites Moulin-Frier and Oudeyer 2012
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is important to recognize, however, that, while biological drives are prompted by salient and easily recognizable signs (e.g., somatic signals for hunger or sex), recognizing and eliminating information gaps requires a radically different, knowledge-based mechanism.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: Biological drives are prompted by salient and easily recognizable signs.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By using a local measure of learning the system avoids difficulties associated with defining an absolute (and potentially unknowable) competence or epistemic goal.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similar to an information gap mechanism, this system produces a targeted search for information that drives the agent to learn.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite its considerable strengths, a potential limitation of the information gap hypothesis is that agents may not be able to estimate the starting or desired levels of uncertainty given their necessarily limited knowledge of the broader context.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: In scientific research, the results of an experiment typically open up new questions that had not been foreseen, and it is not possible to estimate in advance the current entropy and the final desired state.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, a quantitative response to learning progress (which is distinct from phasic responses to novelty, surprise or arousal) has not been demonstrated in empirical investigations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, the agent needs some prior knowledge in order to set the starting and the reference points.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, these actions have an important limitation in that they do not guarantee that an agent will learn.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mere fact that an event is novel or surprising does not guarantee that it contains regularities that are detectable, generalizable or useful.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Second, the system self-organizes development and learning trajectories that share fundamental qualitative properties with infant development, in particular the gradual shift of interest from simpler to more complex skills (Oudeyer and Kaplan 2006; Oudeyer, Kaplan et al. 2007; Kaplan and Oudeyer 2011; Moulin-Frier and Oudeyer 2012) (Fig. 2).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites Oudeyer and Kaplan 2006
- Not checked yetcites Oudeyer, Kaplan et al. 2007
- Not checked yetcites Kaplan and Oudeyer 2011
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Computational models have also incorporated uncertainty-based strategies, generating biases toward actions or states that have high variance or entropy”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Cohn, Ghahramani et al. 1996
- Not checked yetcites Rothkopf and Ballard 2010
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Possible candidates for such a system include frontal systems that encode the uncertainty or confidence in humans and monkeys (Fleming, Weil et al. 2010; Fleming, Huijgen et al. 2012; De Martino, Fleming et al. 2013)”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“First, it allows robots to efficiently learn repertoires of skills in high dimensions and under strong time constraints”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites L. Pape 2012 source
- Not checked yetcites Ngo, Luciw et al. 2012
- Not checked yetcites Baranes and Oudeyer 2013
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“and to avoid unfruitful activities that are either well learnt and trivial, or which are random and unlearnable (L. Pape 2012; Ngo, Luciw et al. 2012; Baranes and Oudeyer 2013; Nguyen and Oudeyer 2013).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites L. Pape 2012 source
- Not checked yetcites Ngo, Luciw et al. 2012
- Not checked yetcites Baranes and Oudeyer 2013
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As discussed above, actions driven by randomness, novelty, uncertainty or surprise are valuable for allowing agents to discover new tasks.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the information gap theory links the study of epistemically-based action systems with that of motivated behaviors.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 12
- Probably not a substantial claim. 22
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notably, the eyes never track the hand, which relies on motor and proprioceptive guidance and, for short periods of time, follows a predictable path; instead, they are strategically deployed to acquire new information.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“One salient fact that emerges regarding this question is the sheer vastness of the learning space, especially given the scarce time and energy available for learning.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Deciding how to explore optimally when searching for strategy is a very difficult question, and is almost intractable in the general case.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“A number of processes for open-ended exploration have been described in the literature, which, as we describe below, have individual strengths and weaknesses and may act in complementary fashion to accomplish these goals.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Information gathering actions are a special type of intermediate step that obey the imperative to reduce uncertainty and adjudicate among competing interpretations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while executing a known task
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This suggests that the observers monitor the uncertainty or predictability of external items and use these quantities proactively to deploy gaze”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Eye movements reflect active information search
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Strategies for solving a task, including those for generating informational actions, are not known in advance but must also be learnt.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is important to note that, while these processes require significant exploration, they are goal directed in the sense that they seek to maximize a separate, or extrinsic, reward”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Task-directed search for information through the prism of eye movements > Information sampling while searching for a task strategy
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the challenge of an information seeking mechanism is to learn efficiently a large repertoire of diverse skills given its limited resources, and avoid being trapped in unlearnable situations.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Similarly in the cognitive domain, infants must acquire a vast amount of factual knowledge, rules and social skills.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“although using different terminology and methods, these three lines of research grapple with strikingly similar questions and propose overlapping mechanisms.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking in machine learning, psychology and neuroscience
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The benefits of such a system arise because of the limited cognitive capacities of the agent (i.e., its inability to solve the fitness function directly) (Sorg, Lewis et al. 2010; Lehman and Stanley 2011; Sequeira, Melo et al. 2011) or because information or skills that are not immediately useful may be re-used in the future.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Sorg, Lewis et al. 2010
- Not checked yetcites Lehman and Stanley 2011
- Not checked yetcites Sequeira, Melo et al. 2011
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although exploratory actions can involve physical acts, they are distinct from other motor acts in that their primary goal is not to exert force on the world, but to alter the observer’s epistemic state.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“eye movements reflect visual information search in multiple conditions and are amenable for cellular-level investigations”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In intrinsically motivated contexts, on the other hand, the search for information is a goal in itself – a process we would intuitively call “curiosity” or “interest”.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The fact that animals, and particularly humans, seem avidly to seek out information without an apparent ulterior motive suggests that the brain generates intrinsic rewards that assign value to information”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Information seeking obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
- The authors state this as an assumption: The brain generates intrinsic rewards related to learning or acquiring information.
None of the sources cited for this claim have been checked yet.
In the paper
“This idea resonates with the free-energy principle, which states that the possession of a large array of skills can be useful to avoid future surprises by “anticipating a changing and itinerant world””
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > The benefits and challenges of information seeking
What the sources say
- Not checked yetcites Friston 2010 source
- Not checked yetcites Friston, Thornton et al. 2012
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A more complex form of “contextual novelty” (also called surprise) has been suggested to account for attentional attraction toward salient events”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Boehnke, Berg et al. 2011
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“may be quantified using Bayesian inference as a difference between a prior and posterior world model (Itti and Baldi 2009) or as a high prediction error for high-confidence states (Oudeyer and Kaplan 2007).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
What the sources say
- Not checked yetcites Itti and Baldi 2009 source
- Not checked yetcites Oudeyer and Kaplan 2007
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Just as animals seek to fill gaps in their physical resources (e.g., energy, sex or wealth) they seek to fill gaps in their knowledge by taking learning-oriented actions.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In neuroscience research, the most commonly considered exploration strategies are based on random action selection or automatic biases toward novel, surprising or uncertain events.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Randomness, novelty, surprise and uncertainty
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Defined in this way, curiosity can be viewed as a deprivation phenomenon that seeks to fill a need similar to other reference-point phenomena or biological drives.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This brings us back again to the imperative to minimize uncertainty about the state of the world, and suggests that this imperative is similar to a biological drive.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, to define an information gap one has to monitor one’s level of uncertainty, again similar to eye movement control.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, understanding information seeking requires that we understand how agents monitor their own competence and epistemic states, and specifically how they estimate their uncertainty and generate strategies for reducing that uncertainty.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, eye movements are natural indicators of the brain’s active information search.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“According to the information gap theory, this type of curiosity arises because of a discrepancy between what the observer knows and what he would like to know, where knowledge can be measured with traditional measures of information.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Information gap hypothesis of curiosity
What the sources say
- Not checked yetcites Lowenstein 1994 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, this question requires that we understand the nature of intrinsic rewards that motivate information seeking and learning.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By virtue of their amenability to neurophysiological investigations, may be an excellent model system for tackling this question, especially if studied in conjunction with computational approaches and the brain’s intrinsic reward and cognitive control mechanisms.”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Conclusions
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
- Rests on an assumption: The brain has intrinsic reward and cognitive control mechanisms.
- Rests on an assumption: Eye movements are amenable to neurophysiological investigations.
None of the sources cited for this claim have been checked yet.
In the paper
“or which respond selectively for behavioral change or the beginning of exploratory episodes (Isoda and Hikosaka 2007; Quilodran, Rothe et al. 2008).”
§ Information seeking, curiosity and attention: computational and neural mechanisms > Curiosity and autonomous exploration > Exploration based on learning progress (LP)
What the sources say
- Not checked yetcites Isoda and Hikosaka 2007
- Not checked yetcites Quilodran, Rothe et al. 2008
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The authors state this as an assumption.
The brain generates intrinsic rewards related to learning or acquiring information.
“it seems necessary to assume that the brain generates intrinsic rewards related to learning or acquiring information (Berlyne 1960).”
The paper relies on this without support.
Biological drives are prompted by salient and easily recognizable signs.
“while biological drives are prompted by salient and easily recognizable signs (e.g., somatic signals for hunger or sex)”
The paper relies on this without support.
In scientific research, the results of an experiment typically open up new questions that had not been foreseen, and it is not possible to estimate in advance the current entropy and the final desired state.
“In scientific research for example, the results of an experiment typically open up new questions that had not been foreseen, and it is not possible to estimate in advance what is the current entropy and the final, desired, state.”
The paper relies on this without support.
The central objective of developmental robotics is to design agents that can explore in open-ended environments and develop autonomously without a pre-programmed trajectory, based on their intrinsic interest.
“The central objective of developmental robotics is to design agents that can explore in open-ended environments and develop autonomously without a pre-programmed trajectory, based on their intrinsic interest.”
The paper relies on this without support.
The brain has intrinsic reward and cognitive control mechanisms.
“the brain’s intrinsic reward and cognitive control mechanisms.”
The paper relies on this without support.
Eye movements are amenable to neurophysiological investigations.
“By virtue of their amenability to neurophysiological investigations”
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,178
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“The search may use approaches ranging from reinforcement learning (Kaelbling, Littman et al. 1998; Sutton and Barto 1998; Jens Kober 2012), to stochastic optimization (Spall 2005), evolutionary techniques (Goldberg 1989), or Bayesian optimization (Jones, Schonlau et al.”
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“This idea resonates with the free-energy principle, which states that the possession of a large array of skills can be useful to avoid future surprises by “anticipating a changing and itinerant world” (Friston 2010; Friston, Thornton et al. 2012).”
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Conflict, arousal, and curiosity.
Berlyne, D. E. (1960) · McGraw-Hill Book Company · doi:10.1037/11164-000 · Cited by 6,018 · cited 1×
“To explain such behaviors and the high degree of motivation associated with them, it seems necessary to assume that the brain generates intrinsic rewards related to learning or acquiring information (Berlyne 1960).”
Marr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Flagged first, then by citations
23 of the 132 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Nguyen, 2013, Socially guided intrinsic motivation for robot learning of motor skills, Auton Robots
Cited by
Sorted by citations
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
The Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
What is consciousness, and could machines have it?
Dehaene, S., Lau, H., & Kouider, S. (2017) · Science · doi:10.1126/science.aan8871 · Cited by 855
Electronic skins and machine learning for intelligent soft robots
Shih, B., Shah, D., Li, J., Thuruthel, T. G., Park, Y.-L., Iida, F., Bao, Z., Kramer-Bottiglio, R., & Tolley, M. T. (2020) · Science Robotics · doi:10.1126/scirobotics.aaz9239 · Cited by 715
Metadata
- Authors
- Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A.
- Affiliations
- Columbia University (US)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Corresponding author
- Gottlieb, Jacqueline
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2013-11
- Volume
- 17
- Issue
- 11
- Pages
- 585-593
- ISSN
- 1364-6613 (ISSN-L)
- PMC
- PMC4193662
- OpenAlex
- W2013830186
- Semantic Scholar
- 61667ccec10748b39e274f2a13fcf9b7c4a9b275
- Cited by
- 784
- References
- 132
- Citations by year
- 2026: 43 · 2025: 57 · 2024: 77 · 2023: 165 · 2022: 70 · 2021: 68 · 2020: 64 · 2019: 74 · 2018: 42 · 2017: 43 · 2016: 31 · 2015: 21 · 2014: 26 · 2013: 2
- FWCI
- 4.42
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- HAL (submittedVersion)
- Funders
- National Institutes of Health (4r01mh098039-05)
- National Institute of Mental Health (R01 MH-098039, R03MH091590)
- National Institute on Drug Abuse (R21DA030095)
- National Eye Institute (P30EY019007)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychological and Educational Research Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- information seeking, curiosity, attention, exploration, novelty bias, surprise, information gain, eye movements, oculomotor system
- MeSH terms
- Animals, Artificial Intelligence, Attention, Brain, Exploratory Behavior, Humans, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
