Emergent Exploration via Novelty Management
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
When encountering novel environments, animals perform complex yet structured exploratory behaviors. Despite their typical structuring, the principles underlying exploratory patterns are still not sufficiently understood. Here we analyzed exploratory behavioral data from two modalities: whisking and locomotion in rats and mice. We found that these rodents maximized novelty signal-to-noise ratio during each exploration episode, where novelty is defined as the accumulated information gain. We further found that these rodents maximized novelty during outbound exploration, used novelty-triggered withdrawal-like retreat behavior, and explored the environment in a novelty-descending sequence. We applied a hierarchical curiosity model, which incorporates these principles, to both modalities. We show that the model captures the major components of exploratory behavior in multiple timescales: single excursions, exploratory episodes, and developmental timeline. The model predicted that novelty is managed across exploratory modalities. Using a novel experimental setup in which mice encountered a novel object for the first time in their life, we tested and validated this prediction. Further predictions, related to the development of brain circuitry, are described. This study demonstrates that rodents select exploratory actions according to a novelty management framework and suggests a plausible mechanism by which mammalian exploration primitives can be learned during development and integrated in adult exploration of complex environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 6×
“Modeling efforts had been focused so far on specific scenarios (Tchernichovski et al., 1998; Harish and Golomb, 2010) or high-level information theoretical aspects (Polani, 2009; Still, 2009; Friston, 2010; Tishby and Polani, 2011) of these behaviors.”
BackgroundInfluentialInternal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685 · cited 2×
“, 2012) that attempted to predict the next sensory state given the current one and the action performed (i.e., a “forward model”; Kawato, 1999; Lalazar and Vaadia, 2008); (2) a critic, which attempted to predict future accumulated rewards; and (3) an actor, which determined the next action given the current state usin…”
BackgroundCanonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2×
“1a), which was composed of (1) a perceiver, which was a Bayesian learner (Bastos et al., 2012) that attempted to predict the next sensory state given the current one and the action performed (i.e., a “forward model”; Kawato, 1999; Lalazar and Vaadia, 2008); (2) a critic, which attempted to predict…”
BackgroundPath integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727
The Hierarchical Model of Approach-Avoidance Motivation
Elliot, A. J. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9028-7 · Cited by 1,385
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
A computational neuroanatomy for motor control
Shadmehr, R., & Krakauer, J. W. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1280-5 · Cited by 1,187
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 2×
“We incorporate these observations in a minimal model based on an intrinsic motivation (Harlow, 1950; Schmidhuber, 1990; Oudeyer et al., 2007; Singh et al., 2010; Baldassarre, 2011) reinforcement learning scheme in which novelty serves as an intrinsic reward (Gordon et al., 2014).”
BackgroundMethodIntrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
Cited by
Information and selforganization: A unifying approach and applications
Haken, H., & Portugali, J. (2016) · Entropy · doi:10.3390/e18060197 · Cited by 75
Fotowat, H., Lee, C., Jun, J. J., & Maler, L. (2019) · eLife · doi:10.7554/elife.44119 · Cited by 69
Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking
Naudé, J., Tolu, S., Dongelmans, M., Torquet, N., Valverde, S., Rodriguez, G., Pons, S., Maskos, U., Mourot, A., Marti, F., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4223 · Cited by 61
Metadata
- Authors
- Gordon, G., Fonio, E., & Ahissar, E.
- Venue
- Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2014-09-17
- Volume
- 34
- Issue
- 38
- Pages
- 12646-12661
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1997248856
- Cited by
- 49
- References
- 19
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Emergent Exploration via Novelty Management. https://app.cochat.ai/papers/10.1523/jneurosci.1872-14.2014
- The paper
- Gordon, G., Fonio, E., & Ahissar, E. (2014). Emergent Exploration via Novelty Management. Journal of Neuroscience. https://doi.org/10.1523/jneurosci.1872-14.2014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.