Towards a neuroscience of active sampling and curiosity
Abstract
In natural behaviour, animals actively interrogate their environments using endogenously generated 'question-and-answer' strategies. However, in laboratory settings participants typically engage with externally imposed stimuli and tasks, and the mechanisms of active sampling remain poorly understood. We review a nascent neuroscientific literature that examines active-sampling policies and their relation to attention and curiosity. We distinguish between information sampling, in which organisms reduce uncertainty relevant to a familiar task, and information search, in which they investigate in an open-ended fashion to discover new tasks. We review evidence that both sampling and search depend on individual preferences over cognitive states, including attitudes towards uncertainty, learning progress and types of information. We propose that, although these preferences are non-instrumental and can on occasion interfere with external goals, they are important heuristics that allow organisms to cope with the high complexity of both sampling and search, and generate curiosity-driven investigations in large, open environments in which rewards are sparse and ex ante unknown.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Because agents find pleasure in reducing manageable uncertainty, they are attracted to just-uncertain-enough environments.
“Research has shown that because agents find pleasure in reducing manageable uncertainty, they are attracted to just-uncertain-enough environments”
From Active inference goes to school: the importance of active learning in the age of large language models (2024) · cites this paper as [51]
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Conflict, arousal, and curiosity.
Berlyne, D. E. (1960) · McGraw-Hill Book Company · doi:10.1037/11164-000 · Cited by 6,018 · see citing works
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844 · see citing works
The psychology of curiosity: A review and reinterpretation.
Loewenstein, G. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.1.75 · Cited by 2,738 · see citing works
Sweet anticipation: music and the psychology of expectation
Huron, D., Marcus, R., Pearce, T., & Müllensiefen, D. (2007) · Choice Reviews Online · doi:10.5860/choice.44-4368 · Cited by 1,830 · see citing works
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works
Temporal Resolution of Uncertainty and Dynamic Choice Theory
Kreps, D. M., & Porteus, E. L. (1978) · Econometrica · doi:10.2307/1913656 · Cited by 1,753 · see citing works
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · see citing works
Visual fixations and the computation and comparison of value in simple choice
Krajbich, I., Armel, C., & Rangel, A. (2010) · Nature Neuroscience · doi:10.1038/nn.2635 · Cited by 1,408 · see citing works
Anticipation and the Valuation of Delayed Consumption
Loewenstein, G. F. (1987) · The Economic Journal · doi:10.2307/2232929 · Cited by 1,361 · see citing works
Surfing Uncertainty: Prediction, Action, and the Embodied Mind
Clark, A. (2016) · doi:10.1093/acprof:oso/9780190217013.001.0001 · Cited by 1,358 · see citing works
Huron, D. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/6575.001.0001 · Cited by 1,337 · see citing works
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · see citing works
(2015) · Cited by 1,141 · see citing works
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works
Self-citationCohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121 · see citing works
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077 · see citing works
Attention, intention, and priority in the parietal lobe
Bisley, J. W., & Goldberg, M. E. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152823 · Cited by 1,043 · see citing works
The Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026 · see citing works
Berlyne, D. E. (1954) · British Journal of Psychology General Section · doi:10.1111/j.2044-8295.1954.tb01243.x · Cited by 930 · see citing works
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
The Power of Interest for Motivation and Engagement
Renninger, K. A., & Hidi, S. E. (2015) · Routledge eBooks · doi:10.4324/9781315771045 · Cited by 919 · see citing works
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882 · see citing works
Optimal eye movement strategies in visual search
Najemnik, J., & Geisler, W. S. (2005) · Nature · doi:10.1038/nature03390 · Cited by 841 · see citing works
Psychological Expected Utility Theory and Anticipatory Feelings
Caplin, A., & Leahy, J. V. (2001) · The Quarterly Journal of Economics · doi:10.1162/003355301556347 · Cited by 812 · see citing works
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784 · see citing works
Self-citationEye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775 · see citing works
States of Curiosity Modulate Hippocampus-Dependent Learning via the Dopaminergic Circuit
Gruber, M. J., Gelman, B. D., & Charan Ranganath, A. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.060 · Cited by 742 · see citing works
Exploring the Psychology of Interest
Silvia, P. J. (2006) · doi:10.1093/acprof:oso/9780195158557.001.0001 · Cited by 734 · see citing works
Précis of Simple heuristics that make us smart
Todd, P. M., & Gigerenzer, G. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003447 · Cited by 718 · see citing works
Reward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606 · see citing works
A tutorial on Bayesian nonparametric models
Gershman, S. J., & Blei, D. M. (2011) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2011.08.004 · Cited by 606 · see citing works
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548 · see citing works
The Emerging Neuroscience of Intrinsic Motivation: A New Frontier in Self-Determination Research
Di Domenico, S. I., & Ryan, R. M. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00145 · Cited by 542 · see citing works
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 542 · see citing works
Revealed Preference, Rational Inattention, and Costly Information Acquisition
Caplin, A., & Dean, M. R. W. (2015) · American Economic Review · doi:10.1257/aer.20140117 · Cited by 532 · see citing works
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528 · see citing works
Associative processes in intuitive judgment
Morewedge, C. K., & Kahneman, D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.004 · Cited by 492 · see citing works
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 489 · see citing works
Alison Gopnik, C. (2012) · Science · doi:10.1126/science.1223416 · Cited by 469 · see citing works
Active learning of inverse models with intrinsically motivated goal exploration in robots
Baranès, A., & Oudeyer, P. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.05.008 · Cited by 466 · see citing works
Self-citationA visual salience map in the primate frontal eye field
Thompson, K. G., & Bichot, N. P. (2005) · Progress in Brain Research · doi:10.1016/s0079-6123(04)47019-8 · Cited by 431 · see citing works
Neurocomputational mechanisms underlying subjective valuation of effort costs
Chong, T. T.-J., Apps, M., Giehl, K., Sillence, A., Grima, L. L., & Husain, M. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002598 · Cited by 415 · see citing works
The attention habit: how reward learning shapes attentional selection
Anderson, B. A. (2015) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12957 · Cited by 406 · see citing works
Predictions and the brain: how musical sounds become rewarding
Salimpoor, V. N., Zald, D. H., Zatorre, R. J., Dagher, A., & McIntosh, A. R. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.001 · Cited by 404 · see citing works
Perceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 388 · see citing works
Intrinsically Motivated Learning in Natural and Artificial Systems
Baldassarre, G., & Mirolli, M. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1 · Cited by 380 · see citing works
The prefrontal cortex and the executive control of attention
Rossi, A. F., Pessoa, L., Desimone, R., & Ungerleider, L. G. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1642-z · Cited by 378 · see citing works
Metacognitive Judgments and Control of Study
Metcalfe, J. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01628.x · Cited by 374 · see citing works
The Attentional Drift-Diffusion Model Extends to Simple Purchasing Decisions
Krajbich, I. M., Lu, D., Camerer, C. F., & Rangel, A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00193 · Cited by 362 · see citing works
The free energy principle for action and perception: A mathematical review
Buckley, C. L., Kim, C. S., McGregor, S., & Seth, A. K. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.09.004 · Cited by 352 · see citing works
Active Inference, Curiosity and Insight
Friston, K. J., Lin, M., Frith, C., Pezzulo, G., Hobson, J. A., & Ondobaka, S. (2017) · Neural Computation · doi:10.1162/neco_a_00999 · Cited by 347 · see citing works
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339 · see citing works
Eyetracking and selective attention in category learning
Rehder, B., & Hoffman, A. B. (2005) · Cognitive Psychology · doi:10.1016/j.cogpsych.2004.11.001 · Cited by 315 · see citing works
Blanchard, T. C., Hayden, B. Y., & Bromberg-Martin, E. S. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.050 · Cited by 301 · see citing works
Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments
Leong, Y. C., Radulescu, A., Daniel, R., DeWoskin, V., & Niv, Y. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.040 · Cited by 294 · see citing works
The under-appreciated drive for sense-making
Nick Chater, A., & Loewenstein, G. F. (2015) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2015.10.016 · Cited by 272 · see citing works
Curiosity and reward: Valence predicts choice and information prediction errors enhance learning.
Marvin, C. B., & Daphna Shohamy, A. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000140 · Cited by 263 · see citing works
Neural mechanisms underlying the induction and relief of perceptual curiosity
Jepma, M., Verdonschot, R. G., van Steenbergen, H., Rombouts, S. A. R. B., & Nieuwenhuis, S. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00005 · Cited by 262 · see citing works
Finding Useful Questions: On Bayesian Diagnosticity, Probability, Impact, and Information Gain.
Nelson, J. D. (2005) · Psychological Review · doi:10.1037/0033-295x.112.4.979 · Cited by 255 · see citing works
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · see citing works
Self-citationInformation gaps: A theory of preferences regarding the presence and absence of information.
Golman, R., & Loewenstein, G. F. (2016) · Decision · doi:10.1037/dec0000068 · Cited by 233 · see citing works
Vossel, S., Thiel, C. M., & Fink, G. R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.019 · Cited by 228 · see citing works
Reward modulates attention independently of action value in posterior parietal cortex
Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-09.2009 · Cited by 219 · see citing works
Self-citationEye movement statistics in humans are consistent with an optimal search strategy
Najemnik, J., & Geisler, W. S. (2008) · Journal of Vision · doi:10.1167/8.3.4 · Cited by 208 · see citing works
An information theory account of cognitive control
Fan, J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00680 · Cited by 203 · see citing works
Neural Mechanisms of Incentive Salience in Naturalistic Human Vision
Hickey, C., & Peelen, M. V. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.049 · Cited by 201 · see citing works
Musical pleasure and reward: mechanisms and dysfunction
Zatorre, R. J. (2015) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12677 · Cited by 194 · see citing works
Where to look next? Eye movements reduce local uncertainty
Renninger, L. W., Verghese, P., & Coughlan, J. M. (2007) · Journal of Vision · doi:10.1167/7.3.6 · Cited by 192 · see citing works
Intrinsic Valuation of Information in Decision Making under Uncertainty
Bennett, D., Bode, S., Brydevall, M., Warren, H. A., & Murawski, C. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005020 · Cited by 186 · see citing works
Infants’ preferences for native speakers are associated with an expectation of information
Begus, K., Gliga, T., & Southgate, V. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1603261113 · Cited by 181 · see citing works
Top–Down Attentional Deficits in Macaques with Lesions of Lateral Prefrontal Cortex
Rossi, A. F., Bichot, N. P., Desimone, R., & Ungerleider, L. G. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2939-07.2007 · Cited by 173 · see citing works
Moulin-Frier, C., Nguyen, S., & Oudeyer, P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01006 · Cited by 172 · see citing works
Self-citationAttention, Reward, and Information Seeking
Gottlieb, J., Hayhoe, M., Hikosaka, O., & Rangel, A. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3270-14.2014 · Cited by 168 · see citing works
Self-citationNeurobiological basis of individual variation in stimulus-reward learning
Flagel, S. B., & Robinson, T. E. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.12.004 · Cited by 165 · see citing works
A causal role for right frontopolar cortex in directed, but not random, exploration
Zajkowski, W. K., Kossut, M. M., & Wilson, R. C. (2017) · eLife · doi:10.7554/elife.27430 · Cited by 164 · see citing works
Reward Guides Vision when It's Your Thing: Trait Reward-Seeking in Reward-Mediated Visual Priming
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014087 · Cited by 164 · see citing works
Is it better to select or to receive? Learning via active and passive hypothesis testing.
Markant, D. B., & Gureckis, T. M. (2013) · Journal of Experimental Psychology General · doi:10.1037/a0032108 · Cited by 157 · see citing works
Induction and Relief of Curiosity Elicit Parietal and Frontal Activity
van Lieshout, L. L. F., Vandenbroucke, A. R. E., Müller, N. C. J., Cools, R., & de Lange, F. P. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.2816-17.2018 · Cited by 151 · see citing works
Computational Complexity and Human Decision-Making
Bossaerts, P. L., & Murawski, C. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.09.005 · Cited by 151 · see citing works
Inferring Relevance in a Changing World
Wilson, R. C., & Niv, Y. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00189 · Cited by 150 · see citing works
Charting the expansion of strategic exploratory behavior during adolescence.
Somerville, L. H., Sasse, S. F., Garrad, M. C., Drysdale, A. T., Akar, N. A., Insel, C., & Wilson, R. C. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000250 · Cited by 147 · see citing works
Spatial attention, precision, and Bayesian inference: a study of saccadic response speed
Vossel, S., Mathys, C., Daunizeau, J., Bauer, M., Driver, J., Friston, K. J., & Stephan, K. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs418 · Cited by 146 · see citing works
In search of the neural circuits of intrinsic motivation
Kaplan, F. (2007) · Frontiers in Neuroscience · doi:10.3389/neuro.01.1.1.017.2007 · Cited by 139 · see citing works
Irrational choice and the value of information
Vasconcelos, M., Monteiro, T., & Kacelnik, A. (2015) · Scientific Reports · doi:10.1038/srep13874 · Cited by 139 · see citing works
Eye movements reveal epistemic curiosity in human observers
Baranès, A., Oudeyer, P., & Gottlieb, J. P. (2015) · Vision Research · doi:10.1016/j.visres.2015.10.009 · Cited by 136 · see citing works
Self-citationCurious eyes: Individual differences in personality predict eye movement behavior in scene-viewing
Risko, E. F., Anderson, N., Lanthier, S. N., & Kingstone, A. F. (2011) · Cognition · doi:10.1016/j.cognition.2011.08.014 · Cited by 127 · see citing works
Modeling Task Control of Eye Movements
Hayhoe, M., & Ballard, D. H. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.020 · Cited by 125 · see citing works
Park, J., Shimojo, E., & Shinsuke Shimojo, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1004374107 · Cited by 122 · see citing works
The neural encoding of information prediction errors during non-instrumental information seeking
Brydevall, M., Bennett, D., Murawski, C., & Bode, S. (2018) · Scientific Reports · doi:10.1038/s41598-018-24566-x · Cited by 117 · see citing works
Arousal-related adjustments of perceptual biases optimize perception in dynamic environments
Krishnamurthy, K., Nassar, M. R., Sarode, S., & Gold, J. I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0107 · Cited by 117 · see citing works
Active sensing in the categorization of visual patterns
Yang, S., Lengyel, M., & Wolpert, D. (2016) · eLife · doi:10.7554/elife.12215 · Cited by 112 · see citing works
The modulation of savouring by prediction error and its effects on choice
Iigaya, K., Story, G. W., Kurth-Nelson, Z. L., Dolan, R. J., & Dayan, P. (2016) · eLife · doi:10.7554/elife.13747 · Cited by 110 · see citing works
Multi-Armed Bandits for Intelligent Tutoring SystemsPreprint
Clement, B., Roy, D., Oudeyer, P., & Lopes, M. C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.3174 · Cited by 107 · see citing works
Self-citationNelson, J. D., McKenzie, C. R. M., Cottrell, G. W., & B, T. J. S. A. (2010) · Psychological Science · doi:10.1177/0956797610372637 · Cited by 105 · see citing works
Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex
Ebitz, R. B., Albarran, E., & Moore, T. (2017) · Neuron · doi:10.1016/j.neuron.2017.12.007 · Cited by 101 · see citing works
Visual Decision-Making in an Uncertain and Dynamic World
Gold, J. I., & Stocker, A. A. (2017) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111815-114511 · Cited by 100 · see citing works
Cortical coupling reflects Bayesian belief updating in the deployment of spatial attention
Vossel, S., Mathys, C., Stephan, K. E., & Friston, K. J. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1382-15.2015 · Cited by 99 · see citing works
The renaissance of belief-based utility in economics
Loewenstein, G. F., & Molnár, A. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0301-z · Cited by 96 · see citing works
Daddaoua, N., Lopes, M. C., & Gottlieb, J. P. (2016) · Scientific Reports · doi:10.1038/srep20202 · Cited by 89 · see citing works
Self-citationBaranès, A., Oudeyer, P., & Gottlieb, J. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00317 · Cited by 85 · see citing works
Self-citationAsking the right questions about the psychology of human inquiry: Nine open challenges
Coenen, A., Nelson, J. D., & Gureckis, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1470-5 · Cited by 84 · see citing works
Selective overweighting of larger magnitudes during noisy numerical comparison
Spitzer, B., Waschke, L., & Summerfield, C. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0145 · Cited by 83 · see citing works
The role of uncertainty and reward on eye movements in a virtual driving task
Sullivan, B. T., Johnson, L., Rothkopf, C. A., Ballard, D., & Hayhoe, M. (2012) · Journal of Vision · doi:10.1167/12.13.19 · Cited by 81 · see citing works
Metacognitive Control and Optimal Learning
Son, L., & Sethi, R. (2006) · Cognitive Sciences · doi:10.1207/s15516709cog0000_74 · Cited by 79 · see citing works
Visualization of unsteady viscous flow around turbine blade
Jimbo, T., Biswas, D., Yokono, Y., & Niizeki, Y. (2008) · Journal of Visualization · doi:10.1007/bf03181903 · Cited by 78 · see citing works
Parietal neurons encode expected gains in instrumental information
Foley, N. C., Kelly, S. P., Mhatre, H., Lopes, M. C., & Gottlieb, J. P. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1613844114 · Cited by 76 · see citing works
Self-citationNovelty vs. Familiarity Principles in Preference Decisions: Task-Context of Past Experience Matters
Liao, H., Yeh, S., & Shinsuke Shimojo, A. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00043 · Cited by 75 · see citing works
Experimental Testing of Intrinsic Preferences for NonInstrumental Information
Eliaz, K., & Schotter, A. (2007) · American Economic Review · doi:10.1257/aer.97.2.166 · Cited by 72 · see citing works
Human Visual Search Does Not Maximize the Post-Saccadic Probability of Identifying Targets
Morvan, C., & Maloney, L. T. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002342 · Cited by 67 · see citing works
Martín, R. S., Appelbaum, L. G., Huettel, S. A., & Woldorff, M. G. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu160 · Cited by 66 · see citing works
Predicting human visuomotor behaviour in a driving task
Johnson, L. M., Sullivan, B. T., Hayhoe, M., & Ballard, D. H. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0044 · Cited by 64 · see citing works
Novelty Enhances Visual Salience Independently of Reward in the Parietal Lobe
Foley, N. C., Jangraw, D. C., Peck, C., & Gottlieb, J. P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4171-13.2014 · Cited by 63 · see citing works
Self-citationRobust averaging protects decisions from noise in neural computations
Li, V., Castañón, S. H., Solomon, J. A., Vandormael, H., & Summerfield, C. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005723 · Cited by 63 · see citing works
Approach-Induced Biases in Human Information Sampling
Hunt, L. T., Rutledge, R. B., Malalasekera, W. M. N., Kennerley, S. W., & Dolan, R. J. (2016) · PLOS Biology · doi:10.1371/journal.pbio.2000638 · Cited by 60 · see citing works
Valence, Not Utility, Underlies Reward-Driven Prioritization in Human Vision
Barbaro, L., Peelen, M. V., & Hickey, C. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1128-17.2017 · Cited by 55 · see citing works
Gottlieb, J. P. (2017) · Cortex · doi:10.1016/j.cortex.2017.08.019 · Cited by 49 · see citing works
Self-citationAttention as foraging for information and value
Manohar, S., & Husain, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00711 · Cited by 45 · see citing works
Human representation of visuo-motor uncertainty as mixtures of orthogonal basis distributions
Zhang, H., Daw, N. D., & Maloney, L. T. (2015) · Nature Neuroscience · doi:10.1038/nn.4055 · Cited by 39 · see citing works
Asking better questions: How presentation formats influence information search.
Wu, C. M., Meder, B., Filimon, F., & Nelson, J. D. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000374 · Cited by 35 · see citing works
Kenjereš, S., & Hanjalić, K. (2004) · Journal of Visualization · doi:10.1007/bf03181477 · Cited by 35 · see citing works
A Neural Correlate of Motivational Conflict in the Superior Colliculus of the Macaque
Isoda, M., & Hikosaka, O. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90275.2008 · Cited by 31 · see citing works
Güçlütürk, Y., Güçlü, U., van Gerven, M. A. J., & van Lier, R. (2018) · Scientific Reports · doi:10.1038/s41598-018-21636-y · Cited by 26 · see citing works
Ting, L. L. (2005) · Journal of Visualization · doi:10.1007/bf03181593 · Cited by 24 · see citing works
Developmental learning for Intelligent Tutoring Systems
Clement, B., Roy, D., Oudeyer, P., & Lopes, M. C. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6983019 · Cited by 23 · see citing works
Self-citationEfficient saccade planning requires time and clear choices
Ghahghaei, S., & Verghese, P. (2015) · Vision Research · doi:10.1016/j.visres.2015.05.006 · Cited by 21 · see citing works
Neural Correlates of Temporal Credit Assignment in the Parietal Lobe
Gersch, T. M., Foley, N. C., Eisenberg, I. W., & Gottlieb, J. P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088725 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Process Account of Curiosity and Interest: A Reward-Learning Perspective
Murayama, K., FitzGibbon, L., & Sakaki, M. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09499-9 · Cited by 306 · see citing works
Murayama, K. (2022) · Psychological Review · doi:10.1037/rev0000349 · Cited by 331 · see citing works
Hierarchical motor control in mammals and machines
Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274 · see citing works
Gruber, M. J., & Charan Ranganath, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.10.003 · Cited by 264 · see citing works
When Is More Uncertainty Better? A Model of Uncertainty Regulation and Effectiveness
Griffin, M. A., & Grote, G. (2020) · Academy of Management Review · doi:10.5465/amr.2018.0271 · Cited by 223 · see citing works
Balancing exploration and exploitation with information and randomization
Wilson, R. C., Bonawitz, E. B., Costa, V. D., & Ebitz, R. B. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.10.001 · Cited by 215 · see citing works
The past, present, and future of selection history
Anderson, B. A., Kim, H., Kim, A. J., Liao, M., Mrkonja, L., Clement, A., & Grégoire, L. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.004 · Cited by 197 · see citing works
Diverse motives for human curiosity
Kobayashi, K., Ravaioli, S., Baranès, A., Woodford, M., & Gottlieb, J. P. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0589-3 · Cited by 157 · see citing works
Self-citationDuan, H., Fernández, G., van Dongen, E. V., & Kohn, N. (2020) · Brain Structure and Function · doi:10.1007/s00429-020-02074-x · Cited by 170 · see citing works
Two Distinct Types of Eye-Head Coupling in Freely Moving Mice
Meyer, A. F., O'Keefe, J. M., & Poort, J. (2020) · Current Biology · doi:10.1016/j.cub.2020.04.042 · Cited by 162 · see citing works
Juechems, K., & Summerfield, C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.012 · Cited by 147 · see citing works
On the roles of function and selection in evolving systems
Wong, M. L., Cleland, C. E., Arend, D., Bartlett, S., Cleaves, H. J., Demarest, H., Prabhu, A., Lunine, J. I., & Hazen, R. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2310223120 · Cited by 165 · see citing works
Spatial modulation of hippocampal activity in freely moving macaques
Mao, D., Avila, E., Caziot, B., Laurens, J., Dickman, J. D., & Angelaki, D. E. (2021) · Neuron · doi:10.1016/j.neuron.2021.09.032 · Cited by 131 · see citing works
Fixation patterns in simple choice reflect optimal information sampling
Callaway, F., Rangel, A., & Griffiths, T. L. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008863 · Cited by 141 · see citing works
Play in predictive minds: A cognitive theory of play.
Andersen, M. M., Kiverstein, J., Miller, M., & Roepstorff, A. (2023) · Psychological Review · doi:10.1037/rev0000369 · Cited by 122 · see citing works
Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks
Lau, J. K. L., Ozono, H., Kuratomi, K., Komiya, A., & Murayama, K. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0848-3 · Cited by 124 · see citing works
Learning action-oriented models through active inference
Tschantz, A., Seth, A. K., & Buckley, C. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007805 · Cited by 121 · see citing works
Development of directed and random exploration in children
Meder, B., Wu, C. M., Schulz, E., & Ruggeri, A. (2021) · Developmental Science · doi:10.1111/desc.13095 · Cited by 114 · see citing works
Cultivating an understanding of curiosity as a seed for creativity
Gross, M. E., Zedelius, C. M., & Schooler, J. W. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.015 · Cited by 114 · see citing works
Hunters, busybodies and the knowledge network building associated with deprivation curiosity
Lydon‐Staley, D. M., Zhou, D., Sizemore, A. E., Zurn, P., & Bassett, D. S. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00985-7 · Cited by 109 · see citing works
Formalizing planning and information search in naturalistic decision-making
Hunt, L. T., Daw, N. D., Kaanders, P., MacIver, M. A., Mugan, U., Procyk, E., Redish, A. D., Russo, E., Scholl, J., Stachenfeld, K., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00866-w · Cited by 107 · see citing works
Akiti, K., Tsutsui‐Kimura, I., Xie, Y., Mathis, A., Markowitz, J. E., Anyoha, R., Datta, S. R., Mathis, M. W., Uchida, N., & Watabe‐Uchida, M. (2022) · Neuron · doi:10.1016/j.neuron.2022.08.022 · Cited by 100 · see citing works
Play, Curiosity, and Cognition
Chu, J., & Schulz, L. E. (2020) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-070120-014806 · Cited by 93 · see citing works
Humans monitor learning progress in curiosity-driven exploration
Ten, A., Kaushik, P., Oudeyer, P. Y., & Gottlieb, J. P. (2021) · Nature Communications · doi:10.1038/s41467-021-26196-w · Cited by 97 · see citing works
Self-citationThe seductive lure of curiosity: information as a motivationally salient reward
FitzGibbon, L., Lau, J. K. L., & Murayama, K. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.05.014 · Cited by 94 · see citing works
Energization and Direction Are Both Essential Parts of Motivation
Elliot, A. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197662359.003.0002 · Cited by 91 · see citing works
Curiosity as a Metacognitive Feeling
Goupil, L., & Proust, J. (2023) · Cognition · doi:10.1016/j.cognition.2022.105325 · Cited by 89 · see citing works
Gao, H., Ou, Y., Zhang, Z., Ni, M., Zhou, X., & Liao, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.573779 · Cited by 84 · see citing works
Dogmatism manifests in lowered information search under uncertainty
Schulz, L., Rollwage, M., Dolan, R. J., & Fleming, S. M. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2009641117 · Cited by 76 · see citing works
Colas, C., Karch, T., Sigaud, O., & Oudeyer, P. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13554 · Cited by 101 · see citing works
Self-citationParietal neurons encode information sampling based on decision uncertainty
Horan, M., Daddaoua, N., & Gottlieb, J. P. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0440-1 · Cited by 75 · see citing works
Self-citationCuriosity and the dynamics of optimal exploration
Poli, F., O’Reilly, J. X., Mars, R. B., & Hunnius, S. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.02.001 · Cited by 79 · see citing works
Dubourg, E., & Baumard, N. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000923 · Cited by 71 · see citing works
Eye Movements as a Window into Decision-Making
Spering, M. (2022) · Annual Review of Vision Science · doi:10.1146/annurev-vision-100720-125029 · Cited by 63 · see citing works
The Next 50 Years of Neuroscience
Altimus, C. M., Marlin, B. J., Charalambakis, N., Colón-Rodríguez, A., Glover, E. J., Izbicki, P., Johnson, A. C., Lourenco, M. V., Makinson, R. A., McQuail, J. A., et al. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0744-19.2019 · Cited by 67 · see citing works
Supporting curiosity in schools and classrooms
Peterson, E. G. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.05.006 · Cited by 66 · see citing works
The neuroscience of active learning and direct instruction
Dubinsky, J. M., & Hamid, A. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105737 · Cited by 101 · see citing works
Intrinsic reward: potential cognitive and neural mechanisms
Blain, B., & Sharot, T. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.008 · Cited by 57 · see citing works
Stupacher, J., Matthews, T. E., Pando‐Naude, V., Elst, O. F. V., & Vuust, P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.906190 · Cited by 56 · see citing works
A taxonomy of surprise definitions
Modirshanechi, A., Brea, J., & Gerstner, W. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2022.102712 · Cited by 60 · see citing works
Choosing to view morbid information involves reward circuitry
Oosterwijk, S., Snoek, L., Koppele, J. T., Engelbert, L. H., & Scholte, H. S. (2020) · Scientific Reports · doi:10.1038/s41598-020-71662-y · Cited by 58 · see citing works
Curiosity, information demand and attentional priority
Gottlieb, J. P., Cohanpour, M., Li, Y., Singletary, N. M., & Zabeh, E. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.016 · Cited by 54 · see citing works
Self-citationLatent learning, cognitive maps, and curiosity
Wang, M. Z., & Hayden, B. Y. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.06.003 · Cited by 58 · see citing works
Visual novelty, curiosity, and intrinsic reward in machine learning and the brain
Jaegle, A., Mehrpour, V., & Rust, N. C. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.08.004 · Cited by 54 · see citing works
BND*-DDQN: Learn to Steer Autonomously Through Deep Reinforcement Learning
Wu, K., Wang, H., Esfahani, M. A., & Yuan, S. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2928820 · Cited by 54 · see citing works
Safron, A. (2021) · Entropy · doi:10.3390/e23060783 · Cited by 52 · see citing works
Frömer, R., & Shenhav, A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.12.006 · Cited by 50 · see citing works
Monosov, I. E., & Rushworth, M. F. S. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01079-2 · Cited by 48 · see citing works
Systems neuroscience of curiosity
Cervera, R. L., Wang, M. Z., & Hayden, B. Y. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.06.011 · Cited by 56 · see citing works
To know, to feel, to share? Exploring the motives that drive curiosity for negative content
Niehoff, E., & Oosterwijk, S. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.012 · Cited by 51 · see citing works
Curiosity and the economics of attention
Wojtowicz, Z., & Loewenstein, G. F. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.09.002 · Cited by 51 · see citing works
Visual affects: Linking curiosity, Aha-Erlebnis, and memory through information gain
de Cruys, S. V., Damiano, C., Boddez, Y., Król, M. E., Goetschalckx, L., & Wagemans, J. P. (2021) · Cognition · doi:10.1016/j.cognition.2021.104698 · Cited by 50 · see citing works
Learning progress mediates the link between cognitive effort and task engagement
Sayalı, C., Heling, E., & Cools, R. (2023) · Cognition · doi:10.1016/j.cognition.2023.105418 · Cited by 52 · see citing works
Curiosity-driven exploration: foundations in neuroscience and computational modeling
Modirshanechi, A., Kondrakiewicz, K., Gerstner, W., & Haesler, S. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2023.10.002 · Cited by 48 · see citing works
The role of rewards in motivation—Beyond dichotomies
Bardach, L., & Murayama, K. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102056 · Cited by 72 · see citing works
Palmer, D. D., Dumont, J. R., Dexter, T. D., Prado, M. A. M., Finger, E. C., Bussey, T. J., & Saksida, L. M. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107443 · Cited by 52 · see citing works
An active inference model of hierarchical action understanding, learning and imitation
Proietti, R., Pezzulo, G., & Tessari, A. (2023) · Physics of Life Reviews · doi:10.1016/j.plrev.2023.05.012 · Cited by 47 · see citing works
The ventral striatum dissociates information expectation, reward anticipation, and reward receipt
Filimon, F., Nelson, J. D., B, T. J. S. A., Sereno, M. I., & Cottrell, G. W. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911778117 · Cited by 46 · see citing works
Naïve to expert: Considering the role of previous knowledge in memory
Alonso, A., van der Meij, J., Tse, D., & Genzel, L. (2020) · Brain and Neuroscience Advances · doi:10.1177/2398212820948686 · Cited by 46 · see citing works
Finding a balance: modulatory effects of positive affect on attentional and cognitive control
Paul, K., Pourtois, G., van Steenbergen, H., Gable, P. A., & Dreisbach, G. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.002 · Cited by 44 · see citing works
The computational cost of active information sampling before decision-making under uncertainty
Petitet, P., Attaallah, B., Manohar, S., & Masud Husain, B. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01116-6 · Cited by 43 · see citing works
Curiosity or savouring? Information seeking is modulated by both uncertainty and valence
van Lieshout, L. L. F., Traast, I. J., de Lange, F. P., & Cools, R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257011 · Cited by 44 · see citing works
Uncertainty increases curiosity, but decreases happiness
van Lieshout, L. L. F., de Lange, F. P., & Cools, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-93464-6 · Cited by 44 · see citing works
Attentional economics links value-modulated attentional capture and decision-making
Pearson, D., Watson, P., Albertella, L., & Pelley, M. E. L. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00053-z · Cited by 45 · see citing works
The Lure of Counterfactual Curiosity: People Incur a Cost to Experience Regret
FitzGibbon, L., Komiya, A., & Murayama, K. (2021) · Psychological Science · doi:10.1177/0956797620963615 · Cited by 40 · see citing works
Curiosity in childhood and adolescence — what can we learn from the brain
Gruber, M., & Fandakova, Y. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.031 · Cited by 35 · see citing works
Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making
He, X., Modirshanechi, A., Lehmann, M. P., Gerstner, W., & Herzog, M. H. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009070 · Cited by 45 · see citing works
Curiosity: The effects of feedback and confidence on the desire to know.
Metcalfe, J., Vuorre, M., Towner, E., & Eich, T. S. (2022) · Journal of Experimental Psychology General · doi:10.1037/xge0001284 · Cited by 38 · see citing works
Apathy is associated with reduced precision of prior beliefs about action outcomes.
Hezemans, F. H., Wolpe, N., & Rowe, J. B. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000739 · Cited by 37 · see citing works
The thermodynamic brain and the evolution of intellect: the role of mental energy
Déli, É., & Kisvárday, Z. F. (2020) · Cognitive Neurodynamics · doi:10.1007/s11571-020-09637-y · Cited by 36 · see citing works
If it's important, then I’m curious: Increasing perceived usefulness stimulates curiosity
Dubey, R., Griffiths, T. L., & Lombrozo, T. (2022) · Cognition · doi:10.1016/j.cognition.2022.105193 · Cited by 36 · see citing works
Human-AI joint task performance: Learning from uncertainty in autonomous driving systems
Constantinides, P., Monteiro, E., & Mathiassen, L. (2024) · Information and Organization · doi:10.1016/j.infoandorg.2024.100502 · Cited by 36 · see citing works
Delis, I., Ince, R. A. A., Sajda, P., & Wang, Q. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.0861-21.2022 · Cited by 34 · see citing works
Language and culture internalization for human-like autotelic AI
Colas, C., Karch, T., Moulin-Frier, C., & Oudeyer, P.-Y. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00591-4 · Cited by 34 · see citing works
Self-citationLiu, Y., Long, T., Zhang, L., Wang, Y., Zhang, X., & Li, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3373378 · Cited by 34 · see citing works
A Neurocomputational Model for Intrinsic Reward
Chew, B., Blain, B., Dolan, R. J., & Rutledge, R. B. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0858-20.2021 · Cited by 40 · see citing works
Humans actively sample evidence to support prior beliefs
Kaanders, P., Sepúlveda, P., Folke, T., Ortoleva, P., & Martino, B. D. (2022) · eLife · doi:10.7554/elife.71768 · Cited by 43 · see citing works
A Reinforcement Meta-Learning Framework of Executive Function and Information Demand
Silvetti, M., Lasaponara, S., Daddaoua, N., Horan, M., & Gottlieb, J. P. (2021) · Neural Networks · doi:10.1016/j.neunet.2022.10.004 · Cited by 29 · see citing works
Self-citationCapturing, clarifying, and consolidating the curiosity-creativity connection
Koutstaal, W., Kedrick, K., & Gonzalez-Brito, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-19694-4 · Cited by 31 · see citing works
Eye movements reveal spatiotemporal dynamics of visually-informed planning in navigation
Zhu, S. L., Lakshminarasimhan, K. J., Arfaei, N., & Angelaki, D. E. (2022) · eLife · doi:10.7554/elife.73097 · Cited by 30 · see citing works
Murphy, C., Dehmelt, V., Yonelinas, A. P., Charan Ranganath, A., & Gruber, M. J. (2021) · Learning & Memory · doi:10.1101/lm.052241.120 · Cited by 30 · see citing works
Medial Frontal Cortex Activity Predicts Information Sampling in Economic Choice
Kaanders, P., Nili, H., O'Reilly, J. X., & Hunt, L. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.0392-21.2021 · Cited by 27 · see citing works
Naturalistic neuroscience and virtual reality
Thurley, K. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.896251 · Cited by 28 · see citing works
The effect of information gap and uncertainty on curiosity and its resolution
Singh, A., & Manjaly, J. A. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2021.1908311 · Cited by 29 · see citing works
Strategically managing learning during perceptual decision making
Masis, J. A., Chapman, T., Rhee, J. Y., Cox, D., & Saxe, A. (2023) · eLife · doi:10.7554/elife.64978 · Cited by 39 · see citing works
Deep Active Inference and Scene Construction
Heins, R. C., Mirza, M. B., Parr, T., Friston, K. J., Kagan, I., & Pooresmaeili, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.509354 · Cited by 27 · see citing works
How the conception of control influences our understanding of actions
Floegel, M., Kasper, J., Perrier, P., & Kell, C. A. (2023) · Nature reviews. Neuroscience · doi:10.1038/s41583-023-00691-z · Cited by 32 · see citing works
Learning action-oriented models through active inferencePreprint
Tschantz, A., Seth, A. K., & Buckley, C. L. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/764969 · Cited by 28 · see citing works
Poli, F., Ghilardi, T., Beijers, R., de Weerth, C., Hinne, M., Mars, R. B., & Hunnius, S. (2023) · Developmental Science · doi:10.1111/desc.13460 · Cited by 27 · see citing works
Bidirectional influences of information sampling and concept learning.
Braunlich, K., & Love, B. C. (2021) · Psychological Review · doi:10.1037/rev0000287 · Cited by 27 · see citing works
Hunters, busybodies, and the knowledge network building associated with curiosityPreprint
Lydon‐Staley, D. M., Zhou, D., Blevins, A. S., Zurn, P., & Bassett, D. S. (2019) · doi:10.31234/osf.io/undy4 · Cited by 27 · see citing works
(2023) · doi:10.1093/oso/9780197662359.001.0001 · Cited by 30 · see citing works
Humans actively sample evidence to support prior beliefs.
Kaanders, P., Sepúlveda, P., Folke, T., Ortoleva, P., & Martino, B. D. (2021) · UCL Discovery (University College London) · doi:10.17863/cam.83863 · Cited by 26 · see citing works
Surprise and novelty in the brain
Modirshanechi, A., Becker, S., Brea, J., & Gerstner, W. (2023) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2023.102758 · Cited by 29 · see citing works
Empowerment contributes to exploration behaviour in a creative video game
Brändle, F., Stocks, L. J., Tenenbaum, J. B., Gershman, S. J., & Schulz, E. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01661-2 · Cited by 34 · see citing works
Neurocomputational mechanisms underlying the subjective value of information
Goh, A. X.-A., Bennett, D., Bode, S., & Chong, T. T. ‐. (2021) · Communications Biology · doi:10.1038/s42003-021-02850-3 · Cited by 25 · see citing works
The Quest for Simplicity in Human Learning: Identifying the Constraints on Attention
Galdo, M., Weichart, E. R., Sloutsky, V., & Turner, B. M. (2022) · Cognitive Psychology · doi:10.1016/j.cogpsych.2022.101508 · Cited by 13 · see citing works
Computational cross‐species views of the hippocampal formation
Zhu, S. L., Lakshminarasimhan, K. J., & Angelaki, D. E. (2023) · Hippocampus · doi:10.1002/hipo.23535 · Cited by 24 · see citing works
Feeling-of-knowing experiences breed curiosity
Brooks, G., Yang, H., & Köhler, S. (2021) · Memory · doi:10.1080/09658211.2020.1867746 · Cited by 24 · see citing works
Remembering the Past to See the Future
Rust, N. C., & Palmer, S. E. (2021) · Annual Review of Vision Science · doi:10.1146/annurev-vision-093019-112249 · Cited by 24 · see citing works
- Authors
- Gottlieb, J., & Oudeyer, P.-Y.
- Affiliations
- Mortimer B. Zuckerman Mind Brain Behavior Institute (US)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Corresponding author
- Gottlieb, Jacqueline
- Venue
- Nature Reviews Neuroscience
- Published
- 2018-11-05
- Volume
- 19
- Issue
- 12
- Pages
- 758-770
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2899529983
- Cited by
- 494
- References
- 128
- Citations by year
- 2026: 39 · 2025: 68 · 2024: 53 · 2023: 136 · 2022: 49 · 2021: 67 · 2020: 55 · 2019: 26 · 2017: 1
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- Funders
- National Eye Institute (P30EY019007)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychological and Educational Research Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- active sampling, curiosity, information sampling, information search, attention, uncertainty, cognitive states, exploration, learning progress, sparse rewards, open environments
- MeSH terms
- Animals, Attention, Brain, Cognition, Exploratory Behavior, Humans, Neurosciences, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
