Dopamine modulates novelty seeking behavior during decision making.
Open accessAbstract
Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These triggers and states include novelty and other violations of expectations, active video game play, stress, and risk.
“These triggers and states include novelty and other violations of expectations (Costa, Tran, Turchi, & Averbeck, 2014;Duzel, Bunzeck, Guitart-Masip, & Duzel, 2010;Murty & Adcock, 2014), active video game play (Koepp et al., 1998), stress (Lighthall, Gorlik, Schoeke, Frank, & Mather, 2013), and risk (Schultz, 2010).”
From Optimizing performance through intrinsic motivation and attention for learning: The OPTIMAL theory of motor learning (2016) · cites this paper as Costa et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Philosophical transactions of the Royal Society of London. B
Press, H. (1886) · Cited by 10,087 · see citing works
Applied linear statistical models : regression, analysis of variance, and experimental designs
Neter, J., Wasserman, W., & Kutner, M. (1974) · Andalas University Repository (Andalas University) · Cited by 2,847 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964 · see citing works
The principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592 · see citing works
Impulsivity, compulsivity, and top-down cognitive control
Dalley, J. W., Everitt, B. J., & Robbins, T. W. (2011) · Neuron · doi:10.1016/j.neuron.2011.01.020 · Cited by 1,589 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Controlling low-level image properties: The SHINE toolbox
Willenbockel, V., Sadr, J., Fiset, D., Horne, G. O., Gosselin, F., & Tanaka, J. W. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.671 · Cited by 1,166 · see citing works
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · see citing works
Cohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Kreek, M. J., Nielsen, D. A., Butelman, E. R., & LaForge, K. S. (2005) · Nature Neuroscience · doi:10.1038/nn1583 · Cited by 1,024 · see citing works
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Neter, J., Wasserman, W., & Kutner, M. (1990) · Cited by 635 · see citing works
Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629 · see citing works
Neuronal basis of sequential foraging decisions in a patchy environment
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2011) · Nature Neuroscience · doi:10.1038/nn.2856 · Cited by 513 · see citing works
Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503 · see citing works
Hyperactivity and impaired response habituation in hyperdopaminergic mice
Zhuang, X., Oosting, R. S., Jones, S. R., Gainetdinov, R. R., Miller, G. W., Caron, M. G., & Hen, R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.4.1982 · Cited by 493 · see citing works
Wills, T. A., Vaccaro, D., & McNamara, G. (1994) · Journal of Substance Abuse · doi:10.1016/s0899-3289(94)90039-6 · Cited by 480 · see citing works
Dopamine: generalization and bonuses
Kakade, S. M., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 477 · see citing works
Dopamine D4 Receptor-Knock-Out Mice Exhibit Reduced Exploration of Novel Stimuli
Dulawa, S. C., Grandy, D. K., Low, M. J., Paulus, M. P., & Geyer, M. A. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09550.1999 · Cited by 432 · see citing works
Structural and metabolic brain changes in the striatum associated with methamphetamine abuse
Chang, L., Alicata, D., Ernst, T. M., & Volkow, N. D. (2007) · Addiction · doi:10.1111/j.1360-0443.2006.01782.x · Cited by 431 · see citing works
Lewis, D. A., Melchitzky, D. S., Sesack, S. R., Whitehead, R. E., Auh, S., & Sampson, A. (2001) · Journal of Comparative Neurology · doi:10.1002/cne.1092 · Cited by 352 · see citing works
Animal Foraging and the Evolution of Goal‐Directed Cognition
Hills, T. T. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_50 · Cited by 331 · see citing works
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards
Robinson, S., Sandstrom, S. M., Denenberg, V. H., & Palmiter, R. D. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.5 · Cited by 247 · see citing works
A controlled, powerful multiple-comparison strategy for several situations.
Levin, J. R., Serlin, R. C., & Seaman, M. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.153 · Cited by 246 · see citing works
Kahlig, K. M., & Galli, A. (2003) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2003.08.065 · Cited by 230 · see citing works
Housden, C. R., O’Sullivan, S. S., Joyce, E. M., Lees, A. J., & Roiser, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.84 · Cited by 176 · see citing works
Tonic Dopamine Modulates Exploitation of Reward Learning
Beeler, J. A., Daw, N. D., Frazier, C. R. M., & Zhuang, X. (2010) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2010.00170 · Cited by 173 · see citing works
Controls of tonic and phasic dopamine transmission in the dorsal and ventral striatum
Zhang, L., Doyon, W. M., Clark, J. J., Phillips, P. E. M., & Dani, J. A. (2009) · Molecular Pharmacology · doi:10.1124/mol.109.056317 · Cited by 161 · see citing works
Cilia, R., Ko, J. H., Cho, S. S., van Eimeren, T., Marotta, G., Pellecchia, G., Pezzoli, G., Antonini, A., & Strafella, A. P. (2010) · Neurobiology of Disease · doi:10.1016/j.nbd.2010.03.013 · Cited by 158 · see citing works
A flexible software tool for temporally-precise behavioral control in Matlab
Asaad, W. F., & Eskandar, E. N. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2008.07.014 · Cited by 153 · see citing works
Cocaine alters cerebral metabolism within the ventral striatum and limbic cortex of monkeys
Huston-Lyons, D., Friedman, D. P., Nader, M. A., & Porrino, L. J. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-03-01230.1996 · Cited by 120 · see citing works
Relationship between dopamine system genes and extraversion and novelty seeking
Голимбет, В. Е., Алфимова, М. В., Gritsenko, I. K., & Ebstein, R. P. (2007) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-007-0058-8 · Cited by 105 · see citing works
Neural mechanisms of acquired phasic dopamine responses in learning
Hazy, T. E., Frank, M. J., & O’Reilly, R. C. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.019 · Cited by 103 · see citing works
A common mechanism for adaptive scaling of reward and novelty
Bunzeck, N., Dayan, P., Dolan, R. J., & Düzel, E. (2010) · Human Brain Mapping · doi:10.1002/hbm.20939 · Cited by 99 · see citing works
Leroy, C., Karila, L., Martinot, J., Lukasiewicz, M., Duchesnay, É., Comtat, C., Dollé, F., Benyamina, A., Eric Artiges, A., Ribeiro, M. J., et al. (2011) · Addiction Biology · doi:10.1111/j.1369-1600.2011.00356.x · Cited by 91 · see citing works
Risk and learning in impulsive and nonimpulsive patients with Parkinson's disease
Djamshidian, A., Jha, A., O’Sullivan, S. S., Silveira‐Moriyama, L., Jacobson, C., Brown, P., Lees, A. J., & Averbeck, B. B. (2010) · Movement Disorders · doi:10.1002/mds.23247 · Cited by 90 · see citing works
Self-citationBandit processes and dynamic allocation indicesPreprint
Gittens, J. C. (2010) · RePEc: Research Papers in Economics · Cited by 86 · see citing works
Novelty seeking behaviour in Parkinson's disease
Djamshidian, A., O’Sullivan, S. S., Wittmann, B. C., Lees, A. J., & Averbeck, B. B. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.04.026 · Cited by 81 · see citing works
Self-citationGlowa, J. R., Wojnicki, F. H. E., Matecka, D., Rice, K. C., & Rothman, R. B. (1995) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.3.3.232 · Cited by 61 · see citing works
Søgaard, U., MICHALOW, J., BUTLER, B., Laursen, A. L., INGERSEN, S. H., Skrumsager, B. K., & Rafaelsen, O. J. (1990) · International Clinical Psychopharmacology · doi:10.1097/00004850-199010000-00001 · Cited by 61 · see citing works
Reed, P., Mitchell, C., & Nokes, T. (1996) · Animal Learning & Behavior · doi:10.3758/bf03198952 · Cited by 59 · see citing works
Czoty, P., Justice, J. B., & Howell, L. (2000) · Psychopharmacology · doi:10.1007/s002130050054 · Cited by 57 · see citing works
Viewing preferences of rhesus monkeys related to memory for complex pictures, colours and faces
Wilson, F. A. W., & Goldman‐Rakic, P. S. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90066-3 · Cited by 52 · see citing works
Averbeck, B. B., Djamshidian, A., O’Sullivan, S. S., Housden, C. R., Roiser, J. P., & Lees, A. J. (2013) · Behavioral Neuroscience · doi:10.1037/a0032079 · Cited by 48 · see citing works
Self-citationTsukada, H., Harada, N., Nishiyama, S., Ohba, H., & Kakiuchi, T. (2000) · Brain Research · doi:10.1016/s0006-8993(00)02057-6 · Cited by 40 · see citing works
The drive to strive: goal generation based on current needs
Murray, E. A., & Rudebeck, P. H. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00112 · Cited by 37 · see citing works
Laatikainen, L. M., Sharp, T., Bannerman, D. M., Harrison, P. J., & Tunbridge, E. M. (2012) · Journal of Psychopharmacology · doi:10.1177/0269881112454228 · Cited by 33 · see citing works
Mitz, A. R. (2005) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2005.07.012 · Cited by 33 · see citing works
A controlled, powerful multiple-comparison strategy for several situations.
Levin, J. R., Serlin, R. C., & Seaman, M. A. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.1.153 · Cited by 33 · see citing works
Rangel‐Gomez, M., Hickey, C., van Amelsvoort, T., Bet, P. M., & Meeter, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066469 · Cited by 31 · see citing works
Eriksson, O., Långström, B., & Josephsson, R. (2011) · Upsala Journal of Medical Sciences · doi:10.3109/03009734.2011.563878 · Cited by 4 · see citing works
Bubser, M., & Deutch, A. Y. (1999) · Synapse · doi:10.1002/(sici)1098-2396(199904)32:1
Flagged first, then by citations
Research works printed but not linked: 1
- Stephens David W Krebs JR 1986 Foraging theory Princeton, N.J Princeton University Press
Cited by
Sorted by citations
Wulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238 · see citing works
Resynthesizing behavior through phylogenetic refinement
Cisek, P. (2019) · Attention Perception & Psychophysics · doi:10.3758/s13414-019-01760-1 · Cited by 294 · see citing works
Neuroscience of Internet Pornography Addiction: A Review and Update
Love, T., Laier, C., Brand, M., Hatch, L., & Hajela, R. (2015) · Behavioral Sciences · doi:10.3390/bs5030388 · Cited by 262 · see citing works
A Primer on Foraging and the Explore/Exploit Trade-Off for Psychiatry Research
Addicott, M. A., Pearson, J. M., Sweitzer, M. M., Barack, D. L., & Platt, M. L. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.108 · Cited by 219 · see citing works
Balancing exploration and exploitation with information and randomization
Wilson, R. C., Bonawitz, E. B., Costa, V. D., & Ebitz, R. B. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.10.001 · Cited by 215 · see citing works
Self-citationSemaglutide reduces alcohol intake and relapse-like drinking in male and female rats
Aranäs, C., Edvardsson, C. E., Shevchouk, O. T., Zhang, Q., Witley, S., Blid Sköldheden, S., Zentveld, L., Vallöf, D., Tufvesson-Alm, M., & Jerlhag, E. (2023) · eBioMedicine · doi:10.1016/j.ebiom.2023.104642 · Cited by 158 · see citing works
Charting the expansion of strategic exploratory behavior during adolescence.
Somerville, L. H., Sasse, S. F., Garrad, M. C., Drysdale, A. T., Akar, N. A., Insel, C., & Wilson, R. C. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000250 · Cited by 147 · see citing works
Open-Label Placebo: Reflections on a Research Agenda
Kaptchuk, T. J. (2018) · Perspectives in biology and medicine · doi:10.1353/pbm.2018.0045 · Cited by 150 · see citing works
The importance of nutrition in aiding recovery from substance use disorders: a review
Jeynes, K. D., & Gibson, E. L. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.07.006 · Cited by 142 · see citing works
The psychology of novelty in memorable tourism experiences
Skavronskaya, L., Moyle, B., Scott, N., & Kralj, A. (2019) · Current Issues in Tourism · doi:10.1080/13683500.2019.1664422 · Cited by 138 · see citing works
The Cambridge Handbook of Personality Psychology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822 · Cited by 140 · see citing works
Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning
Costa, V. D., Monte, O. D., Lucas, D. R., Murray, E. A., & Averbeck, B. B. (2016) · Neuron · doi:10.1016/j.neuron.2016.09.025 · Cited by 133 · see citing works
Self-citationSubcortical Substrates of Explore-Exploit Decisions in Primates
Costa, V. D., Mitz, A. R., & Averbeck, B. B. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.017 · Cited by 131 · see citing works
Self-citationDopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2020) · eLife · doi:10.7554/elife.51260 · Cited by 121 · see citing works
Novelty seeking is linked to openness and extraversion, and can lead to greater creative performance
Gocłowska, M. A., Ritter, S. M., Elliot, A. J., & Baas, M. (2019) · Journal of Personality · doi:10.1111/jopy.12387 · Cited by 145 · see citing works
Theory of Choice in Bandit, Information Sampling and Foraging Tasks
Averbeck, B. B. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004164 · Cited by 105 · see citing works
Self-citationDopamine blockade impairs the exploration-exploitation trade-off in rats
Cinotti, F., Fresno, V., Aklil, N., Coutureau, É., Girard, B., Marchand, A. R., & Khamassi, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-43245-z · Cited by 94 · see citing works
A primate temporal cortex–zona incerta pathway for novelty seeking
Ogasawara, T., Sogukpinar, F., Zhang, K., Feng, Y.-Y., Pai, J., Jezzini, A., & Monosov, I. E. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00950-1 · Cited by 96 · see citing works
Dopamine neurons learn relative chosen value from probabilistic rewards
Lak, A., Stauffer, W. R., & Schultz, W. (2016) · eLife · doi:10.7554/elife.18044 · Cited by 87 · see citing works
Neural circuitry of information seeking
Bromberg-Martin, E. S., & Monosov, I. E. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.006 · Cited by 89 · see citing works
Temperament and brain networks of attention
Posner, M. I., & Rothbart, M. K. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0254 · Cited by 87 · see citing works
The neurocomputational bases of explore-exploit decision-making
Hogeveen, J., Mullins, T. S., Romero, J. D., Eversole, E., Rogge-Obando, K., Mayer, A. R., & Costa, V. D. (2022) · Neuron · doi:10.1016/j.neuron.2022.03.014 · Cited by 84 · see citing works
Self-citationPersonality and Parkinson's disease: A meta-analysis
Santangelo, G., Garramone, F., Baiano, C., D’Iorio, A., Piscopo, F., Raimo, S., & Vitale, C. (2018) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2018.01.013 · Cited by 84 · see citing works
Yu, H., Liu, P., Huang, X., & Cao, Y. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.596582 · Cited by 80 · see citing works
Human complex exploration strategies are enriched by noradrenaline-modulated heuristics
Dubois, M., Habicht, J., Michely, J., Moran, R., Dolan, R. J., & Hauser, T. U. (2021) · eLife · doi:10.7554/elife.59907 · Cited by 76 · see citing works
Novelty–variety as a candidate basic psychological need: New evidence across three studies
Bagheri, L., & Milyavskaya, M. (2020) · Motivation and Emotion · doi:10.1007/s11031-019-09807-4 · Cited by 74 · see citing works
Dubourg, E., & Baumard, N. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000923 · Cited by 71 · see citing works
Huang, F., Tang, S., Sun, P., & Luo, J. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.01.070 · Cited by 71 · see citing works
Primate Orbitofrontal Cortex Codes Information Relevant for Managing Explore–Exploit Tradeoffs
Costa, V. D., & Averbeck, B. B. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2355-19.2020 · Cited by 60 · see citing works
Self-citation(Reinforcement?) Learning to forage optimally
Kolling, N., & Akam, T. E. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.008 · Cited by 58 · see citing works
Ballou, S., Kaptchuk, T. J., Hirsch, W., Nee, J. W., Iturrino, J., Hall, K. T., Kelley, J. M., Cheng, V., Kirsch, I., Jacobson, E., et al. (2017) · Trials · doi:10.1186/s13063-017-1964-x · Cited by 56 · see citing works
Dopamine Modulates the Efficiency of Sensory Evidence Accumulation During Perceptual Decision Making
Beste, C., Adelhöfer, N., Gohil, K., Passow, S., Roessner, V., & Li, S. (2018) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyy019 · Cited by 54 · see citing works
López‐Cruz, L., Carbo‐Gas, M., Pardo, M., Bayarri, P., Valverde, O., Ledent, C. A., Salamone, J. D., & Correa, M. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.12.020 · Cited by 56 · see citing works
Liking as a balance between synchronization, complexity and novelty
Ravreby, I., Shilat, Y., & Yeshurun, Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-06610-z · Cited by 54 · see citing works
Kaiser, R. H., Treadway, M. T., Wooten, D., Kumar, P., Goer, F., Murray, L., Beltzer, M., Pechtel, P., Whitton, A. E., Cohen, A. L., et al. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx281 · Cited by 50 · see citing works
Lloyd, A., McKay, R., Sebastian, C. L., & Balsters, J. H. (2021) · Developmental Science · doi:10.1111/desc.13075 · Cited by 49 · see citing works
HIV-1 proteins dysregulate motivational processes and dopamine circuitry
Bertrand, S. J., Mactutus, C. F., Harrod, S. B., Moran, L. M., & Booze, R. M. (2018) · Scientific Reports · doi:10.1038/s41598-018-25109-0 · Cited by 40 · see citing works
Curiosity: primate neural circuits for novelty and information seeking
Monosov, I. E. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00784-9 · Cited by 44 · see citing works
Cremer, A., Kalbe, F., Müller, J. C., Wiedemann, K., & Schwabe, L. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01517-9 · Cited by 39 · see citing works
Exploring Visual Selective Attention towards Novel Stimuli in Alzheimer's Disease Patients
Chau, S. A., Herrmann, N., Eizenman, M., Chung, J., & Lanctôt, K. L. (2015) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000442383 · Cited by 40 · see citing works
Cultural distance and international tourists’ intention to visit a destination
Bi, J., & Gu, C. (2019) · Asia Pacific Journal of Tourism Research · doi:10.1080/10941665.2019.1635503 · Cited by 39 · see citing works
Reinforcement learning links spontaneous cortical dopamine impulses to reward
Foo, C., Lozada, A. F., Aljadeff, J., Li, Y., Wang, J. W., Slesinger, P. A., & Kleinfeld, D. (2021) · Current Biology · doi:10.1016/j.cub.2021.06.069 · Cited by 36 · see citing works
Sethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36 · see citing works
Naderi, M., Jamwal, A., Ferrari, M. C. O., Niyogi, S., & Chivers, D. P. (2016) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2016.01.002 · Cited by 34 · see citing works
Tang, H., Costa, V. D., Bartolo, R., & Averbeck, B. B. (2022) · Cell Reports · doi:10.1016/j.celrep.2021.110198 · Cited by 36 · see citing works
Self-citationArenas, M. C., Aguilar, M. A., Montagud‐Romero, S., Mateos-García, A., Navarro-Francés, C. I., Miñarro, J., & Rodríguez‐Arias, M. (2015) · Current Neuropharmacology · doi:10.2174/1570159x13666150921112841 · Cited by 33 · see citing works
Ben‐Eliyahu, A., & Zeidner, M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.041 · Cited by 33 · see citing works
Hills, T. T., & Butterfill, S. (2015) · Current Zoology · doi:10.1093/czoolo/61.2.368 · Cited by 32 · see citing works
Distinct roles for dopamine clearance mechanisms in regulating behavioral flexibility
Korn, C., Akam, T. E., Jensen, K. H. R., Vagnoni, C., Huber, A., Tunbridge, E. M., & Walton, M. E. (2021) · Molecular Psychiatry · doi:10.1038/s41380-021-01194-y · Cited by 32 · see citing works
López‐Cruz, L., Miguel, N. S., Bayarri, P., Baqi, Y., Müller, C. E., Salamone, J. D., & Correa, M. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00206 · Cited by 32 · see citing works
What is dopamine doing in model-based reinforcement learning?
Akam, T. E., & Walton, M. E. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.10.010 · Cited by 31 · see citing works
Decision making: effects of methylphenidate on temporal discounting in nonhuman primates
Rajala, A. Z., Jenison, R. L., & Populin, L. C. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00278.2015 · Cited by 25 · see citing works
Individual differences in exploration and persistence: Grit and beliefs about ability and reward
Dale, G., Sampers, D., Loo, S., & Green, C. S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203131 · Cited by 30 · see citing works
Adaptive Response Theory: An Evolutionary Framework for Clinical Research in Art Therapy
Kaimal, G. (2019) · Art Therapy · doi:10.1080/07421656.2019.1667670 · Cited by 29 · see citing works
DeYoung, C. G., & Blain, S. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.026 · Cited by 31 · see citing works
Reactivating hippocampal-mediated memories during reconsolidation to disrupt fear
Grella, S. L., Fortin, A. H., Ruesch, E. A., Bladon, J. H., Reynolds, L. F., Gross, A., Shpokayte, M., Cincotta, C., Zaki, Y., & Ramirez, S. (2022) · Nature Communications · doi:10.1038/s41467-022-32246-8 · Cited by 30 · see citing works
Zonisamide inhibits monoamine oxidase and enhances motor performance and social activity
Uemura, M. T., Asano, T., Hikawa, R., Yamakado, H., & Takahashi, R. (2017) · Neuroscience Research · doi:10.1016/j.neures.2017.05.008 · Cited by 28 · see citing works
Finasteride inhibited brain dopaminergic system and open‐field behaviors in adolescent male rats
Li, L., Kang, Y., Ji, X., Li, Y., Li, S., Zhang, X., Cui, H., & Shi, G. (2017) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.12781 · Cited by 28 · see citing works
Parr, A. C., Sydnor, V. J., Calabro, F. J., & Luna, B. (2024) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2024.101399 · Cited by 27 · see citing works
Ardanı, A. R., Naghibzadeh, B., Hosseini, F. F., Asadpour, Z., & Khabazianzadeh, F. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.06.035 · Cited by 27 · see citing works
Kokhan, V. S., Lebedeva-Georgievskaya, K. B., Кудрин, В. С., Bazyan, A. S., Maltsev, A. V., & Shtemberg, A. S. (2018) · Life Sciences in Space Research · doi:10.1016/j.lssr.2018.11.003 · Cited by 27 · see citing works
Baas, M., Nijstad, B. A., Koen, J., Boot, N. C., & Dreu, C. K. W. D. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000223 · Cited by 27 · see citing works
Parasubthalamic calretinin neurons modulate wakefulness associated with exploration in male mice
Guo, H., Jiang, J.-B., Xu, W., Zhang, M.-T., Chen, H., Shi, H., Wang, L., He, M., Lazarus, M., Li, S., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37797-y · Cited by 26 · see citing works
Models of neuromodulation for computational psychiatry
Iglesias, S., Tomiello, S., Schneebeli, M., & Stephan, K. E. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1420 · Cited by 26 · see citing works
Early Visual Foraging in Relationship to Familial Risk for Autism and Hyperactivity/Inattention
Gliga, T., Smith, T. J., Likely, N., Charman, T., & Johnson, M. H. (2015) · Journal of Attention Disorders · doi:10.1177/1087054715616490 · Cited by 26 · see citing works
Goal commitment is supported by vmPFC through selective attention
Holton, E., Grohn, J., Ward, H., Manohar, S., O’Reilly, J. X., & Kolling, N. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01844-5 · Cited by 24 · see citing works
Smith, C. T., Juan, M. D. S., Dang, L. C., Katz, D. T., Perkins, S. F., Burgess, L. L., Cowan, R. L., Manning, H. C., Nickels, M. L., Claassen, D. O., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0328-y · Cited by 24 · see citing works
Reisenzein, R., Hildebrandt, A., & Weber, H. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.009 · Cited by 26 · see citing works
Jach, H. K., Cools, R., Frisvold, A., Grubb, M. A., Hartley, C. A., Hartmann, J., Hunter, L., Jia, R., de Lange, F. P., Larisch, R., et al. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2415236121 · Cited by 35 · see citing works
Gambling Phenotypes in Online Sports Betting
Granero, R., Jiménez‐Múrcia, S., del Pino‐Gutiérrez, A., Mora‐Maltas, B., Valenciano‐Mendoza, E., Baenas, I., Gómez‐Peña, M., Moragas, L., Codina, E., López-González, H., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00482 · Cited by 23 · see citing works
A Curiosity-Based Learning Method for Spiking Neural Networks
Shi, M., Zhang, T., & Zeng, Y. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00007 · Cited by 22 · see citing works
A role for adaptive developmental plasticity in learning and decision making
Lin, W. C., Delevich, K. M., & Wilbrecht, L. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.010 · Cited by 24 · see citing works
Neural mechanisms of information seeking
Kobayashi, K., & Kable, J. W. (2024) · Neuron · doi:10.1016/j.neuron.2024.04.008 · Cited by 24 · see citing works
The value of novelty in schizophrenia
Martinelli, C., Rigoli, F., Averbeck, B. B., & Shergill, S. S. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2017.05.007 · Cited by 22 · see citing works
Self-citationJahn, C. I., Varazzani, C., Sallet, J., Walton, M. E., & Bouret, S. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa089 · Cited by 21 · see citing works
Maladaptive explore/exploit trade-offs in schizophrenia
Speers, L. J., & Bilkey, D. K. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2023.02.001 · Cited by 17 · see citing works
Zhang, G., Li, S., Kang, Y., Che, J., Cui, R., Song, S., Cui, H., & Shi, G. (2016) · Hormones and Behavior · doi:10.1016/j.yhbeh.2016.02.001 · Cited by 19 · see citing works
Exploratory preferences explain the human fascination for imaginary worlds in fictional stories
Dubourg, E., Thouzeau, V., de Dampierre, C., Mogoutov, A., & Baumard, N. (2023) · Scientific Reports · doi:10.1038/s41598-023-35151-2 · Cited by 19 · see citing works
Yildirim, B. O., & Derksen, J. J. L. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.07.005 · Cited by 18 · see citing works
Dopamine disruption increases cleanerfish cooperative investment in novel client partners
Soares, M. C., Santos, T. P., & Messias, J. P. M. (2017) · Royal Society Open Science · doi:10.1098/rsos.160609 · Cited by 17 · see citing works
Kurzina, N. P., Volnova, A. B., Aristova, I., & Gainetdinov, R. R. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.654469 · Cited by 17 · see citing works
Stimulus Novelty Energizes Actions in the Absence of Explicit Reward
Koster, R., Seow, T. X. F., Dolan, R. J., & Düzel, E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159120 · Cited by 15 · see citing works
Distinct motivations to seek out information in healthy individuals and problem gamblers
Dezza, I. C., Noël, X., Cleeremans, A., & Yu, A. J. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01523-3 · Cited by 16 · see citing works
Porcelli, S., Marsano, A., Caletti, E., Sala, M., Abbiati, V., Bellani, M., Perlini, C., Rossetti, M. G., Mandolini, G. M., Pigoni, A., et al. (2017) · Neuropsychobiology · doi:10.1159/000490955 · Cited by 15 · see citing works
Robinson, M. D., & Sedikides, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.031 · Cited by 17 · see citing works
The Five-Factor Model of Personality: Consensus and Controversy
McCrae, R. R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.013 · Cited by 18 · see citing works
Understanding sensory regulation in typical and atypical development: The case of sensory seeking
Piccardi, E. S., & Gliga, T. (2022) · Developmental Review · doi:10.1016/j.dr.2022.101037 · Cited by 15 · see citing works
Liang, Z., Zhao, Q., Zhou, Z., Yu, Q., Li, S., & Chen, S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.601548 · Cited by 16 · see citing works
Aloi, J. M., Crum, K. I., Blair, K. S., Zhang, R., Bashford‐Largo, J., Bajaj, S., Schwartz, A., Carollo, E., Hwang, S., Leiker, E., et al. (2021) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2021.100944 · Cited by 15 · see citing works
Self-citationAbdominal vagal deafferentation alters affective behaviors in rats
Klarer, M., Weber‐Stadlbauer, U., Arnold, M., Langhans, W., & Meyer, U. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.04.015 · Cited by 15 · see citing works
Adaptive Decision‐Making “Fast” and “Slow”: A Model of Creative Thinking
Khalil, R., & Brüne, M. (2025) · European Journal of Neuroscience · doi:10.1111/ejn.70024 · Cited by 17 · see citing works
Song, M. R., & Lee, S. W. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.03.005 · Cited by 13 · see citing works
The dopamine circuit as a reward-taxis navigation system
Karin, O., & Alon, U. S. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010340 · Cited by 14 · see citing works
White, S. F., Tyler, P. M., Botkin, M. L., Erway, A. K., Thornton, L. C., Kolli, V. B., Pope, K., Meffert, H., & Blair, J. (2016) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2016.08.010 · Cited by 14 · see citing works
Exploratory preferences explain the cultural success of imaginary worlds in modern societiesPreprint
Dubourg, E., Thouzeau, V., de Dampierre, C., & Baumard, N. (2021) · doi:10.31234/osf.io/d9uqs · Cited by 14 · see citing works
Environmental uncertainty and the advantage of impulsive choice strategies
Burk, D. C., & Averbeck, B. B. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010873 · Cited by 13 · see citing works
Self-citationDistractibility and Impulsivity in ADHD as an Evolutionary Mismatch of High Trait Curiosity
Cunff, A. L. (2024) · Evolutionary Psychological Science · doi:10.1007/s40806-024-00400-8 · Cited by 17 · see citing works
Riding the elephant in the room: Towards a revival of the optimal level of stimulation model
de Aldecoa, P. I., Burdett, E., & Gustafsson, E. (2022) · Developmental Review · doi:10.1016/j.dr.2022.101051 · Cited by 15 · see citing works
Taylor, W. C. (2021) · Journal of Aging and Physical Activity · doi:10.1123/japa.2020-0360 · Cited by 13 · see citing works
Ianni, A. M., Eisenberg, D. P., Boorman, E. D., Constantino, S. M., Hegarty, C. E., Gregory, M. D., Masdeu, J. C., Kohn, P. D., Behrens, T. E. J., & Berman, K. F. (2023) · Nature Communications · doi:10.1038/s41467-023-41897-0 · Cited by 12 · see citing works
- Authors
- Costa, V. D., Tran, V. L., Turchi, J., & Averbeck, B. B.
- Affiliations
- National Institutes of Health (US)
- Venue
- Behavioral Neuroscience
- Published
- 2014
- Volume
- 128
- Issue
- 5
- Pages
- 556-566
- ISSN
- 0735-7044 (ISSN-L)
- 1939-0084
- PMC
- PMC5861725
- OpenAlex
- W2133403871
- Cited by
- 263
- References
- 54
- Citations by year
- 2026: 13 · 2025: 20 · 2024: 22 · 2023: 16 · 2022: 41 · 2021: 16 · 2020: 60 · 2019: 14 · 2018: 18 · 2017: 14 · 2016: 19 · 2015: 10
- FWCI
- 6.56
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Behavioral Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- dopamine, novelty seeking, decision-making, dopamine transporter, GBR 12909, exploration-exploitation, reinforcement learning models, impulsivity, behavioral addiction, dopamine reuptake
- MeSH terms
- Animals, Choice Behavior, Dopamine, Exploratory Behavior, Macaca mulatta, Male, Models, Psychological, Neuropsychological Tests, Piperazines, Probability, Reinforcement, Psychology, Dopamine Uptake Inhibitors, Dopamine Plasma Membrane Transport Proteins
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
