The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
Open accessAbstract
Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Experimental Tests of the Endowment Effect and the Coase Theorem
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1990) · Journal of Political Economy · doi:10.1086/261737 · Cited by 3,194 · cited 2×
“Pavlovian interference likely contributes to many quirks of behaviour such as impulsivity [12], framing and [13], endowment effects [14] and many other ‘‘anomalies’’ [15], including neurological [16–19] and psychiatric diseases [20–26].”
BackgroundExperimental Tests of the Endowment Effect and the Coase Theorem
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (2000) · Behavioral Law and Economics · doi:10.1017/cbo9781139175197.009 · Cited by 2,873
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationPredictably irrational: the hidden forces that shape our decisions
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0969 · Cited by 2,514
Manual for the state-trait anxiety inventory (form Y) : "self-evaluation questionnaire"
Spielberger, C. D., Gorsuch, R. L., & Lushene, R. E. (1970) · Consulting Psychologists Press eBooks · Cited by 2,352
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Self-citationRelation of cue to consequence in avoidance learning
Garcia, J., & Koelling, R. A. (1966) · Psychonomic Science · doi:10.3758/bf03342209 · Cited by 1,975
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
The Neuropsychology of Anxiety: An enquiry into the function of the septo-hippocampal system
Gray, J. A., & McNaughton, N. (2003) · doi:10.1093/acprof:oso/9780198522713.001.0001 · Cited by 1,928
On the generality of the laws of learning.
Seligman, M. E. (1970) · Psychological Review · doi:10.1037/h0029790 · Cited by 1,744
Species-specific defense reactions and avoidance learning
Bolles, R. C. (1970) · Psychological Review · doi:10.1037/h0028589 · Cited by 1,610
Frames, Biases, and Rational Decision-Making in the Human Brain
De Martino, B., Kumaran, D., Seymour, B., & Dolan, R. J. (2006) · Science · doi:10.1126/science.1128356 · Cited by 1,590
Self-citationTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Self-citationStochastic models for learning.
Bush, R. R., & Mosteller, F. (1955) · John Wiley & Sons, Inc. eBooks · doi:10.1037/14496-000 · Cited by 1,511
Robinson, T. E., & Berridge, K. C. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145237 · Cited by 1,509
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 5×
“The functional architecture of responding involves two fundamental components that are behaviourally [1] and computationally [2] separable: Pavlovian and instrumental.”
BackgroundInfluentialIkemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Some quantitative properties of anxiety.
Estes, W. K., & Skinner, B. F. (1941) · Journal of Experimental Psychology · doi:10.1037/h0062283 · Cited by 1,349
A two-dimensional neuropsychology of defense: fear/anxiety and defensive distance
McNaughton, N., & Corr, P. J. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.03.005 · Cited by 1,308
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 1×
“Dopamine may have a dominant influence in this: it is both known to be released, and influential, in some aversive settings [82–85] and has a more evident relationship to vigour [33,34].”
BackgroundSelf-citationColumnar organization in the midbrain periaqueductal gray: modules for emotional expression?
Bandler, R., & Shipley, M. T. (1994) · Trends in Neurosciences · doi:10.1016/0166-2236(94)90047-7 · Cited by 1,051
Long story short: the serotonin transporter in emotion regulation and social cognition
Canli, T., & Lesch, K.-P. (2007) · Nature Neuroscience · doi:10.1038/nn1964 · Cited by 1,034
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Neuroleptics and operant behavior: The anhedonia hypothesis
Wise, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00010372 · Cited by 1,016
5-HT and mechanisms of defence
Deakin, J. F. W., & Graeff, F. G. (1991) · Journal of Psychopharmacology · doi:10.1177/026988119100500414 · Cited by 1,010
Reconciling the role of central serotonin neurons in human and animal behavior
Soubrié, P. (1986) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00022871 · Cited by 996
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Ainslie, G. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9781139164191 · Cited by 955
Contemporary Animal Learning Theory.
Abrahamson, D. (1981) · Europe PMC (PubMed Central) · Cited by 945
Frank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 888
Cell type-specific loss of BDNF signaling mimics optogenetic control of cocaine reward
Lobo, M. K., Covington, H. E., Chaudhury, D., Friedman, A. K., Sun, H., Damez-Werno, D., Dietz, D. M., Zaman, S., Koo, J. W., Kennedy, P. J., et al. (2010) · Science · doi:10.1126/science.1188472 · Cited by 880
Information Theory, Inference, and Learning Algorithms
(2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.834752 · Cited by 866
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Self-citationPhasic excitation of dopamine neurons in ventral VTA by noxious stimuli
Brischoux, F., Chakraborty, S., Brierley, D. I., & Ungless, M. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0811507106 · Cited by 801
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764 · cited 1×
“Third, given dopamine’s established positive correlation with approach and PIT [87,88], we expect genetic polymorphisms that boost DA levels, such as the SLC6A3 polymorphism of the dopamine transporter [89], to increase the impact of appetitive Pavlovian stimuli on approach.”
BackgroundCoordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
AUTO‐MAINTENANCE IN THE PIGEON: SUSTAINED PECKING DESPITE CONTINGENT NON‐REINFORCEMENT2
Williams, D. R., & Williams, H. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-511 · Cited by 712
Amphetamine-induced dopamine release in human ventral striatum correlates with euphoria
Drevets, W. C., Gautier, C., Price, J. C., Kupfer, D. J., Kinahan, P. E., Grace, A. A., Price, J. L., & Mathis, C. A. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01038-6 · Cited by 706 · cited 1×
“Pavlovian interference likely contributes to many quirks of behaviour such as impulsivity [12], framing and [13], endowment effects [14] and many other ‘‘anomalies’’ [15], including neurological [16–19] and psychiatric diseases [20–26].”
BackgroundAnticipatory affect: neural correlates and consequences for choice
Knutson, B., & Greer, S. M. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0155 · Cited by 687
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
Narendra, K. S., & Thathachar, M. A. L. (1974) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1974.5408453 · Cited by 668
Serotoninergic regulation of emotional and behavioural control processes
Cools, R., Roberts, A. C., & Robbins, T. W. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.011 · Cited by 656
Self-citationInformationTheory, Inference, and Learning Algorithms
Mackay, D. J. C. (2003) · Cited by 648
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Hikida, T., Kimura, K., Wada, N., Funabiki, K., & Nakanishi, S. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.011 · Cited by 592 · cited 2×
“It should be noted, though, that, acting via the indirect path and D2 receptors, dopamine itself has also been suggested to be important in mediating ‘nogo’ behaviour due to punishments [18,53,79].”
BackgroundAlcohol promotes dopamine release in the human nucleus accumbens
Boileau, I., Assaad, J., Pihl, R. O., Benkelfat, C., Leyton, M., Diksic, M., Tremblay, R. E., & Dagher, A. (2003) · Synapse · doi:10.1002/syn.10226 · Cited by 591
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589
Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response.
Holland, P. C. (1977) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.3.1.77 · Cited by 561
Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557
Genotype Influences In Vivo Dopamine Transporter Availability in Human Striatum
Heinz, A. (2000) · Neuropsychopharmacology · doi:10.1016/s0893-133x(99)00099-8 · Cited by 538
Self-citationLearning and Behavior: A Contemporary Synthesis
Bouton, M. E. (2006) · Cited by 509
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Shear, M. K., Vander Bilt, J., Rucci, P., Endicott, J., Lydiard, B., Otto, M. W., Pollack, M. H., Chandler, L., Williams, J., Ali, A., et al. (2001) · Depression and Anxiety · doi:10.1002/da.1033 · Cited by 483
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464
Self-citationOpponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Self-citationThe misbehavior of value and the discipline of the will
Dayan, P., Niv, Y., Seymour, B., & D. Daw, N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.002 · Cited by 388
Self-citationSerotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
Self-citationHall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., & Everitt, B. J. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01577.x · Cited by 355
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 314
Human Pavlovian–Instrumental Transfer
Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4028-07.2008 · Cited by 301
Self-citationSuri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
Crockett, M. J., Clark, L., & Robbins, T. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2513-09.2009 · Cited by 271
Heinz, A. (2002) · European Psychiatry · doi:10.1016/s0924-9338(02)00628-4 · Cited by 270
Self-citationThe Neuropsychology of Anxiety
Gray, J. A. (1984) · Lehr-und Forschungstexte Psychologie · doi:10.1007/978-3-642-69631-2_5 · Cited by 270
Serotonin, inhibition, and negative mood
Dayan, P., & Huys, Q. J. M. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040004 · Cited by 263
Self-citation5-Hydroxytryptamine and punishment
TYE, N. C., EVERITT, B. J., & IVERSEN, S. D. (1977) · Nature · doi:10.1038/268741a0 · Cited by 232
Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus.
Lovibond, P. F. (1983) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.9.3.225 · Cited by 220
Dopamine is necessary for cue-dependent fear conditioning
Fadok, J. P., Dickerson, T. M. K., & Palmiter, R. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1616-09.2009 · Cited by 213
Inhibitory interactions between appetitive and aversive stimuli.
Dickinson, A., & Pearce, J. M. (1977) · Psychological Bulletin · doi:10.1037//0033-2909.84.4.690 · Cited by 209
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206
Auto-Shaping in Rats to the Presentation of Another Rat Predicting Food
Timberlake, W., & Grant, D. L. (1975) · Science · doi:10.1126/science.190.4215.690 · Cited by 202
Faure, A., Reynolds, S. M., Richard, J. M., & Berridge, K. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4961-07.2008 · Cited by 193
Neurogenetics and Pharmacology of Learning, Motivation, and Cognition
Frank, M. J., & Fossella, J. A. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.96 · Cited by 192
The Neural Mechanisms Underlying the Influence of Pavlovian Cues on Human Decision Making
Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0897-08.2008 · Cited by 179
Chase, H. W., Frank, M. J., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010) · Psychological Medicine · doi:10.1017/s0033291709990468 · Cited by 174
Cools, R., Robinson, O. J., & Sahakian, B. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301598 · Cited by 172
Self-citationOn the neural control of social emotional behavior
Roelofs, K., Minelli, A., Mars, R. B., van Peer, J. M., & Toni, I. (2008) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn036 · Cited by 171
Serotonergic Dysfunction, Negative Mood States, and Response to Alcohol
Heinz, A., Mann, K., Weinberger, D. R., & Goldman, D. (2001) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2001.tb02240.x · Cited by 167
Self-citationWICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165
The biological function of Pavlovian conditioning: The best defense is a good offense.
Hollis, K. L. (1984) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.10.4.413 · Cited by 163
Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms
Frank, M. J., & Hutchison, K. E. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.04.048 · Cited by 163
An approach through the looking-glass
Hershberger, W. A. (1986) · Animal Learning & Behavior · doi:10.3758/bf03200092 · Cited by 156
Serotonergic Dysfunction, Negative Mood States, and Response to Alcohol
Heinz, A., Mann, K. F., Weinberger, D. R., & Goldman, D. A. (2001) · Alcoholism Clinical and Experimental Research · doi:10.1097/00000374-200104000-00002 · Cited by 151
Self-citationPavlovian Processes in Consumer Choice: The Physical Presence of a Good Increases Willingness-to-Pay
Bushong, B., King, L. M., Camerer, C. F., & Rangel, A. (2010) · American Economic Review · doi:10.1257/aer.100.4.1556 · Cited by 144
Striatal Dopamine Responses to Intranasal Cocaine Self-Administration in Humans
Cox, S. M. L., Benkelfat, C., Dagher, A., Delaney, J. S., Durand, F., McKenzie, S. A., Kolivakis, T., Casey, K. F., & Leyton, M. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.01.021 · Cited by 142
Freezing as an avoidance response: Another look at the operant-respondent distinction
Bolles, R. C., & Riley, A. L. (1973) · Learning and Motivation · doi:10.1016/0023-9690(73)90016-7 · Cited by 130
Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., & Wrase, J. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21092 · Cited by 115
Self-citationFaure, A., Richard, J. M., & Berridge, K. C. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011223 · Cited by 114
Murschall, A., & Hauber, W. (2006) · Learning & Memory · doi:10.1101/lm.127106 · Cited by 101
On the Ability of Prey to Recognize Predators
Hirsch, S. M., & Bolles, R. C. (1980) · Zeitschrift für Tierpsychologie · doi:10.1111/j.1439-0310.1980.tb01064.x · Cited by 95
Foundations of Animal Behavior: Classic Papers with Commentaries
Houck, L. D., & Drickamer, L. C. (1996) · Cited by 90
Inescapable shock activates serotonergic neurons in all raphe nuclei of rat
Takase, L. F., Nogueira, M. I., Baratta, M. V., Bland, S. T., Watkins, L. R., Maier, S. F., Fornal, C. A., & Jacobs, B. L. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.12.020 · Cited by 79
Lex, B., & Hauber, W. (2010) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2009.11.002 · Cited by 61
Differential effects of central serotonin manipulation on hyperactive and stereotyped behaviour
Carter, C., & PYCOCK, C. (1978) · Life Sciences · doi:10.1016/0024-3205(78)90222-9 · Cited by 60
Takase, L. F., Nogueira, M. I., Bland, S. T., Baratta, M. V., Watkins, L. R., Maier, S. F., Fornal, C. A., & Jacobs, B. L. (2005) · Behavioural Brain Research · doi:10.1016/j.bbr.2005.04.008 · Cited by 59
The use of extinction to investigate the nature of neuroleptic-induced avoidance deficits
Beninger, R. J., Mason, S. T., Phillips, A. G., & Fibiger, H. C. (1980) · Psychopharmacology · doi:10.1007/bf00426515 · Cited by 55
Overmier, J., Bull, J. A., & Pack, K. (1971) · Learning and Motivation · doi:10.1016/0023-9690(71)90001-4 · Cited by 32
Acquisition of Conditioned Inhibition in Rats is Impaired by Ablation of Serotoninergic Pathways
Lister, S., Pearce, J. M., Butcher, S. P., Collard, K. J., & Foster, G. A. (1996) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1996.tb01224.x · Cited by 19
Reinforcers and control : towards a computational aetiology of depression
Huys, Q. J. M. (2007) · UCL Discovery (University College London) · Cited by 16
Self-citation
Cited by
Ten simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586
Barrett, L. F. (2012) · Emotion · doi:10.1037/a0027555 · Cited by 503
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480
Self-citationHuys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439
Self-citation
Metadata
- Authors
- Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., & Dayan, P.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-04-21
- Volume
- 7
- Issue
- 4
- Pages
- e1002028
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2083607057
- Cited by
- 416
- References
- 114
- FWCI
- 8.44
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.