The Psychology of Animal Learning

Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system

Gray, J. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00013066 · Cited by 4,477

Fears, phobias, and preparedness: toward an evolved module of fear and fear learning

Öhman, A., & Mineka, S. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.483 · Cited by 3,147

A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.

Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023

Spatial localization does not require the presence of local cues

Morris, R. G. M. (1981) · Learning and Motivation · doi:10.1016/0023-9690(81)90020-5 · Cited by 2,699

Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex

Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129

Context, time, and memory retrieval in the interference paradigms of Pavlovian learning

Bouton, M. E. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.80 · Cited by 1,896

Context and Behavioral Processes in Extinction: Table 1.

Bouton, M. E. (2004) · Learning & Memory · doi:10.1101/lm.78804 · Cited by 1,808

Toward a modern theory of adaptive networks: Expectation and prediction.

Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450

Neuronal Reward and Decision Signals: From Theories to Data

Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126

Dopamine reward prediction-error signalling: A two-component response

Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036

A modern learning theory perspective on the etiology of panic disorder.

Bouton, M. E., Mineka, S., & Barlow, D. H. (2001) · Psychological Review · doi:10.1037/0033-295x.108.1.4 · Cited by 1,017

Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning

Kelley, A. E. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.11.015 · Cited by 942

Reward, Motivation, and Reinforcement Learning

Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855

The role of dopamine in locomotor activity and learning

Beninger, R. J. (1983) · Brain Research Reviews · doi:10.1016/0165-0173(83)90038-3 · Cited by 848

The neuropsychological basis of addictive behaviour

Everitt, B. J., Dickinson, A., & Robbins, T. W. (2001) · Brain Research Reviews · doi:10.1016/s0165-0173(01)00088-1 · Cited by 808

How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements

Bindra, D. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00059380 · Cited by 732

Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems

EVERITT, B. J., PARKINSON, J. A., OLMSTEAD, M. C., ARROYO, M., ROBLEDO, P., & ROBBINS, T. W. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09280.x · Cited by 708

Reduced frequency of knowledge of results enhances motor skill learning.

Winstein, C. J., & Schmidt, R. A. (1990) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.16.4.677 · Cited by 708

Involvement of the amygdala in stimulus-reward associations: interaction with the ventral striatum

Cador, M., Robbins, T. W., & Everitt, B. J. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90354-0 · Cited by 652

Tests to assess motor phenotype in mice: a user's guide

Brooks, S. P., & Dunnett, S. B. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2652 · Cited by 621

Dissociation in Effects of Lesions of the Nucleus Accumbens Core and Shell on Appetitive Pavlovian Approach Behavior and the Potentiation of Conditioned Reinforcement and Locomotor Activity byd-Amphetamine

Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W., & Everitt, B. J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-06-02401.1999 · Cited by 555

Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction

Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., & Everitt, B. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.027 · Cited by 520

Towards an immuno-precipitated neurodevelopmental animal model of schizophrenia

Meyer, U., Feldon, J., Schedlowski, M., & Yee, B. K. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.10.012 · Cited by 494

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416

Generalization of conditioned fear-potentiated startle in humans: experimental validation and clinical relevance

Lissek, S., Biggs, A. L., Rabin, S. J., Cornwell, B. R., Alvarez, R. P., Pine, D. S., & Grillon, C. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.02.005 · Cited by 401

Allostasis, amygdala, and anticipatory angst

Schulkin, J., McEwen, B. S., & Gold, P. W. (1994) · Neuroscience & Biobehavioral Reviews · doi:10.1016/0149-7634(94)90051-5 · Cited by 380

Defense system psychopharmacology: An ethological approach to the pharmacology of fear and anxiety

Blanchard, R. J., Yudko, E. B., Rodgers, R. J., & Blanchard, D. C. (1993) · Behavioural Brain Research · doi:10.1016/0166-4328(93)90100-5 · Cited by 367

Cognitive Inflexibility after Prefrontal Serotonin Depletion Is Behaviorally and Neurochemically Specific

Clarke, H., Walker, S., Dalley, J., Robbins, T., & Roberts, A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj120 · Cited by 351

The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm

LeDoux, J. E., Moscarello, J., Sears, R., & Campese, V (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.166 · Cited by 348

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338

Associative vs topographical accounts of the immediate shock-freezing deficit in rats: Implications for the response selection rules governing species-specific defensive reactions

Fanselow, M. S. (1986) · Learning and Motivation · doi:10.1016/0023-9690(86)90018-4 · Cited by 326

Pathways of the Past: the Imprint of Memory

Horn, G. (2004) · Nature reviews. Neuroscience · doi:10.1038/nrn1324 · Cited by 308

Complex motor and sensorimotor functions of striatal and accumbens dopamine: involvement in instrumental behavior processes

Salamone, J. D. (1992) · Psychopharmacology · doi:10.1007/bf02245133 · Cited by 291

The persistence of maladaptive memory: Addiction, drug memories and anti-relapse treatments

Milton, A. L., & Everitt, B. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.002 · Cited by 279

A normative perspective on motivation

NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251

Neural systems implicated in delayed and probabilistic reinforcement

Cardinal, R. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.004 · Cited by 248

Darwin in Mind: New Opportunities for Evolutionary Psychology

Bolhuis, J. J., Brown, G. R., Richardson, R. C., & Laland, K. N. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1001109 · Cited by 242

Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs

ROBBINS, T. W. (1976) · Nature · doi:10.1038/264057a0 · Cited by 241

Increased sensitivity to amphetamine and reward-related stimuli following social isolation in rats: possible disruption of dopamine-dependent mechanisms of the nucleus accumbens

Jones, G. H., Marsden, C. A., & Robbins, T. W. (1990) · Psychopharmacology · doi:10.1007/bf02244105 · Cited by 232

Associative representational plasticity in the auditory cortex: a synthesis of two disciplines

Weinberger, N. M. (2007) · Learning & Memory · doi:10.1101/lm.421807 · Cited by 223

Behavioral treatment of chronic pain: The spouse as a discriminative cue for pain behavior

Block, A. R., Kremer, E. F., & Gaylor, M. (1980) · Pain · doi:10.1016/0304-3959(80)90011-1 · Cited by 223

Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens

Dalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214

Computational principles of memory

Chaudhuri, R., & Fiete, I. (2016) · Nature Neuroscience · doi:10.1038/nn.4237 · Cited by 213

The etiology of phobias: A nonassociative account

Menzies, R. G., & Clarke, J. C. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(94)00039-5 · Cited by 207

Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms

Wörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203

Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping performance in rats.

Cardinal, R. N., Parkinson, J. A., Lachenal, G., Halkerston, K. M., Rudarakanchana, N., Hall, J., Morrison, C. H., Howes, S. R., Robbins, T. W., & Everitt, B. J. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.4.553 · Cited by 201

Temporal specificity of fear conditioning: Effects of different conditioned stimulus--unconditioned stimulus intervals on the fear-potentiated startle effect.

Davis, M., Schlesinger, L. S., & Sorenson, C. A. (1989) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.15.4.295 · Cited by 192

Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer

MALONEY, L. T., & MAMASSIAN, P. (2009) · Visual Neuroscience · doi:10.1017/s0952523808080905 · Cited by 180

The cognition of ‘nuisance’ species

Barrett, L. P., Stanton, L. A., & Benson-Amram, S. (2019) · Animal Behaviour · doi:10.1016/j.anbehav.2018.05.005 · Cited by 166

Potentiation of the effects of reward-related stimuli by dopaminergic-dependent mechanisms in the nucleus accumbens

Cador, M., Taylor, J. R., & Robbins, T. W. (1991) · Psychopharmacology · doi:10.1007/bf02246039 · Cited by 158

Relative roles of ventral striatal D1 and D2 dopamine receptors in responding with conditioned reinforcement

Wolterink, G., Phillips, G., Cador, M., Donselaar-Wolterink, I., Robbins, T. W., & Everitt, B. J. (1993) · Psychopharmacology · doi:10.1007/bf02251293 · Cited by 158

Limbic cortical-ventral striatal systems underlying appetitive conditioning

Parkinson, J. A., Cardinal, R. N., & Everitt, B. J. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26019-6 · Cited by 149

Environments as cues to smoke: Implications for human extinction-based research and treatment.

Conklin, C. A. (2006) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.14.1.12 · Cited by 154

Cue exposure therapy for the treatment of alcohol use disorders: a meta-analytic review

Mellentin, A. I., Skøt, L., Nielsen, B., Schippers, G. M., Nielsen, A. S., Stenager, E., & Juhl, C. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.07.006 · Cited by 149

Animal neuropsychology: validation of the intra-dimensional extra-dimensional set shifting task for mice

GARNER, J., THOGERSON, C., WURBEL, H., MURRAY, J., & MENCH, J. (2006) · Behavioural Brain Research · doi:10.1016/j.bbr.2006.06.002 · Cited by 147

Fractionating Blunted Reward Processing Characteristic of Anhedonia by Over-Activating Primate Subgenual Anterior Cingulate Cortex

Alexander, L., Gaskin, P. L. R., Sawiak, S. J., Fryer, T. D., Hong, Y. T., Cockcroft, G. J., Clarke, H. F., & Roberts, A. C. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.021 · Cited by 120

Neural representations during sleep: From sensory processing to memory traces

Hennevin, E., Huetz, C., & Edeline, J.-M. (2007) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2006.10.006 · Cited by 133

Encoding of Geometric and Featural Spatial Information by Goldfish (Carassius auratus).

Vargas, J. P., López, J. C., Salas, C., & Thinus-Blanc, C. (2004) · Journal of Comparative Psychology · doi:10.1037/0735-7036.118.2.206 · Cited by 129

Deprivation of parenting disrupts development of homeostatic and reward systems in marmoset monkey offspring

Pryce, C. R., Dettling, A. C., Spengler, M., Schnell, C. R., & Feldon, J. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.05.002 · Cited by 124

Generalized anxiety disorder (GAD) as an unsuccessful search for safety

Woody, S., & Rachman, S. (1994) · Clinical Psychology Review · doi:10.1016/0272-7358(94)90040-x · Cited by 115

Receptor subtype-specific dopaminergic agents and conditioned behavior

Beninger, R. J., Hoffman, D. C., & Mazurski, E. J. (1989) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(89)80019-3 · Cited by 109

Signals of threat do not capture, but prioritize, attention: A conditioning approach.

Notebaert, L., Crombez, G., Van Damme, S., De Houwer, J., & Theeuwes, J. (2011) · Emotion · doi:10.1037/a0021286 · Cited by 107

How personality relates to intelligence test performance: Implications for a theory of intelligence, ageing research and personality assessment

Robinson, D. L. (1985) · Personality and Individual Differences · doi:10.1016/0191-8869(85)90110-2 · Cited by 98

Effects of extinction, pimozide, SCH 23390, and metoclopramide on food-rewarded operant responding of rats

Beninger, R. J., Cheng, M., Hahn, B. L., Hoffman, D. C., Mazurski, E. J., Morency, M. A., Ramm, P., & Stewart, R. J. (1987) · Psychopharmacology · doi:10.1007/bf00210842 · Cited by 93

Purposive behavior and cognitive mapping: a neural network model

Schmajuk, N. A., & Thieme, A. D. (1992) · Biological Cybernetics · doi:10.1007/bf00201023 · Cited by 91

Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing

Chang, S. E., Wheeler, D. S., & Holland, P. C. (2012) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2012.03.008 · Cited by 68

A bottom up approach towards the acquisition and expression of sequential representations applied to a behaving real-world device: Distributed Adaptive Control III

Verschure, P. F. M. J., & Voegtlin, T. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00029-x · Cited by 73

Re-visiting Internet Addiction among Taiwanese Students: A Cross-Sectional Comparison of Students’ Expectations, Online Gaming, and Online Social Interaction

Lee, Y.-H., Ko, C.-H., & Chou, C. (2015) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-014-9915-4 · Cited by 73

β2-Subunit-containing nicotinic acetylcholine receptors are involved in nicotine-induced increases in conditioned reinforcement but not progressive ratio responding for food in C57BL/6 mice

Brunzell, D. H., Chang, J. R., Schneider, B., Olausson, P., Taylor, J. R., & Picciotto, M. R. (2006) · Psychopharmacology · doi:10.1007/s00213-005-0099-z · Cited by 71

Evidence for opiate-dopamine cross-sensitization in nucleus accumbens: Studies of conditioned reward

Cunningham, S. T., & Kelley, A. E. (1992) · Brain Research Bulletin · doi:10.1016/0361-9230(92)90137-m · Cited by 65

Reward Contexts Extend Dopamine Signals to Unrewarded Stimuli

Kobayashi, S., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2013.10.061 · Cited by 63

University students' Motivated Attention and use of regulation strategies on social media

Wu, J.-Y. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.08.016 · Cited by 62

Reconsolidation and extinction of an appetitive pavlovian memory

Flavell, C. R., & Lee, J. L. C. (2013) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.04.009 · Cited by 53

Effects of deletion of gria1 or gria2 genes encoding glutamatergic AMPA-receptor subunits on place preference conditioning in mice

Mead, A. N., Brown, G., Le Merrer, J., & Stephens, D. N. (2005) · Psychopharmacology · doi:10.1007/s00213-004-2071-8 · Cited by 52

A mouse model of stress-enhanced fear learning demonstrates extinction-sensitive and extinction-resistant effects of footshock stress

Hassien, A. M., Shue, F., Bernier, B. E., & Drew, M. R. (2020) · Behavioural Brain Research · doi:10.1016/j.bbr.2019.112391 · Cited by 48

Conditioned fear modulates visual selection.

Mulckhuyse, M., Crombez, G., & Van der Stigchel, S. (2013) · Emotion · doi:10.1037/a0031076 · Cited by 42

Amygdala Dopamine Receptors Are Required for the Destabilization of a Reconsolidating Appetitive Memory

Merlo, E., Ratano, P., Ilioi, E. C., Robbins, M. A. L. S., Everitt, B. J., & Milton, A. L. (2015) · eneuro · doi:10.1523/eneuro.0024-14.2015 · Cited by 38

Modeling signal features of escape response: Effects of cessation conditioning in "learned helplessness" paradigm.

Minor, T. R., Trauner, M. A., Lee, C.-Y., & Dess, N. K. (1990) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.16.2.123 · Cited by 37

Training Issues Unique to Autism Spectrum Disorders

LeBlanc, L. A., Gravina, N., & Carr, J. E. (2009) · Applied Behavior Analysis for Children with Autism Spectrum Disorders · doi:10.1007/978-1-4419-0088-3_13 · Cited by 30

Previous Exposure to Nicotine Enhances the Incentive Motivational Effects of Amphetamine via Nicotine-Associated Contextual Stimuli

Cortright, J. J., Sampedro, G. R., Neugebauer, N. M., & Vezina, P. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.80 · Cited by 27

Contextual conditioning during free-operant extinction: Unsignaled, signaled, and backward-signaled noncontingent food

Baker, A. G. (1990) · Animal Learning & Behavior · doi:10.3758/bf03205240 · Cited by 27

Enhanced Operant Extinction and Prefrontal Excitability in a Mouse Model of Angelman Syndrome

Sidorov, M. S., Judson, M. C., Kim, H., Rougie, M., Ferrer, A. I., Nikolova, V. D., Riddick, N. V., Moy, S. S., & Philpot, B. D. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2828-17.2018 · Cited by 25

Exploration and Its Measurement: A Psychopharmacological Perspective

Kelley, A. E., Cador, M., & Stinus, L. (2003) · Psychopharmacology · doi:10.1385/0-89603-129-2:95 · Cited by 13

PDR - a multi-level model of fear and pain

Bolles, R. C., & Fanselow, M. S. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005136 · Cited by 9