Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
“…for flying maneuvers ing, rewards are ‘‘incentives’’ and serve as goals of behavior take this information into account and help to avoid excesfollowing associations between behavioral responses and sive strain on the mechanical components of the plane, thus outcomes (Dickinson and Balleine 1994).”
BackgroundWhat is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
“, and by an improved understanding of associative learning mechanisms that conceive of behavioral output as an interaction between pavlovian and instrumental learning processe”
BackgroundGetting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
“Responses of toni(Dickinson and Balleine, 1994).”
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129
“This appears to occur by two mechanisms (Dickinson, 1994; Dickinson & Balleine, 1994).”
BackgroundInfluentialBalleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
“It is one of more striking properties of goal-directed actions that performance is determined by the experienced reward value of the outcomes associated with actions and, unlike habits or other reflexes, is not directly affected by shifts in primary motivation (Dickinson and Balleine, 1994).”
BackgroundSelf-citationBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
“This representation should contain a prediction of the future reward together with the contingency that associates the behavioral action to the reward (Dickinson & Balleine 1994).”
BackgroundGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Self-citationRobinson, T. E., & Berridge, K. C. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145237 · Cited by 1,509
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
“…tend to be relatively preferred, or to elicit approach, goal-directed, or consummatory behavior, or generate a high degree of demand, and that these effects are a fundamental aspect of positive reinforcement (Dickinson and Balleine, 1994; Salamone and Correa, 2002; Salamone et al., 2012).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
“, pressing a lever or pulling a chain when these actions earn different food rewards, is determined by the animals’ encoding the association between a specific action and outcome and the current value of the outcome; choice is sensitive both to degradation of the action– outcome contingency and to outcome revaluation…”
BackgroundSelf-citationPrefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329
“When animals learn to perform actions for rewarding outcomes, they do so via several psychological mechanisms (see [19,40,41,43]).”
BackgroundRelative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
“From reward expectation to goal direction Expected rewards might serve as goals for voluntary behaviour if information about the reward is present while the behavioural response towards the reward is being prepared and execute”
BackgroundYin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226
“, / / % 6 J A/ > :.”
Self-citationDrug addiction: updating actions to habits to compulsions ten years on
Everitt, B. J., & Robbins, T. W. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033457 · Cited by 1,225
Neurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,196
Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M. R., & Obeso, J. A. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2915 · Cited by 1,134
“However, during the past 20 years it has become clear that animals can also encode causal relationships between actions and outcome”
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
“We have not considered here the anatomically and psychologically distinct category of “goal-directed” behaviors ( Dickinson and Balleine 1994 ), whose pattern of immediate and learned motivational sensitivity is rather different, and to which another class of RL models is more appropriate (Daw et al. 2005).”
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
“In goal-directed behavior, the outcome is represented during the behavior leading to the outcome, and furthermore, the contingency of that outcome on the action is represented (133).”
BackgroundMethodInfluentialThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
“In Experiment 1, pre-training lesions of the posterior DMS abolished the sensitivity of rats’ instrumental performance to both outcome devaluation and contingency degradation when tested in extinction, whereas lesions of the anterior DMS had no effect.”
BackgroundSelf-citationEffort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000
“Thorndike, Hull, Spence, Premack, Timberlake, and Dickinson, despite their different perspectives, all have emphasized that there is a fundamental motivational component to reinforcement processes (Dickinson and Balleine 1994; Salamone and Correa 2002).”
BackgroundNucleus accumbens shell and core dopamine: differential role in behavior and addiction
Di Chiara, G. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00286-3 · Cited by 996
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
“As rewards may constitute basic goals of behavior (Dickinson and Balleine, 1994), the motivational functions of the orbitofrontal cortex may be partly based on the processing of reward information.”
BackgroundThe cognitive functions of the caudate nucleus
Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2008.09.004 · Cited by 940
“Contemporary theories now favour a dual-process model of instrumental learning: a simple, though less flexible, S-R system and a cognitive knowledge-based system (Dickinson and Balleine, 1994).”
BackgroundMultiple Parallel Memory Systems in the Brain of the Rat
White, N. M., & McDonald, R. J. (2002) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2001.4008 · Cited by 893
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Self-citationSalamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817
Kelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 778
Dopamine neurons and their role in reward mechanisms
Schultz, W. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80007-4 · Cited by 766
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764
“…processes such as incentive salience, because it measures the ability of a cue to trigger motivation for rewards in the absence of both primary and secondary reinforcement (Rescorla and Solomon, 1967; Toates, 1986; Dickinson and Dawson, 1987; Balleine, 1994; Dickinson and Balleine, 1994).”
BackgroundMethodCoordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
From the ventral to the dorsal striatum: devolving views of their roles in drug addiction
Everitt, B. J., & Robbins, T. W. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.010 · Cited by 675
The role of dopamine in drug abuse viewed from the perspective of its role in motivation
Di Chiara, G. (1995) · Drug and Alcohol Dependence · doi:10.1016/0376-8716(95)01118-i · Cited by 629
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622
Self-citationGremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589
“…associations are generally thought to be impervious to devaluation manipulations, because the outcome itself is not represented within the associative structure controlling responding, and so changes in its value have no immediate effect on performance (Adams, 1982; Dickinson and Balleine, 1994).”
BackgroundSelf-citationCharacterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
“Analogous distinctions have been drawn for goal-directed versus habitual behaviour in instrumental learnin”
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564
“In contrast to this position, contemporary theories have drawn a strong distinction between these two sources of reward arguing, instead, that the incentive value of the instrumental outcome and the excitatory effects of Pavlovian cues on instrumental performance are mediated by distinct learning processes ( Dickinson…”
BackgroundResultInfluentialSelf-citationParkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W., & Everitt, B. J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-06-02401.1999 · Cited by 555
“The potentiative effects on behavior of D-amphetamine are critically dependent on the NAcc shell, whereas the expression or potentiation of Pavlovian conditioned responses generated by the presentation of incentive stimuli (Rescorla and Solomon, 1967; Dickinson and Balleine, 1994) depends on the integrity of the NAcc…”
BackgroundChudasama, Y., & Robbins, T. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08771.2003 · Cited by 543
“, conditional stimulus (CS)– unconditional stimulus] associations or depend on habit (stimulus–response) learning, all of which can potentially contribute to behavioral performance (Dickinson and Balleine, 1994).”
BackgroundNeuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 542
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517
“Rewards can serve as goals of behaviour if the reward and the contingency between action and reward are represented in the brain during the action [1].”
BackgroundDopamine: 50 years in perspective
Iversen, S. D., & Iversen, L. L. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.002 · Cited by 518
Obsessive-compulsive disorder: Puzzles and prospects
Robbins, T. W., Vaghi, M. M., & Banca, P. (2019) · Neuron · doi:10.1016/j.neuron.2019.01.046 · Cited by 510
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475
“Evidence for the Coexistence of Multiple Control Systems Although Dickinson & Balleine (1994) demonstrated that rats are capable of performing in a goal-directed manner, Dickinson et al. (1995) also showed that those same animals may also exhibit habitual tendencies.”
BackgroundLearning from Sensory and Reward Prediction Errors during Motor Adaptation
Izawa, J., & Shadmehr, R. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002012 · Cited by 477
“In fact, goal directed action in habitual learning is mediated by two representations: a representation of the instrumental contingency between the action and the outcome, and a representation of the outcome as a goal for the agent [40].”
BackgroundDifferential neural responses evoked by orthonasal versus retronasal odorant perception in humans
Small, D. M., Gerber, J. C., Mak, Y. E., & Hummel, T. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.022 · Cited by 463
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
“Irrelevant, non-safety-related rewards would then be flattened selectively in a way reminiscent of motivational states such as hunger, thirst, or sodium deprivation (Dickinson and Balleine, 1994).”
BackgroundMechanisms underlying cortical activity during value-guided choice
Hunt, L. T., Kolling, N., Soltani, A., Woolrich, M. W., Rushworth, M. F. S., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3017 · Cited by 454
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447
“Consequently, changes in outcome value can have no direct influence on performance ( Dickinson & Balleine, 1994 ).”
BackgroundSelf-citationAmphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
“Thus, rats’ instrumental performance has been shown to be sensitive to postconditioning changes in reward value (Adams and Dickinson, 1981; Colwill and Rescorla, 1985; Dickinson and Balleine, 1994).”
BackgroundAnimal cognition and animal behaviour
Shettleworth, S. J. (2001) · Animal Behaviour · doi:10.1006/anbe.2000.1606 · Cited by 438
“Perhaps suprisingly, the best-studied example is food-rewarded bar pressing in rats (Dickinson 1994; Dickinson & Balleine 1994).”
BackgroundWyvell, C. L., & Berridge, K. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07831.2001 · Cited by 436
“However, once the hyperincentive cue was no longer present, motivation for sucrose reward would instead be guided primarily by other processes, ranging from simple associative response habits to cognitive act–outcome expectations, mediated by separate neural systems (Balleine and Killcross, 1994; Dickinson and Ballein…”
BackgroundSpruijt, B. M., van den Bos, R., & Pijlman, F. T. A. (2001) · Applied Animal Behaviour Science · doi:10.1016/s0168-1591(00)00204-5 · Cited by 436
“This rewarding value is included in the incentive motivational models which are current in animal learning theory (e.g. Berridge, 1996; Dickinson and Balleine, 1994).”
BackgroundAssociative theories of goal-directed behaviour: a case for animal–human translational models
Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424
“There is now extensive evidence for this process of incentive learning in rats (Dickinson & Balleine, 1994, 2008).”
BackgroundSelf-citationThe role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Self-citationA neural correlate of response bias in monkey caudate nucleus
Lauwereyns, J., Watanabe, K., Coe, B., & Hikosaka, O. (2002) · Nature · doi:10.1038/nature00892 · Cited by 424
Can fish suffer?: perspectives on sentience, pain, fear and stress
Chandroo, K. P., Duncan, I. J. H., & Moccia, R. D. (2004) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2004.02.004 · Cited by 412
“It follows that if fish are to be given welfare consideration, they must reasonably demonstrate the cognitive characteristics of sentient beings.”
BackgroundLesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402
“Contemporary theories of instrumental learning assume that acquisition and performance of instrumental actions require interactions of both S–R habits and action– outcome processes (Dickinson, 1981; Dickinson and Balleine, 1994; Dickinson et al., 1995) and that, after extended training, S–R processes gain domination o…”
BackgroundMechanisms of motivation–cognition interaction: challenges and opportunities
Braver, T. S., Krug, M. K., Chiew, K. S., Kool, W., Westbrook, J. A., Clement, N. J., Adcock, R. A., Barch, D. M., Botvinick, M. M., Carver, C. S., et al. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0300-0 · Cited by 391
“As we described above, one classic approach is to identify goal-direct behaviors via outcome revaluation procedures , since habitual behaviors have been found to be insensitive to such manipulations (Dickinson & Balleine, 1994).”
Self-citationThe importance of habits in eating behaviour. An overview and recommendations for future research
Riet, J. V., Sijtsema, S. J., Dagevos, H., & De Bruijn, G.-J. (2011) · Appetite · doi:10.1016/j.appet.2011.07.010 · Cited by 399
The Role of Learning in the Operation of Motivational Systems
Dickinson, A., & Balleine, B. (2002) · Stevens' Handbook of Experimental Psychology · doi:10.1002/0471214426.pas0312 · Cited by 384
Self-citationInfluence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
The place of dopamine in the cortico-basal ganglia circuit
Haber, S. N. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.008 · Cited by 364
“…and the development of habits, recognized that integration between functional circuits was necessary to carry out goal-directed behaviors (Mogenson et al., 1980; Percheron and Filion, 1991; Dickinson and Balleine, 1994; Haber et al., 2000; Belin and Everitt, 2008; Leung and Balleine, 2013).”
Persistent Increase in the Motivation to Take Heroin in Rats with a History of Drug Escalation
Ahmed, S. (2000) · Neuropsychopharmacology · doi:10.1016/s0893-133x(99)00133-5 · Cited by 364
“However, over repeated training sessions, extinction performance becomes mainly automatic and relatively insensitive to the incentive value of the reinforcer (for reviews, Dickinson 1994; Dickinson and Balleine 1994).”
BackgroundEffects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Cromwell, H. C., & Schultz, W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01014.2002 · Cited by 362
The integrative function of the basal ganglia in instrumental conditioning
Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356
“[6,7,10] for eviews), there is also considerable evidence suggesting that, unlike avlovian CR’s, these actions are sensitive to changes in the causal elation to their consequences; generally, rats will stop respondng if performance no longer delivers the instrumental outcome nd will stop responding even faster if thei…”
BackgroundSelf-citationThe effect of lesions of the basolateral amygdala on instrumental conditioning
Balleine, B. W., Killcross, A. S., & Dickinson, A. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-02-00666.2003 · Cited by 355
“In addition, it is now well established that the rats’ evaluation of the incentive value of the food, i.e., its affective and motivationally relevant properties, critically determines the performance of actions instrumental to its delivery (for review, see Dickinson and Balleine, 1994; Balleine, 2001).”
BackgroundInfluentialSelf-citationHall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., & Everitt, B. J. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01577.x · Cited by 355
“…by different contingencies ± the CS-US contingency in the case of Pavlovian conditioning and the response-reinforcer contingency in the case of instrumental conditioning ± Pavlovian CSs have a major impact upon instrumental performance (Rescorla & Solomon, 1967; Dickinson & Balleine, 1994).”
BackgroundSelf-citationDialogues on prediction errors
Niv, Y., & Schoenbaum, G. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.03.006 · Cited by 344
“Goal-directed behavior, which probably uses representations of contingencies and rewards for forward-looking planning, might not be dependent on learning via dopamine and TD prediction errors [32, 60 ,61].”
Goal-directed learning and obsessive-compulsive disorder
Gillan, C. M., & Robbins, T. W. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0475 · Cited by 348
Book Review: Reward Signaling by Dopamine Neurons
Schultz, W. (2001) · The Neuroscientist · doi:10.1177/107385840100700406 · Cited by 344
“These activities are in general compatible with a goal directional account, according to which, rewards may serve as goals for voluntary behavior if information about the reward is present while behavioral reactions toward the reward are being prepared and executed (Dickinson and Balleine 1994).”
ResultCoutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342
Arana, F. S., Parkinson, J. A., Hinton, E., Holland, A. J., Owen, A. M., & Roberts, A. C. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-29-09632.2003 · Cited by 345
“Such emotional cues can engage multiple psychological processes, including attention and associability, the effectiveness of memory consolidation, pavlovian arousal, and goal-directed action (Dickinson and Balleine, 1994; Cahill and McGaugh, 1996; Holland, 1997; Killcross et al., 1997; Holland and Gallagher, 1999; Par…”
BackgroundConditioning, remembering, and forgetting.
Bouton, M. E. (1994) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.20.3.219 · Cited by 333
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
“, the affective and motivationally relevant properties of the outcome [10,11,48,55].”
BackgroundSelf-citationThe role of central dopamine D3 receptors in drug addiction: a review of pharmacological evidence
Heidbreder, C. A., Gardner, E. L., Xi, Z.-X., Thanos, P. K., Mugnaini, M., Hagan, J. J., & Ashby, C. R. (2005) · Brain Research Reviews · doi:10.1016/j.brainresrev.2004.12.033 · Cited by 322
“Furthermore, chronic administration of A-437203 for 21 days produces a significant and selective decrease in the number of spontaneously active VTA DA neurons in anesthetized rats [85], a finding similar to that reported for SB-277011-A [9].”
Predictive representations can link model-based reinforcement learning to model-free mechanisms
Russek, E. M., Momennejad, I., Botvinick, M. M., Gershman, S. J., & Daw, N. D. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005768 · Cited by 326
“…animals can indeed flexibly adapt their behavior following such manipulations (without any further retraining–e.g. tested on the very first trial, or without feedback) has long been interpreted as evidence for their use of internal models, as in model-based RL or similar methods [1,23,39].”
MethodEveritt, B. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12644 · Cited by 318
“…and taking are instrumental behaviours and that the general concept of positive reinforcement conflates at least two different processes which have been identified by contemporary analyses of instrumental conditioning with conventional reinforcers (Dickinson, 1985; Dickinson & Balleine, 1994).”
BackgroundReward prediction in primate basal ganglia and frontal cortex
Schultz, W., Tremblay, L., & Hollerman, J. R. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00071-9 · Cited by 318
Reward learning: reinforcement, incentives, and expectations
Berridge, K. C. (2000) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(00)80022-5 · Cited by 318
“…and most motivated behavior (Berridge & Robinson, 1998; Bindra, 1978; Blackburn, Pfaus, & Phillips, 1992; Bolles, 1972; Depue & Collins, 1999; Dickinson & Balleine, 1994; Flaherty, 1996; Panksepp, 1998; Phillips, Blaha, Pfaus, & Blackburn, 1992; Stewart, de Wit, & Eikelboom, 1984; Toates,…”
MethodNeural systems implicated in delayed and probabilistic reinforcement
Cardinal, R. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.004 · Cited by 248
“…delayed reinforcement can be enhanced if rats are exposed to the relevant contextual cues prior to instrumental training, and this enhancement is lessened if 'free' (non-contingent) rewards are given during the contextual pre-exposure periods (Dickinson & Balleine, 1994; Dickinson et al., 1992).”
BackgroundInfluentialSjoerds, Z., de Wit, S., van den Brink, W., Robbins, T. W., Beekman, A. T. F., Penninx, B. W. J. H., & Veltman, D. J. (2013) · Translational Psychiatry · doi:10.1038/tp.2013.107 · Cited by 312
“11,12 On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 314
Self-citationRoesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 306
“…behavior requires that the value of the outcome associated with an action be explicitly represented at the time when the action is being planned (Dickinson and Balleine 1994) and 2) because there must exist somewhere in the brain neurons whose activity underlies emotional states experienced…”
BackgroundInfluentialThe basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306
“…this biological significance is not innately attached to specific reward representations, but rather must be acquired through experience with the reward in a relevant need state- so called incentive learning (Balleine et al., 1995; Balleine and Dickinson 1998; Dickinson and Balleine, 1994, 2002).”
BackgroundHuman Pavlovian–Instrumental Transfer
Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4028-07.2008 · Cited by 301
“PIT is one of the key paradigms used to explore motivational aspects of the interaction between instrumental and pavlovian conditioning (Dickinson and Balleine, 1994, 2002; Holland, 2004; Niv, 2007), and depends crucially on the integrity of the amygdala and the nucleus accumbens (NAcc).”
BackgroundOn the psychology of drinking: Being thirsty and perceptually ready
Aarts, H., Dijksterhuis, A., & de Vries, P. (2001) · British Journal of Psychology · doi:10.1348/000712601162383 · Cited by 300
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299
“Psychological counterparts include cognitive maps of goal outcomes, with values obtained by episodic memories of experience with those goals in states similar to current conditions, and understanding of act-outcome relationships needed to obtain those goals [17,18,89,92–94].”
BackgroundCorrelated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
“That is, the stimulus takes on specific motivational incentive properties (CS) originally possessed by the primary reward itself (Bolles, 1972; Bindra, 1978; Toates, 1986; Dickinson and Balleine, 1994).”
Boulougouris, V., Dalley, J. W., & Robbins, T. W. (2007) · Behavioural Brain Research · doi:10.1016/j.bbr.2007.02.005 · Cited by 297
Negative symptoms: the ‘pathology’ of motivation and goal-directed behaviour
Brown, R. G., & Pluck, G. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01626-x · Cited by 303
Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues
Meyer, P. J., Lovic, V., Saunders, B. T., Yager, L. M., Flagel, S. B., Morrow, J. D., & Robinson, T. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038987 · Cited by 304
“In this sense, behavior is mediated by the explicit expectation of the outcome [91,92].”
BackgroundThe role of dopamine in the accumbens core in the expression of Pavlovian‐conditioned responses
Saunders, B. T., & Robinson, T. E. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08217.x · Cited by 299
“…of dopamine antagonism on the learning and expression of a ST CR vs. a GT CR, it is important to consider the distinction between a CS and an incentive stimulus, long emphasized by learning theorists (Konorski, 1967; Bindra, 1978; Toates, 1986; Dickinson & Balleine, 1994, 2002; Berridge, 2001).”
Background
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.