Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Items 101–200 of 996
The role of habit in compulsivity
Gillan, C. M., Robbins, T. W., Sahakian, B. J., van den Heuvel, O. A., & van Wingen, G. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.033 · Cited by 292
“Typically contingency degradation is achieved by presenting (previously response-contingent) reinforcers in the absence of the response, and testing behavioural sensitivity to this change as above (Dickinson and Balleine, 1994).”
BackgroundReward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 285
Motivational control after extended instrumental training
Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., & Boakes, R. A. (1995) · Animal Learning & Behavior · doi:10.3758/bf03199935 · Cited by 287
“Dickinson and Balleine (1994) refer to this process as incentive learning.”
BackgroundSelf-citationStory, G. W., Vlaev, I., Seymour, B., Darzi, A., & Dolan, R. J. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00076 · Cited by 286
“…corresponds to the definition of “goal-directed” behavior in animal learning experiments as rapidly sensitive to changes in outcome value or the contingency between response and outcome (Colwill and Rescorla, 1986; Dickinson and Balleine, 1994; Balleine and Dickinson, 1998; Domjan, 2003).”
BackgroundDopamine transients are sufficient and necessary for acquisition of model-based associations
Sharpe, M. J., Chang, C. Y., Liu, M. A., Batchelor, H. M., Mueller, L. E., Jones, J. L., Niv, Y., & Schoenbaum, G. (2017) · Nature Neuroscience · doi:10.1038/nn.4538 · Cited by 300
“Of course, such non-specific responding would also be insensitive to devaluation of the food reward 36 , contrary to our results.”
Model-based learning protects against forming habits
Gillan, C. M., Otto, A. R., Phelps, E. A., & Daw, N. D. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0347-6 · Cited by 283
The persistence of maladaptive memory: Addiction, drug memories and anti-relapse treatments
Milton, A. L., & Everitt, B. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.002 · Cited by 279
“However, one way in which negative reinforcement may continue to control drug-seeking behaviour is via ‘incentive learning’ (Dickinson and Balleine, 1994), which has been shown to undergo consolidation and Milton & Everitt 13 reconsolidation within the amygdala (Wang et al., 2005; see §4).”
Explicit memory creation during sleep demonstrates a causal role of place cells in navigation
de Lavilléon, G., Lacroix, M. M., Rondi-Reig, L., & Benchenane, K. (2015) · Nature Neuroscience · doi:10.1038/nn.3970 · Cited by 279
Retrospective and prospective coding for predicted reward in the sensory thalamus
Komura, Y., Tamura, R., Uwano, T., Nishijo, H., Kaga, K., & Ono, T. (2001) · Nature · doi:10.1038/35087595 · Cited by 273
Stress-induced modulation of instrumental behavior: From goal-directed to habitual control of action
Schwabe, L., & Wolf, O. T. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.12.038 · Cited by 269
“More recent theories of instrumental behavior postulate that instrumental action may be mediated by at least three different learning processes [2,15,16]: (i) a contingency learning process that encodes the (causal) relationship between an action and an outcome; (ii) an incentive learning process during which an instr…”
Dopamine D3Receptor Antagonism Inhibits Cocaine-Seeking and Cocaine-Enhanced Brain Reward in Rats
Vorel, S. R., Ashby, C. R., Paul, M., Liu, X., Hayes, R., Hagan, J. J., Middlemiss, D. N., Stemp, G., & Gardner, E. L. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09595.2002 · Cited by 269
“" CPP presumably measures drug-seeking behavior specifically evoked by the incentive salience (Bindra, 1968; Bolles, 1972; Dickinson and Balleine, 1994) acquired by environmental cues after repeated association with cocaine.”
Alcohol seeking by rats: action or habit?
Dickinson, A., Wood, N., & Smith, J. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/0272499024400016 · Cited by 268
“Dickinson and Balleine (Balleine & Dickinson, 1998; Dickinson & Balleine, 1994, 2000, 2002) argued that the assignment of incentive value to an outcome, a process that they call instrumental incentive learning, is based primarily upon the hedonic reactions elicited by the outcome.”
BackgroundSelf-citationCalculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268
“…of actions relies on the computation of temporal correlations between the rate of performance and the occurrence of environmental events, particularly the relationship between actions and motivationally significant events such as rewards (Baum, 1973; Dickinson, 1994; Dickinson and Balleine, 1994).”
BackgroundSelf-citationLimbic Corticostriatal Systems and Delayed Reinforcement
CARDINAL, R. N., WINSTANLEY, C. A., ROBBINS, T. W., & EVERITT, B. J. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1308.004 · Cited by 265
Orangutans Modify Their Gestural Signaling According to Their Audience's Comprehension
Cartmill, E. A., & Byrne, R. W. (2007) · Current Biology · doi:10.1016/j.cub.2007.06.069 · Cited by 250
Western Scrub-Jays Anticipate Future Needs Independently of Their Current Motivational State
Correia, S. P. C., Dickinson, A., & Clayton, N. S. (2007) · Current Biology · doi:10.1016/j.cub.2007.03.063 · Cited by 258
“This specific-satiety effect acts on the animals’ motivational state, which modulates the incentive value assigned to the food, thereby controlling behavior [20, 21].”
BackgroundSelf-citationInfluence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257
“According to motivational theory (Dickinson and Balleine 1994), there should be representations of the outcome already at the time at which behavioral reactions toward the reward are being prepared and executed (knowing the outcome when doing the action).”
BackgroundParkinson, J. A., Willoughby, P. J., Robbins, T. W., & Everitt, B. J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.42 · Cited by 314
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251
Representation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 252
Reward functions of the basal ganglia
Schultz, W. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-016-1510-0 · Cited by 248
“2004, 2005), which require the processing of reward information and of the actions required to obtain the reward (Dickinson and Balleine 1994).”
BackgroundSeparate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241
“Given that instrumental behavior is initially goal directed and later becomes habit drive”
BackgroundWhat Biological Functions Are and Why They Matter
Garson, J. (2019) · doi:10.1017/9781108560764 · Cited by 239
Does the orbitofrontal cortex signal value?
Schoenbaum, G., Takahashi, Y., Liu, T., & McDannald, M. A. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06210.x · Cited by 232
Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05934.x · Cited by 231
“…that would account for the decrease in responding in the baseline period and during presentation of the same stimulus (but see Balleine, 1992; Dickinson & Balleine, 1994) ) the very much greater effect of satiety on general transfer suggests that this reduction in responding was far from…”
BackgroundSelf-citationCardinal, R. N., & Howes, N. J. (2005) · BMC Neuroscience · doi:10.1186/1471-2202-6-37 · Cited by 232
Associative learning and animal cognition
Dickinson, A. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0220 · Cited by 219
Self-citationInvolvement of basal ganglia and orbitofrontal cortex in goal-directed behavior
Hollerman, J. R., Tremblay, L., & Schultz, W. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26015-9 · Cited by 221
Balleine, B. W., & Dickinson, A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08954.2000 · Cited by 218
“We have referred to this as incentive learning (Balleine, 1992; Dickinson and Balleine, 1994).”
BackgroundSelf-citationNeural and psychological mechanisms underlying appetitive learning: links to drug addiction
Cardinal, R. N., & Everitt, B. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.004 · Cited by 220
“Hunger, a natural motivational state, increases the hedonic impact of foodstuffs [8] and this in turn teaches the animal that it is worth working for those foodstuffs more when it is hungry [3].”
BackgroundHow Humans Integrate the Prospects of Pain and Reward during Choice
Talmi, D., Dayan, P., Kiebel, S. J., Frith, C. D., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2026-09.2009 · Cited by 217
“Because our task did not incorporate a crucial devaluation test to prove goal directedness (Dickinson and Balleine, 1994; Valentin et al., 2007), we cannot conclusively attribute effects to interactions between model-based and model-free control systems.”
BackgroundMethodMeasuring wanting and liking from animals to humans: a systematic review
Pool, E., Sennwald, V., Delplanque, S., Brosch, T., & Sander, D. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.01.006 · Cited by 211
“This prediction involves active reconstruction of past episodic memories of liking experiences with the current reward and the use of these episodic memories to anticipate or predict a future experience (Dickinson and Balleine, 1994; Kahneman and Tversky, 1984).”
BackgroundInfluentialSemantics of primate gestures: intentional meanings of orangutan gestures
Cartmill, E. A., & Byrne, R. W. (2010) · Animal Cognition · doi:10.1007/s10071-010-0328-7 · Cited by 195
“2006; Pika 2008), and neuroscience (Dickinson and Balleine 1994).”
The role of withdrawal in heroin addiction: enhances reward or promotes avoidance?
Hutcheson, D. M., Everitt, B. J., Robbins, T. W., & Dickinson, A. (2001) · Nature Neuroscience · doi:10.1038/nn0901-943 · Cited by 206
Self-citationMnemonic functions of the basal ganglia
White, N. M. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80004-9 · Cited by 204
Dopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2014.08.064 · Cited by 204
Dickinson, A. (1994) · Animal Learning and Cognition · doi:10.1016/b978-0-08-057169-0.50009-7 · Cited by 200
Self-citationde Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200
“1) (Thorndike, 1931; Sutton and Barto, 1981; Dickinson and Balleine, 1994; Killcross and Coutureau, 2003) [for review, see Dickinson and Balleine (1993), Dickinson (1994), and de Wit and Dickinson (2009)].”
BackgroundSelf-citationMemory processes in classical conditioning
Bouton, M. E., & Moody, E. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.001 · Cited by 205
“Also importantly, how the animal currently values the representation of the outcome in instrumental learning depends upon a subtle process known as ‘incentive learning,’ [137,140,141].”
BackgroundPeciña, S., Schulkin, J., & Berridge, K. C. (2006) · BMC Biology · doi:10.1186/1741-7007-4-8 · Cited by 194
“, primary instrumental response reinforcement, secondary response reinforcement, discriminative stimulus occasion setting, general stress/frustration drive, Pavlovian S-R habits) [29-37].”
Baldwin, A. E., Sadeghian, K., & Kelley, A. E. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-03-01063.2002 · Cited by 194
“R) learning (Thorndike, 1911; Hull, 1943) as well as more modern interpretations of instrumental learning (Packard et al., 1989; Dickinson and Balleine, 1994) posit that multiple processes influence adaptive motor learning.”
BackgroundThe role of incentive learning in instrumental outcome revaluation by sensory-specific satiety
Balleine, B. W., & Dickinson, A. (1998) · Animal Learning & Behavior · doi:10.3758/bf03199161 · Cited by 188
Self-citationEarly consolidation of instrumental learning requires protein synthesis in the nucleus accumbens
Hernandez, P. J., Sadeghian, K., & Kelley, A. E. (2002) · Nature Neuroscience · doi:10.1038/nn973 · Cited by 186
“gif" NDATA ITEM> ]> Instrumental learning, whereby an organism learns a new motor action to obtain a positive outcome (procurement of food when hungry, avoidance of danger or pain), is fundamental to behavioral adaptatio”
BackgroundSchwabe, L., & Wolf, O. T. (2010) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.12.010 · Cited by 189
“…learning of associations between actions and the incentive value of an outcome (action—outcome learning), and a habit learning process that involves learning associations between contexts or stimuli and responses (stimulus—response learning) (Dickinson , 1985; Dickinson and Balleine, 1994).”
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02833.x · Cited by 189
Self-citationStill at the Choice‐Point: Action Selection and Initiation in Instrumental Conditioning
BALLEINE, B. W., & OSTLUND, S. B. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.006 · Cited by 184
Self-citationDistinct opioid circuits determine the palatability and the desirability of rewarding events
Wassum, K. M., Ostlund, S. B., Maidment, N. T., & Balleine, B. W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905874106 · Cited by 182
“Thus, in rats, an increase in food deprivation increases the performance of lever-pressing actions that gain access to a palatable food reward only after the rats have been given the opportunity to consume that food in the deprived state (23, 24).”
BackgroundSelf-citationCost, Benefit, Tonic, Phasic: What Do Response Rates Tell Us about Dopamine and Motivation?
NIV, Y. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.018 · Cited by 183
The Neurobiology of Reference-Dependent Value Computation
De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4832-08.2009 · Cited by 174
“…brain remains a key question in neuroscience (Dayan and Abbott, 2001; Montague et al., 2006; Rangel et al., 2008), microeconomics (Glimcher and Rustichini, 2004; Camerer et al., 2005), reinforcement learning (Barto and Sutton, 1998) and animal behavior (Dickinson and Balleine, 1994; Schultz, 2004).”
BackgroundTactile learning and the individual evaluation of the reward in honey bees ( Apis mellifera L.)
Scheiner, R., Erber, J., & Page Jr., R. E. (1999) · Journal of Comparative Physiology A: Sensory, Neural, and Behavioral Physiology · doi:10.1007/s003590050360 · Cited by 175
“In vertebrates, the relationship between the strength of the reward and its e ects on learning has also been widely discussed (Dickinson and Balleine 1994).”
BackgroundSpielberg, J. M., Miller, G. A., Engels, A. S., Herrington, J. D., Sutton, B. P., Banich, M. T., & Heller, W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.08.037 · Cited by 173
“Yet motivation is important for the maintenance of goal-directed behavior over time (Dickinson & Balleine, 1994), which suggests the involvement of dorsolateral prefrontal cortex (DLPFC, part of the middle frontal gyrus), a brain region more commonly associated with executive function and working…”
Learning robust cortico-cortical associations with the basal ganglia: An integrative review
Hélie, S., Ell, S. W., & Ashby, F. G. (2015) · Cortex · doi:10.1016/j.cortex.2014.10.011 · Cited by 173
“For example, rule-based learning that depends on declarative memory and goal-directed instrumental responding are both flexible with regard to their sensitivity to the nature and timing of feedback (Balleine, 2001; Dickinson & Balleine, 1994; Maddox et al., 2003; Maddox & Ing, 2005).”
A top-down perspective on dopamine, motivation and memory
Phillips, A. G., Vacca, G., & Ahn, S. (2008) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2007.10.014 · Cited by 172
Neural contributions to the motivational control of appetite in humans
Hinton, E. C., Parkinson, J. A., Holland, A. J., Arana, F. S., C. Roberts, A., & Owen, A. M. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03589.x · Cited by 170
“…the control of appetite has yet to be defined fully due to difficulties in disentangling genetically determined predispositions (Barsh et al., 2000), biochemical signals (Schwartz et al., 2000; Tschop et al., 2000), and affective and motivational factors (Dickinson & Balleine, 1994; Small, 2002).”
BackgroundMethodBehavioral and Movement Disorders Induced by Local Inhibitory Dysfunction in Primate Striatum
Worbe, Y., Baup, N., Grabli, D., Chaigneau, M., Mounayar, S., McCairn, K., Féger, J., & Tremblay, L. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn214 · Cited by 167
“Motivation can be defined as a driving force of goal-directed behaviors that translates expected reward into action (Dickinson and Balleine 1994; Berridge 2004).”
BackgroundTremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 168
“Rewards play a central role in mediating voluntary behavior (Dickinson and Balleine 1994).”
BackgroundHart, G., Leung, B. K., & Balleine, B. W. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.11.003 · Cited by 166
“In this review we will be primarily concerned with goal-directed actions, which are flexible, rapidly acquired actions the acquisition and performance of which is mediated by the formation of action-outcome associations (cf. Balleine, 2001; Dickinson & Balleine, 1994).”
BackgroundSelf-citationMannella, F., Gurney, K., & Baldassarre, G. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00135 · Cited by 166
“Figure 1 summarizes the main ideas in the literature related to the interpretation of the mechanisms underlying these processes and their relation to S-R/habitual behaviors (e.g., see Dickinson and Balleine, 1994; Balleine and Dickinson, 1998; Cardinal et al., 2002a).”
The Primate Ventral Pallidum Encodes Expected Reward Value and Regulates Motor Action
Tachibana, Y., & Hikosaka, O. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.030 · Cited by 168
“This is the hallmark of ‘‘goal-directed behavior based on motivational values’’ (Dickinson and Balleine, 1994).”
BackgroundIndividual variation in resisting temptation: Implications for addiction
Saunders, B. T., & Robinson, T. E. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.008 · Cited by 166
Schwabe, L., Tegenthoff, M., Höffken, O., & Wolf, O. T. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1304-12.2012 · Cited by 162
“Goal-directed and habit processes are thought to operate in tandem and habit behavior develops usually only after extended training (Adams, 1982; Dickinson and Balleine, 1994; Balleine and Dickinson, 1998b; Killcross and Coutureau, 2003).”
BackgroundRenteria, R., Baltz, E. T., & Gremel, C. M. (2018) · Nature Communications · doi:10.1038/s41467-017-02615-9 · Cited by 164
Animal affect and decision-making
Mendl, M., & Paul, E. S. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.01.025 · Cited by 185
Corbit, L. H., & Janak, P. H. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07153.x · Cited by 165
“…response and its consequences or outcome; action choice will depend not only on knowledge of this relationship but also on an evaluative process that examines the value of that outcome relative to alternatives (Adams & Dickinson, 1981; Dickinson & Balleine, 1994; Balleine & Dickinson, 1998).”
BackgroundDissociation of Psychomotor Sensitization from Compulsive Cocaine Consumption
Ahmed, S. H., & Cador, M. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300834 · Cited by 160
“By correcting or reducing this reward deficit, cocaine would secondarily acquire the ability to induce drug-seeking behavior, probably through a process of incentive learning not unlike that described recently by Dickinson and his colleagues (Dickinson and Balleine, 1994; Hutcheson et al, 2001).”
Methamphetamine‐induced structural plasticity in the dorsal striatum
Jedynak, J. P., Uslaner, J. M., Esteban, J. A., & Robinson, T. E. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05316.x · Cited by 152
“When animals initially learn that an action reliably produces a desired outcome they tend to repeat that action, and initially their behavior is controlled by explicit anticipation of the outcome or goal (Dickinson & Balleine, 1994).”
BackgroundTHE BEHAVIORAL PHARMACOLOGY OF EFFORT‐RELATED CHOICE BEHAVIOR: DOPAMINE, ADENOSINE AND BEYOND
Salamone, J. D., Correa, M., Nunes, E. J., Randall, P. A., & Pardo, M. (2012) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2012.97-125 · Cited by 153
Salamone, J. D., Arizzi, M. N., Sandoval, M., Cervone, K., & Aberman, J. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0994-x · Cited by 171
“Of course, instrumental behavior is a very complex and multifaceted phenomenon, with several factors influencing response output (for example, Pavlovian and instrumental associative factors, motivational processes, and work requirements of the schedule; Collier and Jennings 1969; Staddon 1979, 1983; Hursh et al. 1988;…”
BackgroundResultLimbic cortical-ventral striatal systems underlying appetitive conditioning
Parkinson, J. A., Cardinal, R. N., & Everitt, B. J. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26019-6 · Cited by 149
“Firstly, animals may act in a goal-directed fashion (Dickinson and Balleine, 1994);”
BackgroundSalwiczek, L. H., Prétôt, L., Demarta, L., Proctor, D., Essler, J., Pinto, A. I., Wismer, S., Stoinski, T., Brosnan, S. F., & Bshary, R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049068 · Cited by 145
“As discussed above, it is possible that the receipt of intermediate rewards interferes with learning mechanisms in that it lowers the incentive value of the second reward [54].”
BackgroundPittig, A., Wong, A. H. K., Glück, V. M., & Boschet, J. M. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103550 · Cited by 144
On habits and addiction: an associative analysis of compulsive drug seeking
Ostlund, S. B., & Balleine, B. W. (2008) · Drug Discovery Today: Disease Models · doi:10.1016/j.ddmod.2009.07.004 · Cited by 147
“[9,15,16] for reviews).”
BackgroundSelf-citationCheung, T. H., & Cardinal, R. N. (2005) · BMC Neuroscience · doi:10.1186/1471-2202-6-36 · Cited by 150
“Instrumental conditioning with delayed reinforcement can be enhanced if rats are exposed to the relevant contextual cues prior to instrumental training, and this enhancement is lessened if 'free' (non-contingent) rewards are given during the contextual pre-exposure periods [9,17].”
BackgroundInfluentialSelective Reward Deficit in Mice Lacking β-Endorphin and Enkephalin
Hayward, M. D., Pintar, J. E., & Low, M. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-18-08251.2002 · Cited by 134
“This hypothesis will have to be addressed in future experiments by examining incentive valuation directly (Dickinson and Balleine, 1994).”
Individual differences in the neurophysiology of reward and the obesity epidemic
Small, D. M. (2009) · International Journal of Obesity · doi:10.1038/ijo.2009.71 · Cited by 144
The Role of the Hippocampus in Instrumental Conditioning
Corbit, L. H., & Balleine, B. W. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04233.2000 · Cited by 145
“Although for many years instrumental learning was characterized solely in stimulus–response (S-R) terms, recent evidence from outcome devaluation studies has made it clear that, in instrumental conditioning, rats are able to encode the specific consequences of their actions and that the encoded action–outcome (A-O) re…”
BackgroundMethodInfluentialSelf-citationAlgorithms for survival: a comparative perspective on emotions
Bach, D. R., & Dayan, P. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2017.35 · Cited by 158
Paul, E. S., & Mendl, M. T. (2018) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2018.01.008 · Cited by 142
“It is generally accepted that the most traditional and commonly employed instrumental paradigm, in which rats learn to produce actions such as lever presses or chain-pulls, can be said to be instrumental in nature (Skinner, 1938; Dickinson and Balleine, 1994).”
BackgroundEmotional reactions to learning in cattle
Hagen, K., & Broom, D. M. (2004) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2003.11.007 · Cited by 172
“The idea of a process agency, and of understanding the causal connection between a response and a reward, can be accommodated in theories of goal-directed action and incentive learning (Dickinson and Balleine, 1994).”
BackgroundEffects of ibotenic acid lesions of the Nucleus Accumbens on instrumental action
Balleine, B. W., & Killcross, S. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90104-x · Cited by 154
Self-citationInteractions between the prefrontal cortex and amygdala during delay discounting and reversal.
Churchwell, J. C., Morris, A. M., Heurtelou, N. M., & Kesner, R. P. (2009) · Behavioral Neuroscience · doi:10.1037/a0017734 · Cited by 141
“…is that time estimation and incentive value are crucial variables for understanding choice behavior of animals with bilateral or disconnection inactivation of mPFC and BLA in this task (Barratt, 1983; Dickinson & Balleine, 1994; Evenden, 1999; Ghods-Sharifi, et al., 2009; Wittmann & Paulus, 2008).”
BackgroundDifferential roles of caudate nucleus and putamen during instrumental learning
Brovelli, A., Nazarian, B., Meunier, M., & Boussaoud, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.059 · Cited by 142
“According to the associative-cybernetic account of the model (Dickinson and Balleine, 1993, 1994; de Wit and Dickinson, 2009), reinforcement learning in the sensorimotor system is a slow process that develops with training and it is not sufficient to drive appropriate motor responses early during…”
InfluentialKeeler, J. F., Pretsell, D. O., & Robbins, T. W. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.07.021 · Cited by 172
Parkes, S. L., & Balleine, B. W. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5071-12.2013 · Cited by 138
“Choice between goal-directed actions depends on an animal’s ability to integrate the relationship between actions and their consequences with changes in the relative reward or incentive value of those consequences (Dickinson and Balleine, 1994; Balleine, 2001, 2005).”
BackgroundSelf-citationPears, A., Parkinson, J. A., Hopewell, L., Everitt, B. J., & Roberts, A. C. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-35-11189.2003 · Cited by 137
“A likely explanation for why there are variable effects of prefrontal lesions on the performance of animals on these different response schedules is because of the multiple associations that can be formed among responses, conditioned stimuli, and primary reinforcers (for review, see Dickinson and Balleine, 1994 ), any…”
BackgroundWassum, K. M., Ostlund, S. B., Balleine, B. W., & Maidment, N. T. (2011) · Learning & Memory · doi:10.1101/lm.2229311 · Cited by 135
Self-citation21st century neurobehavioral theories of decision making in addiction: Review and evaluation
Bickel, W. K., Mellis, A. M., Snider, S. E., Athamneh, L. N., Stein, J. S., & Pope, D. A. (2018) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2017.09.009 · Cited by 134
“As discussed in detail by Dickinson and Balleine (1994), these theories distinguish between Pavlovian and instrumental learning processes underlying drug addiction.”
BackgroundInfluentialHoward, J. D., & Kahnt, T. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3473-16.2017 · Cited by 136
“Importantly, updating of these representations must occur on the fly, and thus without the need for additional stimulus– outcome learning (Dickinson and Balleine, 1994).”
BackgroundChib, V. S., De Martino, B., Shimojo, S., & O'Doherty, J. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.02.038 · Cited by 130
“…responses come to be elicited by a stimulus that predicts the subsequent delivery of a reward, and an instrumental system in which actions are selected flexibly in order to increase the probability of obtaining reward (Bray et al., 2008; Dickinson and Balleine, 1994; Talmi et al., 2008).”
Devan, B. D., Hong, N. S., & McDonald, R. J. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.06.002 · Cited by 157
“Two intervening variables frequently involved in discussions of behavioral selection are attention and motivation (e.g., Dickinson & Balleine, 1994; Duncan, 1984; Mackintosh, 1965; Mackintosh, 1975; Milner, 1977), and a great deal has been written about the neural mechanisms underlying these…”
BackgroundDistinct cortical–amygdala projections drive reward value encoding and retrieval
Malvaez, M., Shieh, C., Murphy, M. D., Greenfield, V. Y., & Wassum, K. M. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0374-7 · Cited by 135
Relative reward processing in primate striatum
Cromwell, H. C., Hassani, O. K., & Schultz, W. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2223-z · Cited by 142
“Orbitofrontal neurons adapt their discrimination to the current rewards (Tremblay and Schultz 1999), although they rarely show the goal-related (Dickinson and Balleine 1994) movement preparatory delay activity of striatal neurons (Hollerman et al. 1998) (Fig.”
BackgroundSwart, J. C., Froböse, M. I., Cook, J. L., Geurts, D. E. M., Frank, M. J., Cools, R., & den Ouden, H. E. M. (2017) · eLife · doi:10.7554/elife.22169 · Cited by 152
“…sys- tems allow organisms to adaptively learn action-outcome contingencies, by assigning value to actions that in the past have led to good outcomes, while reducing value of actions that led to nega- tive outcomes (Dickinson and Balleine, 1994; Rescorla and Wagner, 1972; Robbins and Everitt, 2007).”
BackgroundBeyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 125
Ishiwari, K., Weber, S. M., Mingote, S., Correa, M., & Salamone, J. D. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.08.007 · Cited by 143
“Primary motivational processes, Pavlovian and instrumental associative factors, and work requirements of the schedule, all serve as factors that regulate instrumental performance [1,5,8,14,16,19,21,26,27,31,33,40] .”
BackgroundFenu, S., Bassareo, V., & Di Chiara, G. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-17-06897.2001 · Cited by 132
“In principle a role of DA in this process might derive from its involvement in the hedonic properties of rewards (Wise et al., 1978) or in learning of the association between the stimuli and reward (Pavlovian learning), between responses and their outcome (instrumental learning), or between stimuli and responses (habi…”
BackgroundFirst-person action experience reveals sensitivity to action efficiency in prereaching infants
Skerry, A. E., Carey, S. E., & Spelke, E. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312322110 · Cited by 127
“At test, there was a significant difference in the proportion of looking to the efficient reaching action across the two habituation groups [F(1, 50) = 4.”
BackgroundSome highlights of research on the effects of caudate nucleus lesions over the past 200 years
White, N. M. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.003 · Cited by 145
Ostlund, S. B., LeBlanc, K. H., Kosheleff, A. R., Wassum, K. M., & Maidment, N. T. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.96 · Cited by 142
Plastic Corticostriatal Circuits for Action Learning: What's Dopamine Got to Do with It?
COSTA, R. M. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.015 · Cited by 125
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.