Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Items 301–400 of 996
Cheke, L. G., & Clayton, N. S. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.59 · Cited by 66
Wassum, K. M., Cely, I. C., Balleine, B. W., & Maidment, N. T. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3102-10.2011 · Cited by 67
“…goal-directed actions are heavily influenced by the incentive value of the reward (Balleine and Dickinson, 1998), which is dependent on prior reward experience, and is therefore distinct from the general motivational effects of cues (Dickinson and Balleine, 1994; Corbit and Balleine, 2005).”
BackgroundSelf-citationHogarth, L., & Chase, H. W. (2012) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0027203 · Cited by 79
Expectancies in decision making, reinforcement learning, and ventral striatum
van der Meer, M. A. A., & Redish, A. D. (2010) · Frontiers in Neuroscience · doi:10.3389/neuro.01.006.2010 · Cited by 81
“The fi rst limitation is illustrated, for instance, by experiments that involve a motivational shift (Krieckhaus and Wolf, 1968; Dickinson and Balleine, 1994).”
BackgroundMotor Cortex in Voluntary Movements
(2004) · Frontiers in neuroscience · doi:10.1201/9780203503584.supl · Cited by 67
Vaghi, M. M., Cardinal, R. N., Apergis-Schoute, A. M., Fineberg, N. A., Sule, A., & Robbins, T. W. (2019) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2018.09.014 · Cited by 69
Cognitive and neuronal systems underlying obesity
Kanoski, S. E. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.01.007 · Cited by 66
“, [47,78,79]) showing that the ability of a food deprivation or repletion state to influence operant responding for food reinforcement is highly depen-”
The role of Pavlovian cues in alcohol seeking in dependent and nondependent rats.
Glasner, S. V., Overmier, J. B., & Balleine, B. W. (2005) · Journal of Studies on Alcohol · doi:10.15288/jsa.2005.66.53 · Cited by 66
Self-citationWendler, E., Gaspar, J. C. C., Ferreira, T. L., Barbiero, J. K., Andreatini, R., Vital, M. A. B. F., Blaha, C. D., Winn, P., & Da Cunha, C. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.11.009 · Cited by 65
“Actions instrumental to obtain positive (appetitive) reinforcement are thought to be learned both as goal-directed actions and S-R habits (Dickinson and Balleine, 1994).”
Behavioural expression of positive anticipation for food or opportunity to play in lambs.
Anderson, C., Yngvesson, J., Boissy, A., Uvnäs-Moberg, K., & Lidfors, L. (2015) · Behavioural Processes · doi:10.1016/j.beproc.2015.02.003 · Cited by 65
“To our knowledge it has not been studied empirically in farm animals, that anticipation will be expressed by goal directed behaviours, also called consummatory conditioned responses (Panksepp, 2005; Dickinson and Balleine, 1994; Pearce, 2008) that has been observed”
BackgroundSalwiczek, L. H., Watanabe, A., & Clayton, N. S. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.06.011 · Cited by 80
“They relied on the ‘specific satiety effect’ that eating one type of food selectively reduces the incentive value of this specific food type, while it does not interfere with eating any other kind of food [19,20].”
BackgroundThe role of opioid processes in reward and decision-making
Laurent, V., Morse, A. K., & Balleine, B. W. (2015) · British Journal of Pharmacology · doi:10.1111/bph.12818 · Cited by 64
“The first is the reward value assigned to the consequences or outcome of an action (Adams and Dickinson, 1981; Rescorla, 1990; Dickinson, 1994; Dickinson and Balleine, 1994).”
BackgroundSelf-citationWhat can associative learning do for planning?
Lind, J. (2018) · Royal Society Open Science · doi:10.1098/rsos.180778 · Cited by 73
Bradfield, L. A., & Hart, G. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.11.009 · Cited by 67
“value of the outcome or goal (goal criterion), and the contingency between the action and outcome (instrumental criterion (15)).”
BackgroundLaurent, V., Bertran-Gonzalez, J., Chieng, B. C., & Balleine, B. W. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.4592-13.2014 · Cited by 62
“, a stimulus associated with a particular outcome biases choice toward actions that earn that same outcome (Colwill and Rescorla, 1988; Dickinson and Balleine, 1994; Holmes et al., 2010).”
BackgroundSelf-citationDual-process theories and consciousness: the case for ‘Type Zero’ cognition: Table 1.
Shea, N., & Frith, C. D. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw005 · Cited by 63
“…of behaviour that have been learnt instrumentally in response to reward feedback have long been known to divide into goal-directed behaviour, which is immediately sensitive to the devaluation of an outcome, and habit-based behaviour, which is not (Dickinson and Balleine 1994, in non-human animals).”
BackgroundVandaele, Y., Cantin, L., Serre, F., Vouillac‐Mendoza, C., & Ahmed, S. H. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.195 · Cited by 68
“They can foresee certain future events, as when they pursue immediate goals (Corballis, 2013; Dickinson and Balleine, 1994; Johnson and Redish, 2007), but their time horizon is likely too narrow to encompass the delayed direct influence of a current drug choice on future choices.”
BackgroundAutomaticity and multiple memory systems
Ashby, F. G., & Crossley, M. J. (2012) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1172 · Cited by 70
Effects of optimism on motivation in rats
Ryguła, R., Gołębiowska, J., Kregiel, J., Kubik, J., & Popik, P. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00032 · Cited by 68
“It has been conceptualized as selecting goals based on their predictive value, initiating behavior to achieve goals, and maintaining goal-directed action (Dickinson and Balleine, 1994; Wigfield and Eccles, 2000).”
BackgroundLearning and the Evolution of Conscious Agents
Jablonka, E., & Ginsburg, S. (2022) · Biosemiotics · doi:10.1007/s12304-022-09501-y · Cited by 61
“They showed that in rats, desirability is learned by manipulating the value of a learned outcome of an action (reviewed in Dickinson & Balleine, 1994, 2000, 2010), and that rats’ decisions and human causal judgment show similar illusions under manipulations of the action-outcome contingency…”
BackgroundBrovelli, A., Chicharro, D., Badier, J., Wang, H., & Jirsa, V. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4892-14.2015 · Cited by 72
“The associative-cybernetic model formalizes these notions as the coordination of a habit memory module encoding S–R associations with an associative memory module, representing the belief that a given response causes a particular outcome (Dickinson and Balleine, 1994; Dickinson, 2012).”
InfluentialReconsolidation of a well-learned instrumental memory
Exton-McGuinness, M. T. J., Patton, R. C., Sacco, L., & Lee, J. L. C. (2014) · Learning & Memory · doi:10.1101/lm.035543.114 · Cited by 69
Different dorsal striatum circuits mediate action discrimination and action generalization
Hilario, M., Holloway, T., Jin, X., & Costa, R. M. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08073.x · Cited by 60
Hilário, M. R. F., & Costa, R. M. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.030.2008 · Cited by 71
“These studies established that goal-directed actions are sensitive to changes in the expected value of the outcome and the contingency between the action and the outcome (A-O); while habitual behaviors are insensitive to changes in outcome value and contingency between action and outcome, suggesting they are governed…”
BackgroundInfluentialPavlovian Control of Escape and Avoidance
Millner, A. J., Gershman, S. J., Nock, M. K., & den Ouden, H. E. M. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01224 · Cited by 55
Abnormal patterns of displacement activities: A review and reinterpretation
Anselme, P. (2008) · Behavioural Processes · doi:10.1016/j.beproc.2008.05.001 · Cited by 58
“There are indeed good reasons for separating motivational and releasing properties of a stimulus, as suggested by some works in the fields of animal psychology (e.g. Dickinson and Balleine, 1994).”
Fujimoto, A., Hori, Y., Nagai, Y., Kikuchi, E., Oyama, K., Suhara, T., & Minamimoto, T. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.2399-18.2018 · Cited by 63
“The loss of information regarding motivational value could promote a shift from goal-directed to habitual control of action (Dickinson, 1985; Dickinson and Balleine, 1994), which is implicated in the hallmark of addictive disorders (Everitt and Robbins, 2005; Ersche et al.”
BackgroundInfluentialPeak, J. N., Chieng, B. C. H., Hart, G., & Balleine, B. W. (2020) · eLife · doi:10.7554/elife.58544 · Cited by 71
Self-citationToward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation
Cunha, C. D., Boschen, S. L., Gómez‐A, A., Ross, E. K., Gibson, W. S. J., Min, H.-K. P., Lee, K. H., & Blaha, C. D. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.02.003 · Cited by 68
Top-Down Response Suppression Mitigates Action Tendencies Triggered by a Motivating Stimulus
Freeman, S. M., Razhas, I., & Aron, A. R. (2014) · Current Biology · doi:10.1016/j.cub.2013.12.019 · Cited by 62
Attenuated Dopamine Efflux in the Rat Nucleus Accumbens During Successive Negative Contrast.
Genn, R. F., Ahn, S., & Phillips, A. G. (2004) · Behavioral Neuroscience · doi:10.1037/0735-7044.118.4.869 · Cited by 66
Moors, A. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1235900 · Cited by 90
“One popular type of theory are dual process theories, which distinguish between two types of mechanisms, based on the type of content of the representations (Balleine & Dickinson, 1998; Dickinson & Balleine, 1994; Heyes & Dickinson, 1993)7: a goal-directed and a stimulusdriven mechanism.”
BackgroundBehavioral characterization of mdx3cv mice deficient in C-terminal dystrophins
Vaillend, C., & Ungerer, A. (1999) · Neuromuscular Disorders · doi:10.1016/s0960-8966(99)00029-2 · Cited by 65
The Comparative Study of Learning from 1994-2013
Blaser, R. E., & Bellizzi, C. (2014) · International Journal of Comparative Psychology · doi:10.46867/ijcp.2014.27.01.06 · Cited by 59
A place for emotions in behavior systems research
Burghardt, G. M. (2019) · Behavioural Processes · doi:10.1016/j.beproc.2019.06.004 · Cited by 60
Dynamic influences on the neural encoding of social valence
Padilla-Coreano, N., Tye, K. M., & Zelikowsky, M. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00609-1 · Cited by 66
Viejo, G. D., Khamassi, M., Brovelli, A., & Girard, B. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00225 · Cited by 66
The Integrated Theory of Emotional Behavior Follows a Radically Goal-Directed Approach
Moors, A. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1275207 · Cited by 67
“The distinction between stimulus-driven and goal-directed mechanisms is borrowed from the operant learning literature, where both mechanisms are defined in terms of the content of their mediating representations (Dickinson & Balleine, 1994).”
BackgroundMaisto, D., Barca, L., Van den Bergh, O., & Pezzulo, G. (2021) · Psychological Review · doi:10.1037/rev0000290 · Cited by 49
Barbano, M. F., Saux, M. L., & Cador, M. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1390-6 · Cited by 66
“In accordance with the incentive learning hypothesis of Dickinson and Balleine (1994) , the fact that the animals have learned the contingency “lever press/food reward” under food deprivation might modify the instrumental performance.”
BackgroundResultThe interoceptive cue properties of ghrelin generalize to cues produced by food deprivation
Davidson, T. L., Kanoski, S. E., Tracy, A. L., Walls, E. K., Clegg, D. J., & Benoit, S. C. (2005) · Peptides · doi:10.1016/j.peptides.2005.02.014 · Cited by 61
Structure and development of behavior systems
Hogan, J. A. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210948 · Cited by 58
Pharmacology of Sucrose-Reinforced Place-Preference Conditioning
Delamater, A. R., Sclafani, A. J., & Bodnar, R. J. (2000) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(99)00251-8 · Cited by 56
Amygdaloid inputs define a caudal component of the ventral striatum in primates
Fudge, J. L., Breitbart, M. A., & McClain, C. (2004) · Journal of Comparative Neurology · doi:10.1002/cne.20228 · Cited by 55
Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning
Luque, D., Beesley, T., Morris, R. W., Jack, B. N., Griffiths, O., Whitford, T. J., & Pelley, M. E. L. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3205-16.2017 · Cited by 67
“R activation is faster than goal-directed processing (e.g., the associative-cybernetic model; Dickinson and Balleine, 1994).”
MethodNeurocognitive mechanisms of perception–action coordination: A review and theoretical integration
Ridderinkhof, K. R. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.05.008 · Cited by 68
Exton-McGuinness, M. T. J., & Lee, J. L. C. (2015) · eNeuro · doi:10.1523/eneuro.0009-15.2015 · Cited by 56
“While this can function to generally increase (or decrease) overall activity, it can also act to modulate the vigor of specific instrumental behaviors associated with a specific outcome (Dickinson and Balleine, 1994; Corbit et al., 2007).”
BackgroundThinking Outside the Box: Orbitofrontal Cortex, Imagination, and How We Can Treat Addiction
Schoenbaum, G. M., Chang, C.-Y., Lucantonio, F., & Takahashi, Y. K. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.147 · Cited by 58
“Such behavior is variously described as goal-directed or model-based (Daw et al, 2005; Dickinson and Balleine, 1994), although these terms are typically used to describe instrumental behavior, whereas orbitofrontal function does not seem to be constrained to instrumental activities.”
Role of primary motivation in stimulus preexposure effects.
Killcross, S., & Balleine, B. W. (1996) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.22.1.32 · Cited by 60
Self-citationA neuronal mechanism for motivational control of behavior
Courtin, J., Bitterman, Y., Müller, S., Hinz, J., Hagihara, K. M., Müller, C., & Lüthi, A. (2022) · Science · doi:10.1126/science.abg7277 · Cited by 53
“M aintaining motivational states allows animals to direct behavior to achieve desired goals (1).”
BackgroundPathways to the persistence of drug use despite its adverse consequences
McNally, G. P., Jean-Richard-dit-Bressel, P., Millan, E. Z., & Lawrence, A. J. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02040-z · Cited by 60
“Incentive learning is well established for non-drug reinforcers [105, 115, 116].”
BackgroundIncentive salience attribution under reward uncertainty: A Pavlovian model
Anselme, P. (2014) · Behavioural Processes · doi:10.1016/j.beproc.2014.10.016 · Cited by 59
Gal, R., & Libersat, F. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010019 · Cited by 52
“have been the subject of extensive study for decades [2–4].”
Schaefer, L. M., & STEINGLASS, J. E. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-020-01213-9 · Cited by 52
Hinton, E. C., Holland, A. J., Gellatly, M. S. N., Soni, S., & Owen, A. M. (2006) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2006.00812.x · Cited by 50
Control over a stressor involves the posterior dorsal striatum and the act/outcome circuit
Amat, J., Christianson, J. P., Aleksejev, R. M., Kim, J., Richeson, K. R., Watkins, L. R., & Maier, S. F. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12609 · Cited by 50
“However, the study of brain mechanisms involved in instrumental reward learning came to indicate that both types of learning occur under different circumstances, and involve separable brain mechanisms (Dickinson & Balleine, 1994; Yin et al., 2005; Shiflett & Balleine, 2011).”
BackgroundInternal-state-dependent control of feeding behavior via hippocampal ghrelin signaling
Wee, R. W. S., Mishchanchuk, K., AlSubaie, R., Church, T. W., Gold, M. G., & MacAskill, A. F. (2023) · Neuron · doi:10.1016/j.neuron.2023.10.016 · Cited by 50
“7,8 Such value-based associations between sensory cues and the consumption of food are therefore crucial for efficient anticipatory behavior around food.”
Swart, J. C., Frank, M. J., Määttä, J. I., Jensen, O. B., Cools, R., & den Ouden, H. E. M. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2005979 · Cited by 62
Frömer, R., & Shenhav, A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.12.006 · Cited by 66
Motivated Reinforcement Learning
Dayan, P. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0006 · Cited by 49
A Parasitoid Wasp Manipulates the Drive for Walking of Its Cockroach Prey
Gal, R., & Libersat, F. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.076 · Cited by 55
Strong and weak alignment of large language models with human values
Khamassi, M., Nahon, M., & Chatila, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-70031-3 · Cited by 101
“…associations, no matter how complex the stimuli, constellations of stimuli, or contextual stimuli are, and goal-oriented behaviors with the intention to reach a particular goal and the use of internal models to estimate which actions are necessary to produce or reach that goal [40, 65].”
Laurent, V., Wong, F. L., & Balleine, B. W. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3415-16.2017 · Cited by 54
“However, it is well established that choice is also influenced by the value of the outcomes delivered by the instrumental actions (Dickinson and Balleine, 1994); an action delivering a valued outcome will be favored over an action earning a less valued outcome.”
BackgroundResultSelf-citationGenerating Options and Choosing Between Them Depend on Distinct Forms of Value Representation
Morris, A., Phillips, J., Huang, K., & Cushman, F. A. (2021) · Psychological Science · doi:10.1177/09567976211005702 · Cited by 69
“Cached value representations— computed in dopaminergic circuits of the basal ganglia— are imprecise but efficient, and they capture key features of habitual as opposed to planned behavior (Dickinson & Balleine, 1994; Dolan & Dayan, 2013).”
BackgroundMethodCardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2003) · International Congress Series · doi:10.1016/s0531-5131(03)01013-6 · Cited by 62
“Finally, Pavlovian CSs can modulate instrumental performance [12,13], an effect termed Pavlovian–instrumental transfer (PIT).”
BackgroundResultInfluentialIncreasing farm animal welfare by positively motivated instrumental behaviour
Manteuffel, G., Langbein, J., & Puppe, B. (2009) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2009.02.014 · Cited by 61
Taste reactivity patterns in domestic cats (Felis silvestris catus)
van den Bos, R., Meijer, M. K., & Spruijt, B. M. (2000) · Applied Animal Behaviour Science · doi:10.1016/s0168-1591(00)00124-6 · Cited by 55
Catecholaminergic modulation of the avoidance of cognitive control.
Froböse, M. I., Swart, J. C., Cook, J. L., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000523 · Cited by 53
“Most generally, the motivational control of goal-directed behaviour is well established to depend on the learning of the value and cost of our actions (Dickinson & Balleine, 1994).”
Adolescents exhibit reduced Pavlovian biases on instrumental learning
Raab, H. A., & Hartley, C. A. (2020) · Scientific Reports · doi:10.1038/s41598-020-72628-w · Cited by 56
Kent, M., Rivers, C. T., & Wrenn, G. L. (2015) · Behavioral Sciences · doi:10.3390/bs5020264 · Cited by 65
“Goal-directed action is more psychological in nature, and is motivated by belief in a contingency between an outcome and a goal and a desire for an outcome [3].”
BackgroundGadziola, M. A., & Wesson, D. W. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.3328-15.2016 · Cited by 54
Planning activity for internally generated reward goals in monkey amygdala neurons
Hernádi, I., Grabenhorst, F., & Schultz, W. (2015) · Nature Neuroscience · doi:10.1038/nn.3925 · Cited by 46
“Cueposition Juice d / ay Monkey + + β ε 6 (2)”
An MEG signature corresponding to an axiomatic model of reward prediction error
Talmi, D., Fuentemilla, L., Litvak, V., Duzel, E., & Dolan, R. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.051 · Cited by 46
“The way humans and animals respond to the environment depends on prior expectations about the likelihood of events, and on whether they perceive those events to be good or bad (Dickinson and Balleine, 1994).”
BackgroundReduced goal‐directed action control in autism spectrum disorder
Alvares, G. A., Balleine, B. W., Whittle, L., & Guastella, A. J. (2016) · Autism Research · doi:10.1002/aur.1613 · Cited by 47
“Goal-directed actions reflect the integration of two sources of information: (a) knowledge of the causal consequences or outcome of an action; and (b) the value of the outcome [Balleine & Dickinson, 1998; Dickinson & Balleine, 1994].”
BackgroundSelf-citationCaching mechanisms for habit formation in Active Inference
Maisto, D., Friston, K. J., & Pezzulo, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.083 · Cited by 55
“In general, deliberative processing is considered more cognitively demanding but also more flexi-ble than habits [3,14,47] .”
BackgroundInterfacing behavioral and neural circuit models for habit formation
Lerner, T. N. (2020) · Journal of Neuroscience Research · doi:10.1002/jnr.24581 · Cited by 53
“A goal-directed behavior should be responsive to both action–outcome contingency changes and changes in outcome value (Dickinson & Balleine, 1994), so the loss of either is used as evidence for habit.”
BackgroundMendelsohn, A., Pine, A., & Schiller, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.019 · Cited by 54
“The rewarded cues can then activate motivational systems, which engender the potentiation of the instrumental (goal-directed) action (Dickinson and Balleine, 1994).”
Motivating operations and stimulus control
Edwards, T. L., Lotfizadeh, A. D., & Poling, A. D. (2019) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.516 · Cited by 50
Baracchi, D., Cabirol, A., Devaud, J., Haase, A., d’Ettorre, P., & Giurfa, M. (2020) · Communications Biology · doi:10.1038/s42003-020-01183-x · Cited by 45
Homayoun, H., & Moghaddam, B. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06679.x · Cited by 54
“In the PIT paradigm, the CS-associated instrumental responses are the core feature of PIT, where the motivational state evoked by CS ‘transfers’ to instrumental incentives that reinstate an extinguished instrumental action (Dickinson & Balleine, 1994; Cardinal et al., 2002).”
Ruiz-Tejada, A., Neisewander, J. L., & Katsanos, C. S. (2022) · Brain Sciences · doi:10.3390/brainsci12030333 · Cited by 63
“Although motivation controls goal-directed behavior that is dependent on a reward [51], habit is formed as a result of repetition and may eventually become insensitive to reward (i.”
BackgroundA dopamine mechanism for reward maximization
Schultz, W. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2316658121 · Cited by 49
Beliefs and desires in the predictive brain
Yon, D., Heyes, C. M., & Press, C. (2020) · Nature Communications · doi:10.1038/s41467-020-18332-9 · Cited by 57
Fenu, S., & Di Chiara, G. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02899.x · Cited by 44
Dopamine levels modulate the updating of tastant values
Costa, R. M., Gutierrez, R., De Araujo, I. E., Coelho, M. R. P., Kloth, A. D., Gainetdinov, R. R., Caron, M. G., Nicolelis, M. A. L., & Simon, S. A. (2007) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2006.00257.x · Cited by 44
Bouton, M. E., & Sunsay, C. (2001) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/713932752 · Cited by 49
“Perhaps the food US makes the animal feel better while it is frustrated, and responding to the CS is ultimately influenced by the animal’s knowledge of how the reinforcer affects that motivational state (cf. Dickinson & Balleine, 1994).”
BackgroundFunctional Organization and Adaptability of a Decision-Making Network in Aplysia
Nargeot, R., & Simmers, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00113 · Cited by 46
“These adaptive behaviors can be rhythmic and relatively stereotyped, or may be highly variable and directed toward a specific goal (Dickinson and Balleine, 1994; Marder, 2000; Pearson, 2000; Brembs, 2011a).”
BackgroundIndividual differences in bodily freezing predict emotional biases in decision making
Ly, V., Huys, Q. J. M., Stins, J. F., Roelofs, K., & Cools, R. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00237 · Cited by 52
“…or punishment-predictive stimuli modulate instrumental responses (Estes and Skinner, 1941; Estes, 1948; Di Giusto et al., 1974; Lovibond, 1983; Dickinson and Balleine, 1994; Bray et al., 2008; Talmi et al., 2008; Declercq and De Houwer, 2009; Trick et al., 2011; Prévost et al., 2012; Geurts…”
Clayton, N. S. (2001) · Behavioral Neuroscience · doi:10.1037//0735-7044.115.3.614 · Cited by 43
Laurent, V., & Balleine, B. W. (2015) · Current Biology · doi:10.1016/j.cub.2015.02.044 · Cited by 45
“Although this finding suggests that rats can use predictive information to guide choice, it does not provide any direct evidence of counterfactual reasoning; whereas considerable evidence suggests that rats can encode specific action-outcome relationships [12, 13], there is currently no evidence that they encode the o…”
BackgroundSelf-citationSexually conditioned incentives:
López, H. H., & Ettenberg, A. (2002) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(01)00732-8 · Cited by 50
“Thus, subjects’ motivation to approach the goalbox was mediated not only by the presence of secondary incentives (including the S+), but also the establishment of a stimulus– response association (and/or action–outcome association; Dickinson and Balleine, 1994).”
BackgroundReconsolidation blockade for the treatment of addiction: challenges, new targets, and opportunities
Exton-McGuinness, M. T. J., & Milton, A. L. (2018) · Learning & Memory · doi:10.1101/lm.046771.117 · Cited by 46
“Encoding the incentive value of a reinforcer is vital to the functioning of any outcome-based memory association, and disrupting it will reduce expression of all outcome-associated behaviors in a goal-directed fashion (see Dickinson and Balleine 1994 for discussion).”
BackgroundThe Contents and Causes of Curiosity
Carruthers, P. (2021) · The British Journal for the Philosophy of Science · doi:10.1086/716609 · Cited by 49
Actions, policies, values, and the basal ganglia
Daw, N. D., Niv, Y., & Dayan, P. (2006) · MPG.PuRe (Max Planck Society) · Cited by 48
Dopamine antagonism attenuates the unconditioned incentive value of estrous female cues
López, H. H., & Ettenberg, A. (2001) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(00)00472-x · Cited by 42
Computational perspectives on human fear and anxiety
Yamamori, Y., & Robinson, O. J. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104959 · Cited by 46
Framing effect following bilateral amygdala lesion
Talmi, D., Hurlemann, R., Patin, A., & Dolan, R. J. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.03.005 · Cited by 49
Plans, Habits, and Theory of Mind
Gershman, S. J., Gerstenberg, T., Baker, C. L., & Cushman, F. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162246 · Cited by 56
“Classic work by Dickinson and colleagues [33, 34] argued that planned and habitual strategies constitute two separate systems of behavioral control.”
BackgroundVaghi, M. M. S., Moutoussis, M., Váša, F., Kievit, R., Hauser, T. U., Vértes, P. E., Shahar, N., Romero-García, R., Kitzbichler, M. G., Bullmore, E. T., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1922273117 · Cited by 44
“Alternatively, choices can be habitual where, through prior repetition and learning, they can be executed without deliberation (1, 2).”
Consolidation of Goal-Directed Action Depends on MAPK/ERK Signaling in Rodent Prelimbic Cortex
Hart, G., & Balleine, B. W. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.1772-16.2016 · Cited by 50
“There is now extensive evidence that animals integrate both evaluative and contingency related information to acquire goal-directed actions and make value-guided decisions in instrumental tasks (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998).”
BackgroundSelf-citation
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.