Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Items 501–600 of 996
From the Reward Circuit to the Valuation System: How the Brain Motivates Behavior
Pessiglione, M., & Lebreton, M. P. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1236-0_11 · Cited by 26
“Incentive value is one of these concepts; it can be understood as the feature of a goal that will activate the behavior toward this goal (Dickinson and Balleine 1994).”
BackgroundPiray, P., & Daw, N. D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/856849 · Cited by 22
Human Motives: Hedonism, Altruism, and the Science of Affect
Carruthers, P. (2024) · doi:10.1093/oso/9780198906131.001.0001 · Cited by 29
Brain Structural Substrates of Reward Dependence during Behavioral Performance
Dayan, E., Hamann, J. M., Averbeck, B. B., & Cohen, L. G. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3141-14.2014 · Cited by 23
“Motivational processes are a fundamental driver of human performance, affecting the acquisition of new knowledge and skills (Dweck, 1986; Dickinson and Balleine, 1994).”
BackgroundEvaluation of the hypothesis that phasic dopamine constitutes a cached-value signal
Sharpe, M. J., & Schoenbaum, G. M. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.12.002 · Cited by 24
Scaling relative incentive value in anticipatory behavior
Pellegrini, S., & Papini, M. R. (2006) · Learning and Motivation · doi:10.1016/j.lmot.2006.08.002 · Cited by 21
“Another claim relevant to this issue is that running behavior in a runway can be best understood as arising from Pavlovian contingencies that control goal-approach behavior (Dickinson & Balleine, 1994).”
BackgroundAttention is necessary for subliminal instrumental conditioning
Mastropasqua, T., & Turatto, M. (2015) · Scientific Reports · doi:10.1038/srep12920 · Cited by 21
Park, J., Lee, E.-H., Kwon, H., Baek, I., Seo, J.-S., Kim, K., & Han, P. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.09.027 · Cited by 20
Biased choice and incentive salience: Implications for addiction.
Pelley, M. E. L., Watson, P., & Wiers, R. W. H. J. (2024) · Behavioral Neuroscience · doi:10.1037/bne0000583 · Cited by 21
Deconstructing 5-HT6 receptor effects on striatal circuit function
Eskenazi, D., Brodsky, M., & Neumaier, J. F. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.04.046 · Cited by 23
“The instrumental learning design did not distinguish between action-outcome and stimulus-response learning, which would have required another probe test such as reinforcer-devaluation (Dickinson and Balleine, 1994).”
BackgroundHabitual nicotine-seeking in rats following limited training
Loughlin, A., Funk, D. R., Coen, K., & Lê, A. D. (2017) · Psychopharmacology · doi:10.1007/s00213-017-4655-0 · Cited by 25
Reward shifts in forced-choice and free-choice autoshaping with rats.
Conrad, S. E., & Papini, M. R. (2018) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000187 · Cited by 19
Timberlake’s theories dissolve anomalies
Killeen, P. R. (2019) · Behavioural Processes · doi:10.1016/j.beproc.2019.103894 · Cited by 20
Pitfalls of Behavioral Selectionism
Tonneau, F., & Sokolowski, M. B. C. (2000) · Perspectives in ethology · doi:10.1007/978-1-4615-1221-9_6 · Cited by 16
Resolution of outcome-induced response conflict by humans after extended training
de Wit, S., Ridderinkhof, K. R., Fletcher, P. C., & Dickinson, A. (2012) · Psychological Research · doi:10.1007/s00426-012-0467-3 · Cited by 28
“The notion of competing controllers of habitual and goaldirected behaviour has been captured in dual-system accounts, such as the associative-cybernetic model (de Wit & Dickinson, 2009; Dickinson & Balleine, 1994) and computational models (Daw, Niv, & Dayan, 2005).”
BackgroundSelf-citationJohnson, A. W., Bannerman, D. M., Rawlins, N., Sprengel, R., & Good, M. A. (2007) · Behavioral Neuroscience · doi:10.1037/0735-7044.121.6.1192 · Cited by 20
McNulty, C. J., Fallon, I. P., Amat, J., Sanchez, R. J., Leslie, N. R., Root, D. H., Maier, S. F., & Baratta, M. V. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01443-w · Cited by 23
Adaptive control of human action: the role of outcome representations and reward signals
Marien, H., Aarts, H., & Custers, R. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00602 · Cited by 21
Prospective and Pavlovian mechanisms in aversive behaviour
Rigoli, F., Pezzulo, G., & Dolan, R. J. (2015) · Cognition · doi:10.1016/j.cognition.2015.10.017 · Cited by 18
“…the appetitive domain has investigated a form of instrumental behaviour guided by goal-directed processes which are based on stimulus-action-outcome associations, but the part played by these mechanisms in the aversive domain remains unclear (Balleine & Dickinson, 1998; Dickinson & Balleine, 1994).”
What are goals? And if so, how many?
Rolf, M., & Asada, M. (2015) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2015.7346167 · Cited by 21
“Such representations should in particular reflect what aspects of a situation are relevant in relation to action and the underlying desire [1] and thus abstract from irrelevant aspects ([26], [21]).”
BackgroundInfluentialKendig, M. D., Cheung, A. M. K., Raymond, J. S., & Corbit, L. H. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00216 · Cited by 20
Intermittent feeding alters sensitivity to changes in reward value
Parkes, S. L., Furlong, T. M., Black, A. D., & Balleine, B. W. (2017) · Appetite · doi:10.1016/j.appet.2017.02.009 · Cited by 20
Self-citationLoss of striatal tyrosine‐hydroxylase interneurons impairs instrumental goal‐directed behavior
Kaminer, J., Espinoza, D., Bhimani, S., Tepper, J. M., Koós, T. Z., & Shiflett, M. W. (2019) · European Journal of Neuroscience · doi:10.1111/ejn.14412 · Cited by 24
“This behavioral flexibility relies on an animal forming an association between its actions and the outcomes or consequences of those actions (Adams & Dickinson, 1981; Balleine & Ostlund, 2007; Dickinson & Balleine, 1994).”
BackgroundA-learning: A new formulation of associative learning theory
Ghirlanda, S., Lind, J., & Enquist, M. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01749-0 · Cited by 22
What Can Different Brains Do with Reward?
Murray, E. A., Wise, S. P., & Rhodes, S. E. V. (2011) · Frontiers in neuroscience · doi:10.1201/b10776-6 · Cited by 22
Carvalho, O. P., Silva, A. J., & Balleine, B. W. (2001) · International Journal of Comparative Psychology · doi:10.46867/c4d01m · Cited by 21
“…the specific consequences of their actions and that the encoded action-outcome (A-O) relation plays a critical role in the initial acquisition and performance of an instrumental action (see Balleine, 2001; Dickinson & Balleine, 1994; Colwill & Rescorla, 1986, for detailed reviews of this issue).”
BackgroundSelf-citationA Goal-Directed Bayesian Framework for Categorization
Rigoli, F., Pezzulo, G., Dolan, R. J., & Friston, K. J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00408 · Cited by 20
“…in which biological organisms aim to occupy certain goal-states associated with self-preservation (Rosenblueth et al., 1943; Miller et al., 1960; Dickinson and Balleine, 1994; Pezzulo and Rigoli, 2011; Botvinick and Toussaint, 2012; Solway and Botvinick, 2012; Friston et al., 2013, 2015;…”
BackgroundMethodBehavioral controls of food intake
Benoit, S. C., & Tracy, A. L. (2007) · Peptides · doi:10.1016/j.peptides.2007.10.019 · Cited by 19
“Therefore, animals assign incentive values to specific foods based upon the degree of food deprivation present when the foods are consumed [3,4,31,32].”
BackgroundExtinction and the associative structure of heterogeneous instrumental chains
Thrailkill, E. A., & Bouton, M. E. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2016.06.005 · Cited by 19
“Incentive learning is well-documented in studies of simple instrumental behavior (Balleine, 1992; Dickinson & Balleine, 1994), but the phenomenon appears to be restricted to those behaviors in a chain that are remote from, or distal to, the primary reinforcer.”
Hommel, B. (2017) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199399550.013.18 · Cited by 19
Pre-trial cocaine biases choice toward cocaine through suppression of the nondrug option
Freese, L., Durand, A., Guillem, K., & Ahmed, S. H. (2018) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2018.07.010 · Cited by 17
“The fact that during no-choice session, rats initiated responding for sweet water while their motivation was still partially suppressed by cocaine may suggest that responding for sweet water is not entirely goal-directed and thus less sensitive to the current level of motivation for sweet water (Dickinson and Balleine…”
Dorsomedial Striatal Activity Tracks Completion of Behavioral Sequences in Rats
Vandaele, Y., Ottenheimer, D. J., & Janak, P. H. (2021) · eNeuro · doi:10.1523/eneuro.0279-21.2021 · Cited by 20
“Introduction Goal-directed behaviors depend on outcome expectation to guide the behavioral response (Dickinson, 1989; Dickinson and Balleine, 1994).”
BackgroundPsychological and Neuroscientific Connections with Reinforcement Learning
Shah, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_16 · Cited by 20
Effects of a systemic AMPA/KA and NMDA receptor blockade on pavlovian–instrumental transfer
Murschall, A., & Hauber, W. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0073-9 · Cited by 20
“Appetitive pavlovian stimuli can markedly elevate instrumental responding directed toward a common reward, a phenomenon termed pavlovian–instrumental transfer (PIT) (Estes 1948; Lovibond 1983; for review, see Dickinson and Balleine 1994).”
BackgroundCholecystokinin attenuates incentive learning in rats.
Balleine, B. W., Davies, A., & Dickinson, A. (1995) · Behavioral Neuroscience · doi:10.1037//0735-7044.109.2.312 · Cited by 17
Self-citationCerebral reorganization in Parkinson's disease.
Helmich, R. C. G. (2011) · Radboud Repository (Radboud University) · Cited by 111
Marutani, T., Yahata, N., Ikeda, Y., Ito, T., Yamamoto, M., Matsuura, M., Matsushima, E., Okubo, Y., Suzuki, H., & Matsuda, T. (2011) · Psychiatry and Clinical Neurosciences · doi:10.1111/j.1440-1819.2011.02189.x · Cited by 16
Tafet, G. E., & Alonso, T. O. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1600165 · Cited by 30
“A goal-directed behavior may depend, not only on the value assigned to associations between actions and outcomes, but also on the probability that outcomes will occur in the presence or absence of these actions (28).”
Hunger improves reinforcement-driven but not planned action
van Swieten, M. M. H., Bogacz, R., & Manohar, S. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-021-00921-w · Cited by 17
Sato, N., Shidara, H., & Ogawa, H. (2019) · Scientific Reports · doi:10.1038/s41598-019-54555-7 · Cited by 18
Problematic eating as an issue of habitual control
Pierce-Messick, Z. J., & Corbit, L. H. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110294 · Cited by 18
“Wanting” versus “needing” related value: An fMRI meta‐analysis
Bosulu, J., Allaire, M., Tremblay‐Grénier, L., Luo, Y., Eickhoff, S. B., & Hétu, S. (2022) · Brain and Behavior · doi:10.1002/brb3.2713 · Cited by 19
“Thus, ‘Needing’ST related value can have an impact on choice and action selection (Dickinson & Balleine 1994) or preference (Salamone et al, 2018).”
BackgroundInflated reward value in early opiate withdrawal
Wassum, K. M., Greenfield, V. Y., Linker, K. E., Maidment, N. T., & Ostlund, S. B. (2014) · Addiction Biology · doi:10.1111/adb.12172 · Cited by 19
“…state sets—through the process referred to as instrumental incentive learning—the incentive value that is recalled when making a decision to engage in an instrumental action to earn that specific reward when in that same state in the future (Balleine 1992; Dickinson & Balleine 1994).”
BackgroundHow Did the Chicken Cross the Road? With Her Striatal Cholinergic Interneurons, Of Course
Schoenbaum, G. M., Stalnaker, T. A., & Niv, Y. (2013) · Neuron · doi:10.1016/j.neuron.2013.06.033 · Cited by 19
“…sensitivity to devaluation, demonstrated that behavior was indeed goal directed (i.e., guided by an expectation of the specific outcome and its unique attributes [Dickinson and Balleine, 1994]) and that intact cholinergic activity in the pDMS is not necessary for this fundamental learning process.”
BackgroundLooking for Discriminating Is Different from Looking for Looking’s Sake
Bieg, H., Bresciani, J., Bülthoff, H., & Chuang, L. L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045445 · Cited by 18
“Most everyday tasks consist of simple goal-directed behaviors [5,52,53].”
BackgroundThe implicit power motive predicts action selection
Stoeckart, P. F., Strick, M., Bijleveld, E., & Aarts, H. (2016) · Psychological Research · doi:10.1007/s00426-016-0768-z · Cited by 22
“We argue that establishing an action-outcome relationship between a specific action and an outcome with motivecongruent (dis)incentive value can allow implicit motives to predict action selection (Dickinson & Balleine, 1994; Eder & Hommel, 2013; Schultheiss et al., 2005b).”
BackgroundAn Assessment of Factors Contributing to Instrumental Performance for Sexual Reward in the Rat
Woodson, J. C., & Balleine, B. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990143000199 · Cited by 16
“Considerable evidence suggests that changes in primary motivation affect instrumental performance by modifying the reward or incentive value that an animal assigns to the instrumental outcome (cf., Balleine, 2000; Dickinson & Balleine, 1994, for reviews).”
BackgroundSelf-citationThe cognitive architecture of anxiety-like behavioral inhibition.
Bach, D. R. (2017) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000282 · Cited by 21
“…requires a detailed model of the environment, enabling a prospective and explicit (although not necessarily conscious) evaluation of all possible future outcomes and their probabilities; action is then selected to maximize the expected future outcome (Daw et al., 2005; Dickinson & Balleine, 1994).”
InfluentialCognitive Dimension of Operant Learning ☆
Blaisdell, A. P. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21007-9 · Cited by 18
Neuroscience of Drugs and Addiction
Robbins, T. W., Cardinal, R. N., Ciano, P. D., Halligan, P. W., Hellemans, K., Lee, J. L. C., & Everitt, B. J. (2007) · Elsevier eBooks · doi:10.1016/b978-012370624-9/50006-2 · Cited by 21
Theory-driven computational models of drug addiction in humans: Fruitful or futile?
Lim, T. V., & Ersche, K. D. (2023) · Addiction Neuroscience · doi:10.1016/j.addicn.2023.100066 · Cited by 18
Multiple Memory Systems in the Brain: Cooperation and Competition
White, N. M. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00094-2 · Cited by 21
Genauck, A., Matthis, C., Andrejević, M., Ballon, L., Chiarello, F., Duecker, K., Heinz, A., Kathmann, N., & Romanczuk‐Seiferth, N. (2020) · Addiction Biology · doi:10.1111/adb.12951 · Cited by 16
“PIT is one of the key effects deepening our understanding of cue-controlled behaviors (Dickinson & Balleine, 1994; Dickinson Anthony & Balleine Bernard, 2002; Holmes, Marchand, & Coutureau, 2010; Niv, Daw, Joel, & Dayan, 2007).”
BackgroundLeveraging Basic Science for the Clinic—From Bench to Bedside
Corlett, P. R., & Schoenbaum, G. M. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.3656 · Cited by 16
A push for examining subjective experience in value-based decision-making
Schreiner, D. C., Yalcinbas, E. A., & Gremel, C. M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.020 · Cited by 19
A role for reward valuation in the serotonergic modulation of impulsivity
Desrochers, S. S., Lesko, E., Magalong, V. M., Balsam, P. D., & Nautiyal, K. M. (2021) · Psychopharmacology · doi:10.1007/s00213-021-05944-2 · Cited by 16
A reaction-time paradigm to measure reward-oriented bias in rats.
Lauwereyns, J., & Wisnewski, R. (2006) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.32.4.467 · Cited by 16
Involvement of opioid signaling in food preference and motivation
Morales, I., Font, L., Currie, P. J., & Pastor, R. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.06.002 · Cited by 17
Laventure, S., & Benchenane, K. (2019) · Hippocampus · doi:10.1002/hipo.23143 · Cited by 15
“According to Dickinson and Balleine (1994), an action is goal-directed if its performance is controlled both by the representation of the contingency between the action and the outcome, and by the representation of the outcome as a goal.”
BackgroundHydration level is an internal variable for computing motivation to obtain water rewards in monkeys
Minamimoto, T., Yamada, H., Hori, Y., & Suhara, T. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3054-3 · Cited by 16
“, from hunger to satiation) for specific rewards affect the behavior to attain these rewards (Dickinson and Balleine 1994).”
BackgroundEffect of the 5-HT1A agonist, 8-OH-DPAT on instrumental performance in rats
Balleine, B. W., Fletcher, N., & Dickinson, A. (1996) · Psychopharmacology · doi:10.1007/bf02247396 · Cited by 15
“Thus, rather than being directly sensitive to post-training changes in motivational state, instrumental performance has been found to be largely controlled by the way such changes affect an animal's experience of the incentive value of the outcome, a process we have referred to as incentive learning (Balleine 1992; Di…”
BackgroundSelf-citationComment on Vandaele and Ahmed: Rethinking habits in addiction
Berridge, K. C. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-00932-0 · Cited by 14
A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward
Piquet, R., Faugère, A., & Parkes, S. L. (2023) · Current Biology · doi:10.1016/j.cub.2023.11.036 · Cited by 15
Zhang, C., Dulinskas, R., Ineichen, C., Greter, A., Sigrist, H., Li, Y., Alanis‐Lobato, G., Hengerer, B., & Pryce, C. R. (2024) · Communications Biology · doi:10.1038/s42003-024-06658-9 · Cited by 17
“Incentive motivation refers to the activation and reinforcement of goal-directed behaviour by reward stimuli per se as well as stimuli that predict them, and has clear overlap with reward interest and anticipation 11,12 .”
BackgroundKeller, K. L., Vollrath-Smith, F. R., Jafari, M., & Ikemoto, S. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3300-9 · Cited by 18
“For example, rats trained to approach and feed under a hungry state will seek out food regardless of being hungry or sated, if they have not experienced eating food under a sated state in the same context (Dickinson and Balleine 1994).”
BackgroundFronto-striatal gray matter contributions to discrimination learning in Parkinson's disease
O’Callaghan, C., Moustafa, A. A., de Wit, S., Shine, J. M., Robbins, T. W., Lewis, S. J. G., & Hornberger, M. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00180 · Cited by 16
“The interplay between the habitual and goal-directed modes can be explained by the “dual-systems” account, whereby instrumental learning can be supported by either modality (Dickinson and Balleine, 1994; de Wit and Dickinson, 2009).”
Tan, S. L. T., Handasyde, K. A., Rault, J., & Mendl, M. (2019) · Animal Cognition · doi:10.1007/s10071-019-01318-6 · Cited by 14
Jones, S., Hyde, A., & Davidson, T. L. (2020) · Nutrition Research · doi:10.1016/j.nutres.2020.05.001 · Cited by 18
“That is, after a valued outcome is experienced under a specific motivational state, subsequent exposure to the state can augment appetitive behavior, in anticipation of acquiring that outcome [4].”
BackgroundTroisi, J., Bryant, E., & Kane, J. (2012) · The Psychological Record · doi:10.1007/bf03395830 · Cited by 15
Reward, Context, and Human Behaviour
Blaukopf, C. L., & DiGirolamo, G. J. (2007) · The Scientific World JOURNAL · doi:10.1100/tsw.2007.122 · Cited by 20
“For this behaviour to be labelled goal-directed behaviour, the reward and the contingency between action and reward both need to be represented in the brain during the action[77].”
BackgroundBursts and Heavy Tails in Temporal and Sequential Dynamics of Foraging Decisions
Jung, K., Jang, H., Kralik, J. D., & Jeong, J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003759 · Cited by 17
“Although progress has been made on characterizing outcome-driven behavior as governed by the goal-directed system [44,45], and stimulus-driven behavior as governed by the habit system [45–48], it nonetheless remains difficult to predict an individual’s preference and choice responses over a long period of time.”
BackgroundPattern of access determines influence of junk food diet on cue sensitivity and palatability
Kosheleff, A. R., Araki, J., Hsueh, J., Le, A., Quizon, K., Ostlund, S. B., Maidment, N. T., & Murphy, N. P. (2017) · Appetite · doi:10.1016/j.appet.2017.12.009 · Cited by 16
The Cost of Imagined Actions in a Reward-Valuation Task
Sellitto, M., Terenzi, D., Starita, F., di Pellegrino, G., & Battaglia, S. (2022) · Brain Sciences · doi:10.3390/brainsci12050582 · Cited by 13
The positive valence system, adaptive behaviour and the origins of reward
Burton, T. J., & Balleine, B. W. (2022) · Emerging Topics in Life Sciences · doi:10.1042/etls20220007 · Cited by 18
Self-citationSato, R., Shimomura, K., & Morita, K. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011206 · Cited by 15
Sensorimotor Learning in Response to Errors in Task Performance
Sadaphal, D. P., Kumar, A., & Mutha, P. K. (2022) · eNeuro · doi:10.1523/eneuro.0371-21.2022 · Cited by 15
“Specifically, actions are guided by representations of outcomes they produce given the state of the environment and what these outcomes are worth, as in model-based reinforcement learning (Dickinson and Balleine, 1994; Doya, 2000; Daw et al., 2005; Doll et al., 2012).”
BackgroundTurner, K. M., & Balleine, B. W. (2023) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.898 · Cited by 19
“These differences in control have been argued to emerge from distinct associative structures, with goal-directed actions mediated by response – outcome (R-O) associations and habits by stimulus – response (S-R) associations (Balleine & Dickinson, 1998; Dickinson & Balleine, 1994).”
BackgroundSelf-citationAcute psychophysiological stress impairs human associative learning
Ehlers, M. R., & Todd, R. M. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.09.003 · Cited by 17
Chiara, G. D. (2002) · Handbook of experimental pharmacology · doi:10.1007/978-3-662-06765-9_10 · Cited by 13
The grounding of motivation in artificial animals: Indices of motivational behavior
Savage, T. (2002) · Cognitive Systems Research · doi:10.1016/s1389-0417(02)00070-0 · Cited by 13
The role of the hypothalamic melanocortin system in behavioral appetitive processes
Benoit, S. C., Tracy, A. L., Air, E. L., Kinzig, K. P., Seeley, R. J., & Davidson, T. L. (2001) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(01)00558-5 · Cited by 13
Bernal‐Gamboa, R., Gámez, A. M., & Nieto, J. (2018) · Behavioural Processes · doi:10.1016/j.beproc.2018.01.021 · Cited by 15
Distinct Neural Circuits Underlie Prospective and Concurrent Memory-Guided Behavior
Hamm, A. G., & Mattfeld, A. T. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.08.002 · Cited by 13
“Instrumental behavior is dissociable into goal-directed and stimulus-bound or habitual control (Dickinson and Balleine, 1994), with each having been mapped to different neurobiological circuits.”
BackgroundStrand, P. S., Robinson, M. J. F., Fiedler, K. R., Learn, R., & Anselme, P. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-02047-z · Cited by 14
“Current evidence suggests that sign-tracking is not an instrumental response because it can detract from reward maximization and is insensitive to its consequences (e.g., Anselme, 2016; Dickinson & Balleine, 1994).”
BackgroundWhat Role Does Striatal Dopamine Play in Goal-directed Action?
Hart, G., Burton, T. J., & Balleine, B. W. (2024) · Neuroscience · doi:10.1016/j.neuroscience.2024.03.020 · Cited by 14
“…Balleine, 2015); and involves a form of error correction learning: in both rats and humans signaling the non-143 contingent outcome in a contingency degradation situa-144 tion is sufficient to block the degradation effect (Dickinson and Charnock, 1985; Colwill and Rescorla, 1986; Morris et al., 2022).”
BackgroundSelf-citationSome conceptual problems with the classical theory of behaviour
Anselme, P. (2007) · Behavioural Processes · doi:10.1016/j.beproc.2007.02.027 · Cited by 12
Reduced Affective Biasing of Instrumental Action With tDCS Over the Prefrontal Cortex
Ly, V., Bergmann, T. O., Gladwin, T. E., Volman, I., Usberti, N., Cools, R., & Roelofs, K. (2016) · Brain stimulation · doi:10.1016/j.brs.2016.02.002 · Cited by 12
“For additional information about this publication click this link. http://hdl.handle.net/2066/168096 Please be advised that this information was generated on 2019-10-27 and may be subject to change.”
Rosales, J.-H., Zamarripa, M. S., Ramos, F., & Ramos, M. A. (2017) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2017.09.003 · Cited by 13
“These structures identify physiological needs and require a connection with other systems to guide actions in search of what the body needs to satisfy these needs (Dickinson & Balleine, 1994; Kalivas & Volkow, 2007).”
BackgroundA generative spiking neural-network model of goal-directed behaviour and one-step planning
Basanisi, R., Brovelli, A., Cartoni, E., & Baldassarre, G. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007579 · Cited by 22
Comparing albino and hooded Wistar rats of both sexes on a range of behavioral and learning tasks
Boakes, R. A., Boot, B. P., Clarke, J. V., & Carver, A. C. (2000) · Psychobiology · doi:10.3758/bf03331992 · Cited by 14
Reward processing in the human brain
Porcelli, A. J., & Delgado, M. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00007-8 · Cited by 21
Short article: Rats learn to eat more to avoid hunger
Jarvandi, S., Thibault, L., & Booth, D. (2008) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210802426858 · Cited by 12
“Incentive motivational accounts of ingestion-related animal behaviour processes have become increasingly popular (Berridge, 1996, 2004; Dickinson & Balleine, 1994; Dickinson & Dawson, 1989).”
Cognitive Dimension of Operant Learning
Blaisdell, A. P. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00184-4 · Cited by 23
Instrumental and Classical Conditioning
Weiss, S. J. (2014) · Wiley eBooks · doi:10.1002/9781118468135.ch17 · Cited by 15
Adaptive planning depth in human problem-solving
Eluchans, M., Lancia, G. L., Maselli, A., D’Alessandro, M., Gordon, J. R., & Pezzulo, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.241161 · Cited by 15
“Having said this, our specific setting, in which the problem maps are novel and fully visible, epitomizes the use of model-based planners [5,76–79].”
The interplay between executive functions and updating predictive representations
Pedraza, F., Vékony, T., Farkas, B. C., Haesebaert, F., Phelipon, R., Mihalecz, I., Janacsek, K., Tillmann, B., Anders, R., Plancher, G., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-14876-2 · Cited by 13
Hunger enhances consistent economic choices in non-human primates
Yamada, H. (2017) · Scientific Reports · doi:10.1038/s41598-017-02417-5 · Cited by 12
“, all possible combination of three items out of five items (5C3) and each pairwise comparison of three items were made twice (23).”
BackgroundThe two‐step task, avoidance, and OCD
Geramita, M. A., Yttri, E. A., & Ahmari, S. E. (2020) · Journal of Neuroscience Research · doi:10.1002/jnr.24594 · Cited by 15
“In contingency degradation paradigms, the association between the action and outcome is broken (Dickinson & Balleine, 1994; Dickinson & Charnock, 1985).”
BackgroundLeung, B. K., Merlin, S., Walker, A. K., Lawther, A. J., Paxinos, G., Eapen, V., Clarke, R. A., Balleine, B. W., & Furlong, T. M. (2023) · Behavioural Brain Research · doi:10.1016/j.bbr.2023.114610 · Cited by 11
“This is the first application of goal-directed and habitual tests of behaviour to a genetic animal model of ASD or GTS as operationalised by Dickinson, Balleine and colleagues [33,34,87,93], which is an important step toward probing translational striatal-dependent alterations in behaviour in these mouse”
Self-citationHabits and the subexploration of better transportation options: A dual-system approach
Henríquez-Jara, B., Guevara, C. Á., Munizaga, M. A., & Perez, O. D. (2023) · Travel Behaviour and Society · doi:10.1016/j.tbs.2024.100877 · Cited by 15
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.