Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Items 401–500 of 996
Integrating early results on ventral striatal gamma oscillations in the rat
van der Meer, M. A. A. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00028 · Cited by 44
Kuhns, L., Kroon, E., Lesscher, H. M. B., Mies, G. W., & Cousijn, J. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-02100-y · Cited by 52
“Goal-directed behavior: Goal-directed behavior refers to when actions are sensitive to both the outcome value (goal) and contingency between the behavior and the outcome [92].”
BackgroundShulman, A., Goldstein, B., & STRASHUN, A. M. (2009) · PubMed · Cited by 48
Anticipatory behaviour in animals: A critical review
Anderson, C., von Keyserlingk, M., Lidfors, L., & Weary, D. M. (2020) · Animal Welfare · doi:10.7120/09627286.29.3.231 · Cited by 49
Moore, J. W., Teufel, C., Subramaniam, N., Davis, G. J., & Fletcher, P. C. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00023 · Cited by 47
“According to so-called “response-outcome” (R-O) theories of intentional action (Thorndike, 1931; Dickinson and Balleine, 1993, 1994; de Wit and Dickinson, 2009), once R-O associations have been established, thoughts about actions prior to movement automatically trigger thoughts about associated…”
MethodAmemori, K.-I., & Sawaguchi, T. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj042 · Cited by 39
“The value of a reward expected from a successful behavior is important for the purposeful organization of goal-directed behavior (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998).”
BackgroundBalleine, B. W., Morris, R. W., & Leung, B. K. (2014) · Brain Research · doi:10.1016/j.brainres.2014.12.023 · Cited by 45
Self-citationReward Acts on the pFC to Enhance Distractor Resistance of Working Memory Representations
Fallon, S. J., & Cools, R. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00676 · Cited by 46
“This intuition is supported by human and animal work suggesting that reward enhances goal-directed behavior through increasing dopamine levels (Wise, 2004; Robbins & Everitt, 1996; Dickinson & Balleine, 1994).”
Self-feeding behaviour of rainbow trout, Oncorhynchus mykiss, offered diets with distinct feed oils
Geurden, I., Corraze, G. R., & Boujard, T. (2007) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2006.12.006 · Cited by 44
“Hence, the level of operant responding for a feed is commonly used as an index of feeding motivation of the animal (Teitelbaum, 1966; Dickinson and Balleine, 1994), determined by the animal’s internal (physiological) status and the external (incentive) value of the food (McFarland and Sibly, 1975; Barbano and Cador, 2…”
BackgroundHellemans, K. G. C., Dickinson, A., & Everitt, B. J. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.1.103 · Cited by 42
Self-citationThe drive to strive: goal generation based on current needs
Murray, E. A., & Rudebeck, P. H. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00112 · Cited by 38
“Indeed, devaluation tasks have been theorized to interrogate knowledge regarding the causal relationships between actions and the outcomes to which they lead (Dickinson and Balleine, 1994).”
BackgroundConditioned taste aversion versus avoidance: A re-examination of the separate processes hypothesis
Schier, L. A., Hyde, K. M., & Spector, A. C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217458 · Cited by 40
Fractionating the all‐or‐nothing definition of goal‐directed and habitual decision‐making
Schreiner, D. C., Renteria, R., & Gremel, C. M. (2020) · Journal of Neuroscience Research · doi:10.1002/jnr.24545 · Cited by 41
“The initial definition of goal‐di‐ rected control stipulated that an action should be sensitive to both outcome value and contingency (e.g., Dickinson & Balleine, 1994).”
BackgroundInhibitory control hinders habit change
Horváth, K., Németh, D., & Janacsek, K. (2022) · Scientific Reports · doi:10.1038/s41598-022-11971-6 · Cited by 40
The modulation of operant variation by the probability, magnitude, and delay of reinforcement
Stahlman, W. D., & Blaisdell, A. P. (2011) · Learning and Motivation · doi:10.1016/j.lmot.2011.05.001 · Cited by 39
“Konorski recognized that stimulus events (e.g., Pavlovian CSs and instrumental discriminative stimuli) are not unitary in nature, but instead are multifaceted – consisting of specific sensory features of the reward and their affective components (see also Balleine, 2001; Dickinson & Balleine, 1994).”
Elfwing, S., & Seymour, B. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329799 · Cited by 47
“The nature of the learning rules that govern action learning (i.e. instrumental, or operant conditioning) for rewards are relatively well understood [19].”
BackgroundAmygdala-Cortical Control of Striatal Plasticity Drives the Acquisition of Goal-Directed Action
Fisher, S. D., Ferguson, L. A., Bertran-Gonzalez, J., & Balleine, B. W. (2020) · Current Biology · doi:10.1016/j.cub.2020.08.090 · Cited by 36
Self-citationDialogue on economic choice, learning theory, and neuronal representations
Padoa‐Schioppa, C., & Schoenbaum, G. M. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.06.004 · Cited by 38
“However, goal-directed behavior, as it is currently defined by learning theorists such as Balleine and Dickinson [44], is instrumental or specifically based on action-outcome associations.”
Duka, T., Crombag, H. S., & Stephens, D. N. (2011) · Journal of Psychopharmacology · doi:10.1177/0269881110388324 · Cited by 35
“…associated with an appetitive event, aside from becoming an elicitor of approach and being able to capture attention (as discussed earlier), can directly affect and modulate goal-directed instrumental behavior in a variety of ways (Dickinson and Balleine, 1994; Mackintosh, 1974; Rescorla, 1988).”
BackgroundLewis, A. H., Porcelli, A. J., & Delgado, M. R. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00179 · Cited by 41
“…stress has been found not to behaviorally impair Pavlovian conditioning itself, but rather to lead to deficiencies in Pavlovianto-instrumental transfer (Morgado et al., 2012)—a measure of the influence of Pavlovian cues on instrumental behavior (for review, see Dickinson and Balleine, 1994).”
BackgroundHanus, D. (2016) · Journal of comparative psychology · doi:10.1037/a0040235 · Cited by 40
“Later theorists acknowledged the fact that certain animal actions might be driven by expectations of an outcome (Tolman, 1932) and therefore influenced by the value of that outcome (Colwill & Rescorla, 1985; Dickinson & Balleine, 1994; Rescorla, 1988).”
BackgroundSu, L., Yang, X., & Huang, Y. (2021) · Journal of Travel Research · doi:10.1177/00472875211000446 · Cited by 37
“Dickinson and Balleine (1994) defined goal-directed behaviors as a psychological representation expressed through actions.”
BackgroundEffects of reinforcer magnitude on an animal model of impulsive behavior
Farrar, A. M., Kieres, A. K., Hausknecht, K. A., de Wit, H., & Richards, J. B. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00139-6 · Cited by 38
“However, it is noteworthy that rats will reduce food intake during water deprivation (Verplanck and Hayes, 1953) perhaps to prevent ingested food from altering internal water balance (Dickinson and Balleine, 1994).”
BackgroundKirsch, J. A., Vlachos, I., Hausmann, M., Rose, J., Yim, M. Y., Aertsen, A., & Güntürkün, O. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.11.010 · Cited by 43
“Since reward plays a central role in shaping behavior [6], its representation reflects the basis of goal-directed actions [58].”
Learned Influences on Appetite, Food Choice, and Intake
Gibson, E. L., & Brunstrom, J. M. (2007) · Elsevier eBooks · doi:10.1016/b978-012370633-1/50011-6 · Cited by 42
Understanding the Formation of Human Habits: An Analysis of Mechanisms of Habitual Behaviour
Marien, H., Custers, R., & Aarts, H. (2018) · Springer eBooks · doi:10.1007/978-3-319-97529-0_4 · Cited by 44
Instrumental outcome devaluation is attenuated by the anti-emetic ondansetron.
Balleine, B. W., Gerner, C., & Dickinson, A. (1995) · PubMed · Cited by 39
Self-citationMemory priming and trial spacing effects in Pavlovian learning
Sunsay, C., Stetson, L., & Bouton, M. E. (2004) · Learning & Behavior · doi:10.3758/bf03196023 · Cited by 35
“Alternatively, the animal might learn that the food pellet has especially high incentive value when the trial has been delayed for a while (see Dickinson & Balleine, 1994).”
BackgroundAmaya, K. A., Stott, J. J., & Smith, K. S. (2020) · Learning & Memory · doi:10.1101/lm.051144.119 · Cited by 39
“A key feature of habitual or model-free behavior is that it persists despite changes to the value of the outcome that it precedes (Dickinson and Balleine, 1994).”
Leveraging cognitive neuroscience for making and breaking real-world habits
Buabang, E. K., Donegan, K. R., Rafei, P., & Gillan, C. M. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.10.006 · Cited by 34
“O contingencies and outcome values [32].”
Subtypes in addiction and their neurobehavioral profiles across three functional domains
Drossel, G., Brucar, L. R., Rawls, E., Hendrickson, T. J., & Zilverstand, A. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02426-1 · Cited by 37
“It has further been argued that these three mechanisms are dependent on each other, going back to studies showing that substances of abuse impair all of the neurobiological systems underlying them [11 – 14].”
Nippert, K. E., Rowland, C. P., Vazey, E. M., & Moorman, D. E. (2024) · Neuropharmacology · doi:10.1016/j.neuropharm.2024.110114 · Cited by 38
Laurent, V., Wong, F. L., & Balleine, B. W. (2014) · British Journal of Pharmacology · doi:10.1111/bph.12731 · Cited by 37
“One variable that regulates this choice is the presence of stimuli sharing a predictive history with the consequences of available actions; for example, Pavlovian stimuli that predict a particular outcome bias choice towards actions that earn that outcome (Colwill and Rescorla, 1988; Dickinson and Balleine, 1994; Holm…”
BackgroundSelf-citationMoors, A., Fini, C., Everaert, T., Bardi, L., Bossuyt, E., Kuppens, P., & Braß, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217266 · Cited by 38
A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders
Story, G. W., Moutoussis, M., & Dolan, R. J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01948 · Cited by 37
Characterizing Human Habits in the Lab
Nebe, S., Kretzschmar, A., Brandt, M. C., & Tobler, P. N. (2024) · Collabra Psychology · doi:10.1525/collabra.92949 · Cited by 42
Relative reward effects on operant behavior: Incentive contrast, induction and variety effects
Webber, E. S., Chambers, N., Kostek, J. A., Mankin, D. E., & Cromwell, H. C. (2015) · Behavioural Processes · doi:10.1016/j.beproc.2015.05.003 · Cited by 37
“These responses that include the nosepoke, leverpress and the food cup retrieval are oft-used as measures in conditioning experiments on motivation (Dickinson and Balleine, 1994; Corbit and Balleine, 2003).”
BackgroundWhat Can Different Brains Do with Reward?
Gottfried, J. A. (2011) · CRC Press eBooks · doi:10.1201/b10776-10 · Cited by 33
Combined model-free and model-sensitive reinforcement learning in non-human primates
Miranda, B., Malalasekera, W. M. N., Behrens, T. E. J., Dayan, P., & Kennerley, S. W. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007944 · Cited by 33
“Their estimates of long-run rewards are thereby readily adaptive to environmental or motivational changes that are known to the model, just like goaldirected actions [3, 4].”
BackgroundGoal-Directed and Habitual Control in Human Substance Use: State of the Art and Future Directions
Doñamayor, N., Ebrahimi, C., Arndt, V. A., Weiß, F., Schlagenhauf, F., & Endraß, T. (2022) · Neuropsychobiology · doi:10.1159/000527663 · Cited by 44
Characteristics of fast-spiking neurons in the striatum of behaving monkeys
Yamada, H., Inokawa, H., Hori, Y., Pan, X., Matsuzaki, R., Nakamura, K., Samejima, K., Shidara, M., Kimura, M., Sakagami, M., et al. (2015) · Neuroscience Research · doi:10.1016/j.neures.2015.10.003 · Cited by 37
Benoit, S. C., Davidson, T. L., Chan, K., Trigilio, T., & Jarrard, L. E. (1999) · Psychobiology · doi:10.3758/bf03332096 · Cited by 36
Handbook of Psychology, volume 4, Experimental Psychology
Healy, A., & Proctor, R. W. (2003) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 33
Binary Theorizing Does Not Account for Action Control
Hommel, B. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02542 · Cited by 36
Vena, A. A., Zandy, S. L., Cofresí, R. U., & Gonzales, R. A. (2020) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2020.107573 · Cited by 36
Extinction under a behavioral microscope: Isolating the sources of decline in operant response rate
Cheung, T. H. C., Neisewander, J. L., & Sanabria, F. (2012) · Behavioural Processes · doi:10.1016/j.beproc.2012.02.012 · Cited by 34
“Extinction is also often implemented in concert with reinforcer-devaluation to establish whether responding is goaldirected or habitual (Dickinson and Balleine 1994; Dickinson et al. 1995; Olmstead et al. 2001).”
BackgroundThe Acquisition of an Appetite
HALL, W. G., Arnold, H. M., & Myers, K. P. (2000) · Psychological Science · doi:10.1111/1467-9280.00223 · Cited by 33
“Dickinson and Balleine (1994, 1995), following Tolman (1949), called attention to the role of incentive learning in operant goal-seeking processes.”
BackgroundHabits and goals: a motivational perspective on action control
Ceceli, A. O., & Tricomi, E. M. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.12.005 · Cited by 35
“However, the motivational account of action control focuses on the attribution of the motivational origin of actions to value-based goal pursuit versus cue-triggered habitual control [3,6].”
BackgroundMiller, R. R., & Grace, R. C. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei0413 · Cited by 33
“More recently, however, Dickinson and colleagues (see Dickinson & Balleine, 1994, for review) have provided evidence that in some circumstances, subjects must learn the incentive properties of outcomes in instrumental conditioning.”
BackgroundMotivational sensitivity of outcome-response priming: Experimental research and theoretical models
Watson, P., Wiers, R. W. H. J., Hommel, B., & de Wit, S. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1449-2 · Cited by 34
The learning of prospective and retrospective cognitive maps within neural circuits
Namboodiri, V. M. K., & Stuber, G. D. (2021) · Neuron · doi:10.1016/j.neuron.2021.09.034 · Cited by 41
“In typical VR schedules, animals remain sensitive to reward devaluation for considerably longer amounts of training (Adams, 1982; Dickinson and Balleine, 1994; Dickinson et al., 1983).”
BackgroundLudvig, E. A., Bellemare, M. G., & Pearson, K. G. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-021-1.ch006 · Cited by 43
“More recent work has drawn into question to what degree these simple stimulus- response associations drive behaviour in operant conditioning experiments (Balleine & Dickinson, 1998; Daw, Niv, & Dayan, 2005; Dickinson & Balleine, 1994; for a recent review, see Balleine & O’Doherty, 2009).”
BackgroundClark, A. M., Bouret, S., Young, A. M., Murray, E. A., & Richmond, B. J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.3605-12.2013 · Cited by 32
“, its value, is a key factor in determining the latency, accuracy, and vigor of goal-directed behavior (Dickinson and Balleine, 1994).”
BackgroundResponse to Suddendorf & Corballis (2008): in defence of animal foresight
Clayton, N. S., Correia, S. P. C., Raby, C. R., Alexis, D. M., Emery, N. J., & Dickinson, A. (2008) · Animal Behaviour · doi:10.1016/j.anbehav.2008.06.020 · Cited by 35
Self-citationExtended cocaine-seeking produces a shift from goal-directed to habitual responding in rats
Leong, K.-C., Berini, C., Ghee, S. M., & Reichel, C. M. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.06.021 · Cited by 35
“The shift from initial drug use to drug abuse can be thought of as a shift from initial goaldirected behavior to habitual and compulsive drug taking (Dickinson & Balleine, 1994), and is driven by studies showing that a shift from cognitive to habitual behaviors follow extended training (Dickinson,…”
BackgroundCardinal, R. N., Robbins, T. W., & Everitt, B. J. (2003) · Elsevier eBooks · doi:10.1016/b978-008044056-9/50048-8 · Cited by 35
“Finally, Pavlovian conditioned stimuli (CSs) can modulate instrumental performance directly (Dickinson 1994; Dickinson and Balleine 1994), an effect termed Pavlovian– instrumental transfer (PIT).”
BackgroundInfluentialKilleen, P. R. (2014) · International Journal of Comparative Psychology · doi:10.46867/ijcp.2014.27.04.04 · Cited by 33
Habitual Preference for the Nondrug Reward in a Drug Choice Setting
Vandaele, Y., Guillem, K., & Ahmed, S. H. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.00078 · Cited by 31
“The deliberative goal-directed process depends on a representation of the outcome as a goal and requires encoding of both the outcome value and the instrumental contingency between the action and the outcome (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998).”
BackgroundParallel and hierarchical neural mechanisms for adaptive and predictive behavioral control
Macpherson, T., Matsumoto, M., Gomi, H., Morimoto, J., Uchibe, E., & Hikida, T. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.009 · Cited by 37
Hadj‐Bouziane, F., Bénatru, I., Brovelli, A., Klinger, H., Thobois, S., Broussolle, E., Boussaoud, D., & Meunier, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00351 · Cited by 36
“…(Dickinson, Frontiers in Human Neuroscience www.frontiersin.org January 2013 | Volume 6 | Article 351 | 1 HUMAN NEUROSCIENCE 1985; Rescorla, 1991; Dickinson and Balleine, 1993, 1994; Dickinson, 1994; Staddon and Cerutti, 2003; Balleine and O’Doherty, 2010; Daw et al., 2011; Doll et al., 2012).”
Lex, B., & Hauber, W. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.46 · Cited by 37
“In instrumental conditioning, rats also encode the contingency between their actions and the incentive value of the outcomes (eg, Balleine and Dickinson, 1998; Dickinson and Balleine, 1994).”
BackgroundExperimentally induced and real-world anxiety have no demonstrable effect on goal-directed behaviour
Gillan, C. M., Vaghi, M. M. S., Hezemans, F. H., Grothe, S. V. G., Dafflon, J., Brühl, A. B., Savulich, G., & Robbins, T. W. (2020) · Psychological Medicine · doi:10.1017/s0033291720000203 · Cited by 35
“Goal-directed behaviour is characterised by actions that are appropriate to the current desire for a given outcome and informed by the knowledge of the causal relationship between an action and the associated outcome (Dickinson & Balleine, 1994).”
Stress diminishes outcome but enhances response representations during instrumental learning
Meier, J. K., Staresina, B. P., & Schwabe, L. (2022) · eLife · doi:10.7554/elife.67517 · Cited by 27
Striatal dopamine release tracks the relationship between actions and their consequences
Hart, G., Burton, T. J., Nolan, C. R., & Balleine, B. W. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.113828 · Cited by 32
Self-citationSchepers, S. T., & Bouton, M. E. (2018) · Appetite · doi:10.1016/j.appet.2018.10.016 · Cited by 32
Hackel, L. M., Berg, J. J., Lindström, B., & Amodio, D. M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02592 · Cited by 34
Real-Time Value Integration during Economic Choice Is Regulated by Orbitofrontal Cortex
Gardner, M., Conroy, J. C., Sanchez, D. C., Zhou, J., & Schoenbaum, G. M. (2019) · Current Biology · doi:10.1016/j.cub.2019.10.058 · Cited by 32
“Interestingly, pre-feeding in the context of economic choice did not result in the unitary ‘‘devaluation’’ effect often observed in simple, Pavlovian, or even instrumental settings [26, 27, 28, 35, 36].”
BackgroundNicotine-seeking reinstatement is reduced by inhibition of instrumental memory reconsolidation
Tedesco, V., Mutti, A., Auber, A., & Chiamulera, C. (2014) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000088 · Cited by 29
“This neuronal adaptation underlies the associative learning processes that lead to the transition from voluntary drug taking to habitual and compulsive drug use (Dickinson and Balleine, 1994; White and McDonald, 2002).”
BackgroundShea, N. J. (2024) · doi:10.1093/9780191997167.001.0001 · Cited by 36
Balancing control: A Bayesian interpretation of habitual and goal-directed behavior
Schwöbel, S., Marković, D., Smolka, M. N., & Kiebel, S. J. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102472 · Cited by 37
O’Callaghan, C., Vaghi, M. M. S., Brummerloh, B., Cardinal, R. N., & Robbins, T. W. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.01.021 · Cited by 31
“ciations; it also requires computation of the likelihood that an outcome will occur in the presence or absence of a given action (Baum, 1973; Dickinson and Balleine, 1994; Schultz, 2015).”
Recent developments in the habit hypothesis of OCD and compulsive disorders
Gillan, C. M. (2021) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2020_199 · Cited by 27
Oleson, E. B., Hamilton, L. R., & Gomez, D. M. (2021) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2021.660218 · Cited by 30
“In the latter scenario, the habitual behavior is believed to be unresponsive to changes in outcome value and the contingency between action and outcome (Dickinson and Balleine, 1994).”
BackgroundAmodio, P., Farrar, B. G., Krupenye, C., Ostojić, L., & Clayton, N. S. (2021) · eLife · doi:10.7554/elife.69647 · Cited by 32
Hunger cues as modulatory stimuli.
Davidson, T. L. (2004) · American Psychological Association eBooks · doi:10.1037/10298-008 · Cited by 27
Interpersonal dysfunction in borderline personality: a decision neuroscience perspective
Hallquist, M. N., Hall, N. T., Schreiber, A., & Dombrovski, A. Y. (2017) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.09.011 · Cited by 33
Learning to Cooperate: The Evolution of Social Rewards in Repeated Interactions
Dridi, S., & Akçay, E. (2017) · The American Naturalist · doi:10.1086/694822 · Cited by 27
“One may de ne a reward as an event that generates a particular pattern of activation of neural 69 circuits that induces positive feedback on behavior (26, 29, 31).”
BackgroundGestational alcohol exposure disrupts cognitive function and striatal circuits in adult offspring
Carlson, V. C. C., Gremel, C. M., & Lovinger, D. M. (2020) · Nature Communications · doi:10.1038/s41467-020-16385-4 · Cited by 28
A molecularly integrated amygdalo-fronto-striatal network coordinates flexible learning and memory
Li, D. C., Dighe, N. M., Barbee, B. R., Pitts, E. G., Kochoian, B. A., Blumenthal, S. A., Figueroa, J., Leong, T. L., & Gourley, S. L. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01148-9 · Cited by 28
Motivating operations in appetite research
Tapper, K. (2005) · Appetite · doi:10.1016/j.appet.2005.05.002 · Cited by 32
“Dickinson and Balleine (1994) do not explicitly discuss non-regulatory feeding.”
BackgroundMethodInfluentialHistory- and Current Instruction-Based Coding of Forthcoming Behavioral Outcomes in the Striatum
Yamada, H., Matsumoto, N., & Kimura, M. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00779.2007 · Cited by 30
Ovarian Hormones Mediate Changes in Adaptive Choice and Motivation in Female Rats
Yoest, K. E., Cummings, J., & Becker, J. B. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00250 · Cited by 32
Turner, K. M., & Parkes, S. L. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.010 · Cited by 28
“In order for a response to be goal-directed, it must be driven by a causal relationship between performance of the response and access to the goal and a representation that the outcome of that response is a desired goal (Dickinson and Balleine, 1994; Heyes and Dickinson, 1990).”
Oyama, K., Hori, Y., Mimura, K., Nagai, Y., Eldridge, M. A. G., Saunders, R. C., Miyakawa, N., Hirabayashi, T., Hori, Y., Inoue, K., et al. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.0229-22.2022 · Cited by 29
“The subjective desirability (i.e., value) of an expected reward is a key factor in determining the latency, accuracy, and vigor of goal-directed behavior (Dickinson and Balleine, 1994).”
BackgroundBasolateral amygdala parvalbumin interneurons coordinate oscillations to drive reward behaviors
Amaya, K. A., Teboul, E., Weiss, G. L., Antonoudiou, P., & Maguire, J. L. (2024) · Current Biology · doi:10.1016/j.cub.2024.02.041 · Cited by 23
The role of dopamine in the dorsomedial striatum in place and response learning
Lex, B., Sommer, S., & Hauber, W. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.10.081 · Cited by 27
Yamada, H., Louie, K., & Glimcher, P. W. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.06.011 · Cited by 26
“ewards, as measured from the behavioral responses of rats and onkeys, has been observed to decrease after rewards are conumed (Dickinson and Balleine, 1994; Minamimoto et al., 2009).”
BackgroundTime-mapping and future-oriented behavior in free-ranging wild fruit bats
Harten, L. M., Chen, X., de Marcas, L., Rachum, A., Handel, M., Goldshtein, A., Levi, M. F., Rosencwaig, S., & Yovel, Y. (2024) · Current Biology · doi:10.1016/j.cub.2024.05.046 · Cited by 25
Effects of Outcome Devaluation on the Performance of a Heterogeneous Instrumental Chain
Balleine, B. W., & Dickinson, A. (2005) · International Journal of Comparative Psychology · doi:10.46867/ijcp.2005.18.04.09 · Cited by 31
Self-citationExecutive Function Assigns Value to Novel Goal-Congruent Outcomes
McDougle, S. D., Ballard, I. C., Baribault, B., Bishop, S. J., & Collins, A. G. E. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab205 · Cited by 30
Conceptual representations in goal-directed decision making
Shea, N. J., Krug, K., & Tobler, P. N. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.4.418 · Cited by 29
“Yes, but only if it has had previous experience that sucrose solution salves thirst (Balleine & Dickinson, 1998b; Dickinson & Balleine, 1994; Dickinson, Balleine, Watt, Gonzalez, & Boakes, 1995), because only then has it learned that that outcome (the liquid) is rewarding in the drive state of…”
BackgroundThe role of nidopallium caudolaterale in the goal-directed behavior of pigeons
Liu, X., Wan, H., Li, S., Shang, Z., & Shi, L. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.02.042 · Cited by 27
A stimulus-control account of regulated drug intake in rats
Panlilio, L. V., Thorndike, E. B., & Schindler, C. W. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0978-6 · Cited by 23
“This hypothesis is consistent with research demonstrating “instrumental incentive learning” (Dickinson and Balleine 1994; Hutcheson et al. 2001).”
ResultEffect of contingent hunger state on development of appetite for a novel fruit snack
Gibson, E. L., & Wardle, J. (2001) · Appetite · doi:10.1006/appe.2001.0420 · Cited by 26
The consequences of AI training on human decision-making
Treiman, L. S., Ho, C.-J., & Kool, W. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2408731121 · Cited by 32
General Pavlovian-to-instrumental transfer in humans: Evidence from Bayesian inference
Degni, L., Dalbagno, D., Starita, F., Benassi, M., di Pellegrino, G., & Garofalo, S. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.945503 · Cited by 25
Neural interactions in the human frontal cortex dissociate reward and punishment learning
Combrisson, E., Basanisi, R., Gueguen, M. C. M., Rheims, S., Kahane, P., Bastin, J., & Brovelli, A. (2024) · eLife · doi:10.7554/elife.92938 · Cited by 28
A time course analysis of satiety-induced instrumental outcome devaluation
Parkes, S. L., Marchand, A. R., Ferreira, G., & Coutureau, É. (2016) · Learning & Behavior · doi:10.3758/s13420-016-0226-1 · Cited by 27
“…actions in both humans and animals is determined by knowledge regarding the contingency between actions and their outcomes as well as the current motivational value of the outcome (Adams & Dickinson, 1981; Balleine & Dickinson, 1998; Colwill & Rescorla, 1985; Dickinson & Balleine, 1994).”
BackgroundPickard, H., & Ahmed, S. H. (2016) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198727224.003.0002 · Cited by 28
“Similarly, we do not deny that rats can pursue a short-term goal, taking the immediate consequences of their choices and anticipated events into account (Dickinson and Balleine 1994).”
BackgroundDemonstrating and disrupting well-learned habits
Ceceli, A. O., Myers, C. E., & Tricomi, E. M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234424 · Cited by 25
“The motivational control framework identifies habits as 125 cue-dependent, and goal-directed behaviors as those contingent on the outcome [1].”
Background
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.