Motivational control of goal-directed action
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If the outcome subsequently becomes equally available with and without a lever press, goal-directed control leads to a decrease in pressing (Dickinson and Balleine, 1994; Dickinson and Charnock, 1985).”
From Goals and Habits in the Brain (2013) · cites this paper as Dickinson and Balleine, 1994
Experimental — accuracy not yet measuredIn the citing paper
“According to dual-systems accounts, two dissociable learning processes can be identified in instrumental behavior.11,12”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
In the citing paper
“On one hand, goal-directed actions are performed in order to achieve desirable goals (positive reinforcement) or to avoid undesirable outcomes (negative reinforcement).”
From Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients (2013) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,633
Nebraska Symposium on Motivation, 1961
WHITEHORN, J. C. (1963) · American Journal of Psychiatry · doi:10.1176/ajp.119.9.904 · Cited by 2,338
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,221
Rozin, P. N., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.23 · Cited by 1,877
Progress in Psychobiology and Physiological Psychology
(2003) · Progress in Psychobiology and Physiological Psychology · doi:10.1108/s0363-0951200318 · Cited by 1,696
Rozin, P., & Fallon, A. E. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.23 · Cited by 1,674 · cited 1×
“…devaluation procedure, Garcia (1989) has argued that this form of conditioning sets up a conditioned feedback loop that is activated when the flavor is subsequently contacted to produce disgust or distaste, a state that Rozin and Fallon (1987), among others, have identified as a primary emotion.”
BackgroundMowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670
The Quarterly Journal of Experimental Psychology
Treisman, A. M., & Geffen, G. (2012) · From Perception to Consciousness · doi:10.1093/acprof:osobl/9780199734337.003.0007 · Cited by 1,649
Research works printed but not linked: 5
- Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
- Pelchat, M. L., Grill, H. J., Rozin, P., &Jacobs, J. (1983). Quality of acquired responses to taste byRattus norvegicus depends upon type of associated discomfort.Journal of Comparative & Physiological Psychology,97, 140–153. · doi:10.1037/0735-7036.97.2.140 · Paper page
- Sutton, R. S., &Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world.Cognition & Brain Theory,4, 217–246.
- Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
- Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Cited by
Items 201–300 of 996
Orbitofrontal neurons infer the value and identity of predicted outcomes
Stalnaker, T. A., Cooch, N. K., McDannald, M. A., Liu, T.-L., Wied, H., & Schoenbaum, G. (2014) · Nature Communications · doi:10.1038/ncomms4926 · Cited by 122
Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats
de Borchgrave, R., Rawlins, J. N. P., Dickinson, A., & Balleine, B. W. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1031-y · Cited by 135
“Behavioural analysis of the representations underlying instrumental conditioning in rats has revealed a much richer cognitive structure than that postulated by the traditional stimulus-response accounts (Adams 1982; Colwill and Rescorla 1985; Mackintosh 1983; see Dickinson and Balleine 1994; Balleine 2000 for reviews).”
BackgroundMethodInfluentialSelf-citationFeature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus
Lauwereyns, J., Takikawa, Y., Kawagoe, R., Kobayashi, S., Koizumi, M., Coe, B. C., Sakagami, M., & Hikosaka, O. (2002) · Neuron · doi:10.1016/s0896-6273(02)00571-8 · Cited by 132
The role of the medial prefrontal cortex in achieving goals
Matsumoto, K., & Tanaka, K. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.005 · Cited by 123
“These are the conditions that Dickinson and Balleine [21] proposed for defining goaldirected behavior.”
BackgroundIkemoto, S., & Bonci, A. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.04.031 · Cited by 122
“For example, rats that have been previously trained to approach and feed under a hungry state will seek out food regardless of being hungry or sated, if they have not experienced eating food under a sated state in the same context (Dickinson and Balleine, 1994).”
BackgroundYamada, H., Matsumoto, N., & Kimura, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0068-04.2004 · Cited by 124
Modeling functions of striatal dopamine modulation in learning and planning
Suri, R. E., Bargas, J., & Arbib, M. A. (2001) · Neuroscience · doi:10.1016/s0306-4522(00)00554-6 · Cited by 128
“Consistent with this simulation result, motor performance for human and animals can be improved by stimulating planning processes (Dickinson and Balleine, 1994; Decety, 1996).”
BackgroundResultSport consumer motivation: Autonomy and control orientations that regulate fan behaviours
Funk, D. C., Beaton, A. A., & Alexandris, K. (2011) · Sport Management Review · doi:10.1016/j.smr.2011.11.001 · Cited by 158
Lecca, D., Cacciapaglia, F., Valentini, V., Acquas, E., & Chiara, G. D. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0496-y · Cited by 138
“Substitution of cocaine with saline resulted in a marked fall of responding on the active hole from the first extinction session, indicating that responding, under these conditions was strictly dependent upon an action/outcome relationship (Dickinson and Balleine 1994).”
BackgroundDifferential involvement of the central amygdala in appetitive versus aversive learning
Knapska, E., Walasek, G., Nikolaev, E., Neuhäusser-Wespy, F., Lipp, H.-P., Kaczmarek, L., & Werka, T. (2006) · Learning & Memory · doi:10.1101/lm.54706 · Cited by 120
“However, it should be noted that according to the Dickinson and Balleine (1994) dualprocess theory of instrumental motivation, the stimuli used in our study might exert a complex motivational influence, involving both Pavlovian and instrumental elements of conditioning.”
BackgroundAlexander, L., Gaskin, P. L. R., Sawiak, S. J., Fryer, T. D., Hong, Y. T., Cockcroft, G. J., Clarke, H. F., & Roberts, A. C. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.021 · Cited by 120
“Impairments in Pavlovian reward anticipation impact instrumental performance through Pavlovian-to-instrumental transfer, conditioned reinforcement, and conditioned approach (Dickinson and Balleine, 1994; Holland, 1977; Mackintosh, 1974).”
BackgroundSpeed Determines Leadership and Leadership Determines Learning during Pigeon Flocking
Pettit, B., Ákos, Z., Vicsek, T., & Biro, D. (2015) · Current Biology · doi:10.1016/j.cub.2015.10.044 · Cited by 139
Baldwin, A. E., Holahan, M. R., Sadeghian, K., & Kelley, A. E. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.84 · Cited by 122
Hernandez, P. J., & Kelley, A. E. (2004) · Learning & Memory · doi:10.1101/lm.84904 · Cited by 119
“Instrumental or operant learning is another fundamental form of learning, whereby an animal forms associations between its actions and the outcome of those actions in order to operate adaptively on its environment (Thorndike 1911; Skinner 1953; Rescorla 1991; Dickinson and Balleine 1994).”
BackgroundNeural substrates underlying effort, time, and risk-based decision making in motivated behavior
Bailey, M. R., Simpson, E. H., & Balsam, P. D. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2016.07.015 · Cited by 123
Griffiths, K. R., Morris, R. W., & Balleine, B. W. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00101 · Cited by 118
“10, 647– 656. doi: 10.1038/nn1890 Mayberg, H. S. (1997). Limbic-cortical dysregulation: a proposed model of depression.”
BackgroundInfluentialSelf-citationCorbit, L. H., & Balleine, B. W. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_388 · Cited by 133
“This could be through retrieval of the R-O association demonstrated to be critical for goal-directed responding (Dickinson and Balleine 1994), or specific transfer may rely on an O-R association, which could also be formed during free-operant training.”
BackgroundSelf-citationMotivational Control of Instrumental Action
Dickinson, A., & Balleine, B. W. (1995) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep11512272 · Cited by 130
Self-citationRole of the Hippocampal System in Conditional Motor Learning: Mapping Antecedents to Action
Wise, S. P., & Murray, E. A. (1999) · Hippocampus · doi:10.1002/(sici)1098-1063(1999)9:2<101::aid-hipo3>3.0.co;2-l · Cited by 114
Pupil diameter is not an accurate real-time readout of locus coeruleus activity
Megemont, M., McBurney-Lin, J., & Yang, H. (2022) · eLife · doi:10.7554/elife.70510 · Cited by 96
“Since fluctuations of these behavioral variables reflect state changes such as impulsivity, motivation, and task engagement (Dickinson and Balleine, 1994; Mayrhofer et al., 2013; Berditchevskaia et al., 2016; Allen et al., 2019; McBurney- Lin et al., 2020), our results suggest that the coupling between pupil and LC is…”
BackgroundResultDopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112
“However, we acknowledge that the cognitive processes mediating Pavlovian and instrumental learning may be more distinct than this (Dickinson and Balleine, 1994; Dickinson et al., 2000), for example they might depend upon different types of generative model (Dolan and Dayan, 2013; FitzGerald et al.,…”
BackgroundA Reward-Based Framework of Perceived Control
Ly, V., Wang, K. S., Bhanji, J., & Delgado, M. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00065 · Cited by 108
“This interpretation of perceived control is closely related to the definition of instrumental contingency based on reinforcement learning principles, where behavioral strategies and actions are reinforced by contingent desired outcomes (Thorndike, 1911; Shanks and Dickinson, 1991; Dickinson and Balleine, 1994; Liljeho…”
BackgroundMultiple Forms of Value Learning and the Function of Dopamine
Balleine, B. W., Daw, N. D., & O’Doherty, J. P. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00024-5 · Cited by 135
“…is exactly the result that is commonly reported; devaluing one of the food rewards selectively and profoundly reduces the performance of the action that in training delivered that outcome, compared to the action trained with the non-devalued outcome (Dickinson and Balleine, 1994; Balleine, 2001).”
Self-citationMotivational control of heterogeneous instrumental chains.
Balleine, B. W., Garner, C., González, F., & Dickinson, A. (1995) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.21.3.203 · Cited by 112
Self-citationCorbit, L. H., & Balleine, B. W. (2003) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.29.2.99 · Cited by 113
Self-citationShiflett, M. W., Brown, R. A., & Balleine, B. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1778-09.2010 · Cited by 115
“…conditioning in rats suggests that choice between different courses of action depends on integrating causal knowledge of the relationship between actions and their consequences with the current incentive value of those consequences (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998a).”
BackgroundSelf-citationCorbit, L. H., Ostlund, S. B., & Balleine, B. W. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10976.2002 · Cited by 112
“Current behavioral evidence suggests that, in instrumental conditioning, animals encode the causal relationship between actions and their consequences, as well as the current incentive value of the instrumental outcome (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998).”
BackgroundSelf-citationMolecular substrates of action control in cortico-striatal circuits
Shiflett, M. W., & Balleine, B. W. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.05.007 · Cited by 110
“Using these criteria, considerable evidence has accumulated suggesting that, in rodents, actions acquired in instrumental conditioning can be goal-directed (Dickinson and Balleine, 1994, 2002).”
Self-citationSharpe, M. J., Stalnaker, T., Schuck, N. W., Killcross, S., Schoenbaum, G., & Niv, Y. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102824 · Cited by 116
“…training, the strongest response in the DLS acquires greater influence over behavior regardless of the current model in the DMS, in line with the development of rigid habitual behaviors with increasing experience on a task (Dickinson & Balleine 1994, Jog et al. 1999, Killcross & Coutureau 2003).”
The role of drug expectancy in the control of human drug seeking.
Hogarth, L., Dickinson, A., Wright, A., Kouvaraki, M., & Duka, T. (2007) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.33.4.484 · Cited by 106
Self-citationDopamine, Prediction Error and Beyond
Diederen, K. M. J., & Fletcher, P. C. (2021) · The Neuroscientist · doi:10.1177/1073858420907591 · Cited by 106
“One simple but powerful instance of this is the Q-learning model (Dickinson and Balleine 1994; Sutton and Barto 1998).”
BackgroundAitken, T. J., Greenfield, V. Y., & Wassum, K. M. (2016) · Journal of Neurochemistry · doi:10.1111/jnc.13494 · Cited by 110
“…of a CS, but, unlike the behavioral expression of PIT (Balleine 1994; Corbit et al. 2007), requires an opportunity to acquire a new value through relevant state experience [i.e., incentive learning (Dickinson and Balleine 1994) or re-tasting the predicted food reward (Dayan and Berridge 2014)].”
BackgroundNEUROBIOLOGICAL CONSTRAINTS ON BEHAVIORAL MODELS OF MOTIVATION
Nader, K., Bechara, A., & van der Kooy, D. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.85 · Cited by 106
Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior
Garofalo, S., & di Pellegrino, G. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00163 · Cited by 130
“…1996; Holland et al., 2002; Corbit and Balleine, 2003; Holland and Gallagher, 2003; Holland, 2004; Delamater and Holland, 2008; for review, see Dickinson and Balleine, 1994, 2002; Holmes et al., 2010), but some recent studies have also reported this effect in humans (Paredes-Olay et al.,…”
Ostlund, S. B., Winterbauer, N. E., & Balleine, B. W. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1176-09.2009 · Cited by 103
“This capacity is demonstrated by the sensitivity of instrumental performance to manipulations of outcome value and action– outcome contingency (Dickinson and Balleine, 1994).”
BackgroundSelf-citationPrimate orbitofrontal cortex and adaptive behaviour
Roberts, A. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.002 · Cited by 117
The Feeling of Action Tendencies: On the Emotional Regulation of Goal-Directed Behavior
Lowe, R., & Ziemke, T. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00346 · Cited by 99
“…contingencies that impact on goal-directed (or more generally reinforcement–contingent) behavior (cf. Simon, 1967; Frijda, 1986, 1995, 2004, 2007, 2010; Rolls, 1986, 1999, 2005; Oatley and Johnson-Laird, 1987; Dickinson and Balleine, 1994; Cañamero, 2003; Koole, 2009; Boureau and Dayan, 2010).”
Mingote, S., Weber, S. M., Ishiwari, K., Correa, M., & Salamone, J. D. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.03972.x · Cited by 105
“The present study examined the effects of accumbens DA depletions in rats using variable interval (VI) schedules with additional fixed ratio (FR) requirements.”
BackgroundDopamine reverses reward insensitivity in apathy following globus pallidus lesions
Adam, R., Leff, A., Sinha, N., Turner, C., Bays, P., Draganski, B., & Husain, M. (2013) · Cortex · doi:10.1016/j.cortex.2012.04.013 · Cited by 100
“Animal learning theory has proposed that rewards might in fact constitute the basic goals of voluntary behaviour (Dickinson and Balleine, 1994).”
BackgroundThe Role of the Primate Amygdala in Conditioned Reinforcement
Parkinson, J. A., Crofts, H. S., McGuigan, M., Tomic, D. L., Everitt, B. J., & Roberts, A. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07770.2001 · Cited by 102
“An alternative hypothesis is that the CS may act as a conditioned reinforcer by evoking a more specific affective representation of the nutritional or incentive value (Dickinson and Balleine, 1994) of the particular primary reinforcer with which it is associated.”
BackgroundCardinal, R. N., & Cheung, T. H. (2005) · BMC Neuroscience · doi:10.1186/1471-2202-6-9 · Cited by 100
“It is not presently known to what degree responses acquired with a response-reinforcer delay are governed by declarative processes (the action-outcome contingency plus a representation of the instrumental incentive value of the outcome) or procedural mechanisms (stimulus-response habits), both of which are known to in…”
BackgroundMethodA Generalized Selected Effects Theory of Function
Garson, J. (2017) · Philosophy of Science · doi:10.1086/692146 · Cited by 115
Hogarth, L., & Duka, T. (2006) · Psychopharmacology · doi:10.1007/s00213-005-0150-0 · Cited by 96
“Incentive learning studies have demonstrated that the biological value of the expected reinforcer determines the magnitude of instrumental responding for that reinforcer, but these studies did not include measures of emotional responding (Dickinson 1997; Dickinson and Balleine 1994).”
BackgroundMurschall, A., & Hauber, W. (2006) · Learning & Memory · doi:10.1101/lm.127106 · Cited by 97
“Appetitive Pavlovian stimuli can markedly elevate instrumental responding, a phenomenon termed Pavlovian-instrumental transfer (Estes 1948; Lovibond 1983; for review, see Dickinson and Balleine 1994).”
Rhodes, S. E. V., & Murray, E. A. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4374-12.2013 · Cited by 99
“It is thought to depend on knowledge about the causal relationship between actions and the goals to which they lead, including knowledge about the incentive value of the goal (Adams and Dickinson, 1981; Dickinson and Balleine, 1994), and is supported by associations between representations of an instrumental action (r…”
BackgroundParkes, S. L., Bradfield, L. A., & Balleine, B. W. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4153-14.2015 · Cited by 92
“However, it has long been recognized that knowledge of the action– outcome association alone is not sufficient to determine the performance of an action; in addition, the subject must evaluate the incentive value of the outcome (Dickinson and Balleine, 1994; Balleine and Dickinson, 1998).”
BackgroundSelf-citationLex, B., & Hauber, W. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp151 · Cited by 96
Striatal direct and indirect pathways control decision-making behavior
Macpherson, T., Morita, M., & Hikida, T. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01301 · Cited by 96
“…sensitive to devaluation of the US, following repeated training action-outcome associations become habitual, regardless of changes to the outcome (Holland and Rescorla, 1975; Dickinson and Balleine, 1994; Balleine and Dickinson, www.frontiersin.org November 2014 | Volume 5 | Article 1301 | 1 1998).”
BackgroundHellemans, K. G. C., Everitt, B. J., & Lee, J. L. C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3101-06.2006 · Cited by 95
Perez, O. D., & Dickinson, A. (2020) · Psychological Review · doi:10.1037/rev0000201 · Cited by 91
Self-citationThe decision neuroscience perspective on suicidal behavior: evidence and hypotheses
Dombrovski, A. Y., & Hallquist, M. N. (2017) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000297 · Cited by 91
Vandaele, Y., & Ahmed, S. H. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-00899-y · Cited by 119
Model-based decision making and model-free learning
Drummond, N., & Niv, Y. (2020) · Current Biology · doi:10.1016/j.cub.2020.06.051 · Cited by 106
The role of the anterior, mediodorsal, and parafascicular thalamus in instrumental conditioning
Bradfield, L. A., Hart, G., & Balleine, B. W. (2013) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2013.00051 · Cited by 92
“There are two criteria that distinguish instrumental actions from Pavlovian CRs (cf. Dickinson and Balleine, 1994).”
BackgroundMethodResultSelf-citationGillan, C. M., Kalanthroff, E., Evans, M., Weingarden, H. M., Jacoby, R. J., Gershkovich, M., Snorrason, I., Campeas, R., Cervoni, C., Crimarco, N. C., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2998 · Cited by 92
Hierarchical Action Control: Adaptive Collaboration Between Actions and Habits
Balleine, B. W., & Dezfouli, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02735 · Cited by 89
Self-citationSubregions of the ventral striatum show preferential coding of reward magnitude and probability
Yacubian, J., Sommer, T., Schroeder, K., Gläscher, J. P., Braus, D. F., & Büchel, C. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.007 · Cited by 100
“Two important characteristics determine which rewards are behaviorally sought after (Rescorla and Solomon, 1967; Dickinson and Balleine, 1994; Schultz, 2006): reward magnitude and reward probability.”
BackgroundThe role of learning-related dopamine signals in addiction vulnerability
Huys, Q. J. M., Tobler, P. N., Hasler, G., & Flagel, S. B. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63425-2.00003-9 · Cited by 107
“Incentive salience in this context is distinct from incentive motivational properties or “incentive value” in instrumental settings as defined by Dickinson and colleagues (Dickinson and Balleine, 1994; Dickinson et al., 2000).”
BackgroundROESCH, M. R., & OLSON, C. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.004 · Cited by 85
Laurent, V., Leung, B., Maidment, N., & Balleine, B. W. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4688-11.2012 · Cited by 86
“Changes in reward value are derived from consummatory experience with the outcome after shifts in internal motivational conditions, and result in a change in the rewarding properties assigned to the outcome (Dickinson and Balleine, 1994; Balleine, 2004).”
BackgroundSelf-citationModel‐based learning and the contribution of the orbitofrontal cortex to the model‐free world
McDannald, M. A., Takahashi, Y. K., Lopatina, N., Pietras, B. W., Jones, J. L., & Schoenbaum, G. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07982.x · Cited by 84
Gamma-Band Activation Predicts Both Associative Memory and Cortical Plasticity
Headley, D. B., & Weinberger, N. M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2528-11.2011 · Cited by 86
“Another possibility is that gamma induced by the CS reflected arousal during training, and this heightened emotional state was associated with the CS (Dickinson and Balleine, 1994).”
BackgroundThornton-Jones, Z. D., Vickers, S. P., & Clifton, P. G. (2005) · Psychopharmacology · doi:10.1007/s00213-004-2047-8 · Cited by 84
“…deprivation tends to excite the motivational state of an animal (Bindra 1974), pre-feeding an animal prior to testing will reduce the motivational drive (Toates 1981, 1986; Balleine 1992) and reduce instrumental behaviour for food in highly trained rats (see review by Dickinson and Balleine 1994).”
Targeted Stimulation of Human Orbitofrontal Networks Disrupts Outcome-Guided Behavior
Howard, J. D., Reynolds, R., Smith, D. E., Voss, J. L., Schoenbaum, G., & Kahnt, T. (2020) · Current Biology · doi:10.1016/j.cub.2019.12.007 · Cited by 84
Linear reinforcement learning in planning, grid fields, and cognitive control
Piray, P., & Daw, N. D. (2021) · Nature Communications · doi:10.1038/s41467-021-25123-3 · Cited by 78
Age and sex differences in reward behavior in adolescent and adult rats
Hammerslag, L. R., & Gulley, J. M. (2014) · Developmental Psychobiology · doi:10.1002/dev.21127 · Cited by 85
“Performance on the Pavlovian approach task is influenced by goal-directed processes, whereby the representation of the outcome and internal motivation state influence performance of actions directed toward obtaining that outcome, such as trough entries (Dickinson, 1994).”
BackgroundTakikawa, Y., Kawagoe, R., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00238.2004 · Cited by 84
“I N T R O D U C T I O N The ability to predict future reward is important for goaldirected behavior (Dickinson and Balleine 1994).”
BackgroundNelson, A. J. D., & Killcross, S. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00076 · Cited by 83
“…early stages of acquisition, instrumental performance is normally sensitive to post-conditioning changes in reward value (Adams and Dickinson, 1981; Dickinson and Balleine, 1994) but as training proceeds, response control is ceded to the habit system and as a consequence becomes less sensitive to…”
BackgroundEagle, D. M., Humby, T., Dunnett, S. B., & Robbins, T. W. (1999) · Behavioral Neuroscience · doi:10.1037//0735-7044.113.4.718 · Cited by 81
The orbitofrontal cortex, predicted value and choice
Balleine, B. W., Leung, B. K., & Ostlund, S. B. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06270.x · Cited by 80
Self-citationIs comfort food really comforting? Mechanisms underlying stress-induced eating
Pool, E. R., Delplanque, S., Coppin, G., & Sander, D. (2015) · Food Research International · doi:10.1016/j.foodres.2014.12.034 · Cited by 94
“…causal relation with the instrumental action is vital to the goal-directed system, it is not necessary for the habitual system, which involves direct learning between an environmental stimulus and an instrumental action (stimulus – response learning; Dickinson, 1985; Dickinson & Balleine, 1994).”
A Multidimensional Approach to Apathy after Traumatic Brain Injury
Arnould, A., Rochat, L., Azouvi, P., & der Linden, M. V. (2013) · Neuropsychology Review · doi:10.1007/s11065-013-9236-3 · Cited by 98
“The term “directed” means that the action is mediated by knowledge of the contingency between the action and the outcome (Dickinson and Balleine 1994).”
BackgroundHernandez, P. J., Andrzejewski, M. E., Sadeghian, K., Panksepp, J. B., & Kelley, A. E. (2005) · Learning & Memory · doi:10.1101/lm.93105 · Cited by 83
Carruthers, P. (2005) · Oxford University Press eBooks · doi:10.1093/0199277362.003.0012 · Cited by 77
“means / ends reasoners ( Dickinson and Balleine, 1994; Dickinson and Shanks, 1995;”
BackgroundAmygdala-cortical collaboration in reward learning and decision making
Wassum, K. M. (2022) · eLife · doi:10.7554/elife.80926 · Cited by 96
Variation in Emotion and Cognition Among Fishes
Braithwaite, V. A., Huntingford, F. A., & van den Bos, R. (2011) · Journal of Agricultural and Environmental Ethics · doi:10.1007/s10806-011-9355-x · Cited by 88
Premotor cortex is critical for goal-directed actions
Gremel, C. M., & Costa, R. M. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00110 · Cited by 75
“…result Frontiers in Computational Neuroscience www.frontiersin.org August 2013 | Volume 7 | Article 110 | 6 of the learned positive relationship between response rate and reward rate thought to control acquisition of goal-directed actions (Dickinson and Balleine, 1994; Dezfouli and Balleine, 2012).”
BackgroundBerditchevskaia, A., Cazé, R. D., & Schultz, S. R. (2016) · Scientific Reports · doi:10.1038/srep27389 · Cited by 73
“Highly motivated but inefficient animals, on the other hand, may show a more general increase in instrumental response (Dickinson and Balleine 1994) by increasing licking indiscriminately in all time-periods.”
BackgroundLateral Orbitofrontal Inactivation Dissociates Devaluation-Sensitive Behavior and Economic Choice
Gardner, M. P. H., Conroy, J. S., Shaham, M. H., Styer, C. V., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.10.026 · Cited by 76
“For this reason, claims regarding model-based behavior typically require some sort of manipulation to isolate the type of associative information that underlies the putative value being deployed (Dickinson and Balleine, 1994, for example).”
Measuring habit formation through goal-directed response switching.
Luque, D., Molinero, S., Watson, P., López, F. J., & Le Pelley, M. E. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000722 · Cited by 73
Bertran‐Gonzalez, J., Laurent, V., Chieng, B. C. H., Christie, M. J., & Balleine, B. W. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1927-13.2013 · Cited by 83
“…in the laboratory using the outcome-specific pavlovian–instrumental transfer (PIT) paradigm, in which a stimulus predicting a specific pavlovian outcome is shown to bias choice toward those actions that earn the predicted outcome (Colwill and Rescorla, 1988; Dickinson and Balleine, 1994, 2002).”
MethodSelf-citationThe uncertainty processing theory of motivation
Anselme, P. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.12.020 · Cited by 92
“Two modern incentive concepts have proved to be of special interest: incentive salience, which is known to affect Pavlovian processes [28], and instrumental incentive learning [72].”
Asymmetrical interactions between thirst and hunger in Pavlovian-instrumental transfer.
Balleine, B. W. (1994) · PubMed · Cited by 75
Self-citationWalker, J. R., Ahmed, S. H., Gracy, K. N., & Koob, G. F. (2000) · Brain Research · doi:10.1016/s0006-8993(99)02288-x · Cited by 75
Appetitive vs. Aversive conditioning in humans
Andreatta, M., & Pauli, P. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00128 · Cited by 94
Cooper, S. J. (2005) · Appetite · doi:10.1016/j.appet.2005.01.003 · Cited by 84
Dubé, L. (2010) · Elsevier eBooks · doi:10.1016/c2009-0-01687-0 · Cited by 76
Habit learning and memory in mammals: Behavioral and neural characteristics
Gasbarri, A., Pompili, A., Packard, M. G., & Tomaz, C. A. B. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.06.010 · Cited by 89
Associative and sensorimotor cortico‐basal ganglia circuit roles in effects of abused drugs
Gremel, C. M., & Lovinger, D. M. (2016) · Genes Brain & Behavior · doi:10.1111/gbb.12309 · Cited by 82
Carruthers, P., & Williams, D. M. (2022) · Cognition · doi:10.1016/j.cognition.2022.105117 · Cited by 71
“The language of “ model-based ” versus “ model-free ” metacognition is introduced by analogy with model-based versus model-free learning and decision making (Dayan & Berridge, 2014; Dickinson & Balleine, 1994, 2002; Gl ¨ ascher, Daw, Dayan, & O'Doherty, 2010).”
MethodNucleus accumbens dopamine and rate of responding: Neurochemical and behavioral studies
Salamone, J. D., Aberman, J. E., Sokolowski, J. D., & Cousins, M. S. (1999) · Psychobiology · doi:10.3758/bf03332117 · Cited by 72
Instrumental vigour in punishment and reward
Dayan, P. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08026.x · Cited by 72
“Finally, we study how to fit these ideas into nascent treatments that extend concepts of opponency between dopamine and serotonin from valence to invigoration.”
BackgroundLearning the specific quality of taste reinforcement in larval Drosophila
Schleyer, M., Miura, D., Tanimura, T., & Gerber, B. (2015) · eLife · doi:10.7554/elife.04711 · Cited by 60
“On the other hand, reward expectations can apparently also be processed in a qualityspecific manner (e.g., Dickinson and Balleine, 1994; Watanabe, 1996).”
BackgroundLearned and cognitive controls of food intake
Benoit, S. C., Davis, J. F., & Davidson, T. L. (2010) · Brain Research · doi:10.1016/j.brainres.2010.06.009 · Cited by 71
“Therefore, animals assign incentive values to specific foods based upon the degree of food deprivation present when the foods are consumed (e.g., Balleine, 1992; Balleine and Dickinson, 1994; Dickinson and Balleine, 1994; Dickinson and Balleine, 1995).”
Lecca, D., Valentini, V., Cacciapaglia, F., Acquas, E., & Chiara, G. D. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0815-y · Cited by 81
“Substitution of heroin with saline resulted in an initial increase for two sessions followed by a rapid fall of responding on the active hole, indicating that responding was dependent upon an action/outcome relationship (Dickinson and Balleine 1994).”
BackgroundMeffre, J., Sicre, M., Diarra, M., Marchessaux, F., Paleressompoulle, D., & Ambroggi, F. (2019) · Current Biology · doi:10.1016/j.cub.2019.07.069 · Cited by 79
Energetic state during learning affects foraging choices in starlings
Marsh, B. (2004) · Behavioral Ecology · doi:10.1093/beheco/arh034 · Cited by 70
The rationality of animal memory: Complex caching strategies of western scrub jays
Clayton, N. S., Emery, N. J., & Dickinson, A. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198528272.003.0009 · Cited by 79
“This finding corresponds with what we know about motivation in other animals for which food-related desires are both specific and learned ( Dickinson and Balleine 1994, 2002 ).”
ResultSelf-citationThomas, K. L., & Everitt, B. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-07-02526.2001 · Cited by 64
Associative Structures in Pavlovian and Instrumental Conditioning
Hall, G. (2002) · Stevens' Handbook of Experimental Psychology · doi:10.1002/0471214426.pas0301 · Cited by 67
Metadata
- Authors
- Dickinson, A., & Balleine, B.
- Affiliations
- University of Cambridge (GB)
- Venue
- Animal Learning & Behavior
- Published
- 1994-03
- Volume
- 22
- Issue
- 1
- Pages
- 1-18
- ISSN
- 0090-4996 (ISSN-L)
- 1532-5830
- OpenAlex
- W2023732657
- Cited by
- 995
- References
- 106
- Citations by year
- 2026: 35 · 2025: 31 · 2024: 84 · 2023: 33 · 2022: 38 · 2021: 40 · 2020: 49 · 2019: 60 · 2018: 33 · 2017: 45 · 2016: 40 · 2015: 41 · 2014: 49 · 2013: 34 · 2012: 33
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Animal Learning & Behavior (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- goal-directed behavior, operant conditioning, classical conditioning, motivational states, hunger, thirst, incentive learning, outcome value, contingency learning, discriminative stimulus, Tolman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.