Goal-Driven Cognition in the Brain: A Computational Framework
Open accessThe DOI matches its OpenAlex record; 117 of the 117 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 1×
“…learning (RL), which has largely followed in the behaviorist tradition by emphasizing stimulus – response (S-R) learning, has become quite prominent (Sutton, 1988Sutton & Barto, 1990Sutton & Barto, 1998Montague, Dayan, & Sejnowski, 1996Schultz, Dayan, & Montague, 1997Schultz, 1998Hollerman &…”
BackgroundPlans and the structure of behavior.
Miller, G. A., Galanter, E., & Pribram, K. H. (1960) · doi:10.1037/10039-000 · Cited by 4,630
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Steel, P. (2007) · Psychological bulletin · doi:10.1037/0033-2909.133.1.65 · Cited by 3,417 · cited 1×
“gly, recent research shows that the tendency to procrastinate is strongly associated with impulsivity (the two are identical at a latent genetic level) (Gustavson, Miyake, Hewitt, & Friedman, 2014Steel, 2007), which is consistent with the goal selection framework: impulsive decision makers tend to focus on more im…”
ResultImplementation intentions and goal achievement: a meta-analysis of effects and processes
Gollwitzer, P. M., & Sheeran, P. (2006) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(06)38002-1 · Cited by 3,236 · cited 1×
“(Gollwitzer & Sheeran, 2006).”
Origins and functions of positive and negative affect: A control-process view.
Carver, C. S., & Scheier, M. F. (1990) · Psychological Review · doi:10.1037/0033-295x.97.1.19 · Cited by 2,726
Carver, C. S., & Scheier, M. F. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.1.111 · Cited by 2,650 · cited 1×
“for example along positive vs. negative affect dimensions (Watson & Tellegen, 1985Russell & Barrett, 1999), or along approach vs. avoidance dimensions (Figure 10; Carver & Scheier, 1982), which can be aligned with reward and punishment axes (Rolls, 2005Carver & Harmon-Jones, 2009).”
BackgroundGetting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“For example, the internal model hypothesized in the model-based reinforcement learning (RL) approach (Daw et al., 2005Dayan, 2009Rangel & Hare, 2010) has a lot in common with our construct of a goalspace.”
BackgroundToward a theory of task motivation and incentives
Locke, E. A. (1968) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(68)90004-4 · Cited by 2,409 · cited 4×
“These active goals must be concrete, with a clear criterion for accomplishment (a clear end), with a perceptual component that supports the ability to track progress toward the goal (Locke, 1968Locke & Latham, 2002), and at least a general action plan for how to proceed.”
BackgroundInfluentialBehavior: The Control of Perception
Kuhn, A., & Powers, W. T. (1975) · Contemporary Sociology · doi:10.2307/2063243 · Cited by 2,398 · cited 4×
“t to make contact with relevant work from the long history of scholarship in the domain of goal-driven behavior (Zeigarnik, 1927Lewin, 1928Tolman, 1932Tolman, 1948Miller, Galanter, & Pribram, 1960Powers, 1973Klinger, 1975Gollwitzer, 1993) (see Austin & Vancouver, 1996 for a thorough review, and the other refer…”
BackgroundInfluentialThe expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Goal constructs in psychology: Structure, process, and content.
Austin, J. T., & Vancouver, J. B. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.120.3.338 · Cited by 2,319 · cited 1×
“…behavior (Zeigarnik, 1927Lewin, 1928Tolman, 1932Tolman, 1948Miller, Galanter, & Pribram, 1960Powers, 1973Klinger, 1975Gollwitzer, 1993) (see Austin & Vancouver, 1996 for a thorough review, and the other references mentioned above on active work in areas outside of cognitive neuroscience).”
BackgroundNeuron Activity Related to Short-Term Memory
Fuster, J. M., & Alexander, G. E. (1971) · Science · doi:10.1126/science.173.3997.652 · Cited by 2,085 · cited 1×
“…(or task set representations; Rogers & Monsell, 1995), which can then provide focused, top-down biasing to influence processing elsewhere in the brain in a cognitively-framed, task-focused manner (e.g., Fuster & Alexander, 1971Goldman-Rakic, 1987O’Reilly, Braver, & Cohen, 1999Miller & Cohen, 2001).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869
Neural mechanisms of the cognitive model of depression.
Disner, S. G., Beevers, C. G., Haigh, E. A. P., & Beck, A. T. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3027 · Cited by 1,718
Cultural cognition of scientific consensus.
Kahan, D. M., Jenkins‐Smith, H., & Braman, D. (2011) · Journal of Risk Research · doi:10.1080/13669877.2010.511246 · Cited by 1,686
Neurocircuitry of Mood Disorders
Price, J. L., & Drevets, W. C. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.104 · Cited by 1,606 · cited 2×
“This inability to drive goal activation then also drives an overall deactivation of the dlPFC (Price & Drevets, 2010), with various sources suggesting a right vs. left lateralization imbalance (Rosadini & Rossi, 1967Carver & Harmon-Jones, 2009) consistent with the avoidance goals discussion above.”
BackgroundResultReconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · cited 2×
“…cortex (ACC), are important for representing affective states of various sorts, including what might be called “hot” (affectively meaningful) goals (Balleine & Dickinson, 1998Frank & Claus, 2006Noonan, Walton, Behrens, Sallet, Buckley, & Rushworth, 2010Ongür & Price, 2000Pauli, Hazy, &…”
MethodPlacebo and Opioid Analgesia-- Imaging a Shared Neuronal Network
Petrovic, P., Kalso, E., Petersson, K. M., & Ingvar, M. (2002) · Science · doi:10.1126/science.1067176 · Cited by 1,488
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 1×
“Mathematically, the LV phasic dopamine equation (1) is essentially the simple Y-dot (temporal derivative) formulation explored by Sutton and Barto prior to their developing the full TD algorithm (Sutton & Barto, 1981Sutton & Barto, 1990).”
MethodNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418 · cited 1×
“Also, this “directional” aspect of dopaminergic function is consistent with the framework of Salamone and Correa (2012), and the notion that the mesolimbic dopamine system and other limbic areas coordinate approach towards rewarding stimuli (Ikemoto, 2010).”
ResultThe Hierarchical Model of Approach-Avoidance Motivation
Elliot, A. J. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9028-7 · Cited by 1,385 · cited 1×
“s proportional to the gradient of reduction of proximity to the negative stimuli (i.e., getting further away from a predator). This is consistent with various proposals in the literature (Carver, 2006Elliot, 2006Higgins, 1997). The key difference here is that it is hard to concretely assess the end point associated wi…”
ResultTwo types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · cited 1×
“Further, the ability to trigger dopamine bursts by this kind of mitigation of aversive primary PVs can sometimes be transferred to a sizeable subset of the LV-type cells that reliably predict the occurrence of the aversive PV in the first place (Matsumoto & Hikosaka, 2009).”
BackgroundInput-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300
Lateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276
Prefrontal Brain Asymmetry: A Biological Substrate of the Behavioral Approach and Inhibition Systems
Sutton, S. K., & Davidson, R. J. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00413.x · Cited by 1,263
Russo, S. J., Murrough, J. W., Han, M.-H., Charney, D. S., & Nestler, E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3234 · Cited by 1,206
Baxter, M. G., & Murray, E. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn875 · Cited by 1,200
Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · cited 1×
“…2009Nemeth, Hegedus, & Molnar, 1988), while the most anterior rostral medial PFC area may integrate affective information with episodic memories (Carmichael & Price, 1996Cabeza, Kapur, & Tulving, 1997Gilbert, Spengler, Simons, Steele, Lawrie, Frith, & Burgess, 2006), and otherwise play an…”
BackgroundCharacterizing cognition in ADHD: beyond executive dysfunction
Castellanos, F. X., Sonuga-Barke, E. J. S., Milham, M. P., & Tannock, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.01.011 · Cited by 1,170 · cited 1×
“The motivational account also helps to make sense of the increase in response time variability observed in these patients (Castellanos et al., 2006Frank, Santamaria, O’Reilly, & Willcutt, 2007) — sometimes they are engaged in the task, and other times they are not.”
BackgroundFloresco, S. B., West, A. R., Ash, B., Moore, H., & Grace, A. A. (2003) · Nature Neuroscience · doi:10.1038/nn1103 · Cited by 1,106
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Cingulate function in depression: a potential predictor of treatment response
Mayberg, H. S., Brannan, S. K., Mahurin, R. K., Jerabek, P. A., Brickman, J. S., Tekell, J. L., Silva, J. A., McGinnis, S., Glass, T. G., Martin, C. C., et al. (1997) · NeuroReport · doi:10.1097/00001756-199703030-00048 · Cited by 1,029
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 1×
“First, it is necessary to account for the blocking effect (Kamin, 1969aKamin, 1969b) and conditioned inhibition (Rescorla & Wagner, 1972; see Waelti et al., 2001 and Tobler, Dickinson, & Schultz, 2003, respectively for a full theoretical discussion).”
BackgroundEisenberger, N. I. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3231 · Cited by 1,016 · cited 1×
“level forms of negative outcomes that are not viscerally painful, but people describe them as such, and they activate many of the same neural pathways (Kross, Berman, Mischel, Smith, & Wager, 2011Eisenberger, 2012). Thus, pain may serve as a kind of universal negative PV pathway for many different outcomes, which…”
BackgroundWrosch, C., Scheier, M. F., Miller, G. E., Schulz, R., & Carver, C. S. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203256921 · Cited by 991 · cited 1×
“Interestingly, positive outcomes can sometimes be associated with goal abandonment, but this seems to depend on being able to move past the abandoned goal within a larger overall approach goal (Wrosch et al., 2003).”
BackgroundValue from hedonic experience and engagement
Higgins, E. T. (2006) · Psychological Review · doi:10.1037/0033-295x.113.3.439 · Cited by 949 · cited 1×
“More broadly, the notion that cognition can be dominated by engaged goals is consistent with the motivated reasoning framework (Kunda, 1990Westen, Blagov, Harenski, Kilts, & Hamann, 2006), and with the value added by strength of engagement (Higgins, 2006).”
ResultOptimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948
Frank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Ventromedial prefrontal–subcortical systems and the generation of affective meaning
Roy, M., Shohamy, D., & Wager, T. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.005 · Cited by 856 · cited 1×
“Interestingly, a similar map was developed based on analyzing a range of different human fMRI studies (Roy et al., 2012).”
BackgroundThe Iowa Gambling Task and the somatic marker hypothesis: some questions and answers
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.02.002 · Cited by 798
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766
Cerebellar networks with the cerebral cortex and basal ganglia
Bostan, A. C., Dum, R. P., & Strick, P. L. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.03.003 · Cited by 759
Distinct extended amygdala circuits for divergent motivational states
Jennings, J. H., Sparta, D. R., Stamatakis, A. M., Ung, R. L., Pleil, K. E., Kash, T. L., & Stuber, G. D. (2013) · Nature · doi:10.1038/nature12041 · Cited by 704
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
A unified framework for inhibitory control
Munakata, Y., Herd, S. A., Chatham, C. H., Depue, B. E., Banich, M. T., & O’Reilly, R. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.07.011 · Cited by 699
Self-citationJhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., & Holland, P. C. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.001 · Cited by 696
Movement intention after parietal cortex stimulation in humans
Desmurget, M., Reilly, K. T., Richard, N., Szathmari, A., Mottolese, C., & Sirigu, A. (2009) · Science · doi:10.1126/science.1169896 · Cited by 695
Social rejection shares somatosensory representations with physical pain
Kross, E., Berman, M. G., Mischel, W., Smith, E. E., & Wager, T. D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102693108 · Cited by 689
Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675
Diverging neural pathways assemble a behavioural state from separable features in anxiety
Kim, S.-Y., Adhikari, A., Lee, S. Y., Marshel, J. H., Kim, C. K., Mallory, C. S., Lo, M., Pak, S., Mattis, J., Lim, B. K., et al. (2013) · Nature · doi:10.1038/nature12018 · Cited by 666
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · cited 2×
“It is plausible that other neuromodulators may expand the dimensionality of the space (e.g., Doya, 2002Doya, 2008), but even there, v/mPFC is a very large space that has plenty of room for very high dimensional representations of affective states and goals.”
BackgroundSynaptic potentiation onto habenula neurons in the learned helplessness model of depression
Li, B., Piriz, J., Mirrione, M., Chung, C., Proulx, C. D., Schulz, D., Henn, F., & Malinow, R. (2011) · Nature · doi:10.1038/nature09742 · Cited by 634
Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 1×
“…of a PV to associate active stimulus representations, and subsequently can fire based on these stimulus inputs alone, providing an LV-like signal (Balleine & Killcross, 2006Baxter & Murray, 2002Belova, Paton, Morrison, & Salzman, 2007Ono et al., 1995Paton, Belova, Morrison, & Salzman,…”
BackgroundJoel, D., & Weiner, I. (2000) · Neuroscience · doi:10.1016/s0306-4522(99)00575-8 · Cited by 614
Approach, Avoidance, and the Self-Regulation of Affect and Action
Carver, C. S. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9044-7 · Cited by 602
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“Consistent with this prediction, OFC lesions lead to increased impulsive choices in some tasks (Rudebeck et al., 2006Mobini, Body, Ho, Bradshaw, Szabadi, Deakin, & Anderson, 2002), but other studies found decreased impulsive choices with OFC lesions (Zeeb, Floresco, & Winstanley, 2010Winstanley,…”
ResultSchoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579
Critical role of dorsomedial hypothalamic nucleus in a wide range of behavioral circadian rhythms
Chou, T. C., Scammell, T. E., Gooley, J. J., Gaus, S. E., Saper, C. B., & Lu, J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-33-10691.2003 · Cited by 576
Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance
Stamatakis, A. M., & Stuber, G. D. (2012) · Nature Neuroscience · doi:10.1038/nn.3145 · Cited by 564
Effort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560
Emotion and Rationality: A Critical Review and Interpretation of Empirical Evidence
Pham, M. T. (2007) · Review of General Psychology · doi:10.1037/1089-2680.11.2.155 · Cited by 552
The bright side of being blue: depression as an adaptation for analyzing complex problems.
Andrews, P. W., & Thomson, J. A. (2009) · Psychological Review · doi:10.1037/a0016242 · Cited by 549 · cited 1×
“…has been mixed (despite the pervasive belief that depressed people are more rational) (Pham, 2007), but the bias toward rumination associated with negative mood may result in more carefully considered solutions to challenging problems, and in this way be adaptive (Andrews & Thomson, 2009).”
BackgroundNeural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507
Associative processes in intuitive judgment
Morewedge, C. K., & Kahneman, D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.004 · Cited by 492
From threat to fear: the neural organization of defensive fear systems in humans.
Mobbs, D., Marchant, J. L., Hassabis, D., Seymour, B., Tan, G., Gray, M., Petrovic, P., Dolan, R. J., & Frith, C. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2378-09.2009 · Cited by 476
Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory
Ikemoto, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.02.001 · Cited by 454
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453
S., M., S., B., M.-Y., H., C., B., E., S., J., D., & I., A. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0983-0 · Cited by 409
Hong, S., Jhou, T. C., Smith, M., Saleem, K. S., & Hikosaka, O. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1384-11.2011 · Cited by 390
Brain mediators of predictive cue effects on perceived pain
Atlas, L. Y., Bolger, N., Lindquist, M. A., & Wager, T. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0057-10.2010 · Cited by 389
Ji, H., & Shepard, P. D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0958-07.2007 · Cited by 388 · cited 1×
“…eye) can reliably drive dopamine dips (at least for most dopamine cells) through direct activation of the RMTg and/or the LHb as described above (Ji & Shepard, 2007Lecourtier, DeFrancesco, & Moghaddam, 2008Matsumoto & Hikosaka, 2007Shepard, Holcomb, & Gold, 2006Stamatakis & Stuber, 2012Lammel,…”
BackgroundBanishing the homunculus: Making working memory work
Hazy, T. E., Frank, M. J., & O’Reilly, R. C. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.04.067 · Cited by 385
Self-citationResponses to reward in monkey dorsal and ventral striatum
Apicella, P., Ljungberg, T., Scarnati, E., & Schultz, W. (1991) · Experimental Brain Research · doi:10.1007/bf00231732 · Cited by 369
O'Reilly, R. C. (1996) · Neural Computation · doi:10.1162/neco.1996.8.5.895 · Cited by 352 · cited 1×
“This equation was shown to compute the same error gradient as the backpropagation algorithm, subject to symmetry and a 2nd-order numerical integration technique known as the midpoint method, based the generalized recirculation algorithm (GeneRec; (O’Reilly, 1996)).”
MethodSelf-citationFrontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349
The globus pallidus sends reward-related signals to the lateral habenula
Hong, S., & Hikosaka, O. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.035 · Cited by 346
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · cited 1×
“The medial OFC (mOFC) is interconnected with appetitive areas, and thus may represent positive values (PV , δlv+) (Noonan et al., 2010).”
BackgroundThe mesoaccumbens dopamine in coping with stress
Cabib, S., & Puglisi-Allegra, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.012 · Cited by 329
Wager, T. D., Atlas, L. Y., Leotti, L. A., & Rilling, J. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3420-10.2011 · Cited by 328
Amygdala-prefrontal cortical circuitry regulates effort based decision making
Floresco, S. B., & Ghods-Sharifi, S. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj143 · Cited by 316 · cited 1×
“Lesioning the connection between BLA and ACC leads to similar difficulties with choosing the high reward arm paired with high effort (Floresco & Ghods-Sharifi, 2007Floresco et al., 2008).”
BackgroundCoding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300
Overlapping neural systems mediating extinction, reversal and regulation of fear
Schiller, D., & Delgado, M. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.04.002 · Cited by 294
Role of the medial prefrontal cortex in coping and resilience
Maier, S. F., & Watkins, L. R. (2010) · Brain Research · doi:10.1016/j.brainres.2010.08.039 · Cited by 292
The many faces of fatigue in major depressive disorder
Demyttenaere, K., De Fruyt, J., & Stahl, S. M. (2005) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145704004729 · Cited by 288 · cited 1×
“As noted earlier, we can think of depression as characterized an inability to enter the goal-engaged state, resulting in pervasive feelings of fatigue and motivational anhedonia (Demyttenaere et al., 2005Salamone et al., 2007Treadway & Zald, 2011Salamone & Correa, 2012).”
BackgroundLodge, D. J., & Grace, A. A. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300963 · Cited by 280
Oleson, E. B., Gentry, R. N., Chioma, V. C., & Cheer, J. F. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3087-12.2012 · Cited by 272
Functional Neuroanatomy of Recall and Recognition: A PET Study of Episodic Memory
Cabeza, R., Kapur, S., Craik, F. I. M., McIntosh, A. R., Houle, S., & Tulving, E. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.2.254 · Cited by 263
Murray, E. A., O'Doherty, J. P., & Schoenbaum, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-07.2007 · Cited by 238
Frank, M. J., Santamaria, A., O'Reilly, R. C., & Willcutt, E. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301278 · Cited by 227
Computational Models of Performance Monitoring and Cognitive Control
Alexander, W. H., & Brown, J. W. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01085.x · Cited by 193
Motivational Effects on Inhibitory Control in Children With ADHD
SLUSAREK, M., VELLING, S., BUNK, D., & EGGERS, C. (2001) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200103000-00016 · Cited by 184
Cognitive control reflects context monitoring, not motoric stopping, in response inhibition
Chatham, C. H., Claus, E. D., Kim, A., Curran, T., Banich, M. T., & Munakata, Y. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031546 · Cited by 182
Indirection and symbol-like processing in the prefrontal cortex and basal ganglia
Kriete, T., Noelle, D. C., Cohen, J. D., & O’Reilly, R. C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1303547110 · Cited by 181
Self-citationDovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. M. (2012) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-011-9601-8 · Cited by 165 · cited 1×
“Furthermore, motivational manipulations have relatively strong effects, serving to at least partially ameliorate any observed deficits (Dovis et al., 2012Slusarek et al., 2001).”
BackgroundGoal-directed control and its antipodes
Dayan, P. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.004 · Cited by 93 · cited 3×
“Recently, a new distinction between model-free and model-based forms of RL has become an area of active exploration (Daw, Niv, & Dayan, 2005Dayan, 2009Rangel & Hare, 2010).”
BackgroundMethodInfluentialNoradrenergic control of the bed nucleus of the stria terminalis in stress and reward
Flavin, S. A., & Winder, D. G. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.02.013 · Cited by 62
Levels of conflict in reasoning modulate right lateral prefrontal cortex
Stollstorff, M., Vartanian, O., & Goel, V. (2012) · Brain Research · doi:10.1016/j.brainres.2011.05.045 · Cited by 43
Pauli, W. M., Hazy, T. E., & O'Reilly, R. C. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00155 · Cited by 32 · cited 1×
“Further, in addition to its unidirectional driving projection to the CeA, the BLA is bilaterally interconnected with the orbital frontal cortex (OFC) and thus can drive anticipatory PV-like representations there in reaction to LV-like cues in the environment (Pauli et al., 2012b).”
BackgroundSelf-citation
Cited by
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334
“Hierarchical processing has also been advanced to explain the role of dorsolateral (dlPFC [28]) and ventromedial prefrontal cortex (vmPFC [3,29,30]) in control and motivation, respectively, see also [31–33].”
BackgroundDopamine Does Double Duty in Motivating Cognitive Effort
Westbrook, A., & Braver, T. S. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.029 · Cited by 308
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
Measuring implemental delay in procrastination: separating onset and sustained goal striving.
Svartdal, F., Klingsieck, K. B., Steel, P., & Gamst-Klaussen, T. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2019.109762 · Cited by 37
“Diefendorff and Lord (2008) and O'Reilly et al. (2014) approached this issue from a neuroscience perspective.”
Background
Metadata
- Authors
- O’Reilly, R. C., Hazy, T. E., Mollick, J., Mackie, P., & Herd, S. A.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2014-04-30
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1404.7591
- OpenAlex
- W2146689503
- Cited by
- 31
- References
- 117
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.