The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
A Representation of Effort in Decision-Making and Motor Control
Open accessAbstract
Decisions depend on the reward at stake and the effort required. However, these same variables influence the vigor of the ensuing movement, suggesting that factors that affect evaluation of action also influence performance of the selected action. Here, we describe a mathematical framework that links decision-making with motor control. Each action has a utility that combines the reward at stake with its effort requirements, both discounted as a hyperbolic function of time. We suggest that effort is related to the metabolic energy expended to produce that movement. This framework makes wide- ranging predictions, accounting for choices that birds make in walking vs. flying, choices that people make in reaching and force production, and the curious fact that pedestrians walk faster in certain cities. We suggest that decision-making and motor control share a common utility in which the expected rewards and the energetic costs are discounted as a function of time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry
Kravitz, A. V., Freeze, B. S., Parker, P. R. L., Kay, K., Thwin, M. T., Deisseroth, K., & Kreitzer, A. C. (2010) · Nature · doi:10.1038/nature09159 · Cited by 1,885
The Role of Time and Energy in Food Preference
Emlen, J. M. (1966) · The American Naturalist · doi:10.1086/282455 · Cited by 1,470
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 2×
“Earlier work had suggested that the brain may assign a utility for each potential action, where utility contains an interaction between reward and effort [6, 7].”
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 631
Derivation of formulae used to calculate energy expenditure in man.
Brockway, J. M. (1987) · PubMed · Cited by 585
Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 554
Separate Valuation Subsystems for Delay and Effort Decision Costs
Prévost, C., Pessiglione, M., Météreau, E., Cléry-Melin, M.-L., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2752-10.2010 · Cited by 499
Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., & Mahan, K. (1991) · Psychopharmacology · doi:10.1007/bf02245659 · Cited by 436
Influence of Reward Delays on Responses of Dopamine Neurons
Kobayashi, S., & Schultz, W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1600-08.2008 · Cited by 430
Humans can continuously optimize energetic cost during walking
Selinger, J. C., O’Connor, S. M., Wong, J. D., & Donelan, J. M. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.016 · Cited by 395
Gordon, J., Ghilardi, M. F., Cooper, S. E., & Ghez, C. (1994) · Experimental Brain Research · doi:10.1007/bf00241416 · Cited by 351
Motor Adaptation as a Process of Reoptimization
Izawa, J., Rane, T., Donchin, O., & Shadmehr, R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5359-07.2008 · Cited by 347
Self-citationSeidell, J. C., Muller, D. C., Sorkin, J. D., & Andres, R. (1992) · PubMed · Cited by 321
Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making
Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E. M., & Rushworth, M. F. S. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.005 · Cited by 308
Effect of load and speed on the energetic cost of human walking
Bastien, G. J., Willems, P. A., Schepens, B., & Heglund, N. C. (2005) · European Journal of Applied Physiology · doi:10.1007/s00421-004-1286-z · Cited by 226
Temporal Discounting of Reward and the Cost of Time in Motor Control
Shadmehr, R., Orban de Xivry, J. J., Xu-Wilson, M., & Shih, T.-Y. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1343-10.2010 · Cited by 218
Self-citationEnergy-speed relation and optimal speed during level walking
Ralston, H. J. (1958) · Internationale Zeitschrift für Angewandte Physiologie Einschliesslich Arbeitsphysiologie · doi:10.1007/bf00698754 · Cited by 203
On the challenges and mechanisms of embodied decisions
Cisek, P., & Pastor-Bernier, A. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0479 · Cited by 199
The influence of predicted arm biomechanics on decision making
Cos, I., Bélanger, N., & Cisek, P. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00975.2010 · Cited by 186
Reduction of Metabolic Cost during Motor Learning of Arm Reaching Dynamics
Huang, H. J., Kram, R., & Ahmed, A. A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4003-11.2012 · Cited by 180
Self-citationKlein-Flügge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004116 · Cited by 163
The intrinsic value of visual information affects saccade velocities
Xu-Wilson, M., Zee, D. S., & Shadmehr, R. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1879-1 · Cited by 160
Self-citationA Model of Reward- and Effort-Based Optimal Decision Making and Motor Control
Rigoux, L., & Guigon, E. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002716 · Cited by 156
Evidence for Hyperbolic Temporal Discounting of Reward in Control of Movements
Haith, A. M., Reppert, T. R., & Shadmehr, R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0424-12.2012 · Cited by 146
Self-citationJimura, K., Myerson, J., Hilgard, J., Braver, T. S., & Green, L. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.6.1071 · Cited by 143
Dissociating Variability and Effort as Determinants of Coordination
O'Sullivan, I., Burdet, E., & Diedrichsen, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000345 · Cited by 135
Nucleus accumbens dopamine and work requirements on interval schedules
Correa, M., Carlson, B. B., Wisniecki, A., & Salamone, J. D. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00292-9 · Cited by 131
Thura, D., Cos, I., Trung, J., & Cisek, P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0162-14.2014 · Cited by 131
To walk or to fly? How birds choose among foraging modes
Bautista-Sopelana, L. M., Tinbergen, J. M., & Kacelnik, A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.3.1089 · Cited by 131
Modulation of Saccade Vigor during Value-Based Decision Making
Reppert, T. R., Lempert, K. M., Glimcher, P. W., & Shadmehr, R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2621-15.2015 · Cited by 128
Self-citationThe Central Nervous System Does Not Minimize Energy Cost in Arm Movements
Kistemaker, D. A., Wong, J. D., & Gribble, P. L. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00483.2010 · Cited by 119
Vigor of Movements and the Cost of Time in Decision Making
Choi, J. E. S., Vaswani, P. A., & Shadmehr, R. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2798-13.2014 · Cited by 112
Self-citationOpriș, I. C., Lebedev, M., & Nelson, R. J. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00061 · Cited by 104
Limited Encoding of Effort by Dopamine Neurons in a Cost–Benefit Trade-off Task
Pasquereau, B., & Turner, R. S. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4619-12.2013 · Cited by 104
Goble, J. A., Zhang, Y., Shimansky, Y. P., Sharma, S., & Dounskaia, N. V. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00582.2007 · Cited by 90
Reformative self‐control and discounting of reward value by delay or effort1
Sugiwaka, H., & Okouchi, H. (2004) · Japanese Psychological Research · doi:10.1111/j.1468-5884.2004.00231.x · Cited by 71
A Neuroeconomics Approach to Inferring Utility Functions in Sensorimotor Control
Kording, K. P., Fukunaga, I., Howard, I. S., Ingram, J. N., & Wolpert, D. M. (2004) · PLoS Biology · doi:10.1371/journal.pbio.0020330 · Cited by 66
Motor Costs and the Coordination of the Two Arms
Salimpour, Y., & Shadmehr, R. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3095-13.2014 · Cited by 37
Self-citationSackaloo, K., Strouse, E., & Rice, M. S. (2015) · OTJR Occupational Therapy Journal of Research · doi:10.1177/1539449214561763 · Cited by 30
The basal ganglia, the ideal machinery for the cost-benefit analysis of action plans
Hwang, E. J. (2013) · Frontiers in Neural Circuits · doi:10.3389/fncir.2013.00121 · Cited by 28
Load emphasizes muscle effort minimization during selection of arm movement direction
Wang, W., & Dounskaia, N. V. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-70 · Cited by 25
What is chosen first, the hand used for reaching or the target that is reached?
Herbort, O., & Rosenbaum, D. Α. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0488-y · Cited by 8
Cited by
The Role of Variability in Motor Learning
Dhawale, A. K., Smith, M. A., & Ölveczky, B. P. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031548 · Cited by 516
Decision-making in sensorimotor control
Gallivan, J. P., Chapman, C. S., Wolpert, D. M., & Flanagan, J. R. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0045-9 · Cited by 304
Internal models in biological control
McNamee, D., & Wolpert, D. M. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105206 · Cited by 225
Interoception as modeling, allostasis as control
Sennesh, E., Theriault, J., Brooks, D., van de Meent, J.-W., Barrett, L. F., & Quigley, K. S. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108242 · Cited by 107
Concepts, goals and the control of survival-related behaviors
Feldman Barrett, L., & Finlay, B. L. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.10.001 · Cited by 89
Metadata
- Authors
- Shadmehr, R., Huang, H. J., & Ahmed, A. A.
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2016-07
- Volume
- 26
- Issue
- 14
- Pages
- 1929-1934
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W2471992433
- Cited by
- 267
- References
- 43
- FWCI
- 12.54
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.