The DOI matches its Crossref record; 74 of the 76 references it cites were found in a registry or an index.
A goal-driven modular neural network predicts parietofrontal neural dynamics during grasping
Open accessAbstract
Significance: Grasping objects is something primates do effortlessly, but how does our brain coordinate such a complex task? Multiple brain areas across the parietal and frontal cortices of macaque monkeys are essential for shaping the hand during grasping, but we lack a comprehensive model of grasping from vision to action. In this work, we show that multiarea neural networks trained to reproduce the arm and hand control required for grasping using the visual features of objects also reproduced neural dynamics in grasping regions and the relationships between areas, outperforming alternative models. Simulated lesion experiments revealed unique deficits paralleling lesions to specific areas in the grasping circuit, providing a model of how these areas work together to drive behavior.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A shortcoming of this approach is that the DNN does not predict how an individual neuron causally contributes to behaviour, making it difficult to interpret the role of the neuron in the sensorimotor transformation.”
From Mapping model units to visual neurons reveals population code for social behaviour (2024) · cites this paper as [16]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,759
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
The economy of brain network organization
Bullmore, E., & Sporns, O. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3214 · Cited by 3,284
A Generalized Solution of the Orthogonal Procrustes Problem
Schönemann, P. H. (1966) · Psychometrika · doi:10.1007/bf02289451 · Cited by 2,040
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Neural population dynamics during reaching
Churchland, M. M., Cunningham, J. P., Kaufman, M. T., Foster, J. D., Nuyujukian, P., Ryu, S. I., & Shenoy, K. V. (2012) · Nature · doi:10.1038/nature11129 · Cited by 1,704
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A. J., & Schölkopf, B. (2005) · Lecture notes in computer science · doi:10.1007/11564089_7 · Cited by 1,668
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Descending Pathways in Motor Control
Lemon, R. N. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125547 · Cited by 1,599
THE FUNCTIONAL ORGANIZATION OF THE MOTOR SYSTEM IN THE MONKEY
Lawrence, D. G., & Kuypers, H. G. J. M. (1968) · Brain · doi:10.1093/brain/91.1.1 · Cited by 1,301
Visual Processing in Monkey Extrastriate Cortex
Maunsell, J. H. R., & Newsome, W. T. (1987) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.10.030187.002051 · Cited by 1,135
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Saul, K. R., Murray, W. M., & Delp, S. L. (2005) · Annals of Biomedical Engineering · doi:10.1007/s10439-005-3320-7 · Cited by 1,019
Cortical Control of Arm Movements: A Dynamical Systems Perspective
Shenoy, K. V., Sahani, M., & Churchland, M. M. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150509 · Cited by 865
Murata, A., Gallese, V., Luppino, G., Kaseda, M., & Sakata, H. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.5.2580 · Cited by 841
Cadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., Majaj, N. J., & DiCarlo, J. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003963 · Cited by 824
THE FUNCTIONAL ORGANIZATION OF THE MOTOR SYSTEM IN THE MONKEY
Lawrence, D. G., & Kuypers, H. G. J. M. (1968) · Brain · doi:10.1093/brain/91.1.15 · Cited by 791
Object Representation in the Ventral Premotor Cortex (Area F5) of the Monkey
Murata, A., Fadiga, L., Fogassi, L., Gallese, V., Raos, V., & Rizzolatti, G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.4.2226 · Cited by 753
Similarity of Neural Network Representations Revisited
Kornblith, S., Norouzi, M., Lee, H., & Hinton, G. (2019) · arXiv · doi:10.48550/arxiv.1905.00414 · Cited by 724
Sporns, O. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.2.127 · Cited by 712
Webster, M., Bachevalier, J., & Ungerleider, L. G. (1994) · Cerebral Cortex · doi:10.1093/cercor/4.5.470 · Cited by 599
A neural network that finds a naturalistic solution for the production of muscle activity
Sussillo, D., Churchland, M. M., Kaufman, M. T., & Shenoy, K. V. (2015) · Nature Neuroscience · doi:10.1038/nn.4042 · Cited by 598
Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks
Sussillo, D., & Barak, O. (2013) · Neural Computation · doi:10.1162/neco_a_00409 · Cited by 575
Task representations in neural networks trained to perform many cognitive tasks
Yang, G. R., Joglekar, M. R., Song, H. F., Newsome, W. T., & Wang, X.-J. (2019) · Nature Neuroscience · doi:10.1038/s41593-018-0310-2 · Cited by 549
Guidelines for the Care and Use of Mammals in Neuroscience and Behavioral Research
National Research Council (2003) · National Academies Press eBooks · doi:10.17226/10732 · Cited by 530
Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine?
Churchland, M. M., Cunningham, J. P., Kaufman, M. T., Ryu, S. I., & Shenoy, K. V. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.015 · Cited by 526
Kar, K., Kubilius, J., Schmidt, K., Issa, E. B., & DiCarlo, J. J. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0392-5 · Cited by 496
A Predictive Network Model of Cerebral Cortical Connectivity Based on a Distance Rule
Ercsey-Ravasz, M., Markov, N. T., Lamy, C., Van Essen, D. C., Knoblauch, K., Toroczkai, Z., & Kennedy, H. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.036 · Cited by 487
Fogassi, L. (2001) · Brain · doi:10.1093/brain/124.3.571 · Cited by 429
Modeling parietal–premotor interactions in primate control of grasping
Fagg, A. H., & Arbib, M. A. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00047-1 · Cited by 428
Neural population control via deep image synthesis
Bashivan, P., Kar, K., & DiCarlo, J. J. (2019) · Science · doi:10.1126/science.aav9436 · Cited by 427
Luppino, G., Murata, A., Govoni, P., & Matelli, M. (1999) · Experimental Brain Research · doi:10.1007/s002210050833 · Cited by 406
Recurrence is required to capture the representational dynamics of the human visual system
Kietzmann, T. C., Spoerer, C. J., Sörensen, L. K. A., Cichy, R. M., Hauk, O., & Kriegeskorte, N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905544116 · Cited by 406
Cortical connections of the macaque anterior intraparietal (AIP) area
Borra, E., Belmalih, A., Calzavara, R., Gerbella, M., Murata, A., Rozzi, S., & Luppino, G. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm146 · Cited by 402
Tunik, E., Frey, S. H., & Grafton, S. T. (2005) · Nature Neuroscience · doi:10.1038/nn1430 · Cited by 387
Deficit of hand preshaping after muscimol injection in monkey parietal cortex
D, V. G. M., Murata, A., Kaseda, M., Niki, N., & Sakata, H. (1994) · Neuroreport · doi:10.1097/00001756-199407000-00029 · Cited by 377
Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements
Hennequin, G., Vogels, T. P., & Wulfram Gerstner, B. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.045 · Cited by 350
Raghu, M., Gilmer, J., Yosinski, J., & Sohl-Dickstein, J. (2017) · arXiv · doi:10.48550/arxiv.1706.05806 · Cited by 335
Motor Cortex Embeds Muscle-like Commands in an Untangled Population Response
Russo, A. A., Bittner, S. R., Perkins, S. M., Seely, J., London, B. M., Lara, A. H., Miri, A., Marshall, N. J., Kohn, A., Jessell, T. M., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.004 · Cited by 309
Neuronal Interconnection as a Function of Brain Size
Ringo, J. L. (2008) · Brain Behavior and Evolution · doi:10.1159/000114375 · Cited by 304
Cortical pattern generation during dexterous movement is input-driven
Sauerbrei, B., Guo, J., Cohen, J. D., Mischiati, M., Guo, W. W., Kabra, M., Verma, N., Mensh, B. D., Branson, K. M., & Hantman, A. W. (2019) · Nature · doi:10.1038/s41586-019-1869-9 · Cited by 300
The cognitive neuroscience of prehension: recent developments
Grafton, S. T. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2315-2 · Cited by 298
Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area
Baumann, M. A., Fluet, M.-C., & Scherberger, H. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5479-08.2009 · Cited by 256
Self-citationTask-Dependent Changes in the Large-Scale Dynamics and Necessity of Cortical Regions
Pinto, L., Rajan, K., DePasquale, B., Thiberge, S. Y., Tank, D. W., & Brody, C. D. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.025 · Cited by 244
The Largest Response Component in the Motor Cortex Reflects Movement Timing but Not Movement Type
Kaufman, M. T., Seely, J., Sussillo, D., Ryu, S. I., Shenoy, K. V., & Churchland, M. M. (2016) · eNeuro · doi:10.1523/eneuro.0085-16.2016 · Cited by 242
Gămănuț, R., Kennedy, H., Toroczkai, Z., Ercsey-Ravasz, M., Essen, D. C. V., Knoblauch, K., & Burkhalter, A. (2018) · Neuron · doi:10.1016/j.neuron.2017.12.037 · Cited by 215
THE LONG-TERM EFFECTS OF REMOVAL OF SENSORIMOTOR CORTEX IN INFANT AND ADULT RHESUS MONKEYS
Passingham, R. E., Perry, V. H., & WILKINSON, F. (1983) · Brain · doi:10.1093/brain/106.3.675 · Cited by 200
Cortical connections of the anterior (F5a) subdivision of the macaque ventral premotor area F5
Gerbella, M., Belmalih, A., Borra, E., Rozzi, S., & Luppino, G. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0293-6 · Cited by 199
Horvát, S., Gămănuț, R., Ercsey-Ravasz, M., Magrou, L., Gămănuț, B., Van Essen, D. C., Burkhalter, A., Knoblauch, K., Toroczkai, Z., & Kennedy, H. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002512 · Cited by 198
Michaels, J. A., Dann, B., & Scherberger, H. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005175 · Cited by 184
Self-citationChaisangmongkon, W., Swaminathan, S. K., Freedman, D. J., & Wang, X. (2017) · Neuron · doi:10.1016/j.neuron.2017.03.002 · Cited by 159
Task-Driven Convolutional Recurrent Models of the Visual SystemPreprint
Nayebi, A., Bear, D. M., Kubilius, J., Kar, K., Ganguli, S., Sussillo, D., DiCarlo, J. J., & Yamins, D. L. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00053 · Cited by 142
Murata, Y., Higo, N., Oishi, T., Yamashita, A., Matsuda, K., Hayashi, M., & Yamane, S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01001.2007 · Cited by 135
Emergent modular neural control drives coordinated motor actions
Lemke, S. M., Ramanathan, D., Guo, L. T., Won, S. J., & Ganguly, K. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0407-2 · Cited by 129
Object vision to hand action in macaque parietal, premotor, and motor cortices
Schaffelhofer, S., & Scherberger, H. (2016) · eLife · doi:10.7554/elife.15278 · Cited by 127
Self-citationContext-Specific Grasp Movement Representation in Macaque Ventral Premotor Cortex
Fluet, M.-C., Baumann, M. A., & Scherberger, H. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.3343-10.2010 · Cited by 119
Self-citationMotor primitives in space and time via targeted gain modulation in cortical networks
Stroud, J. P., Porter, M. A., Hennequin, G., & Vogels, T. P. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0276-0 · Cited by 119
Decoding a Wide Range of Hand Configurations from Macaque Motor, Premotor, and Parietal Cortices
Schaffelhofer, S., Agudelo-Toro, A., & Scherberger, H. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3594-14.2015 · Cited by 118
Self-citationConnectional heterogeneity of the ventral part of the macaque area 46.
Gerbella, M., Borra, E., Tonelli, S., Rozzi, S., & Luppino, G. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs096 · Cited by 110
Universality and individuality in neural dynamics across large populations of recurrent networks
Maheswaranathan, N., Williams, A. H., Golub, M. D., Ganguli, S., & Sussillo, D. (2019) · PubMed · doi:10.48550/arxiv.1907.08549 · Cited by 103
Borra, E., Gerbella, M., Rozzi, S., & Luppino, G. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1745-11.2011 · Cited by 102
Effects of a primary motor cortex lesion on step-tracking movements of the wrist
Hoffman, D. S., & Strick, P. L. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.2.891 · Cited by 95
Reach and Gaze Representations in Macaque Parietal and Premotor Grasp Areas
Lehmann, S. J., & Scherberger, H. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.5568-12.2013 · Cited by 86
Self-citationInferotemporal Cortex Subserves Three-Dimensional Structure Categorization
Verhoef, B.-E., Vogels, R., & Janssen, P. (2012) · Neuron · doi:10.1016/j.neuron.2011.10.031 · Cited by 77
Carpaneto, J., Umiltà, M. A., Fogassi, L., Murata, A., Gallese, V., Micera, S., & Raos, V. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.04.062 · Cited by 61
Janssen, P., Verhoef, B.-E., & Premereur, E. (2017) · Cortex · doi:10.1016/j.cortex.2017.01.021 · Cited by 50
Shape representations in the primate dorsal visual stream
Theys, T., Romero, M. C., Loon, J. V., & Janssen, P. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00043 · Cited by 48
Musculoskeletal Representation of a Large Repertoire of Hand Grasping Actions in Primates
Schaffelhofer, S., Sartori, M., Scherberger, H., & Farina, D. (2014) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2364776 · Cited by 36
Self-citationA new method of accurate hand- and arm-tracking for small primates
Schaffelhofer, S., & Scherberger, H. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/2/026025 · Cited by 22
Self-citation
Flagged first, then by citations
2 of the 76 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- N. Maheswaranathan . Deep learning models reveal internal structure and diverse computations in the retina under natural scenes. bioRxiv:340943 (14 June 2018).
Cited by
Sorted by citations
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
A neural manifold view of the brain
Perich, M. G., Narain, D., & Gallego, J. Á. (2025) · Nature Neuroscience · doi:10.1038/s41593-025-02031-z · Cited by 125
Varley, T. F., Sporns, O., Schaffelhofer, S., Scherberger, H., & Dann, B. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2207677120 · Cited by 84
Self-citationDecoding the brain: From neural representations to mechanistic models
Mathis, M. W., Rotondo, A. P., Chang, E. F., Tolias, A. S., & Mathis, A. (2024) · Cell · doi:10.1016/j.cell.2024.08.051 · Cited by 91
A virtual rodent predicts the structure of neural activity across behaviours
Aldarondo, D., Merel, J., Marshall, J. D., Hasenclever, L., Klibaite, U., Gellis, A., Tassa, Y., Wayne, G., Botvinick, M., & Ölveczky, B. P. (2024) · Nature · doi:10.1038/s41586-024-07633-4 · Cited by 70
Metadata
- Authors
- Michaels, J. A., Schaffelhofer, S., Agudelo-Toro, A., & Scherberger, H.
- Affiliations
- Western University (CA)
- German Primate Center (DE)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2020-11-30
- Volume
- 117
- Issue
- 50
- Pages
- 32124-32135
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC7749336
- OpenAlex
- W3107175997
- Cited by
- 103
- References
- 76
- Citations by year
- 2026: 12 · 2025: 20 · 2024: 29 · 2023: 18 · 2022: 11 · 2021: 12 · 2020: 1
- FWCI
- 5.64
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (FOR-1847, B3 (SCHE1575/3-2))
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- visually guided grasping, anterior intraparietal area, ventral premotor cortex, primary motor cortex, recurrent neural network model, modular neural networks, muscle kinematics, linear dynamics, lesion models, macaque
- MeSH terms
- Animals, Arm, Female, Frontal Lobe, Hand, Macaca mulatta, Male, Models, Neurological, Motor Activity, Parietal Lobe, Neural Networks, Computer, Hand Strength, Models, Animal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review