Neural mechanisms for the recognition of biological movements
The DOI matches its Crossref record; 139 of the 140 references it cites were found in a registry or an index.
Abstract
The visual recognition of complex movements and actions is crucial for the survival of many species. It is important not only for communication and recognition at a distance, but also for the learning of complex motor actions by imitation. Movement recognition has been studied in psychophysical, neurophysiological and imaging experiments, and several cortical areas involved in it have been identified. We use a neurophysiologically plausible and quantitative model as a tool for organizing and making sense of the experimental data, despite their growing size and complexity. We review the main experimental findings and discuss possible neural mechanisms, and show that a learning-based, feedforward model provides a neurophysiologically plausible and consistent summary of many key experimental results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since humans can recognize complex biological motions by observing only a few point lights placed on a moving body (Giese & Poggio, 2003), point lights can also provide effective feedback, as has been shown for dancing (Eaves et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Giese & Poggio, 2003
Citations
Cites
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Action recognition in the premotor cortex
Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996) · Brain · doi:10.1093/brain/119.2.593 · Cited by 4,968
Visual perception of biological motion and a model for its analysis
Johansson, G. (1973) · Perception & Psychophysics · doi:10.3758/bf03212378 · Cited by 4,462
Ingle, D., Goodale, M. A., & Mansfield, R. J. W. (1982) · The MIT Press eBooks · Cited by 4,118
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997) · Science · doi:10.1126/science.275.5297.213 · Cited by 3,832
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Research works printed but not linked: 5
- Giese, M. A. & Vaina, L. M. Pathways in the analysis of biological motion: computational model and fMRI results. Perception 30, Suppl. 116 (2001).
- Giese, M. A. & Poggio, T. Neural mechanisms for the recognition of biological movements and actions. AI Memo 2002-012/CBCL Paper 219 (Massachusetts Institute of Technology, Cambridge, Massachusetts, 2002).
- Lampl, I., Riesenhuber, M., Poggio, T. & Ferster, D. The max operation in cells in the cat visual cortex. Soc. Neurosci. Abstr. 30, 619 (2001).
- Sereno, M. E. Neural Computation of Pattern Motion (MIT Press, Cambridge, Massachusetts, 1993).
- Pavlova, M. Biological motion perception under various presentation rates. Perception 24, Suppl. 112 (1995).
Cited by
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
“Since humans can recognize complex biological motions by observing only a few point lights placed on a moving body (Giese & Poggio, 2003), point lights can also provide effective feedback, as has been shown for dancing (Eaves et al., 2011).”
BackgroundGrill-Spector, K., & Malach, R. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144220 · Cited by 1,184
Action anticipation and motor resonance in elite basketball players
Aglioti, S. M., Cesari, P., Romani, M., & Urgesi, C. (2008) · Nature Neuroscience · doi:10.1038/nn.2182 · Cited by 1,040
Blake, R., & Shiffrar, M. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190152 · Cited by 974
“Such an involvement is broadly consistent with theories that attribute perception of human motion to a confluence of activity from dorsal and ventral stream brain areas, with the STSp representing a lynchpin within this distributed network (Giese & Poggio 2003, Shiffrar 1994).”
BackgroundMethodTowards the neurobiology of emotional body language
de Gelder, B. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1872 · Cited by 786
“So far, this hypothesis seems consistent with results from motor control studies showing that the control of multi-joint movements is based on synergies between simpler components that encompass only a limited number of joint”
A Biologically Inspired System for Action Recognition
Jhuang, H., Serre, T., Wolf, L., & Poggio, T. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408988 · Cited by 723
“As in [ 10 ], S1 unit responses were obtained by applying the following equation:”
InfluentialSelf-citationThe neural basis of visual body perception
Peelen, M. V., & Downing, P. E. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2195 · Cited by 697
“These suggestions are in line with the results of a detailed computational model of biological motion perception, a key feature of which is a collection of static body-form representation”
ResultMirror neurons: from origin to function
Cook, R., Bird, G., Catmur, C., Press, C., & Heyes, C. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000903 · Cited by 647
“Both visual and motor systems are known to be organized hierarchically (Felleman & Van Essen, 1991; Giese & Poggio, 2003; Jeannerod, 1994; Perrett et al., 1989), comprising different populations encoding relatively low-level (e.g. descriptions of particular ‘precision’ or ‘power’ grips) and more…”
BackgroundInfluentialAffective Body Expression Perception and Recognition: A Survey
Kleinsmith, A., & Bianchi-Berthouze, N. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.16 · Cited by 607
“According to neuroscience studies by Giese and Poggio [83] and Vaina et al.”
MethodWang, M., Yan, Z., Wang, T., Cai, P., Gao, S., Zeng, Y., Wan, C., Wang, H., Pan, L., Yu, J., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0422-z · Cited by 560
The origin of mind: Evolution of brain, cognition, and general intelligence.
Geary, D. C. (2005) · doi:10.1037/10871-000 · Cited by 551
Unstructured human activity detection from RGBD images
Sung, J., Ponce, C., Selman, B., & Saxena, A. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224591 · Cited by 511
Action snippets: How many frames does human action recognition require?
Schindler, K., & van Gool, L. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587730 · Cited by 526
“Dense form (shape) and motion (flow) features are processed in what is sometimes called a “biologically inspired” manner, due to the similarity with the ventral and dorsal pathways of the visual cortex [12, 16]: the two types of information are pro-”
BackgroundMethodRecognizing people from their movement.
Loula, F., Prasad, S., Harber, K., & Shiffrar, M. (2005) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.31.1.210 · Cited by 479
The phi complex as a neuromarker of human social coordination
Tognoli, E., Lagarde, J., DeGuzman, G. C., & Kelso, J. A. S. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611453104 · Cited by 437
Peelen, M. V., Wiggett, A. J., & Downing, P. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.02.004 · Cited by 402
Generalization in vision and motor control
Poggio, T., & Bizzi, E. (2004) · Nature · doi:10.1038/nature03014 · Cited by 386
“Box 1 suggests a strong analogy between vision and motor control in the time-dependent case: the basic strategy is to combine locally tuned units with time-dependent propertie”
BackgroundSelf-citationNeuroanatomical distribution of five semantic components of verbs: Evidence from fMRI
Kemmerer, D., Castillo, J. G., Talavage, T., Patterson, S., & Wiley, C. (2008) · Brain and Language · doi:10.1016/j.bandl.2007.09.003 · Cited by 388
“…projects to higher-order areas of the posterolateral temporal cortex (PLTC) that subserve more complex forms of motion processing, not only for human actions (for reviews see Giese & Poggio, 2003; Blake & Shiffrar, 2007) but also for tools (for reviews see Lewis, 2006; Beauchamp & Martin, 2007).”
Recognising Human Emotions from Body Movement and Gesture Dynamics
Castellano, G., Villalba, S. D., & Camurri, A. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_7 · Cited by 329
“Understanding the human processing mechanism of the stimuli coming from the so called ”biological movement”[5], the one produced by animals in general and humans in particular, would lead to better designed computational models of emotion based on visual analysis of affective body language.”
BackgroundSlow feature analysis for human action recognition
Zhang, Z., & Tao, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.157 · Cited by 307
Human Activity Detection from RGBD ImagesPreprint
Sung, J., Ponce, C., Selman, B., & Saxena, A. (2011) · arXiv (Cornell University) · Cited by 282
The mind behind anthropomorphic thinking: attribution of mental states to other species
Urquiza-Haas, E. G., & Kotrschal, K. (2015) · Animal Behaviour · doi:10.1016/j.anbehav.2015.08.011 · Cited by 267
“…to biological motion, human body motion, hand and mouth movement and facial expressions, as revealed by using either point-light displays or natural biological stimuli (for a review see Allison, Puce, & McCarthy, 2000; Giese & Poggio, 2003; Vaina, Solomon, Chowdhury, Sinha, & Belliveau, 2001).”
BackgroundAutomated home-cage behavioural phenotyping of mice
Jhuang, H., Garrote, E., Yu, X., Khilnani, V., Poggio, T., Steele, A. D., & Serre, T. (2010) · Nature Communications · doi:10.1038/ncomms1064 · Cited by 273
“Developed from a computational model of motion processing in the primate visual corte”
MethodSelf-citationKemmerer, D., Rudrauf, D., Manzel, K., & Tranel, D. (2012) · Cortex · doi:10.1016/j.cortex.2010.11.001 · Cited by 274
Denys, K., Vanduffel, W., Fize, D., Nelissen, K., Peuskens, H., Van Essen, D., & Orban, G. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3569-03.2004 · Cited by 268
“This mixed sensitivity has been predicted in computational studies (Giese and Poggio, 2003) as typical for regions involved in the analysis of biological motion and actions in general.”
BackgroundDeep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
From Agents to Objects: Sexist Attitudes and Neural Responses to Sexualized Targets
Cikara, M., Eberhardt, J. L., & Fiske, S. T. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21497 · Cited by 255
“…Bentin, Gore, & McCarthy, 1998) and biological motion (Blake & Shiffrar, 2007; Mar, Kelley, Heatherton, & Macrae, 2007; Michels, Lappe, & Vaina, 2005; Beauchamp, Lee, Haxby, & Martin, 2002, 2003; Giese & Poggio, 2003; Puce & Perrett, 2003), both of which were held constant across conditions.”
BackgroundConcepts Are More than Percepts: The Case of Action Verbs
Bedny, M., Caramazza, A., Grossman, E., Pascual-Leone, A., & Saxe, R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3039-08.2008 · Cited by 253
“…brain regions that process visual motion, specifically middle temporal area (MT ), which subserves basic motion processing, and the right superior temporal sulcus (rSTS), which is important for biological motion perception (Watson et al., 1993; Grossman et al., 2000, 2005; Giese and Poggio, 2003).”
BackgroundYuan, R., Duan, Q., Tiw, P. J., Li, G., Xiao, Z., Jing, Z., Yang, K., Liu, C., Ge, C., Huang, R., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-31747-w · Cited by 242
Specificity of regions processing biological motion
Peuskens, H., Vanrie, J., Verfaillie, K., & Orban, G. A. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04106.x · Cited by 254
“(1996) reported that the STS activation partly overlapped with hMT ⁄V5+ (human MT ⁄V5 complex and satellites), whereas Grèzes et al. (2001) reported mainly hMT ⁄V5+ activation by biological motion and Grossman et al.”
BackgroundResultInfluentialGender recognition from point-light walkers.
Pollick, F. E., Kay, J. W., Heim, K., & Stringer, R. (2005) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.31.6.1247 · Cited by 231
“Stay Tuned”: Inter-Individual Neural Synchronization During Mutual Gaze and Joint Attention
Saito, D. N., Tanabe, H. C., Izuma, K., Hayashi, M. J., Morito, Y., Komeda, H., Uchiyama, H., Kosaka, H., Okazawa, H., Fujibayashi, Y., et al. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00127 · Cited by 226
“These activation patterns are consistent with a recent computational model of biological motion perception, which proposes that the posterior STS integrates form information from a “ventral” pathway and motion information from a “dorsal” pathway (Giese and Poggio, 2003).”
Activation in Posterior Superior Temporal Sulcus Parallels Parameter Inducing the Percept of Animacy
Schultz, J., Friston, K. J., O’Doherty, J., Wolpert, D. M., & Frith, C. D. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.052 · Cited by 230
“Neuroimaging and neurophysiological data suggest that the neurons in the superior temporal sulcus can be activated by presentations of biological motion (Giese and Poggio, 2003; Puce and Perrett, 2003) such as point-light displays of moving humans and animals.”
BackgroundThe perception of emotion in body expressions
de Gelder, B., de Borst, A. W., & Watson, R. (2015) · WIREs Cognitive Science · doi:10.1002/wcs.1335 · Cited by 226
Jastorff, J., & Orban, G. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4870-08.2009 · Cited by 220
“In a theoretical model by Giese and Poggio (2003), biological motion recognition is based on the integration of shape and motion cues processed in two separate streams.”
BackgroundResultInfluentialSelf-supervised Video Representation Learning by Pace Prediction
Wang, J., Jiao, J., & Liu, Y.-H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_30 · Cited by 210
Atkinson, A. P., Tunstall, M. L., & Dittrich, W. H. (2007) · Cognition · doi:10.1016/j.cognition.2006.05.005 · Cited by 219
Two neural pathways of face processing: A critical evaluation of current models
Bernstein, M., & Yovel, G. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.06.010 · Cited by 218
A Model of Biological Motion Perception from Configural Form Cues
Lange, J., & Lappe, M. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4915-05.2006 · Cited by 220
“This is different from previous models, which combine local features hierarchically into a percept of a human body (Johansson, 1973; Cutting, 1978; Giese and Poggio, 2003).”
BackgroundMethodA quantitative theory of immediate visual recognition
Serre, T., Kreiman, G., Kouh, M., Cadieu, C., Knoblich, U., & Poggio, T. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65004-8 · Cited by 219
“Initial work has been done to extend the model to the visual recognition of action and motions (Giese and Poggio, 2003; Sigala et al., 2005).”
MethodSelf-citationWheaton, K. J., Thompson, J. C., Syngeniotis, A., Abbott, D. F., & Puce, A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.043 · Cited by 217
Temporal Processing Capacity in High-Level Visual Cortex Is Domain Specific
Stigliani, A., Weiner, K. S., & Grill-Spector, K. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4822-14.2015 · Cited by 212
“Consistent with this speculation, computational models of biological motion perception posit the existence of “snapshot” neurons selective to brief frames of action sequences (Giese and Poggio, 2003).”
BackgroundCues to intention: The role of movement information
Sartori, L., Becchio, C., & Castiello, U. (2011) · Cognition · doi:10.1016/j.cognition.2011.01.014 · Cited by 215
“cussed by Giese and Poggio (2003), is that intention-frommovement judgements relied on purely perceptual pro-”
BackgroundThe role of occipitotemporal body-selective regions in person perception
Downing, P. E., & Peelen, M. V. (2011) · Cognitive Neuroscience · doi:10.1080/17588928.2011.582945 · Cited by 215
Wang, J., Jiao, J., Bao, L., He, S., Liu, Y., & Liu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00413 · Cited by 210
“The idea is inspired by Giese and Poggio’s work on human visual system [14], in which the representation of motion is found to be based on a set of learned patterns.”
BackgroundInfluentialMa, Y., Paterson, H. M., & Pollick, F. E. (2006) · Behavior Research Methods · doi:10.3758/bf03192758 · Cited by 202
“As your excitement mounts you joyously pick up a bit of rubbish on the table in front of you and throw it at the bin.”
BackgroundView dependencies in the visual recognition of social interactions
de la Rosa, S., Mieskes, S., Bülthoff, H. H., & Curio, C. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00752 · Cited by 198
“…that occur on both the left and right side of the same body (e.g., left and right elbow) across time because previous research suggest that opponent or antiphase movement of these joints is critical for action recognition (Giese and Poggio, 2003; Casile and Giese, 2005; Thurman and Grossman, 2008).”
BackgroundSchultz, J., Imamizu, H., Kawato, M., & Frith, C. D. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042947874 · Cited by 198
“Psychophysical studies suggest that detection of biological motion is probably effected by very f lexible mechanisms under the influence of learning, different from those involved in the detection of other forms of complex motion ( Giese & Poggio, 2003; Neri, Morrone, & Burr, 1998).”
BackgroundModulation of premotor mirror neuron activity during observation of unpredictable grasping movements
Gangitano, M., Mottaghy, F. M., & Pascual‐Leone, A. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03655.x · Cited by 194
The use of facial motion and facial form during the processing of identity
Knappmeyer, B., Thornton, I. M., & Bülthoff, H. H. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00236-0 · Cited by 187
“Such a compromise, is consistent with a growing body of evidence from behavioral (Bernstein & Cooper, 1997; Lorenceau & Alais, 2001; Stone & Harper, 1999; Wallis & B€ u ulthoff, 2001), computational ( Giese & Poggio, 2003 ) and neural studies (Bradley, Chang, & Andersen, 1998; Decety & Grezes, 1999; Grossman & Blake,…”
Abreu, A. M., Macaluso, E., Azevedo, R. T., Cesari, P., Urgesi, C., & Aglioti, S. M. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08104.x · Cited by 182
“Series of ‘snapshot’ images of sequential human body postures were proposed to be very informative in terms of the consequential outcome of the action in play (Giese & Poggio, 2003; Downing et al., 2006).”
BackgroundInhibitory stabilization and cortical computation
Sadeh, S., & Clopath, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00390-z · Cited by 178
Anthropomorphism influences perception of computer-animated characters' actions
Chaminade, T., Hodgins, J., & Kawato, M. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm017 · Cited by 181
“In agreement with the global processing hypothesis ( Bertenthal and Pinto , 1994 ) , computational models ( Giese and Poggio , 2003 ; Lange and Lappe , 2006 ) have proposed that ' templates ' of configural body cues , roughly corresponding to snapshots of actions , are used when recognizing point -…”
MethodNatural facial motion enhances cortical responses to faces
Schultz, J., & Pilz, K. S. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1721-9 · Cited by 180
“These results suggest an integration of form and motion information in a network of areas including STS, as has been proposed in models of the recognition of biological motion (Giese and Poggio 2003).”
Recognizing emotions expressed by body pose: A biologically inspired neural model
Schindler, K., Van Gool, L., & de Gelder, B. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.05.003 · Cited by 174
“the “snapshot neurons” of [29] and to the “key frames” of [4], and could correspond to neurons tuned to body configurations as observed in [16], except that we allow assignment of several different poses to the same emotion.”
BackgroundMethodAtkinson, A. P. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.05.019 · Cited by 175
Automatic Recognition of Non-Acted Affective Postures
Kleinsmith, A., Bianchi-Berthouze, N., & Steed, A. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2103557 · Cited by 174
“According to Giese and Poggio [59], there are two pathways in the brain for recognizing biological information: one for form (i.e., configuration) information and one for motion information.”
BackgroundA computational model of event segmentation from perceptual prediction
Reynolds, J. R., Zacks, J. M., & Braver, T. S. (2007) · Cognitive Science · doi:10.1080/15326900701399913 · Cited by 172
“1995). These perceptual processing streams are oriented in time such that they not only represent the current state of the world, but represent predictions about what is likely to happen a short time later ( Giese & Poggio, 2003 ).”
BackgroundCyclic time course of motor excitability modulation during the observation of a cyclic hand movement
Borroni, P., Montagna, M., Cerri, G., & Baldissera, F. (2005) · Brain Research · doi:10.1016/j.brainres.2005.10.034 · Cited by 171
Taylor, N. M., Jakobson, L. S., Maurer, D., & Lewis, T. L. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.06.001 · Cited by 168
“First, the processing of biological motion involves the integration of form and motion cues (Beintema & Lappe, 2002; Giese & Poggio, 2003).”
Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics
Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., et al. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2053034 · Cited by 169
“The underlying principle of these systems is to gradually increase both the selectivity of neurons to stimuli along with their invariance to (2D) transformations in a series of processing levels (Giese and Poggio 2003).”
Brain systems for assessing the affective value of faces
Said, C. P., Haxby, J. V., & Todorov, A. (2011) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2010.0351 · Cited by 168
Getting the gist of events: Recognition of two-participant actions from brief displays.
Hafri, A., Papafragou, A., & Trueswell, J. C. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0030045 · Cited by 167
Nelissen, K., Vanduffel, W., & Orban, G. A. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0824-06.2006 · Cited by 165
“resents an important step between early motion processing and biological motion selectivity (Giese and Poggio, 2003).”
BackgroundMotion-onset VEPs: Characteristics, methods, and diagnostic use
Kuba, M., Kubová, Z., Kremláček, J., & Langrová, J. (2007) · Vision Research · doi:10.1016/j.visres.2006.09.020 · Cited by 159
“…new models of visual perception which indicate that the ventral and dorsal (form and motion) pathways co-operate in the recognition of motion stimuli (Giese & Poggio, 2003; Burr & Ross, 2004), motion-onset VEPs seem to be more speciWc for testing predominant or early magnocellular system/ dorsal…”
BackgroundThe meaning of action: a review on action recognition and mapping
Krüger, V., Kragic, D., Ude, A., & Geib, C. (2007) · Advanced Robotics · doi:10.1163/156855307782148578 · Cited by 158
“There is strong neurobiological evidence that human actions and activities are directly connected to the motor control of the human body [43, 99, 100].”
BackgroundThill, S., Pop, C. A., Belpaeme, T., Ziemke, T., & Vanderborght, B. (2012) · Paladyn, Journal of Behavioral Robotics · doi:10.2478/s13230-013-0107-7 · Cited by 153
What is modelled during observational learning?
Hodges, N. J., Williams, A. M., Hayes, S. J., & Breslin, G. (2007) · Journal of Sports Sciences · doi:10.1080/02640410600946860 · Cited by 191
“Giese and Poggio (2003) also showed that although the elbows were important for recognition of motion, the feet were critical for more accurate discrimination across actions, in particular the opponent motion of these effectors. There appears to be substantial evidence that relatively small or local spatial areas acro…”
BackgroundInfluentialAttention, biological motion, and action recognition.
Thompson, J., & Parasuraman, R. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.044 · Cited by 155
“At the same time, many computational models of the perception of biological motion do not include a role for attention (Mather et al., 1992; Giese and Poggio, 2002).”
BackgroundInfluentialLearning to See Biological Motion: Brain Activity Parallels Behavior
Grossman, E. D., Blake, R., & Kim, C.-Y. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042568569 · Cited by 154
“…model of biological motion perception, these neural operations could involve alterations in the connection strengths among neurons amplifying weak signals from ‘‘motion clutter’’ by extracting the strongest features of noise displays while suppressing nonoptimal features (Giese & Poggio, 2003).”
BackgroundInfluentialContrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150
“[26] discuss a feedforward mechanism for visual recognition of complex movements.”
BackgroundThe role of the extrastriate body area in action perception
Downing, P. E., Peelen, M. V., Wiggett, A. J., & Tew, B. D. (2006) · Social Neuroscience · doi:10.1080/17470910600668854 · Cited by 154
“Consistent with the ‘‘static representation’’ hypothesis is a recent model of biological motion perception (Giese & Poggio, 2003).”
ResultInfluentialCritical features for the recognition of biological motion
Casile, A., & Giese, M. A. (2005) · Journal of Vision · doi:10.1167/5.4.6 · Cited by 158
“The neural model that we used for our simulations is part of a more elaborated learning-based model for biological motion recognition, which accounts for a variety of experimental results with normal and point-light walkers (Giese & Poggio, 2003).”
BackgroundMethodInfluentialSelf-citationTypical action perception and interpretation without motor simulation
Vannuscorps, G., & Caramazza, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1516978112 · Cited by 147
“IDs 3 and 5 did not show any significant bias in the easy condition [both χ(2) (1) < 1, both Ps > 0.”
BackgroundInfluentialYovel, G., & O’Toole, A. J. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.02.005 · Cited by 158
Avenanti, A., Annella, L., Candidi, M., Urgesi, C., & Aglioti, S. M. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs040 · Cited by 144
“Studies suggest that STS integrates body form and motion information from ventral and dorsal pathways (Vaina et al. 2001; Giese and Poggio 2003) to create a high-order visual representation of others’ actions.”
BackgroundIncidental Processing of Biological Motion
Thornton, I. M., & Vuong, Q. C. (2004) · Current Biology · doi:10.1016/j.cub.2004.06.025 · Cited by 145
The dynamic neural field approach to cognitive robotics
Erlhagen, W., & Bicho, E. G. (2006) · Journal of Neural Engineering · doi:10.1088/1741-2560/3/3/r02 · Cited by 158
“Examples include aspects of higher level vision including the perception of biological motion (Giese 1999, Giese and Poggio 2003), the transformation of retinal to body-centered coordinates (Salinas and Abbott 1995, 1996), the context-dependent selection of visuomotor maps (Salinas 2003), the…”
BackgroundSelf Recognition versus Recognition of others by Biological Motion: Viewpoint-Dependent Effects
Jokisch, D., Daum, I., & Troje, N. F. (2006) · Perception · doi:10.1068/p5540 · Cited by 152
“…et al 2000; Servos et al 2002; Vaina et al 2001) which is assumed to involve both the dorsal motion pathway as well as the ventral form pathway (Giese and Poggio 2003). ôPresent address: F.C.Donders Centre for Cognitive Neuroimaging, POBox 9101, NL-6500 HBNijmegen, The Netherlands; e-mail:…”
BackgroundThe Extraction of 3D Shape in the Visual System of Human and Nonhuman Primates
Orban, G. A. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113819 · Cited by 150
Sweeny, T. D., Haroz, S., & Whitney, D. C. (2013) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0028712 · Cited by 156
View-Invariant Action Recognition Based on Artificial Neural Networks
Iosifidis, A., Tefas, A., & Pitas, I. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2181865 · Cited by 132
“Neurobiological studies [9] have concluded that the human brain can perceive actions by observing only the human body poses (postures)”
BackgroundMeaningful interactions can enhance visual discrimination of human agents
Neri, P., Luu, J. Y., & Levi, D. M. (2006) · Nature Neuroscience · doi:10.1038/nn1759 · Cited by 146
Flexible Coding for Categorical Decisions in the Human Brain
Li, S., Ostwald, D., Giese, M., & Kourtzi, Z. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3795-07.2007 · Cited by 134
“Stimuli Articulated movement stimuli were generated by linear interpolation and time warping between prototypical trajectories (Giese and Lappe, 2002; Giese and Poggio, 2003; Jastorff et al., 2006) (for more details on the generation and properties of the stimuli, see supplemental information, available at www.”
BackgroundSelf-citationNo evidence for impaired perception of biological motion in adults with autistic spectrum disorders
Murphy, P., Brady, N. P., Fitzgerald, M., & Troje, N. F. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.07.026 · Cited by 140
“Given its location, it has been proposed that the STS integrates form and motion information from the ventral and dorsal streams, respectively, into a percept of the moving human body (Giese & Poggio, 2003).”
BackgroundLifelong learning of human actions with deep neural network self-organization
Parisi, G. I., Tani, J., Weber, C., & Wermter, S. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.09.001 · Cited by 129
“…of body action features in two distinct neural pathways and their subsequent integration in the STS are in line with neurophysiological evidence (Giese & Poggio, 2003; Giese & Rizzolatti, 2015), our model is a strong simplification with respect to biological mechanisms where the two streams…”
BackgroundResultInfluentialMORIGUCHI, Y., OHNISHI, T., MORI, T., MATSUDA, H., & KOMAKI, G. (2007) · Psychiatry and Clinical Neurosciences · doi:10.1111/j.1440-1819.2007.01687.x · Cited by 123
Jokisch, D., Daum, I., Suchan, B., & Troje, N. F. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.06.025 · Cited by 139
“Results from imaging studies as well as from simulations [23] are consistent with neuropsychological findings in neurological patients suffering from focal brain lesions [15] [35] [50] [60] [61].”
MethodResultThe advantage of being left-handed in interactive sports
Hagemann, N. (2009) · Attention Perception & Psychophysics · doi:10.3758/app.71.7.1641 · Cited by 154
“These studies assume that this sensitivity in distinguishing between different human movements depends on visual experience; in other words, if a pattern of motion occurs frequently, it will be easier to discriminate (cf. Giese & Poggio, 2003; Jacobs, Pinto, & Shiffrar, 2004).”
BackgroundResultTaylor, P., Hobbs, J. N., Burroni, J., & Siegelmann, H. T. (2015) · Scientific Reports · doi:10.1038/srep18112 · Cited by 120
“General algorithmic procedure for plotting and sorting the behavioral databases upon connectivity matrices can be outlined in four steps: (1) Compute connectivity order, (2) Compute behavioral element frequencies, (3) Bin connectivity ordering, (4) Regress behavioral element frequency across bins, (5) Corrections on t…”
MethodExperience, Context, and the Visual Perception of Human Movement.
Jacobs, A., Pinto, J., & Shiffrar, M. (2004) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.30.5.822 · Cited by 127
“In the second class of theories, visual sensitivity to human movement depends on visual experience (e.g., Bulthoff, Bulthoff, & Sinha, 1998; Giese & Poggio, 2003; Johansson, 1973).”
BackgroundSaygin, A. P., Cook, J., & Blakemore, S.-J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013491 · Cited by 121
“A number of investigators have highlighted the role of form information in the perception of biological motion [47,48] also supported by models of body movement perception and recent findings from neurophysiology [49,50].”
Asynchronous event-based corner detection and matching
Clady, X., Ieng, S.-H., & Benosman, R. B. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.02.013 · Cited by 119
“This implicit inclusion of the geometric information might explain why motion information driven by the dorsal pathway in the visual cortex can be sufficient to perform classification of biological movements, such as human body motion [35], as it is operated in recent approaches for action recognition [36, 37]; featur…”
MethodPredicting point-light actions in real-time
Graf, M., Reitzner, B., Corves, C., Casile, A., Giese, M. A., & Prinz, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.017 · Cited by 140
Self-citationLearned Non-Rigid Object Motion is a View-Invariant Cue to Recognizing Novel Objects
Chuang, L. L., Vuong, Q. C., & Bülthoff, H. H. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00026 · Cited by 109
Dynamic information for the recognition of conversational expressions
Cunningham, D. W., & Wallraven, C. (2009) · Journal of Vision · doi:10.1167/9.13.7 · Cited by 131
Dynamic Modulation of Human Motor Activity When Observing Actions
Press, C., Cook, J., Blakemore, S.-J., & Kilner, J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1595-10.2011 · Cited by 114
“Giese and Poggio (2003) have modeled processing of form and kinematic biological motion information in separate pathways, but acknowledge that the two pathways are likely to interact at several levels.”
BackgroundDistinct Neural Mechanisms for Body Form and Body Motion Discriminations
Vangeneugden, J., Peelen, M. V., Tadin, D., & Battelli, L. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4032-13.2014 · Cited by 129
“This remarkable skill relies on the accurate discrimination of both body form and body motion cues (Giese and Poggio, 2003; de Gelder, 2006; Blake and Shiffrar, 2007).”
BackgroundResultInfluentialEffects of TMS over Premotor and Superior Temporal Cortices on Biological Motion Perception
van Kemenade, B. M., Muggleton, N. G., Walsh, V., & Saygın, A. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00194 · Cited by 123
Metadata
- Authors
- Giese, M. A., & Poggio, T.
- Affiliations
- Universitätsklinikum Tübingen (DE)
- McGovern Institute for Brain Research (US)
- Corresponding author
- Giese, Martin A.
- Venue
- Nature Reviews Neuroscience
- Published
- 2003-03-01
- Volume
- 4
- Issue
- 3
- Pages
- 179-192
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2095802353
- Cited by
- 955
- References
- 140
- Citations by year
- 2026: 22 · 2025: 28 · 2024: 42 · 2023: 35 · 2022: 35 · 2021: 23 · 2020: 61 · 2019: 27 · 2018: 27 · 2017: 40 · 2016: 48 · 2015: 54 · 2014: 69 · 2013: 42 · 2012: 81
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- human action recognition, motion perception, neural mechanisms, feedforward models, learning-based models, cortical regions, imitation learning
- MeSH terms
- Animals, Humans, Models, Neurological, Motion Perception, Pattern Recognition, Visual, Visual Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.