Neural mechanisms for the recognition of biological movements
The DOI matches its Crossref record; 139 of the 140 references it cites were found in a registry or an index.
Abstract
The visual recognition of complex movements and actions is crucial for the survival of many species. It is important not only for communication and recognition at a distance, but also for the learning of complex motor actions by imitation. Movement recognition has been studied in psychophysical, neurophysiological and imaging experiments, and several cortical areas involved in it have been identified. We use a neurophysiologically plausible and quantitative model as a tool for organizing and making sense of the experimental data, despite their growing size and complexity. We review the main experimental findings and discuss possible neural mechanisms, and show that a learning-based, feedforward model provides a neurophysiologically plausible and consistent summary of many key experimental results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since humans can recognize complex biological motions by observing only a few point lights placed on a moving body (Giese & Poggio, 2003), point lights can also provide effective feedback, as has been shown for dancing (Eaves et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Giese & Poggio, 2003
Citations
Cites
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Action recognition in the premotor cortex
Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996) · Brain · doi:10.1093/brain/119.2.593 · Cited by 4,968
Visual perception of biological motion and a model for its analysis
Johansson, G. (1973) · Perception & Psychophysics · doi:10.3758/bf03212378 · Cited by 4,462
Ingle, D., Goodale, M. A., & Mansfield, R. J. W. (1982) · The MIT Press eBooks · Cited by 4,118
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997) · Science · doi:10.1126/science.275.5297.213 · Cited by 3,832
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Research works printed but not linked: 5
- Giese, M. A. & Vaina, L. M. Pathways in the analysis of biological motion: computational model and fMRI results. Perception 30, Suppl. 116 (2001).
- Giese, M. A. & Poggio, T. Neural mechanisms for the recognition of biological movements and actions. AI Memo 2002-012/CBCL Paper 219 (Massachusetts Institute of Technology, Cambridge, Massachusetts, 2002).
- Lampl, I., Riesenhuber, M., Poggio, T. & Ferster, D. The max operation in cells in the cat visual cortex. Soc. Neurosci. Abstr. 30, 619 (2001).
- Sereno, M. E. Neural Computation of Pattern Motion (MIT Press, Cambridge, Massachusetts, 1993).
- Pavlova, M. Biological motion perception under various presentation rates. Perception 24, Suppl. 112 (1995).
Cited by
Items 101–200 of 952
Li, J., Lam, C. S. Y., Yu, M., Hess, R. F., Chan, L. Y. L., Maehara, G., Woo, G. C., & Thompson, B. S. (2010) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.10-5549 · Cited by 116
“Global motion stimuli(30) are one type of stimuli that have been used with this paradigm, as they contain both signal and noise populations and require neural processing at multiple levels within the visual system.(31) These stimuli consist of a population of noise dots that move randomly and a population of signal do…”
MethodPerception and hierarchical dynamics
Kiebel, S. J. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.020.2009 · Cited by 102
“This is consistent with neuroscience fi ndings that higher cortical levels show invariance over greater time scales than lower levels (Giese and Poggio, 2003; Hasson et al., 2008; Koechlin and Jubault, 2006).”
ResultLinking form and motion in the primate brain
Kourtzi, Z., Krekelberg, B., & Wezel, R. J. A. V. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.013 · Cited by 109
“Further,whereas somemodelspropose that biological motion perception need only make use of form information [65], others stress the integration of information from form-selective neurons in the ventral stream and optic flow detectors in the dorsal stream [ 66 ].”
Integration of shape and motion cues in biological motion processing in the monkey STS
Jastorff, J., Popivanov, I. D., Vogels, R., Vanduffel, W., & Orban, G. A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.12.087 · Cited by 103
“Rostral to the MT/V5 complex, the configuration of the body and its kinematics are processed separately within the lower bank and the fundus/upper bank of the monkey STS respectively, in agreement with the theoretical model by Giese and Poggio (2003). In contrast to our human findings, the main effect of configuration…”
ResultVangeneugden, J., Pollick, F. E., & Vogels, R. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn109 · Cited by 106
“of action recognition proposed by Giese and Poggio (2003):”
BackgroundMotion Encoding in Language and Space
Vulchanova, M., & van der Zee, E. (2012) · doi:10.1093/acprof:oso/9780199661213.001.0001 · Cited by 106
Bio-inspired computer vision: Towards a synergistic approach of artificial and biological vision
Medathati, N. V. K., Neumann, H., Masson, G. S., & Kornprobst, P. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.04.009 · Cited by 122
Using Conceptual Spaces to Model Actions and Events
Gärdenfors, P., & Warglien, M. (2012) · Journal of Semantics · doi:10.1093/jos/ffs007 · Cited by 101
Cadierno, T., & Robinson, P. (2009) · Annual Review of Cognitive Linguistics · doi:10.1075/arcl.7.10cad · Cited by 117
The neurophysiology of human biological motion processing: A high-density electrical mapping study
Krakowski, A. I., Ross, L. A., Snyder, A. C., Sehatpour, P., Kelly, S. P., & Foxe, J. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.058 · Cited by 108
“Basing themselves on the physiological and neuroimaging data, Giese and Poggio (2003) formulated a feed-forward model of parallel ventral-form and dorsal-motion processes that analyze “snapshots” of human forms and “optic-flow” (OF) patterns, in an increasingly global manner, as they converge…”
Brain mechanisms underlying human communication
Noordzij, M. L. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.014.2009 · Cited by 99
“the extraction of posture sequences (Giese and Poggio, 2003), could also support the parsing of a string of object motions into communicative segments.”
BackgroundVisual perception of biological motion by form: A template-matching analysis
Lange, J., Georg, K., & Lappe, M. (2006) · Journal of Vision · doi:10.1167/6.8.6 · Cited by 99
“Giese and Poggio (2003) proposed a model that analyzed form and motion cues separately.”
BackgroundHafri, A., Trueswell, J. C., & Strickland, B. (2018) · Cognition · doi:10.1016/j.cognition.2018.02.011 · Cited by 124
Kaiser, M. D., & Pelphrey, K. A. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.05.005 · Cited by 103
Emotion unfolded by motion: a role for parietal lobe in decoding dynamic facial expressions
Sarkheil, P., Goebel, R., Schneider, F., & Mathiak, K. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss092 · Cited by 97
“Giese and Poggio (2003) have proposed that visual information with shorter time scale is coded by earlier visual areas.”
BackgroundSeeing liquids from visual motion
Kawabe, T., Maruya, K., Fleming, R. W., & Nishida, S. (2014) · Vision Research · doi:10.1016/j.visres.2014.07.003 · Cited by 106
“…of some dynamic objects, but this has been shown only under conditions where object form information is also available (e.g., Chuang, Vuong, & Bülthoff, 2012; Giese & Poggio, 2003; Johansson, 1973; Lu, 2010; Newell, Wallraven, & Huber, 2004; Stone, 1998; Troje, 2008; Vuong & Tarr, 2006).”
Exploring the brain basis of joint action: Co-ordination of actions, goals and intentions
Newman-Norlund, R. D., Noordzij, M. L., Meulenbroek, R. G. J., & Bekkering, H. (2007) · Social Neuroscience · doi:10.1080/17470910701224623 · Cited by 100
“…Solomon, Chowdhury, Sinha, & Belliveau, 2001), as well as reduced human stimuli known as point-light figures (Beauchamp, Lee, Haxby, & Martin, 2003; Giese & Poggio, 2003; Grèzes, Fonlupt, Bertenthal, DelonMartin, Segebarth, & Decety, 2000; Grossman & Blake, 2002; Jellema & Perrett, 2002; Puce &…”
The Conceptual Mind: New Directions in the Study of Concepts
Margolis, E., & Laurence, S. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/9383.001.0001 · Cited by 205
In search of the uncanny valley
Pollick, F. E. (2010) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-12630-7_8 · Cited by 91
“The case of form and motion are interesting since various research leads to the view, consistent with the observation of Mori, that there are separate visual pathways that initially process form and motion information and then at a later stage integrate this information in the process of representing human actions [21…”
ResultSpecificity of Action Representations in the Lateral Occipitotemporal Cortex
Kable, J. W., & Chatterjee, A. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.9.1498 · Cited by 91
“Action recognition likely includes multiple stages, from the perceptual categorization of complex motion patterns to the conceptual understanding of the goal of an action or the intention of the agent (e.g., see the recent model in Giese & Poggio, 2003 ).”
BackgroundHeterogeneous Single-Unit Selectivity in an fMRI-Defined Body-Selective Patch
Popivanov, I. D., Jastorff, J., Vanduffel, W., & Vogels, R. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2748-13.2014 · Cited by 90
“Additionally, body posture coding can contribute to action recognition (Giese and Poggio, 2003; Vangeneugden et al., 2011).”
BackgroundAction perception as hypothesis testing
Donnarumma, F., Costantini, M., Ambrosini, E., Friston, K., & Pezzulo, G. (2017) · Cortex · doi:10.1016/j.cortex.2017.01.016 · Cited by 90
“It has long been known that brain areas such as superior temporal sulcus (STS) are particularly sensitive to the kinematic and dynamical signatures of biological movement that permit its fast recognition (Giese & Poggio, 2003; Puce & Perrett, 2003).”
Learning to discriminate complex movements: Biological versus artificial trajectories
Jastorff, J., Kourtzi, Z., & Giese, M. A. (2006) · Journal of Vision · doi:10.1167/6.8.3 · Cited by 92
“That such learning mechanisms provide a computationally powerful explanation of biological motion recognition is suggested by theoretical models that account for a variety of experimental results (Giese, 2000; Giese & Poggio, 2003; Lee & Wong, 2004).”
BackgroundResultSelf-citationTsotsos, J. K., Liu, Y., Martínez-Trujillo, J., Pomplun, M., Simine, E., & Zhou, K. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.10.011 · Cited by 98
Top-Down Control of Visual Responses to Fear by the Amygdala
Furl, N., Henson, R. N., Friston, K. J., & Calder, A. J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2992-13.2013 · Cited by 100
“These proposals, and our results, dovetail with a sizeable literature on biological motion responses in the posterior STS (Giese and Poggio, 2003) and research in the monkey implicating motion-sensitive areas in expression representation (Furl et al., 2012).”
BackgroundResultDance and music share gray matter structural correlates
Karpati, F. J., Giacosa, C., Foster, N. E. V., Penhune, V. B., & Hyde, K. L. (2016) · Brain Research · doi:10.1016/j.brainres.2016.11.029 · Cited by 109
“, 2015), form and motion processing (Cross et al., 2010; Giese and Poggio, 2003) and biological motion observation (Gilaie-Dotan et al.”
McKay, L. S., Simmons, D. R., McAleer, P., Marjoram, D. K. S., Piggot, J., & Pollick, F. E. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.033 · Cited by 95
“Given that the EBA is thought to extend into motionsensitive areas such as MT (Peelen et al., 2006), this hypothesis seems plausible and may also imply that integration of these cues occurs earlier than previous models have suggested (e.g. Lange and Lappe, 2006; Giese and Poggio, 2003).”
Poggio, T., & Serre, T. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 106
Self-citationAction Recognition Using a Bio-Inspired Feedforward Spiking Network
Escobar, M.-J., Masson, G. S., Viéville, T., & Kornprobst, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0201-1 · Cited by 94
“2.3 Towards a Bio-Inspired System Based on the dorsal and ventral streams of visual processing, the seminal work done by Giese and Poggio (2003) evaluates both pathways in biological motion recognition.”
BackgroundMethodInfluentialOxytocin enhances the perception of biological motion in humans
Kéri, S., & Benedek, G. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.3.237 · Cited by 97
“The recognition of movements and actions of other people is necessary for communicating, decoding “body language,” and learning by imitation ( Giese & Poggio, 2003; Peuskens, Vanrie, Verfaillie, & Orban, 2005; Puce & Perrett, 2003).”
BackgroundGoal attribution to schematic animals: do 6‐month‐olds perceive biological motion as animate?
Schlottmann, A., & Ray, E. (2010) · Developmental Science · doi:10.1111/j.1467-7687.2009.00854.x · Cited by 82
Eccentric perception of biological motion is unscalably poor
Ikeda, H., Blake, R., & Watanabe, K. (2005) · Vision Research · doi:10.1016/j.visres.2005.02.001 · Cited by 83
Keep It Simple and Sparse: Real-Time Action Recognition
Fanello, S., Gori, I., Giorgio Metta, B., & Odone, F. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_10 · Cited by 83
fMR-adaptation reveals invariant coding of biological motion on human STS
Grossman (2010) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.015.2010 · Cited by 84
Dynamic and Static Facial Expressions Decoded from Motion-Sensitive Areas in the Macaque Monkey
Nicholas Furl, A., Hadj‐Bouziane, F., Liu, N., Averbeck, B. B., & Ungerleider, L. G. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.1992-12.2012 · Cited by 85
“Nonface biological motion representation in the posterior STS has been widely studied (Giese and Poggio, 2003) and right hemisphere temporal lobe lesions anterior to MT /V5 show impaired biological motion perception (Vaina and Gross, 2004).”
BackgroundSimulation during observation of human actions – Theories, empirical studies, applications
Zentgraf, K., Munzert, J., Bischoff, M., & Newman‐Norlund, R. (2011) · Vision Research · doi:10.1016/j.visres.2011.01.007 · Cited by 90
Biological motion stimuli are attractive to medaka fish
Nakayasu, T., & Watanabe, E. (2013) · Animal Cognition · doi:10.1007/s10071-013-0687-y · Cited by 86
“Since Johansson’s pioneering work, the perceptual cues of biological motion and the neural mechanisms mediating the perception of biological motion have been investigated extensively in humans (for reviews, see Giese and Poggio 2003; Troje 2008).”
BackgroundTemporal “Bubbles” reveal key features for point-light biological motion perception
Thurman, S. M., & Grossman, E. D. (2008) · Journal of Vision · doi:10.1167/8.3.28 · Cited by 83
“The human STS has been suggested as the integration site of motion and form computation in the construction of point-light biological motion (Giese & Poggio, 2003).”
BackgroundMacrae, C. N., & Quadflieg, S. (2010) · Wiley eBooks · doi:10.1002/9780470561119.socpsy001012 · Cited by 90
Self-organizing neural integration of pose-motion features for human action recognition
Parisi, G. I., Weber, C., & Wermter, S. (2015) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2015.00003 · Cited by 86
“Our recognition scheme for action sequences is in line with a number of studies demonstrating that action discrimination is selective to temporal order (Bertenthal and Pinto, 1993; Giese and Poggio, 2003; Jastorff et al., 2006).”
BackgroundMethodInfluentialA computational neuroethology perspective on body and expression perception
de Gelder, B., & Solanas, M. P. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.05.010 · Cited by 85
“A biologically plausible model is presumably a model that is consistent with the neurophysiological properties of the visual cortex [7,80] as well as with those of other relevant brain areas for body expression perception.”
BackgroundMethodResultVisual perception and neural correlates of novel ‘biological motion’
Pyles, J. A., Garcia, J. O., Hoffman, D. D., & Grossman, E. D. (2007) · Vision Research · doi:10.1016/j.visres.2007.07.017 · Cited by 81
“Recognition of human actions may benefit from the unvarying form of the human body, a prediction explicit in recent models of biological motion perception (Giese & Poggio, 2003; Lange, Georg, & Lappe, 2006).”
BackgroundInfluentialBarraclough, N. E., Xiao, D., Oram, M. W., & Perrett, D. I. (2006) · Progress in brain research · doi:10.1016/s0079-6123(06)54007-5 · Cited by 78
“Following Giese and Poggio (2003) we hypothesized that STS neurons would discriminate articulated postures from standing postures.”
BackgroundMethodInfluentialDifferential activation of pre-SMA and SMA proper during action observation: Effects of instructions
Zentgraf, K., Stark, R. M., Reiser, M., Künzell, S., Schienle, A., Kirsch, P., Walter, B., Vaitl, D., & Munzert, J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.015 · Cited by 94
Troje, N. F. (2008) · Elsevier eBooks · doi:10.1016/b978-012370880-9.00314-5 · Cited by 96
Stereotypes and stereotyping: What's the brain got to do with it?
Quadflieg, S., & Macrae, C. N. (2011) · European Review of Social Psychology · doi:10.1080/10463283.2011.627998 · Cited by 97
“…the mouth, or the body has consistently been found to increase activation in the posterior superior temporal sulcus (pSTS; Campbell et al., 2001; Giese & Poggio, 2003; Grossman & Blake, 2002; Hoffman & Haxby, 2000; Lee et al., 2010; Michels, Lappe, & Vaina, 2005; Pitcher, Dilks, Saxe,…”
BackgroundGiese, M. A., & Rizzolatti, G. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.040 · Cited by 88
“In contrast, AIP is mostly connected with the lower bank of STS, and in particular with its most rostral subdivisions (see Figure 1).”
BackgroundMethodInfluentialSelf-citationDetection of biological and nonbiological motion
Hiris, E. J. (2007) · Journal of Vision · doi:10.1167/7.12.4 · Cited by 75
“In a model of biological motion perception proposed by Giese and Poggio (2003) and updated by Peuskens et al. (2005), both motion and form pathways feed into areas responsible for processing biological motion.”
BackgroundMethodEvent structure, conceptual spaces and the semantics of verbs
Warglien, M., Gärdenfors, P., & Westera, M. (2012) · Theoretical Linguistics · doi:10.1515/tl-2012-0010 · Cited by 80
“We attempt to bridge the research on actions in cognitive science (Giese and Poggio 2003, Giese et al. 2008, Hemeren 2008, Gärdenfors and Warglien, to appear) with work on verbs in lexical semantics.”
Contrasting Specializations for Facial Motion within the Macaque Face-Processing System
Fisher, C., & Freiwald, W. A. (2015) · Current Biology · doi:10.1016/j.cub.2014.11.038 · Cited by 79
“Some neurons in these patches may fire only in response to a specific sequence of poses, a mechanism that has been proposed for the neural coding of biological motion [25, 26].”
Attentional Modulation of Cortical Neuromagnetic Gamma Response to Biological Movement
Pavlova, M. A., Birbaumer, N., & Sokolov, A. N. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi108 · Cited by 76
“…temporal sulcus, the intraparietal cortex, and the lateral occipital complex (primarily the regions corresponding to the kinetic occipital area) are often reported to be activated during viewing of pointlight biological movement (for reviews, see Giese and Poggio, 2003; Puce and Perrett, 2003).”
BackgroundBiological motion drives perception and action
de Xivry, J.-J. O. (2010) · Journal of Vision · doi:10.1167/10.2.6 · Cited by 72
“Due to its particular importance, biological motion is probably processed differently by the visual system than other kinds of motion stimuli (Billino, Braun, Böhm, Bremmer, & Gegenfurtner, 2009; Decety & Grezes, 1999; Giese & Poggio, 2003; Oram & Perrett, 1994).”
BackgroundMeasurement of generalization fields for the recognition of biological motion
Giese, M. A., & Lappe, M. (2002) · Vision Research · doi:10.1016/s0042-6989(02)00093-7 · Cited by 73
Self-citationKeysers, C., Xiao, D. K., Földiák, P., & Perrett, D. I. (2005) · Cognitive Neuropsychology · doi:10.1080/02643290442000103 · Cited by 72
“Connecting the different events in an action sequence or snapshots of biological actions might be interesting examples ( Giese & Poggio, 2003; Jellema & Perrett, 2003).”
BackgroundEmotion recognition using Kinect motion capture data of human gaits
Li, S., Cui, L., Zhu, C., Li, B., Zhao, N., & Zhu, T. (2016) · PeerJ · doi:10.7717/peerj.2364 · Cited by 71
“As shown in the psychological studies on the perception of biological movements (e.g., Giese & Poggio, 2003 ), a few points representing trunk and limbs were enough to provide information for accurate recognition.”
BackgroundThe two-process theory of biological motion processing
Hirai, M., & Senju, A. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.01.010 · Cited by 78
Representing actions and functional properties in conceptual spaces
Gärdenfors, P. (2007) · doi:10.1515/9783110207507.2.167 · Cited by 79
Effects of aging on biological motion discrimination
Pilz, K. S., Bennett, P., & Sekuler, A. B. (2009) · Vision Research · doi:10.1016/j.visres.2009.11.014 · Cited by 69
den Stock, J. V., Tamietto, M., Zhan, M., Heinecke, A., Hervais‐Adelman, A., Legrand, L. B., Pegna, A. J., & de Gelder, B. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00030 · Cited by 77
“The involvement of this area in normal subjects for perceiving socially and biologically relevant stimuli is well documented as evidenced in studies and models of face (Haxby and Gobbini, 2011) and body (Giese and Poggio, 2003) perception.”
BackgroundPerception of biological motion from limited-lifetime stimuli
Beintema, J. A., Georg, K., & Lappe, M. (2006) · Perception & Psychophysics · doi:10.3758/bf03208763 · Cited by 67
“Giese and Poggio (2003) proposed a neural model for processing biological motion that could possibly challenge our explanation of the data in terms of a form-based analysis.”
BackgroundIosifidis, A., Tefas, A., & Pitas, I. (2012) · Signal Processing · doi:10.1016/j.sigpro.2012.08.015 · Cited by 72
“Neurobiological studies [10] have concluded that the human brain can perceive actions by observing only the human body poses (postures) during action execution.”
BackgroundAutomatic visual detection of human behavior: A review from 2000 to 2014
Afsar, P., Cortez, P. C., & Santos, H. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.05.023 · Cited by 71
“There is solid neurobiological confirmation that human activities and actions are straightforwardly connected with the ”motor control” of the human body (Rizzolatti et al., 2001; Giese and Poggio, 2003).”
BackgroundNeural Representations of Observed Actions Generalize across Static and Dynamic Visual Input
Hafri, A., Trueswell, J. C., & Epstein, R. A. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2496-16.2017 · Cited by 74
“…action codes, not mutually exclusive to the above, is that, through experience, static snapshots of actions become associated with full action sequences and thus elicit those sequences (Giese and Poggio, 2003; Jastorff et al., 2009; Singer and Sheinberg, 2010; Vangeneugden et al., 2011).”
BackgroundPerrett, D. I., Xiao, D., Barraclough, N. E., Keysers, C., & Oram, M. W. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902959279 · Cited by 66
Distinct Mechanisms for Coding of Visual Actions in Macaque Temporal Cortex
Vangeneugden, J., Mazière, P. D., Hulle, M. M. V., Jaeggli, T., Gool, L. V., & Vogels, R. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2703-10.2011 · Cited by 74
“Giese and Poggio (2003) proposed two parallel pathways, a motion and a form pathway, for analyzing actions (Schindler and Van Gool, 2008).”
BackgroundMethodInfluentialContributions of form, motion and task to biological motion perception
Thirkettle, M., Benton, C. P., & Scott‐Samuel, N. E. (2009) · Journal of Vision · doi:10.1167/9.3.28 · Cited by 63
“While some theories of biological motion perception focus on the contribution of the local motion signals of the constituent dots (Giese & Poggio, 2003; Neri et al., 1998), others emphasize the possibility of temporal integration of form (Lange et al., 2006) as a route to the global motion of the…”
What the Human Brain Likes About Facial Motion
Schultz, J., Brockhaus, M., Bülthoff, H., & Pilz, K. S. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs106 · Cited by 72
“These results are highly compatible with a neurophysiolo-gically plausible neural model of biological motion processing (Giese and Poggio 2003): a form pathway appears to analyze stimuli as discrete event snapshots, whereas a motion pathway analyzes information based on optic-fl ow information.”
ResultDeficient biological motion perception in schizophrenia: results from a motion noise paradigm
Kim, J., Norton, D. J., McBain, R. K., Öngür, D., & Chen, Y. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00391 · Cited by 72
Normal form from biological motion despite impaired ventral stream function
Gilaie‐Dotan, S., Bentin, S., Harel, M., Rees, G. E., & Saygın, A. P. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.01.009 · Cited by 62
“The extent to which biological motion perception relies upon processing of form by the ventral visual system is under debate (e.g., Blake & Shiffrar, 2007; Giese & Poggio, 2003).”
Chanel, G., Pichon, S., Conty, L., Berthoz, S., Chevallier, C., & Grèzes, J. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.11.010 · Cited by 72
“, 1996), and STS: sulcus temporal superior - (Allison et al., 2000; Giese and Poggio, 2003; Pitcher, 2014)], active during mentalizing [TPJ: temporo-parietal junction and precuneus - (Castelli et al.”
BackgroundInfluentialDyadic interaction processing in the posterior temporal cortex
Walbrin, J., & Koldewyn, K. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.027 · Cited by 73
“…the EBA is highly sensitive to static pose information, and may process body movements as a series of static ‘snapshots’ (Downing et al., 2006; Giese and Poggio, 2003) body (and face) responses are shown to generalise across static and dynamic depictions in broad regions of the posterior…”
BackgroundNaming dynamic and static actions: Neuropsychological evidence
Tranel, D., Manzel, K. W., Asp, E. W., & Kemmerer, D. L. (2008) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2008.03.008 · Cited by 100
“…2006; Peelen et al., 2006; Pelphrey et al., 2003, 2005; Puce et al., 1998; Saygin et al., 2004b; Vaina et al., 2001; for reviews, see Blake & Shiffrar, 2007; Grossman, 2006; Puce & Perrett, 2003; for a neurophysiologically plausible computational model, see Giese & Poggio, 2003, and Giese, 2006).”
BackgroundImportance of facial expression in facial nerve rehabilitation
Byrne, P. J. (2004) · Current Opinion in Otolaryngology & Head & Neck Surgery · doi:10.1097/01.moo.0000134829.61048.64 · Cited by 61
Differential involvement of the cerebellum in biological and coherent motion perception
Jokisch, D., Troje, N. F., Koch, B., Schwarz, M., & Daum, I. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04145.x · Cited by 59
“Findings from imaging studies are complemented by computational simulations modelling key experimental findings with respect to BM perception ( Giese & Poggio, 2003 ) and neuropsychological studies examining patients suffering from selective cortical lesions (MacLeod, 1988; Vaina et al., 1990; Vaina, 1994; Schenk & Zi…”
BackgroundMethodResultInfluentialNeural mechanisms of communicative innovation
Stolk, A., Verhagen, L., Schoffelen, J., Oostenveld, R., Blokpoel, M., Hagoort, P., van Rooij, I., & Toni, I. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1303170110 · Cited by 74
“There are brain circuits that support fast predictions on sensory inputs or consequences of planned actions (10, 11), but those circuits are geared toward a specific domain of application with well-defined priors [e.”
BackgroundGeorgescu, A. L., Kuzmanovic, B., Santos, N. S., Tepest, R., Bente, G., Tittgemeyer, M., & Vogeley, K. T. (2013) · Human Brain Mapping · doi:10.1002/hbm.22259 · Cited by 66
Loffing, F., Hagemann, N., & Strauß, B. (2010) · Journal of Sports Sciences · doi:10.1080/02640410903536459 · Cited by 66
“Support comes from studies in cognitive psychology that revealed orientation-dependent priming and recognition effects (Pavlova & Sokolov, 2000; Verfaillie, 1993) as well as side-specific neural activation when viewing human movements (Giese & Poggio, 2003).”
BackgroundBehavioral speed contagion: Automatic modulation of movement timing by observation of body movements
Watanabe, K. (2007) · Cognition · doi:10.1016/j.cognition.2007.06.001 · Cited by 61
The effect of oxytocin on biological motion perception in dogs (Canis familiaris)
Kovács, K., Kis, A., Kanizsàr, O., Hernádi, A., Gácsi, M., & Topál, J. (2016) · Animal Cognition · doi:10.1007/s10071-015-0951-4 · Cited by 64
Zhang, Y., Zhang, L., Neoh, S. C., Mistry, K., & Hossain, M. A. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.022 · Cited by 59
Roles of the upper and lower bodies in direction discrimination of point-light walkers
Takahashi, K., Fukuda, H., Ikeda, H., Doi, H., Watanabe, K., Ueda, K., & Shinohara, K. (2011) · Journal of Vision · doi:10.1167/11.14.8 · Cited by 58
“A number of psychological and neuroscientific studies have investigated the underlying mechanisms and neural bases of the robust perception of biological motion (for a review, see Blake & Shiffrar, 2007; Giese & Poggio, 2003).”
BackgroundCandidi, M., Stienen, B. M. C., Aglioti, S. M., & de Gelder, B. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.0697-11.2011 · Cited by 64
“This evidence is in line with studies reporting superior temporal activations during observation of static body images implying an action (Giese and Poggio, 2003; Peuskens et al., 2005) or when observing rapid succession of images in different postures (Perrett et al.”
ResultPerceptual Grouping of Biological Motion Promotes Binocular Rivalry
Watson, T., Pearson, J., & Clifford, C. W. G. (2004) · Current Biology · doi:10.1016/j.cub.2004.08.064 · Cited by 59
Heyes, C. M. (2013) · Cortex · doi:10.1016/j.cortex.2013.07.002 · Cited by 57
“…(2013), http://dx.doi.org/10.101 learning theory e can cast light on the origin of MNs, the associative account underlines the value of embedding research on MN function within system-level psychological and computational theories of how the brain produces behavior (e.g., Giese & Poggio, 2003).”
InfluentialFrom Body Form to Biological Motion: The Apparent Velocity of Human Movement Biases Subjective Time
Orgs, G., Bestmann, S., Schüür, F., & Haggard, P. (2011) · Psychological Science · doi:10.1177/0956797611406446 · Cited by 61
“Our results provide the first strong psychophysical evidence for the direct link between body form and biological-motion perception previously hypothesized by computational theories (Giese & Poggio, 2003).”
BackgroundResultInfluentialThe role of spatial and temporal information in biological motion perception
Lange, J., & Lappe, M. (2007) · Advances in Cognitive Psychology · doi:10.2478/v10053-008-0006-3 · Cited by 57
“While some studies claim a crucial influence of areas that are classically assigned to motion perception (e.g., Giese & Poggio, 2003; Peuskens, Vanrie, Verfaillie, & Orban, 2005) other studies challenge this view (e.g., Grossman, Batelli, & Pascual-Leone, 2005) or emphasize the role of areas which…”
InfluentialCortical and subcortical responses to biological motion
Chang, D. H. F., Ban, H., Ikegaya, Y., Fujita, I., & Troje, N. F. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.013 · Cited by 60
“Previous theoretical models (Giese and Poggio, 2003) have posited that biological motion perception occurs in the lateral-occipitotemporal cortex as an end-product of initially segregated cortical streams for basic form (ventral) and kinematic (dorsal) representations.”
BackgroundViewpoint and the recognition of people from their movements.
Prasad, S., & Shiffrar, M. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0012728 · Cited by 62
“Furthermore, computational models indicate that some aspects of biological motion perception can be explained by visual experience alone (e.g., Giese & Poggio, 2003).”
BackgroundInfluentialZhu, G., Yang, M., Yu, K., Xu, W., & Gong, Y. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631297 · Cited by 58
“which are inspired from biological study in [26] and the parameter 2 q controls the width of the tuning curve [ 26 ].”
BackgroundSafford, A. S., Hussey, E. K., Parasuraman, R., & Thompson, J. C. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1779-10.2010 · Cited by 62
“Computational modeling of the perception of human movements has largely assumed it to be a bottom-up process (Giese and Poggio, 2003).”
BackgroundNeural Correlates of Intentional Communication
Noordzij, M. L., Newman-Norlund, S. E., de Ruiter, J. P., Hagoort, P., Levinson, S. C., & Toni, I. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00188 · Cited by 70
“Both human psychophysics and computational models have suggested that perception of biological motion relies on extracting sequences of postures on the basis of dynamic form templates (Beintema and Lappe, 2002; Giese and Poggio, 2003; Vaina and Gross, 2004).”
Gender bending: auditory cues affect visual judgements of gender in biological motion displays
van der Zwan, R., MacHatch, C., Kozlowski, D., Troje, N. F., Blanke, O., & Brooks, A. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1800-y · Cited by 61
“For example, Giese and Poggio (2003) have proposed that the perception of biological motion arises via sequences of processes acting Wrst to extract biological motion cues from the visual array, then discriminations of coherent directions of motion are made, and then Wnally more complicated…”
Your head is there to move you around: Goal-driven models of the primate dorsal pathwayPreprint
Mineault, P., Bakhtiari, S., Richards, B. A., & Pack, C. C. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.09.451701 · Cited by 65
Midline frontal and occipito-temporal activity during error monitoring in dyadic motor interactions
Moreau, Q., Candidi, M., Era, V., Tieri, G., & Aglioti, S. M. (2020) · Cortex · doi:10.1016/j.cortex.2020.01.020 · Cited by 53
Thompson, J. C., & Baccus, W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.051 · Cited by 55
“…that can successfully discriminate features such as walking direction from biological motion using only a form-based template or “snapshot neurons” (Giese and Poggio, 2003; Lange and Lappe, 2006) or motion (Giese and Poggio, 2003) suggest that both of these cues might be important for action…”
BackgroundMovement kinematics affect action prediction: comparing human to non-human point-light actions
Stadler, W., Springer, A., Parkinson, J., & Prinz, W. (2012) · Psychological Research · doi:10.1007/s00426-012-0431-2 · Cited by 64
Wöllner, C., Deconinck, F. J. A., Parkinson, J., Hove, M. J., & Keller, P. E. (2012) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0028130 · Cited by 58
de Gelder, B. (2016) · doi:10.1093/acprof:oso/9780195374346.001.0001 · Cited by 62
Self-supervised Video Representation Learning by Uncovering Spatio-temporal Statistics
Wang, J., Jiao, J., Bao, L., He, S., Liu, W., & Liu, Y. (2020) · PubMed · doi:10.1109/tpami.2021.3057833 · Cited by 65
Toward a Unified Sub-symbolic Computational Theory of Cognition
Butz, M. V. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00925 · Cited by 51
“Abstractions over item interactions have been shown to lead to temporal predictive encodings that can characterize abstract object interactions, such as a push, a pull, or a grasp (Giese and Poggio, 2003; Fleischer et al., 2012).”
Background
Metadata
- Authors
- Giese, M. A., & Poggio, T.
- Affiliations
- Universitätsklinikum Tübingen (DE)
- McGovern Institute for Brain Research (US)
- Corresponding author
- Giese, Martin A.
- Venue
- Nature Reviews Neuroscience
- Published
- 2003-03-01
- Volume
- 4
- Issue
- 3
- Pages
- 179-192
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2095802353
- Cited by
- 955
- References
- 140
- Citations by year
- 2026: 22 · 2025: 28 · 2024: 42 · 2023: 35 · 2022: 35 · 2021: 23 · 2020: 61 · 2019: 27 · 2018: 27 · 2017: 40 · 2016: 48 · 2015: 54 · 2014: 69 · 2013: 42 · 2012: 81
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- human action recognition, motion perception, neural mechanisms, feedforward models, learning-based models, cortical regions, imitation learning
- MeSH terms
- Animals, Humans, Models, Neurological, Motion Perception, Pattern Recognition, Visual, Visual Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.