Neural mechanisms for the recognition of biological movements
The DOI matches its Crossref record; 139 of the 140 references it cites were found in a registry or an index.
Abstract
The visual recognition of complex movements and actions is crucial for the survival of many species. It is important not only for communication and recognition at a distance, but also for the learning of complex motor actions by imitation. Movement recognition has been studied in psychophysical, neurophysiological and imaging experiments, and several cortical areas involved in it have been identified. We use a neurophysiologically plausible and quantitative model as a tool for organizing and making sense of the experimental data, despite their growing size and complexity. We review the main experimental findings and discuss possible neural mechanisms, and show that a learning-based, feedforward model provides a neurophysiologically plausible and consistent summary of many key experimental results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since humans can recognize complex biological motions by observing only a few point lights placed on a moving body (Giese & Poggio, 2003), point lights can also provide effective feedback, as has been shown for dancing (Eaves et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Giese & Poggio, 2003
Citations
Cites
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Action recognition in the premotor cortex
Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996) · Brain · doi:10.1093/brain/119.2.593 · Cited by 4,968
Visual perception of biological motion and a model for its analysis
Johansson, G. (1973) · Perception & Psychophysics · doi:10.3758/bf03212378 · Cited by 4,462
Ingle, D., Goodale, M. A., & Mansfield, R. J. W. (1982) · The MIT Press eBooks · Cited by 4,118
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997) · Science · doi:10.1126/science.275.5297.213 · Cited by 3,832
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Research works printed but not linked: 5
- Giese, M. A. & Vaina, L. M. Pathways in the analysis of biological motion: computational model and fMRI results. Perception 30, Suppl. 116 (2001).
- Giese, M. A. & Poggio, T. Neural mechanisms for the recognition of biological movements and actions. AI Memo 2002-012/CBCL Paper 219 (Massachusetts Institute of Technology, Cambridge, Massachusetts, 2002).
- Lampl, I., Riesenhuber, M., Poggio, T. & Ferster, D. The max operation in cells in the cat visual cortex. Soc. Neurosci. Abstr. 30, 619 (2001).
- Sereno, M. E. Neural Computation of Pattern Motion (MIT Press, Cambridge, Massachusetts, 1993).
- Pavlova, M. Biological motion perception under various presentation rates. Perception 24, Suppl. 112 (1995).
Cited by
Items 201–300 of 952
Motion perception as a model for perceptual aging
Billino, J., & Pilz, K. S. (2019) · Journal of Vision · doi:10.1167/19.4.3 · Cited by 55
“Motion-responsive areas are documented in particular in the superior temporal sulcus, in particular involved in processing of motion information related to faces and bodies (Giese & Poggio, 2003).”
BackgroundIntegrating faces and bodies: Psychological and neural perspectives on whole person perception
Hu, Y., Baragchizadeh, A., & O’Toole, A. J. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.02.021 · Cited by 63
Introducing Memory and Association Mechanism Into a Biologically Inspired Visual Model
Qiao, H., Li, Y., Tang, T., & Wang, P. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2287014 · Cited by 51
“physiology experiments, which mimicked the architecture and response characteristics of the visual cortex. Furthermore, Giese and Poggio have extended the above model to biological motion recognition [5]. They established a hierarchical neural model with two parallel process streams, i.e. form pathway and motion pathw…”
Perceptual and computational analysis of critical features for biological motion
Thurman, S. M., Giese, M. A., & Grossman, E. D. (2010) · Journal of Vision · doi:10.1167/10.12.15 · Cited by 55
“Additional details, as well as a schematic sketch of the model, are available in previously published reports (Casile & Giese, 2005; Giese & Poggio, 2003).”
InfluentialSelf-citationVentral aspect of the visual form pathway is not critical for the perception of biological motion
Gilaie‐Dotan, S., Saygın, A. P., Lorenzi, L. J., Rees, G. E., & Behrmann, M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414974112 · Cited by 50
“Adaptation of the model for biological motion recognition based on Giese and Poggio (52).”
BackgroundMethodNetwork Interactions Explain Sensitivity to Dynamic Faces in the Superior Temporal Sulcus
Furl, N., Henson, R. N., Friston, K. J., & Calder, A. J. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu083 · Cited by 52
“Perception of such stimuli has been repeatedly associated with the human posterior STS (Vaina et al. 2001; Vaina and Gross 2004; Giese and Poggio 2003; Hein and Knight 2008; Jastorff and Orban 2009) with similar results observed in potentially corresponding areas of the macaque STS (Oram and…”
BackgroundMethodResultInfluentialComputation-Based Feature Representation of Body Expressions in the Human Brain
Solanas, M. P., Vaessen, M. J., & de Gelder, B. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa196 · Cited by 55
“and biologically plausible computational model of naturalistic body expressions is available (Giese and Poggio 2003; Serre 2014).”
BackgroundResultInfluentialSasaki, A. T., Kochiyama, T., Sugiura, M., Tanabe, H. C., & Sadato, N. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00236 · Cited by 53
“…August 2012 | Volume 6 | Article 236 | 12 brain areas, such as the fusiform body area and the extrastriate body area, which are proposed to analyze the underlying body postures (Grossman and Blake, 2002; Beauchamp et al., 2003; Giese and Poggio, 2003; Michels et al., 2005; Thompson et al., 2005).”
BackgroundWhat can fish brains tell us about visual perception?
Salva, O. R., Sovrano, V. A., & Vallortígara, G. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00119 · Cited by 53
“For instance, it is well known that motion is an extremely important cue for objectbackground segregation (biological or agentive motion represents a paradigmatic case on this regard Bertenthal and Pinto, 1994; Oram and Perrett, 1996; Giese and Poggio, 2003; Ibbotson, 2007; Nishida, 2011).”
BackgroundThe facing bias in biological motion perception: structure, kinematics, and body parts
Schouten, B. A. M., Troje, N. F., & Verfaillie, K. (2010) · Attention Perception & Psychophysics · doi:10.3758/s13414-010-0018-1 · Cited by 48
“Neurophysiologically plausible models on the perception of biological motion (e.g., Giese & Poggio, 2003) generally incorporate two pathways, a form pathway and a motion pathway, that process the structural and kinematic properties of biological motion in a relatively independent manner before…”
BackgroundPhysiologically Inspired Model for the Visual Recognition of Transitive Hand Actions
Fleischer, F., Caggiano, V., Thier, P., & Giese, M. A. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4129-12.2013 · Cited by 50
“(3) As for previous models for the recognition of non-transitive actions (Giese and Poggio, 2003; Jhuang et al., 2007; Escobar et al., 2009) one might consider a second primary visual pathway that processes local motion and optic flow features instead of form features.”
InfluentialSelf-citationDynamic action recognition based on dynemes and Extreme Learning Machine
Iosifidis, A., Tefas, A., & Pitas, I. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.10.019 · Cited by 47
Visual gravity cues in the interpretation of biological movements: neural correlates in humans
Maffei, V., Indovina, I., Macaluso, E., Ivanenko, Y. P., Orban, G. A., & Lacquaniti, F. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.006 · Cited by 51
“According to an influential model (Giese and Poggio, 2003), BM pattern detectors temporally smooth and summate the activity of snapshot neurons, which are thought to process shape (Beintema and Lappe, 2002; Lange and Lappe, 2006) together with the activity of optic flow pattern neurons which are thought to process loc…”
BackgroundShamble, P. S., Hoy, R., Cohen, I., & Beatus, T. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2017.0308 · Cited by 51
Social-affective features drive human representations of observed actions
Dima, D. C., Tomita, T. M., Honey, C. J., & Işık, L. (2022) · eLife · doi:10.7554/elife.75027 · Cited by 58
Neural Integration of Information Specifying Human Structure from Form, Motion, and Depth
Jackson, S., & Blake, R. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.3116-09.2010 · Cited by 47
“More importantly, current models of biomotion perception contain no explicit means for disambiguating the in-depth orientation of the human figure (Giese and Poggio, 2003; Lange and Lappe, 2006).”
BackgroundInfluentialRossi, A., Parada, F. J., Kolchinsky, A., & Puce, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.04.029 · Cited by 51
“…dynamic stimulus attributes are mainly processed by brain regions considered to be part of the dorsal visual system, and that processing of progressively more complex motion information occurs within this system (Giese and Poggio, 2003; Jastorff and Orban, 2009; Thompson and Parasuraman, 2012).”
BackgroundHierarchical Space-Time Model Enabling Efficient Search for Human Actions
Ning, H., Han, T. X., Walther, D. B., Liu, M., & Huang, T. S. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2017399 · Cited by 51
Oscillations in the human brain during walking execution, imagination and observation
Cevallos, C., Zarka, D., Hoellinger, T., Leroy, A., Dan, B., & Chéron, G. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.06.039 · Cited by 55
Necessary but not sufficient: Motion perception is required for perceiving biological motion
Garcia, J. O., & Grossman, E. D. (2008) · Vision Research · doi:10.1016/j.visres.2008.01.027 · Cited by 52
Nonconscious emotional processing involves distinct neural pathways for pictures and videos
Faivre, N., Charron, S., Roux, P., Lehéricy, S., & Kouider, S. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.10.025 · Cited by 50
“…(i.e., 'snapshots' of expressive faces by neurons in the ventral pathway) and motion information (i.e., integrated optic flow patterns by neurons in the dorsal pathway) without awareness, as proposed elsewhere to account for the conscious recognition of biological motion (Giese & Poggio, 2003).”
Learning Features of Intermediate Complexity for the Recognition of Biological Motion
Sigala, R., Serre, T., Poggio, T., & Giese, M. A. (2005) · Lecture notes in computer science · doi:10.1007/11550822_39 · Cited by 45
“The first level of the model is formed by local motion energy-detectors whose responses are derived from the optic-flow fields of the stimuli assuming physiologically plausible tuning characteristics (see [ 5 ]).”
BackgroundMethodInfluentialSelf-citationVidal, P., & Lacquaniti, F. (2021) · Experimental Brain Research · doi:10.1007/s00221-021-06049-0 · Cited by 54
Video-based Human Action Recognition using Deep Learning: A ReviewPreprint
Pham, H., Khoudour, L., Crouzil, A., Zegers, P., & Velastín, S. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.03775 · Cited by 83
Interactions between motion and form processing in the human visual system
Mather, G., Pavan, A., Marotti, R. B., Campana, G., & Casco, C. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00065 · Cited by 51
“…colleagues have developed and tested a computational model of biological motion analysis that conforms to this architecture: separate analyses in the dorsal and ventral streams converge on a common representation in high-level areas such as STS (Giese and Poggio, 2003; Fleischer and Giese, 2012).”
BackgroundMethodInfluentialDuan, S., Lin, Y., Shi, Q., Wei, X., Zhu, D., Hong, J., Xiang, S., Yuan, W., Shen, G., & Wu, J. (2024) · Advanced Fiber Materials · doi:10.1007/s42765-024-00434-4 · Cited by 49
“Gesture recognition enabled by sensors and computational models is of great value in human–machine interactions [1, 2], health monitoring [1, 3], Metaverse [4, 5], and the study of cognitive neuroscience [6].”
Reference repulsion in the categorical perception of biological motion
Sweeny, T. D., Haroz, S., & Whitney, D. C. (2012) · Vision Research · doi:10.1016/j.visres.2012.05.008 · Cited by 50
“Here, we tested this hypothesis by presenting a test walker for 1000 ms instead of 200 ms.”
Humans Anticipate the Goal of other People’s Point-Light Actions
Elsner, C., Falck‐Ytter, T., & Gredebäck, G. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00120 · Cited by 46
“This direct matching process (Flanagan and Johansson, 2003; Giese and Poggio, 2003; Lange and Lappe, 2006) allows the observer to (4) simulate future action goals based on his/her own motor plans, and through connections with occulomotor control systems (5) to initiate an anticipatory gaze shift to…”
BackgroundComputational Model Based on Neural Network of Visual Cortex for Human Action Recognition
Liu, H., Shu, N., Tang, Q., & Zhang, W. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2669522 · Cited by 45
“These ventral and dorsal streams are separately evaluated in biological motion recognition [13].”
BackgroundTask-dependent enhancement of facial expression and identity representations in human cortex
Dobs, K., Schultz, J., Bülthoff, I., & Gardner, J. L. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.013 · Cited by 47
“…in the STS. Previous studies have suggested that STS may integrate identity, transmitted by form, and expression, transmitted by motion in humans (Giese and Poggio, 2003; Puce et al., 2003; Lange and Lappe, 2006; Furl et al., 2015; Dobs et al., 2017) and monkeys (Desimone and Ungerleider, 1986;…”
Ürgen, B. A., Pehlivan, S., & Saygın, A. P. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.02.006 · Cited by 50
“The first line of research, which we refer as visual neuroscience of action perception, focuses on early stages of visual processing and how actions are processed in the early visual cortex (Giese and Poggio, 2003; Blake and Shiffrar, 2007).”
BackgroundResultBreaking human social decision making into multiple components and then putting them together again
Suzuki, S., & O’Doherty, J. P. (2020) · Cortex · doi:10.1016/j.cortex.2020.02.014 · Cited by 51
Deficits in task-set maintenance and execution networks in Parkinson’s disease
Tinaz, S., Lauro, P. M., Hallett, M., & Horovitz, S. G. (2015) · Brain Structure and Function · doi:10.1007/s00429-014-0981-8 · Cited by 48
“A large variety of tasks based on visual perception of movement recruit these regions (Giese and Poggio 2003; Schultz et al. 2004; Pyles et al. 2007; Jastorff et al. 2011).”
BackgroundBoker, S. M., Cohn, J. F., Theobald, B.-J., Matthews, I., Mangini, M., Spies, J. R., Ambadar, Z., & Brick, T. R. (2011) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0021928 · Cited by 41
A fast, invariant representation for human action in the visual system
Işık, L., Tacchetti, A., & Poggio, T. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00642.2017 · Cited by 50
Self-citationHuman action recognition using histogram of motion intensity and direction from multiple views
Chun, S., & Lee, C.-S. (2016) · IET Computer Vision · doi:10.1049/iet-cvi.2015.0233 · Cited by 48
From single cells to social perception
Barraclough, N. E., & Perrett, D. I. (2011) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2010.0352 · Cited by 55
Modulation of Perception and Brain Activity by Predictable Trajectories of Facial Expressions
Furl, N., van Rijsbergen, N. J., Kiebel, S. J., Friston, K. J., Treves, A., & Dolan, R. J. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp140 · Cited by 51
“2008]) depend on prediction of sensory states (Rao and Ballard 1999; Giese and Poggio 2003; Treves 2004; Friston 2005).”
BackgroundInfluentialConstructing Visual Perception of Body Movement with the Motor Cortex
Orgs, G., Dovern, A., Hagura, N., Haggard, P., Fink, G. R., & Weiss, P. H. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv262 · Cited by 53
“Thus, sequence-selective and body-specific neurons in these areasmight receive sufficient bottom-up input to produce fluent ABM perception, complementing the missing frames that are absent in the ABM stimulus (Giese and Poggio 2003; Jellema and Perrett 2003; Barraclough et al. 2006).”
BackgroundAn ALE meta‐analysis on the audiovisual integration of speech signals
Erickson, L. C., Heeg, E., Rauschecker, J. P., & Turkeltaub, P. E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22572 · Cited by 48
“…2008], both unimodal and multimodal [Allison et al., 2000; Beauchamp et al., 2004a, b, 2008; Bidet-Caulet et al., 2005; Calvert et al., 2000; Giese and Poggio, 2003; Grossman and Blake, 2002; Lahnakoski et al., 2012; Man et al., 2012; Noesselt et al., 2007; Peelen et al., 2010; Pelphrey et…”
BackgroundAction recognition via bio-inspired features: The richness of center–surround interaction
Escobar, M.-J., & Kornprobst, P. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.01.002 · Cited by 43
Physical and Biological Constraints Govern Perceived Animacy of Scrambled Human Forms
Thurman, S. M., & Lu, H. (2013) · Psychological Science · doi:10.1177/0956797612467212 · Cited by 43
“…typically conveyed by points of light on the joints of an animal or human actor, are perceived just as spontaneously and irresistibly as is animacy (Johansson, 1973), and such perception is believed to involve specialized mechanisms (Giese & Poggio, 2003; Kourtzi, Krekelberg, & van Wezel, 2008).”
BackgroundEmergence of multimodal action representations from neural network self-organization
Parisi, G. I., Tani, J., Weber, C., & Wermter, S. (2016) · Cognitive Systems Research · doi:10.1016/j.cogsys.2016.08.002 · Cited by 48
“…actions with high accuracy from video sequences with the use of spatiotemporal hierarchies that functionally resemble the organization of earlier areas of the visual cortex (e.g. Giese & Poggio, 2003; Jung, Hwang, & Tani, 2015; Layher, Giese, & Neumann, 2014; Parisi, Weber, & Wermter, 2015).”
BackgroundMethodInfluentialÜrgen, B. A., & Saygın, A. P. (2019) · Cortex · doi:10.1016/j.cortex.2020.03.014 · Cited by 50
Invariant Recognition Shapes Neural Representations of Visual Input
Tacchetti, A., Işık, L., & Poggio, T. (2018) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091517-034103 · Cited by 47
Self-citationContorted and ordinary body postures in the human brain
Cross, E. S., Mackie, E. C., Wolford, G., & Hamilton, A. F. D. C. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2093-x · Cited by 46
“An inXuential model of body perception has proposed distinct representations of static body form and of body motion (Giese and Poggio 2003).”
BackgroundResultInfluentialQuantifying human sensitivity to spatio-temporal information in dynamic faces
Dobs, K., Bülthoff, I., Breidt, M., Vuong, Q. C., Curio, C., & Schultz, J. (2014) · Vision Research · doi:10.1016/j.visres.2014.04.009 · Cited by 44
Life Detection From Biological Motion
Troje, N. F., & Chang, D. H. F. (2023) · Current Directions in Psychological Science · doi:10.1177/09637214221128252 · Cited by 44
“…of the superior temporal sulcus, in particular, have received emphasis because (a) its anatomical positioning fits well with theoretical models (Giese & Poggio, 2003), (b) the topographical manner in which the region responds depends on the type of motion shown (e.g., hand vs. face motion),…”
BackgroundObservation and imitation of actions performed by humans, androids, and robots: an EMG study
Hofree, G., Ürgen, B. A., Winkielman, P., & Saygın, A. P. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00364 · Cited by 51
“From a systems neuroscience perspective, however, such properties and related neural regions are important to specify (e.g., Giese and Poggio, 2003; Saygin et al., 2004a; Jastorff and Orban, 2009; Nelissen et al., 2011; Saygin, 2012).”
BackgroundMethodBeets, I. A. M., Rösler, F., & Fiehler, K. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00974.2009 · Cited by 42
“An internal model, which merges motor and perceptual experience, is suggested to play a role in the anticipation of action effects (Wolpert and Ghahramani 2000; Wolpert et al. 1995; for an overview about biological movement perception, see Giese and Poggio 2003).”
BackgroundÜrgen, B. A., & Orban, G. A. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118220 · Cited by 46
Parametric animacy percept evoked by a single moving dot mimicking natural stimuli
Schultz, J., & Bülthoff, H. (2013) · Journal of Vision · doi:10.1167/13.4.15 · Cited by 42
“However, for this stimulus to be perceived, integration of form and motion is necessary (Casile & Giese, 2005; Giese & Poggio, 2003; Lange & Lappe, 2006).”
BackgroundTeaching as a Dynamic Phenomenon with Interpersonal Interactions
Watanabe, K. (2013) · Mind Brain and Education · doi:10.1111/mbe.12011 · Cited by 41
Bottari, D., Troje, N. F., Ley, P., Hense, M., Kekunnaya, R., & Röder, B. (2015) · Cortex · doi:10.1016/j.cortex.2015.07.029 · Cited by 42
“Combining physiological and neuroimaging data on humans and animals, Giese and Poggio (2003) proposed a feed-forward model comprising in parallel organized ventral (form related) and dorsal (optic flow related) visual pathways associated with the processing of BM.”
BackgroundAnger and Happiness are Linked Differently to the Explicit Detection of Biological Motion
Ikeda, H., & Watanabe, K. (2009) · Perception · doi:10.1068/p6250 · Cited by 40
“This is known as `biological-motion perception', and there are a large number of studies as well as good reviews on this phenomenon (eg Thornton et al 1998; Verfaillie 2000; Giese and Poggio 2003; Blake and Shiffrar 2007).”
BackgroundParasuraman, R., & Galster, S. M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00273 · Cited by 44
Discerning nonrigid 3D shapes from motion cues
Jain, A., & Zaidi, Q. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1016211108 · Cited by 38
“How this is done by the brain is an open question, but some neural models postulate that it is by the use of snapshot neurons that are tuned to different poses of a deforming humanoid shape (47).”
BackgroundCracco, E., Lee, H., Belle, G. V., Quenon, L., Haggard, P., Rossion, B., & Orgs, G. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab385 · Cited by 39
“…structure-from-motion pathway,perception of biological motion arises from an analysis of the kinematics of observed movements; in the motion-from-structure pathway, it instead arises from combining sequences of static body snapshots into fluent motion (Giese and Poggio 2003; Lange and Lappe 2006).”
InfluentialJung, W. H., Gu, B.-M., Kang, D., Park, J., Yoo, S. Y., Choi, C., Lee, J., & Kwon, J. S. (2008) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-008-0833-8 · Cited by 38
“The STG is a specific region for the integration of motion and form information from the dorsal and ventral pathways [17].”
BackgroundStructural processing in biological motion perception
Lu, H. (2010) · Journal of Vision · doi:10.1167/10.12.13 · Cited by 43
Hirai, M., & Hiraki, K. (2005) · Cognition · doi:10.1016/j.cognition.2005.05.003 · Cited by 37
Gandolfo, M., Abassi, E., Balgova, E., Downing, P. E., Papeo, L., & Koldewyn, K. (2024) · Current Biology · doi:10.1016/j.cub.2023.12.009 · Cited by 48
Abnormal dynamics of activation of object use information in apraxia: Evidence from eyetracking
Lee, C., Mirman, D., & Buxbaum, L. J. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.004 · Cited by 39
“Superior temporal cortical regions have been shown to be active during processing of biological motions (Giese & Poggio, 2003; Puce & Perrett, 2003), object-directed actions (James, VanDerKlok, Stevenson, & James, 2011), and moving objects in interactions that appear to be causal or intentional…”
BackgroundAction Recognition by Motion Detection in Posture Space
Theusner, S., de Lussanet, M. H. E., & Lappe, M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2900-13.2014 · Cited by 41
“Instead, biological motion perception can be performed by analyzing first body posture and then body motion (Beintema and Lappe, 2002; Giese and Poggio, 2003; Lee and Wong, 2004; Lange and Lappe, 2006).”
BackgroundMethod4 Verbs of aquamotion: semantic domains and lexical systems
Lander, Y. A., Maisak, T., & Rakhilina, E. V. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199661213.003.0004 · Cited by 41
Metrics of the perception of body movement
Giese, M. A., Thornton, I. M., & Edelman, S. (2008) · Journal of Vision · doi:10.1167/8.9.13 · Cited by 35
“Such mechanisms can be realized with relatively simple neural circuits (Giese & Poggio, 2003; Hopfield & Brody, 2001), and would contribute substantially to the robustness of action recognition since they result in generalization between actions with slightly different timings.”
BackgroundMethodInfluentialSelf-citationMeta-analytic connectivity modeling of the human superior temporal sulcus
Erickson, L. C., Rauschecker, J. P., & Turkeltaub, P. E. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1215-z · Cited by 45
“Less directly related to audition/language, the STS is involved in processing biological motion (Giese and Poggio 2003) and faces (Haxby et al. 2000).”
BackgroundInfluentialCortical encoding of rhythmic kinematic structures in biological motion
Shen, L., Lu, X., Yuan, X., Hu, R., Wang, Y., & Jiang, Y. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.119893 · Cited by 38
Perception of dynamic Glass patterns
Nankoo, J., Madan, C. R., Spetch, M. L., & WYLIE, D. R. W. (2012) · Vision Research · doi:10.1016/j.visres.2012.09.008 · Cited by 36
“In a quantitative model of biological motion, Giese and Poggio (2003) suggest that ‘‘snapshot’’ neurons in the ventral pathway code for body shapes, and subsequently motion pattern neurons summate sequences of body shapes from the activity of these snapshot neurons.”
Behavioural responses of feral goats (Capra hircus) to helicopters
Tracey, J. P., & Fleming, P. J. S. (2006) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2006.10.009 · Cited by 35
Sharing Space: The Presence of Other Bodies Extends the Space Judged as Near
Fini, C., Costantini, M., & Committeri, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114719 · Cited by 37
“photographs, line drawings, silhouettes) relative to perceptually-matched control objects, as well as during the vision of human biological movement [35].”
BackgroundZarka, D., Cevallos, C., Petieau, M., Hoellinger, T., Dan, B., & Cheron, G. A. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00169 · Cited by 37
“Several studies demonstrated that shape and motion information are treated separately by ventral and dorsal visual streams, and converge to the posterior portion of superior temporal sulcus (Vaina et al., 2001; Giese and Poggio, 2003; Blake and Shiffrar, 2007).”
BackgroundTemporal structure coding with and without awareness
Faivre, N., & Koch, C. (2014) · Cognition · doi:10.1016/j.cognition.2014.02.008 · Cited by 37
The Context–Object–Manipulation Triad: Cross Talk during Action Perception Revealed by fMRI
Wurm, M. F., von Cramon, D. Y., & Schubotz, R. I. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00232 · Cited by 37
“According to Giese and Poggio ( 2003 ), information about form, for example, postures of body parts and shape of objects, is processed by the form pathway in V1, V4, EBA, and finally pSTS, where so-called snapshot patterns are combined with optic flow patterns detected by the motion pathway, that is, V1, V2, hMT, and…”
BackgroundEvaluation of Multimodal Behaviour of Embodied Agents
Stéphanie Buisine, A., Abrilian, S., & Martin, J. (2004) · Human-computer interaction series · doi:10.1007/1-4020-2730-3_8 · Cited by 34
“Besides, no gender differences have been described in biological motion recognition (see Giese and Poggio (2003) ).”
BackgroundEmbodied emotion impairment in Huntington’s disease
Trinkler, I., Devignevielle, S., Achaibou, A., Ligneul, R. V., Brugières, P., Cleret de Langavant, L., De Gelder, B., Scahill, R., Schwartz, S., & Bachoud-Lévi, A.-C. (2017) · Cortex · doi:10.1016/j.cortex.2017.02.019 · Cited by 33
“…on a motor level in HD: We found brain volume differences correlated to emotion recognition in pSTS, posterior parietal and somatosensory cortices, areas previously attributed to shared visuo-motor action representations (Blakemore & Decety, 2001; Grezes et al., 2003; Grezes & Decety, 2001).”
Background2 Distinctions in the linguistic encoding of motion: evidence from a free naming task
Vulchanova, M., Martínez, L., & Vulchanov, V. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199661213.003.0002 · Cited by 33
A self-organizing neural network architecture for learning human-object interactions
Mici, L., Parisi, G. I., & Wermter, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.015 · Cited by 36
Rosenzopf, H., Wiesen, D., Basilakos, A., Yourganov, G., Bonilha, L., Rorden, C., Fridriksson, J., Karnath, H., & Sperber, C. (2022) · Brain Communications · doi:10.1093/braincomms/fcac004 · Cited by 35
“Results concerning the superior temporal sulcus are again prompting towards a possible role of action recognition, more precisely, the perception of biological motion.(69,70) If this important foundation for recognizing actions(71) plays a role in apraxia remains speculation, which requires future studies to be invest…”
BackgroundPerceiving depth in point-light actions
Vanrie, J., & Verfaillie, K. (2006) · Perception & Psychophysics · doi:10.3758/bf03208762 · Cited by 35
“…of computational and neural mechanisms underlying the perception of biological motion in general, and of point-light figures in particular (see Giese & Poggio, 2003, for an overview), one issue that has been largely ignored is the perception of depth in point-light stimuli and of the overall…”
BackgroundDiscrimination of locomotion direction in impoverished displays of walkers by macaque monkeys
Vangeneugden, J. (2010) · Journal of Vision · doi:10.1167/10.4.22 · Cited by 33
What Learning to See Arbitrary Motion Tells Us About Biological Motion Perception.
Hiris, E. J., Krebeck, A., Edmonds, J., & Stout, A. (2005) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.31.5.1096 · Cited by 33
Wang, J., Cherkassky, V. L., Yang, Y., Chang, K.-M. K., Vargas, R., Diana, N., & Just, M. A. (2016) · Cognitive Neuropsychology · doi:10.1080/02643294.2016.1182480 · Cited by 40
Invariant Global Motion Recognition in the Dorsal Visual System: A Unifying Theory
Rolls, E. T., & Stringer, S. M. (2006) · Neural Computation · doi:10.1162/neco.2007.19.1.139 · Cited by 34
“A hierarchical network with the general architecture shown in Figure 2 with separate analyses of form and motion that are combined at a final stage (as in experiment 4) is also useful for biological motion, such as representing a person walking (Giese & Poggio, 2003).”
Limanowski, J., Sarasso, P., & Blankenburg, F. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13824 · Cited by 34
Noyes, E., Hill, M. Q., & O’Toole, A. J. (2018) · Cognitive Research Principles and Implications · doi:10.1186/s41235-018-0117-4 · Cited by 34
“…activated by viewing motion of the face, motion of the body, and more generally, biological motion (Allison, Puce, & McCarthy, 2000; Beauchamp, Lee, Haxby, & Martin, 2003; Fox, Iaria, & Barton, 2009; Giese & Poggio, 2003; Gilaie-Dotan, Kanai, Bahrami, Rees, & Saygin, 2013; Yovel & O’Toole, 2016).”
Animacy and the prediction of behaviour
Schultz, J., & Frith, C. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104766 · Cited by 40
Amara, K., Kerdjidj, O., & Ramzan, N. (2023) · IEEE Access · doi:10.1109/access.2023.3285398 · Cited by 37
“[39], which reveal that specific facial and corporal key points are more relevant to characterising different emotions.”
BackgroundThe KIT Robo-kitchen data set for the evaluation of view-based activity recognition systems
Rybok, L., Friedberger, S., Hanebeck, U. D., & Stiefelhagen, R. (2011) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2011.6100854 · Cited by 32
“Usually, feature types encoding motion and appearance are used in a combined fashion, which is in fact, according to recent studies in neuro-science, in line with the way humans perceive motion patterns [26].”
BackgroundEmotion categorization of body expressions in narrative scenarios
Volkova, E. P., Mohler, B. J., Dodds, T. J., Tesch, J., & Bülthoff, H. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00623 · Cited by 35
“According to Giese and Poggio (2003) there are two distinct neural mechanisms in the brain that facilitate recognition of biological information: one for motion, another for form.”
BackgroundToward ecologically realistic theories in visual short-term memory research
Orhan, A. E., & Jacobs, R. A. (2014) · Attention Perception & Psychophysics · doi:10.3758/s13414-014-0649-8 · Cited by 33
“1a), and even actions (Giese & Poggio, 2003) such as walking, running, etc.1 (Fig.”
Speed and direction changes induce the perception of animacy in 7-month-old infants
Träuble, B., Pauen, S., & Poulin‐Dubois, D. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01141 · Cited by 34
“…information was provided via point-light displays, displaying manner of motion as well as implicit shape information (e.g., Cutting, 1978; Giese and Poggio, 2003; Schlottmann and Ray, 2010) of the objects, the present study manipulated the motion cues of ambiguous shapes so that no morphological…”
BackgroundMethodDurá-Bernal, S., Wennekers, T., & Denham, S. L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048216 · Cited by 36
“Hence, HMAX has been described as the standard model [40] and has been employed as the base model to simulate other phenomena such as attention [42], biological motion [43] and learning using spike-time dependent plasticity (STDP) [44].”
MethodLearning Complex Cell Invariance from Natural Videos: A Plausibility Proof
Masquelier, T., Serre, T., Thorpe, S. J., & Poggio, T. (2007) · Defense Technical Information Center (DTIC) · doi:10.21236/ada477541 · Cited by 37
“While computational models of the visual cortex are becoming increasingly detailed (Riesenhuber and Poggio, 1999; Giese and Poggio, 2003; Deco and Rolls, 2004, 2005; Serre et al., 2005a; Rolls and Stringer, 2006; Berzhanskaya et al., 2007; Masquelier and Thorpe, 2007), the question of how such…”
MethodResultSelf-citationAlp, N., Nikolaev, A. R., Wagemans, J. P., & Kogo, N. (2017) · Scientific Reports · doi:10.1038/srep44012 · Cited by 35
Sperber, C., Wiesen, D., Goldenberg, G., & Karnath, H. (2019) · Cortex · doi:10.1016/j.cortex.2019.08.023 · Cited by 34
Binding biological motion and visual features in working memory.
Ding, X., Zhao, Y., Wu, F., Lu, X., Gao, Z., & Shen, M. (2015) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000061 · Cited by 34
What you see is what you get: motor resonance in peripheral vision
Leonetti, A., Puglisi, G., Šiugždaitė, R., Ferrari, C., Cerri, G., & BORRONI, P. F. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4371-0 · Cited by 38
“We are perceptually tuned to the kinematic aspects of the movement of others around us through the integration of different incoming information from both central and peripheral vision (Giese and Poggio 2003; Thornton et al. 1998; Verfaillie 2000).”
MethodTemporal properties in masking biological motion
Hiris, E. J., Humphrey, D., & Stout, A. (2005) · Perception & Psychophysics · doi:10.3758/bf03193322 · Cited by 31
“Giese and Poggio (2003) have proposed a physiologically plausible model of biological motion perception that processes form and motion information in two pathways.”
BackgroundInfluential9 Granularity, space, and motion‐framed location
Tutton, M. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199661213.003.0009 · Cited by 30
Metadata
- Authors
- Giese, M. A., & Poggio, T.
- Affiliations
- Universitätsklinikum Tübingen (DE)
- McGovern Institute for Brain Research (US)
- Corresponding author
- Giese, Martin A.
- Venue
- Nature Reviews Neuroscience
- Published
- 2003-03-01
- Volume
- 4
- Issue
- 3
- Pages
- 179-192
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2095802353
- Cited by
- 955
- References
- 140
- Citations by year
- 2026: 22 · 2025: 28 · 2024: 42 · 2023: 35 · 2022: 35 · 2021: 23 · 2020: 61 · 2019: 27 · 2018: 27 · 2017: 40 · 2016: 48 · 2015: 54 · 2014: 69 · 2013: 42 · 2012: 81
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- human action recognition, motion perception, neural mechanisms, feedforward models, learning-based models, cortical regions, imitation learning
- MeSH terms
- Animals, Humans, Models, Neurological, Motion Perception, Pattern Recognition, Visual, Visual Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.