Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey
The DOI matches its Crossref record.
Abstract
1. Processing of visual information in primates is believed to occur in at least two separate cortical pathways, commonly labeled the "form" and "motion" pathways. This division lies in marked contrast to our everyday visual experience, in which we have a unified percept of both the form and motion of objects, implying integration of both types of information. We report here on a neuronal population in the anterior part of the superior temporal polysensory area (STPa) both sensitive to form (heads and bodies) and selective for motion direction. 2. A total of 161 cells were found to be sensitive to body form and motion. The majority of cells (125 of 161, 78%) responded to only one combination of view and direction (termed unimodal cells, e.g., left profile view moving left, not right profile moving left, or left profile moving right). We show that the response of some of these cells is selective for both the motion and the form of a single object, not simply the juxtaposition of appropriate form and motion signals. 3. A smaller number of cells (9 of 161, 6%) responded selectively to two opposite combinations of view and direction (e.g., left profile moving left and right profile moving right, but no other view and direction combinations). A few cells (4 of 161, 2%) showed "object-centered" selectivity to view and direction combinations, responding to all directions of motion where the body moves in a direction compatible with the direction it faces, for example, responding to left profile going left, right profile going right, face view moving toward the observer, back view moving away from the observer, but not other view and direction combinations. 4. The majority of the neurons (106 of 138, 77%) selective for specific body view and direction combinations responded best to compatible motion (e.g., left profile moving left), and one fourth (23%) showed selectivity for incompatible motion (e.g., right profile moving left). 5. The relative strengths of motion and form inputs to cells in STPa conjointly sensitive to information about form and motion were assessed. The majority of the responses (95%) were characterized as showing nonlinear summation of form and motion inputs. 6. The capacity to discriminate different directions and different forms was compared across three populations of STPa cells, namely those sensitive to 1) form only, 2) motion only, and 3) both form and motion. The selectivity of the latter class could be predicted from combinations of the other two classes. 7. The response latencies of cells selective for form and motion are on average coincident with cells selective for direction of motion (but not stimulus form). Both these cell populations have response latencies on average 20 ms earlier than cells selective for static form. 8. Calculation of the average of early response latency cells (cell whose response latency was under the sample mean) suggests that direction information is present in cell responses some 35 ms before form information becomes evident. Direction information and form information become evident within 5 ms of each other in the average late response latency cells (those cells whose response latency was greater than the sample mean). Inputs relating to movement show an initial response period that does not discriminate direction. The quality of initial direction discrimination appeared to be independent of response latency. The initial discrimination of form was related to response latency in that cells with longer response latencies showed greater initial discrimination of form in their responses. We argue that these findings are consistent with form inputs arriving to area STPa approximately 20 ms after motion inputs into area STPa.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
The distributed human neural system for face perception
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01482-0 · Cited by 4,891
Social perception from visual cues: Role of the STS region
Allison, T., Puce, A., & McCarthy, G. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01501-1 · Cited by 2,461
The distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,314
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Blake, R., & Shiffrar, M. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190152 · Cited by 974
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955
Understanding the recognition of facial identity and facial expression
Calder, A. J., & Young, A. W. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1724 · Cited by 948
Two-year-olds with autism orient to non-social contingencies rather than biological motion
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., & Jones, W. (2009) · Nature · doi:10.1038/nature07868 · Cited by 921
Neural mechanisms subserving the perception of human actions
Decety, J. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01312-1 · Cited by 906
(2016) · doi:10.3389/fpsyg · Cited by 801
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Global and fine information coded by single neurons in the temporal visual cortex
Sugase, Y., Yamane, S., Ueno, S., & Kawano, K. (1999) · Nature · doi:10.1038/23703 · Cited by 760
Electrophysiology and brain imaging of biological motion
Puce, A., & Perrett, D. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1221 · Cited by 693
Self-citationMirror neurons: from origin to function
Cook, R., Bird, G., Catmur, C., Press, C., & Heyes, C. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000903 · Cited by 647
Where do mirror neurons come from?
Heyes, C. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.007 · Cited by 615
Demystifying social cognition: a Hebbian perspective
Keysers, C., & Perrett, D. I. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.09.005 · Cited by 592
Self-citationThe Anatomy of Spatial Neglect based on Voxelwise Statistical Analysis: A Study of 140 Patients
Karnath, H.-O. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh076 · Cited by 573
An fMRI study of intentional and unintentional (embarrassing) violations of social norms
Berthoz, S. (2002) · Brain · doi:10.1093/brain/awf190 · Cited by 511
Superior Temporal Sulcus—It's My Area: Or Is It?
Hein, G., & Knight, R. T. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20148 · Cited by 486
“There are a number of findings indicating that a region in the anterior portion of the upper STS is selectively involved in the processing of body movements, including gaze direction (Oram & Perrett, 1994, 1996; reviewed in Keysers & Perrett, 2004).”
BackgroundConsensus Paper: The Role of the Cerebellum in Perceptual Processes
Baumann, O., Borra, R. J., Bower, J. M., Cullen, K. E., Habas, C., Ivry, R. B., Leggio, M., Mattingley, J. B., Molinari, M., Moulton, E. A., et al. (2015) · The Cerebellum · doi:10.1007/s12311-014-0627-7 · Cited by 462
fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects
Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903770007380 · Cited by 445
Puce, A. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.445 · Cited by 422
Multiple sensitive periods in human visual development: Evidence from visually deprived children
Lewis, T. L., & Maurer, D. (2005) · Developmental Psychobiology · doi:10.1002/dev.20055 · Cited by 423
Rushworth, M. F. S., Krams, M., & Passingham, R. E. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901750363244 · Cited by 384
Leiguarda, R. C., & Marsden, C. D. (2000) · Brain · doi:10.1093/brain/123.5.860 · Cited by 382
Biological Motion Processing as a Hallmark of Social Cognition
Pavlova, M. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr156 · Cited by 382
Pelphrey, K. A., Shultz, S., Hudac, C. M., & Vander Wyk, B. C. (2011) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2010.02349.x · Cited by 382
Transmodal Sensorimotor Networks during Action Observation in Professional Pianists
Haslinger, B., Erhard, P., Altenmüller, E., Schroeder, U., Boecker, H., & Ceballos-Baumann, A. O. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053124893 · Cited by 379
Towards a unifying neural theory of social cognition
Keysers, C., & Gazzola, V. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)56021-2 · Cited by 367
Integrating automatic and controlled processes into neurocognitive models of social cognition
Satpute, A. B., & Lieberman, M. D. (2006) · Brain Research · doi:10.1016/j.brainres.2006.01.005 · Cited by 347
New insights into the functions of the superior temporal cortex
Karnath, H.-O. (2001) · Nature Reviews Neuroscience · doi:10.1038/35086057 · Cited by 347
Superior temporal and premotor brain areas necessary for biological motion perception
Saygin, A. P. (2007) · Brain · doi:10.1093/brain/awm162 · Cited by 343
Dynamic Perception of Facial Affect and Identity in the Human Brain
LaBar, K. S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.10.1023 · Cited by 334
Neural Representations of Faces and Body Parts in Macaque and Human Cortex: A Comparative fMRI Study
Pinsk, M. A., Arcaro, M., Weiner, K. S., Kalkus, J. F., Inati, S. J., Gross, C. G., & Kastner, S. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91198.2008 · Cited by 333
Barraclough*, N. E., Xiao*, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279586 · Cited by 332
Self-citationRomanski, L. M., Giguere, M., Bates, J. F., & Goldman-Rakic, P. S. (1997) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19970317)379:3<313::aid-cne1>3.0.co;2-6 · Cited by 325
Saleem, K. S., Kondo, H., & Price, J. L. (2008) · Journal of Comparative Neurology · doi:10.1002/cne.21577 · Cited by 315
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312
“One possible mechanism is as follows: Striatal neurons receive biological motion information either directly from area STP (Oram and Perrett, 1996) or indirectly via parietal lobe (Cavada and Goldman-Rakic, 1991) while simultaneously receiving reward-related information from dopaminergic neurons and other reward-relat…”
BackgroundInfluentialde Gelder, B., Van den Stock, J., Meeren, H. K. M., Sinke, C. B. A., Kret, M. E., & Tamietto, M. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.10.008 · Cited by 301
Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis
Grosbras, M., Beaton, S., & Eickhoff, S. B. (2012) · Human Brain Mapping · doi:10.1002/hbm.21222 · Cited by 284
Representations of faces and body parts in macaque temporal cortex: A functional MRI study
Pinsk, M. A., DeSimone, K., Moore, T., Gross, C. G., & Kastner, S. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502605102 · Cited by 279
Neural Representation for the Perception of the Intentionality of Actions
Jellema, T., Baker, C. I., Wicker, B., & Perrett, D. I. (2000) · Brain and Cognition · doi:10.1006/brcg.2000.1231 · Cited by 273
Self-citationView-Based Encoding of Actions in Mirror Neurons of Area F5 in Macaque Premotor Cortex
Caggiano, V., Fogassi, L., Rizzolatti, G., Pomper, J. K., Thier, P., Giese, M. A., & Casile, A. (2011) · Current Biology · doi:10.1016/j.cub.2010.12.022 · Cited by 223
“One possible explanation is that view invariance, although already present in the STS [9, 10], is not completely obtained in this region and, thus, the view-dependent mirror neurons in area F5 play an essential role in the formation of view-invariant representations.”
Anthropomorphism influences perception of computer-animated characters' actions
Chaminade, T., Hodgins, J., & Kawato, M. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm017 · Cited by 181
Attention, biological motion, and action recognition.
Thompson, J., & Parasuraman, R. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.044 · Cited by 155
Exploring Visual–Spatial Working Memory: A Critical Review of Concepts and Models
McAfoose, J., & Baune, B. T. (2009) · Neuropsychology Review · doi:10.1007/s11065-008-9063-0 · Cited by 64
Wible, C. G. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00180 · Cited by 56
Jabbi, M., Kohn, P. D., Nash, T., Ianni, A., Coutlee, C., Holroyd, T., Carver, F. W., Chen, Q., Cropp, B., Kippenhan, J. S., et al. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht427 · Cited by 39
Metadata
- Authors
- Oram, M. W., & Perrett, D. I.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1996-07-01
- Volume
- 76
- Issue
- 1
- Pages
- 109-129
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W1861186579
- Cited by
- 345
- References
- 0
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.