The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Symbolic gestures and spoken language are processed by a common neural system
Open accessAbstract
Symbolic gestures, such as pantomimes that signify actions (e.g., threading a needle) or emblems that facilitate social transactions (e.g., finger to lips indicating “be quiet”), play an important role in human communication. They are autonomous, can fully take the place of words, and function as complete utterances in their own right. The relationship between these gestures and spoken language remains unclear. We used functional MRI to investigate whether these two forms of communication are processed by the same system in the human brain. Responses to symbolic gestures, to their spoken glosses (expressing the gestures' meaning in English), and to visually and acoustically matched control stimuli were compared in a randomized block design. General Linear Models (GLM) contrasts identified shared and unique activations and functional connectivity analyses delineated regional interactions associated with each condition. Results support a model in which bilateral modality-specific areas in superior and inferior temporal cortices extract salient features from vocal-auditory and gestural-visual stimuli respectively. However, both classes of stimuli activate a common, left-lateralized network of inferior frontal and posterior temporal regions in which symbolic gestures and spoken words may be mapped onto common, corresponding conceptual representations. We suggest that these anterior and posterior perisylvian areas, identified since the mid-19th century as the core of the brain's language system, are not in fact committed to language processing, but may function as a modality-independent semiotic system that plays a broader role in human communication, linking meaning with symbols whether these are words, gestures, images, sounds, or objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme
Gould, S. J., & Lewontin, R. C. (1979) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1979.0086 · Cited by 7,770
The cortical organization of speech processing
Hickok, G., & Poeppel, D. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2113 · Cited by 5,495 · cited 1×
“An earlier, related model accounted for mapping of sound and meaning in the processing of spoken language (32).”
BackgroundMaldjian, J. A., Laurienti, P. J., Kraft, R. A., & Burdette, J. H. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00169-1 · Cited by 5,085
Eco, U. (1976) · Indiana University Press eBooks · doi:10.1007/978-1-349-15849-2 · Cited by 2,899
Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858
The spatial and temporal signatures of word production components
Indefrey, P., & Levelt, W. J. M. (2004) · Cognition · doi:10.1016/j.cognition.2002.06.001 · Cited by 2,144
Role of left inferior prefrontal cortex in retrieval of semantic knowledge: A reevaluation
Thompson-Schill, S. L., D’Esposito, M., Aguirre, G. K., & Farah, M. J. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.26.14792 · Cited by 2,121
A cortical network for semantics: (de)constructing the N400
Lau, E. F., Phillips, C., & Poeppel, D. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2532 · Cited by 1,700
Broca, P. P. (1861) · MPG.PuRe (Max Planck Society) · Cited by 1,600
The Representation of Object Concepts in the Brain
Martin, A. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190143 · Cited by 1,591
Bookheimer, S. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142946 · Cited by 1,450
On Broca, brain, and binding: A new framework
Hagoort, P. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.07.004 · Cited by 1,411 · cited 2×
“19) and may play a more domain-general role in rule-based selection (20), retrieval of meaningful items from a field of competing alternatives (21), and subsequent unification or binding processes in which items are integrated into a broader semantic context (22).”
BackgroundNatural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
Brain activity during observation of actions. Influence of action content and subject's strategy
Decety, J. (1997) · Brain · doi:10.1093/brain/120.10.1763 · Cited by 942
McNeill, D. (2011) · Advances in Visual Semiotics · doi:10.1515/9783110874259.351 · Cited by 927
Eight problems for the mirror neuron theory of action understanding in monkeys and humans
Hickok, G. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21189 · Cited by 887
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Babbling in the manual mode: evidence for the ontogeny of language
Petitto, L. A., & Marentette, P. F. (1991) · Science · doi:10.1126/science.2006424 · Cited by 764
Piattelli-Palmarini, M. (1989) · Cognition · doi:10.1016/0010-0277(89)90016-4 · Cited by 610
Primate Communication and the Gestural Origin of Language
Hewes, G. W. (1992) · Current Anthropology · doi:10.1086/204019 · Cited by 602
Petitto, L. A., Zatorre, R. J., Gauna, K., Nikelski, E. J., Dostie, D., & Evans, A. C. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.25.13961 · Cited by 505
A functional imaging study of translation and language switching
Price, C. J., Green, D. W., & von Studnitz, R. (1999) · Brain · doi:10.1093/brain/122.12.2221 · Cited by 435
Damasio, A. R. (1992) · New England Journal of Medicine · doi:10.1056/nejm199202203260806 · Cited by 430
Language, gesture, and the developing brain
Bates, E., & Dick, F. (2002) · Developmental Psychobiology · doi:10.1002/dev.10034 · Cited by 419
Renewal of the Neurophysiology of Language: Functional Neuroimaging
Démonet, J.-F., Thierry, G., & Cardebat, D. (2005) · Physiological Reviews · doi:10.1152/physrev.00049.2003 · Cited by 418
Neural evidence for the interplay between language, gesture, and action: A review
Willems, R. M., & Hagoort, P. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.03.004 · Cited by 393
Goldin-Meadow, S., Mylander, C., de Villiers, J., Bates, E., & Volterra, V. (1984) · Monographs of the Society for Research in Child Development · doi:10.2307/1165838 · Cited by 386
From mouth to hand: Gesture, speech, and the evolution of right-handedness
Corballis, M. C. (2003) · Behavioral and Brain Sciences · doi:10.1017/s0140525x03000062 · Cited by 357
How gestures can become like words.
Kendon, A. (1988) · Cited by 357
When Language Meets Action: The Neural Integration of Gesture and Speech
Willems, R. M., Özyürek, A., & Hagoort, P. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl141 · Cited by 342
The signing brain: the neurobiology of sign language
MacSweeney, M., Capek, C. M., Campbell, R., & Woll, B. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.07.010 · Cited by 331
Petitto, L. A. (1987) · Cognition · doi:10.1016/0010-0277(87)90034-5 · Cited by 326
Listening to talking faces: motor cortical activation during speech perception
Skipper, J. I., Nusbaum, H. C., & Small, S. L. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.11.006 · Cited by 324
Aphasia: Progress in the last quarter of a century
Hillis, A. E. (2007) · Neurology · doi:10.1212/01.wnl.0000265600.69385.6f · Cited by 312
The Development of Language-Like Communication Without a Language Model
Goldin-Meadow, S., & Feldman, H. (1977) · Science · doi:10.1126/science.877567 · Cited by 301
Delineation of single‐word semantic comprehension deficits in aphasia, with anatomical correlation
Hart, J., & Gordon, B. (1990) · Annals of Neurology · doi:10.1002/ana.410270303 · Cited by 282
Speech and gesture share the same communication system
Bernardis, P., & Gentilucci, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.05.007 · Cited by 263
Speech-associated gestures, Broca’s area, and the human mirror system
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.02.008 · Cited by 252
Rogalsky, C., & Hickok, G. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn126 · Cited by 236
Semantic systems or system? Neuropsychological evidence re-examined
Riddoch, M. J., Humphreys, G. W., Coltheart, M., & Funnell, E. (1988) · Cognitive Neuropsychology · doi:10.1080/02643298808252925 · Cited by 232
Neural correlates of the processing of co-speech gestures
Holle, H., Gunter, T. C., Rüschemeyer, S.-A., Hennenlotter, A., & Iacoboni, M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.055 · Cited by 205
Language perception and production
Allport, A., MacKay, D. G., Prinz, W., & Scheerer, E. (1987) · Max Planck Digital Library · Cited by 199
Neural resources for processing language and environmental sounds: Evidence from aphasia
Saygin, A. P. (2003) · Brain · doi:10.1093/brain/awg082 · Cited by 184
Comprehension of symbolic gestures in aphasia
Gainotti, G., & Lemmo, M. A. (1976) · Brain and Language · doi:10.1016/0093-934x(76)90039-0 · Cited by 183
Gallagher, H. L., & Frith, C. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.006 · Cited by 180
Neural basis of pantomiming the use of visually presented objects
Rumiati, R. I., Weiss, P. H., Shallice, T., Ottoboni, G., Noth, J., Zilles, K., & Fink, G. R. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.017 · Cited by 173
The relation between gesture and language in aphasic communication
Cicone, M., Wapner, W., Foldi, N., Zurif, E., & Gardner, H. (1979) · Brain and Language · doi:10.1016/0093-934x(79)90060-9 · Cited by 167
Pantomime Recognition in Aphasics
Duffy, R. J., Duffy, J. R., & Pearson, K. L. (1975) · Journal of Speech and Hearing Research · doi:10.1044/jshr.1801.115 · Cited by 141
Differential cerebral activation during observation of expressive gestures and motor acts
Lotze, M., Heymans, U., Birbaumer, N., Veit, R., Erb, M., Flor, H., & Halsband, U. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.016 · Cited by 141
Gitelman, D. R., Nobre, A. C., Sonty, S., Parrish, T. B., & Mesulam, M.-M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.014 · Cited by 138 · cited 1×
“It has been proposed that the pMTG is the site where lexical representations may be stored (24, 25), but there is evidence that it is engaged in more general manipulation of nonlinguistic stimuli as well (e.”
BackgroundImpact of modality and linguistic complexity during reading and listening tasks
Jobard, G., Vigneau, M., Mazoyer, B., & Tzourio-Mazoyer, N. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.067 · Cited by 134
The neural substrate of gesture recognition
Villarreal, M. F., Fridman, E. A., Amengual, A., Falasco, G., Gerscovich, E. R., Ulloa, E. R., & Leiguarda, R. C. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.03.004 · Cited by 129
Toni, I., de Lange, F. P., Noordzij, M. L., & Hagoort, P. (2008) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2008.03.005 · Cited by 123
The neural basis for novel semantic categorization
Koenig, P. L., Smith, E. E., Glosser, G., DeVita, C., Moore, P., McMillan, C. T., Gee, J., & Grossman, M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.045 · Cited by 102
Communicating hands: ERPs elicited by meaningful symbolic hand postures
Gunter, T. C., & Bach, P. (2004) · Neuroscience Letters · doi:10.1016/j.neulet.2004.09.011 · Cited by 100
The phoneme as a perceptuomotor structure.
Studdert‐Kennedy, M. (1987) · Cited by 97
Montgomery, K. J., & Haxby, J. V. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20127 · Cited by 96
Neural correlates of human action observation in hearing and deaf subjects
Corina, D. P., Chiu, Y.-S., Knapp, H. P., Greenwald, R. R., Jose-Robertson, L. S., & Braun, A. R. (2007) · Brain Research · doi:10.1016/j.brainres.2007.03.054 · Cited by 92
Self-citationPantomime, praxis, and aphasia
Wang, L., & Goodglass, H. (1992) · Brain and Language · doi:10.1016/0093-934x(92)90076-q · Cited by 91
Cross-Cultural Perspectives in Nonverbal Communication
Yamamoto, J. (1990) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199006000-00014 · Cited by 90
Emmorey, K. D., Xu, J., Gannon, P. J., Goldin-Meadow, S., & Braun, A. R. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.001 · Cited by 86
Self-citationOkada, K., & Hickok, G. S. (2009) · Neuroscience Letters · doi:10.1016/j.neulet.2009.01.060 · Cited by 75
Primate Cognition: Introduction to the Issue
Tomasello, M. (2000) · Cognitive Science · doi:10.1207/s15516709cog2403_1 · Cited by 60
Gesture Recognition in Patients with Aphasia
Daniloff, J. K., Noll, J. D., Fristoe, M., & Lloyd, L. L. (1982) · Journal of Speech and Hearing Disorders · doi:10.1044/jshd.4701.43 · Cited by 36
The effects of focal brain damage on pragmatic expression.
Bates, E. A., Hamby, S., & Zurif, E. (1983) · Canadian Journal of Psychology/Revue Canadienne de Psychologie · doi:10.1037/h0080695 · Cited by 36
Observing social gestures: an fMRI study
Knutson, K. M., McClellan, E. M., & Grafman, J. H. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1352-6 · Cited by 27
Cited by
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Eight problems for the mirror neuron theory of action understanding in monkeys and humans
Hickok, G. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21189 · Cited by 887
Stone tools, language and the brain in human evolution
Stout, D., & Chaminade, T. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0099 · Cited by 329
Current trends in stroke rehabilitation. A review with focus on brain plasticity
Johansson, B. B. (2011) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.2010.01417.x · Cited by 282
Left Brain, Right Brain: Facts and Fantasies
Corballis, M. C. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001767 · Cited by 276
Metadata
- Authors
- Xu, J., Gannon, P. J., Emmorey, K., Smith, J. F., & Braun, A. R.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2009-12-08
- Volume
- 106
- Issue
- 49
- Pages
- 20664-20669
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2020545859
- Cited by
- 275
- References
- 67
- FWCI
- 7.77
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.