The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index.
When Language Meets Action: The Neural Integration of Gesture and Speech
Open accessAbstract
Although generally studied in isolation, language and action often co-occur in everyday life. Here we investigated one particular form of simultaneous language and action, namely speech and gestures that speakers use in everyday communication. In a functional magnetic resonance imaging study, we identified the neural networks involved in the integration of semantic information from speech and gestures. Verbal and/or gestural content could be integrated easily or less easily with the content of the preceding part of speech. Premotor areas involved in action observation (Brodmann area [BA] 6) were found to be specifically modulated by action information "mismatching" to a language context. Importantly, an increase in integration load of both verbal and gestural information into prior speech context activated Broca's area and adjacent cortex (BA 45/47). A classical language area, Broca's area, is not only recruited for language-internal processing but also when action observation is integrated with speech. These findings provide direct evidence that action and language processing share a high-level neural integration system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Co-planar stereotaxic atlas of the human brain
Laitinen, L. (1989) · Clinical Neurology and Neurosurgery · doi:10.1016/0303-8467(89)90128-5 · Cited by 7,565
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity
Kutas, M., & Hillyard, S. A. (1980) · Science · doi:10.1126/science.7350657 · Cited by 4,888
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 4×
“Comparison with a cytoarchitectonic probability map of BA 45 (Amunts et al. 1999; Eickhoff et al. 2005), showed that 82% of the voxels in this region were part of BA 45 with its center of gravity ([x y z] [–46 23 25] (Talairach and Tournoux 1988) having a probability of 60% to be part of BA 45.”
MethodInfluentialGesture Visible Action as Utterance
Kendon, A. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807572 · Cited by 3,891
Neurophysiological mechanisms underlying the understanding and imitation of action
Rizzolatti, G., Fogassi, L., & Gallese, V. (2001) · Nature Reviews Neuroscience · doi:10.1038/35090060 · Cited by 3,302
Research works printed but not linked: 4
- Bosman, 2005, Sharpening Occam's razor: is there need for a hand-signing stage prior to vocal communication?, Behav Brain Sci, 28, 128, 10.1017/S0140525X05250033 · doi:10.1017/s0140525x05250033
- Dale, 1999, Optimal experimental design for event-related fMRI, Hum Brain Mapp, 8, 109, 10.1002/(SICI)1097-0193(1999)8:2/3<109::AID-HBM7>3.0.CO;2-W · doi:10.1002/(sici)1097-0193(1999)8:2/3<109::aid-hbm7>3.0.co;2-w
- Holle, 2006, Dynamic co-speech gestures may be used as disambiguation cues: ERP evidence, J Cogn Neurosci (Suppl), 18, 221
- Kutas, 1994, Psycholinguistics electrified: event-related brain potential investigations, 83
Cited by
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
ALE meta-analysis of action observation and imitation in the human brain
Caspers, S., Zilles, K., Laird, A. R., & Eickhoff, S. B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.112 · Cited by 1,386
Two Sides of the Same Coin: Speech and Gesture Mutually Interact to Enhance Comprehension
Kelly, S. D., Özyürek, A., & Maris, E. (2010) · Psychological Science · doi:10.1177/0956797609357327 · Cited by 669
Self-citationThe Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression
Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000865 · Cited by 618
MUC (Memory, Unification, Control) and beyond
Hagoort, P. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00416 · Cited by 427
Self-citationThe Neurobiology of Language Beyond Single Words
Hagoort, P., & Indefrey, P. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-013847 · Cited by 407
Self-citationNeural evidence for the interplay between language, gesture, and action: A review
Willems, R. M., & Hagoort, P. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.03.004 · Cited by 393
Self-citationThe origin of human multi-modal communication
Levinson, S. C., & Holler, J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0302 · Cited by 385
Broca's Region: Novel Organizational Principles and Multiple Receptor Mapping
Amunts, K., Lenzen, M., Friederici, A. D., Schleicher, A., Morosan, P., Palomero-Gallagher, N., & Zilles, K. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000489 · Cited by 357
“Activations in the vicinity of areas 44 and 45 have been reported not only in language, but also in motor tasks [13,19], in experiments focusing on the integration of semantic information from speech and gestures [43], and other tasks requiring cognitive control [44,45].”
BackgroundHagoort, P., & van Berkum, J. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2089 · Cited by 338
Self-citationÖzyürek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.4.605 · Cited by 303
Self-citationBrief training with co-speech gesture lends a hand to word learning in a foreign language
Kelly, S. D., McDevitt, T., & Esch, M. (2009) · Language and Cognitive Processes · doi:10.1080/01690960802365567 · Cited by 282
Symbolic gestures and spoken language are processed by a common neural system
Xu, J., Gannon, P. J., Emmorey, K., Smith, J. F., & Braun, A. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0909197106 · Cited by 275
Speech-associated gestures, Broca’s area, and the human mirror system
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.02.008 · Cited by 252
Processing language in face-to-face conversation: Questions with gestures get faster responses
Holler, J., Kendrick, K. H., & Levinson, S. C. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1363-z · Cited by 167
The core and beyond in the language-ready brain
Hagoort, P. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.01.048 · Cited by 150
Self-citationN400 ERPs for actions: building meaning in context
Amoruso, L., Gelormini, C., Aboitiz, F., Alvarez González, M., Manes, F., Cardona, J. F., & Ibanez, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00057 · Cited by 125
“Consistent with these findings, recent work on language and gesture processing (Willems et al., 2007; Holle et al., 2008; Dick et al., 2009; Hubbard et al., 2009; Kircher et al., 2009) also points to the engagement of temporal areas (STS, STG, MTG), inferior parietal (AG), IFG, and premotor regions in the interplay of…”
ResultMenenti, L., Petersson, K. M., Scheeringa, R., & Hagoort, P. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.21163 · Cited by 114
“It also integrates linguistic with nonlinguistic information, including, for example, world knowledge (Hagoort et al., 2004) or gestures (Willems, Ozyurek, & Hagoort, 2007).”
Willems, R. M., Özyürek, A., & Hagoort, P. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20085 · Cited by 102
Self-citationGestures Enhance Foreign Language Learning
Macedonia, M., & Von Kriegstein, K. (2012) · Biolinguistics · doi:10.5964/bioling.8931 · Cited by 104
“In a study by Willems et al. (2007) investigating the neural integration of speech and action, the authors used a mismatch paradigm.”
MethodGesture Facilitates the Syntactic Analysis of Speech
Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., & Gunter, T. C. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00074 · Cited by 70
Gesture in the developing brain
Dick, A. S., Goldin‐Meadow, S., Solodkin, A., & Small, S. L. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2011.01100.x · Cited by 60
“Thus, with age, left STSp increases activity in response to hand movements, but the meaning does not moderate the amount of activity (see Willems et al., 2007, 2009, for complementary findings).”
BackgroundNeural basis of emotion recognition deficits in first-episode major depression
van Wingen, G. A., van Eijndhoven, P., Tendolkar, I., Buitelaar, J., Verkes, R. J., & Fernández, G. (2011) · Psychological Medicine · doi:10.1017/s0033291710002084 · Cited by 50
Speech-accompanying gestures are not processed by the language-processing mechanisms
Jouravlev, O., Zheng, D., Balewski, Z., Le Arnz Pongos, A., Levan, Z., Goldin-Meadow, S., & Fedorenko, E. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107132 · Cited by 39
Kelly, S. D., Hirata, Y., Manansala, M., & Huang, J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00673 · Cited by 37
Metadata
- Authors
- Willems, R. M., Özyürek, A., & Hagoort, P.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-12-11
- Volume
- 17
- Issue
- 10
- Pages
- 2322-2333
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2106075805
- Cited by
- 342
- References
- 109
- FWCI
- 23.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.