Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Previous research has demonstrated a link between language and action in the brain. The present study investigates the strength of this neural relationship by focusing on a potential interface between the two systems: cospeech iconic gesture. Participants performed a Stroop-like task in which they watched videos of a man and a woman speaking and gesturing about common actions. The videos differed as to whether the gender of the speaker and gesturer was the same or different and whether the content of the speech and gesture was congruent or incongruent. The task was to identify whether a man or a woman produced the spoken portion of the videos while accuracy rates, RTs, and ERPs were recorded to the words. Although not relevant to the task, participants paid attention to the semantic relationship between the speech and the gesture, producing a larger N400 to words accompanied by incongruent versus congruent gestures. In addition, RTs were slower to incongruent versus congruent gesture–speech stimuli, but this effect was greater when the gender of the gesturer and speaker was the same versus different. These results suggest that the integration of gesture and speech during language comprehension is automatic but also under some degree of neurocognitive control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433 · cited 1×
“This interest is fueled by the discovery that language shares neural substrates that are involved in more basic processes such as the production and the perception of action (Nishitani, Schurmann, Amunts, & Hari, 2005; Rizzolatti & Craighero, 2004; Rizzolatti & Arbib, 1998).,This inferior frontal region is in an inter…”
BackgroundControlled and automatic human information processing: I. Detection, search, and attention.
Schneider, W., & Shiffrin, R. M. (1977) · Psychological Review · doi:10.1037/0033-295x.84.1.1 · Cited by 5,902
Half a century of research on the Stroop effect: An integrative review.
MacLeod, C. M. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.2.163 · Cited by 5,500
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
A new method for off-line removal of ocular artifact
Gratton, G., Coles, M. G. H., & Donchin, E. (1983) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(83)90135-9 · Cited by 5,055
Cattaneo, L., & Rizzolatti, G. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.41 · Cited by 3,137
Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858
McNeill, D. (2005) · doi:10.7208/chicago/9780226514642.001.0001 · Cited by 2,157 · cited 1×
“pany speech and convey visual information about object attributes, spatial relationships, and movements (McNeill, 2005; Kendon, 2004; Goldin-Meadow, 2003; Clark, 1996).”
BackgroundGrasping the intentions of others with one's own mirror neuron system
Iacoboni, M., Molnar-Szakacs, I., Gallese, V., Buccino, G., Mazziotta, J. C., & Rizzolatti, G. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030079 · Cited by 2,044
Integration of word meaning and world knowledge in language comprehension
Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. (2004) · Science · doi:10.1126/science.1095455 · Cited by 1,396
Cited by
The Neural Integration of Speaker and Message
Van Berkum, J. J. A., van den Brink, D., Tesink, C. M. J. Y., Kos, M., & Hagoort, P. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20054 · Cited by 516
N400 ERPs for actions: building meaning in context
Amoruso, L., Gelormini, C., Aboitiz, F., Alvarez González, M., Manes, F., Cardona, J. F., & Ibanez, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00057 · Cited by 125
“In addition, under some circumstances (e.g., when explicit instructions about whether to integrate gestures and speech are given), this semantic processing is likely to be under a certain degree of cognitive control (Kelly et al., 2010).”
BackgroundGestures Enhance Foreign Language Learning
Macedonia, M., & Von Kriegstein, K. (2012) · Biolinguistics · doi:10.5964/bioling.8931 · Cited by 104
“Modulation by attention was recently investigated in a stroop task experiment (Kelly et al. 2010).”
BackgroundWillems, R. M., Özyürek, A., & Hagoort, P. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20085 · Cited by 102
Gesture Facilitates the Syntactic Analysis of Speech
Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., & Gunter, T. C. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00074 · Cited by 70
Metadata
- Authors
- Kelly, S. D., Creigh, P., & Bartolotti, J.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2010-04-01
- Volume
- 22
- Issue
- 4
- Pages
- 683-694
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2161540120
- Cited by
- 134
- References
- 17
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing. https://app.cochat.ai/papers/10.1162/jocn.2009.21254
- The paper
- Kelly, S. D., Creigh, P., & Bartolotti, J. (2010). Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing. Journal of Cognitive Neuroscience. https://doi.org/10.1162/jocn.2009.21254
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.