Memory Effects of Speech and Gesture Binding: Cortical and Hippocampal Activation in Relation to Subsequent Memory Performance
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In human face-to-face communication, the content of speech is often illustrated by coverbal gestures. Behavioral evidence suggests that gestures provide advantages in the comprehension and memory of speech. Yet, how the human brain integrates abstract auditory and visual information into a common representation is not known. Our study investigates the neural basis of memory for bimodal speech and gesture representations. In this fMRI study, 12 participants were presented with video clips showing an actor performing meaningful metaphoric gestures (MG), unrelated, free gestures (FG), and no arm and hand movements (NG) accompanying sentences with an abstract content. After the fMRI session, the participants performed a recognition task. Behaviorally, the participants showed the highest hit rate for sentences accompanied by meaningful metaphoric gestures. Despite comparable old/new discrimination performances (d′) for the three conditions, we obtained distinct memory-related left-hemispheric activations in the inferior frontal gyrus (IFG), the premotor cortex (BA 6), and the middle temporal gyrus (MTG), as well as significant correlations between hippocampal activation and memory performance in the metaphoric gesture condition. In contrast, unrelated speech and gesture information (FG) was processed in areas of the left occipito-temporal and cerebellar region and the right IFG just like the no-gesture condition (NG). We propose that the specific left-lateralized activation pattern for the metaphoric speech–gesture sentences reflects semantic integration of speech and gestures. These results provide novel evidence about the neural integration of abstract speech and gestures as it contributes to subsequent memory performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 2×
“Theories about the neural bases of memory binding have focused mainly on interactions between the hippocampus and cortical regions involved in the on-line processing of a stimulus (e.g., Norman & O’Reilly, 2003; Shastri, 2002; Rolls, 2000; Alvarez & Squire, 1994; Eichenbaum, Otto, & Cohen, 1992; Marr, 1971).”
BackgroundAction observation activates premotor and parietal areas in a somatotopic manner: an fMRI study
Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R. J., Zilles, K., Rizzolatti, G., & Freund, H. ‐. (2001) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2001.01385.x · Cited by 2,488
Eichenbaum (2004) · doi:10.1016/j.neuron.2004.08.028 · Cited by 1,464
Norman, K. A., & O'Reilly, R. C. (2003) · Psychological Review · doi:10.1037/0033-295x.110.4.611 · Cited by 1,312
Amunts, K., Kedo, O., Kindler, M., Pieperhoff, P., Mohlberg, H., Shah, N. J., Habel, U., Schneider, F., & Zilles, K. (2005) · Anatomy and Embryology · doi:10.1007/s00429-005-0025-5 · Cited by 1,264 · cited 5×
“The ROIs includes all hippocampal regions (CA, EC, SUB, FD, HATA) of the probability maps defined by Amunts et al. (2005) and the percentages in column ‘‘Prob.’’ refer to the precise probability of the location (anatomical region) of the activation peaks.”
BackgroundMethodInfluentialFrom Conditioning to Conscious Recollection
Eichenbaum, H., & Cohen, N. J. (2004) · doi:10.1093/acprof:oso/9780195178043.001.0001 · Cited by 1,026
Multiple routes to memory: distinct medial temporal lobe processes build item and source memories
Davachi, L., Mitchell, J. P., & Wagner, A. D. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0337195100 · Cited by 899 · cited 1×
“Furthermore, several fMRI studies support the involvement of the IFG in memory encoding for semantic tasks with verbal material (e.g., Henson, Hornberger, & Rugg, 2005; Fletcher, Stephenson, Carpenter, Donovan, & Bullmorel, 2003; Baker, Sanders, Maccotta, & Buckner, 2001; Davachi et al., 2001; Otten et al., 2001; Wagn…”
BackgroundThe hippocampus—what does it do?
Eichenbaum, H., Otto, T., & Cohen, N. J. (1992) · Behavioral and Neural Biology · doi:10.1016/0163-1047(92)90724-i · Cited by 867
Observing the transformation of experience into memory
Paller, K. A., & Wagner, A. D. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01845-3 · Cited by 852 · cited 3×
“…& Rugg, 2003; Casasanto et al., 2002; Strange, Otten, Josephs, Rugg, & Dolan, 2002; Davachi, Maril, & Wagner, 2001; Otten, Henson, & Rugg, 2001; Otten & Rugg, 2001; Kirchhoff, Wagner, Maril, & Stern, 2000; Brewer et al., 1998; Wagner et al., 1998; for a review, see Paller & Wagner, 2002).”
BackgroundHenson, R. N. A., Rugg, M. D., Shallice, T., Josephs, O., & Dolan, R. J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-03962.1999 · Cited by 835 · cited 1×
“... several fMRI studies support the involvement of the IFG in memory encoding for semantic tasks with verbal material (e.g., Henson, Hornberger, & Rugg, 2005; Fletcher, Stephenson, Carpenter, Donovan, & Bullmorel, 2003; Baker, Sanders, Maccotta, & Buckner, 2001; Davachi et al., 2001; Otten et al., 2001; Wagner et al.…”
Background
Cited by
When do gestures communicate? A meta-analysis.
Hostetter, A. B. (2011) · Psychological Bulletin · doi:10.1037/a0022128 · Cited by 558
Özyürek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.4.605 · Cited by 303
Gestures Enhance Foreign Language Learning
Macedonia, M., & Von Kriegstein, K. (2012) · Biolinguistics · doi:10.5964/bioling.8931 · Cited by 104
“In another fMRI study, Straube et al. (2009) investigated memory for speech and gesture representations.”
BackgroundStraube, B. (2012) · Behavioral and Brain Functions · doi:10.1186/1744-9081-8-35 · Cited by 96
Self-citationGesture in the developing brain
Dick, A. S., Goldin‐Meadow, S., Solodkin, A., & Small, S. L. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2011.01100.x · Cited by 60
“, 2008; Martin & Chao, 2001; Price, 2010, for reviews) and gesture (Kircher, Straube, Leube, Weis, Sachs, Willmes, Konrad & Green, 2009; Straube et al., 2011; Straube et al., 2009), and in the storage and representation of action knowledge (Kellenbach, Brett & Patterson, 2003; Lewis, 2006).”
BackgroundInfluential
Metadata
- Authors
- Straube, B., Green, A., Weis, S., Chatterjee, A., & Kircher, T.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press
- Published
- 2009-04-01
- Volume
- 21
- Issue
- 4
- Pages
- 821-836
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W1996761887
- Cited by
- 84
- References
- 13
- FWCI
- 2.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Memory Effects of Speech and Gesture Binding: Cortical and Hippocampal Activation in Relation to Subsequent Memory Performance. https://app.cochat.ai/papers/10.1162/jocn.2009.21053
- The paper
- Straube, B., Green, A., Weis, S., Chatterjee, A., & Kircher, T. (2009). Memory Effects of Speech and Gesture Binding: Cortical and Hippocampal Activation in Relation to Subsequent Memory Performance. Journal of Cognitive Neuroscience. https://doi.org/10.1162/jocn.2009.21053
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.