Two Neurocognitive Mechanisms of Semantic Integration during the Comprehension of Visual Real-world Events
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
How do comprehenders build up overall meaning representations of visual real-world events? This question was examined by recording event-related potentials (ERPs) while participants viewed short, silent movie clips depicting everyday events. In two experiments, it was demonstrated that presentation of the contextually inappropriate information in the movie endings evoked an anterior negativity. This effect was similar to the N400 component whose amplitude has been previously reported to inversely correlate with the strength of semantic relationship between the context and the eliciting stimulus in word and static picture paradigms. However, a second, somewhat later, ERP component—a posterior late positivity—was evoked specifically when target objects presented in the movie endings violated goal-related requirements of the action constrained by the scenario context (e.g., an electric iron that does not have a sharp-enough edge was used in place of a knife in a cutting bread scenario context). These findings suggest that comprehension of the visual real world might be mediated by two neurophysiologically distinct semantic integration mechanisms. The first mechanism, reflected by the anterior N400-like negativity, maps the incoming information onto the connections of various strengths between concepts in semantic memory. The second mechanism, reflected by the posterior late positivity, evaluates the incoming information against the discrete requirements of real-world actions. We suggest that there may be a tradeoff between these mechanisms in their utility for integrating across people, objects, and actions during event comprehension, in which the first mechanism is better suited for familiar situations, and the second mechanism is better suited for novel situations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
On Methods in the Analysis of Profile Data
Greenhouse, S. W., & Geisser, S. (1959) · Psychometrika · doi:10.1007/bf02289823 · Cited by 4,937
Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity
Kutas, M., & Hillyard, S. A. (1980) · Science · doi:10.1126/science.7350657 · Cited by 4,888
Is the P300 component a manifestation of context updating?
Donchin, E., & Coles, M. G. H. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058027 · Cited by 3,585
Brain potentials during reading reflect word expectancy and semantic association
Kutas, M., & Hillyard, S. A. (1984) · Nature · doi:10.1038/307161a0 · Cited by 2,218
Dale, A. M., & Sereno, M. I. (1993) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1993.5.2.162 · Cited by 2,003
Event-related brain potentials elicited by syntactic anomaly
Osterhout, L., & Holcomb, P. J. (1992) · Journal of Memory and Language · doi:10.1016/0749-596x(92)90039-z · Cited by 1,856
Self-citationA cortical network for semantics: (de)constructing the N400
Lau, E. F., Phillips, C., & Poeppel, D. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2532 · Cited by 1,700
Bower, G. H., Black, J. B., & Turner, T. J. (1979) · Cognitive Psychology · doi:10.1016/0010-0285(79)90009-4 · Cited by 1,574
Cited by
Kutas, M., & Federmeier, K. D. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.131123 · Cited by 4,377
A cortical network for semantics: (de)constructing the N400
Lau, E. F., Phillips, C., & Poeppel, D. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2532 · Cited by 1,700
Neural mechanisms of language comprehension: Challenges to syntax
Kuperberg, G. R. (2007) · Brain Research · doi:10.1016/j.brainres.2006.12.063 · Cited by 1,041
Self-citationHasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
The P3b and P600(s): Positive contributions to language comprehension
Leckey, M., & Federmeier, K. D. (2020) · Psychophysiology · doi:10.1111/psyp.13351 · Cited by 160
N400 ERPs for actions: building meaning in context
Amoruso, L., Gelormini, C., Aboitiz, F., Alvarez González, M., Manes, F., Cardona, J. F., & Ibanez, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00057 · Cited by 125
“…activity elicited by action-related anomalous stimuli begins early, approximately at 250–300 ms post-stimulus onset; perhaps reflecting the rapid access that realistic visual images have to semantic memory networks (West and Holcomb, 2002; Sitnikova et al., 2003, 2008; Mudrik et al., 2010).”
BackgroundMethodResultInfluentialThe Language Network Is Recruited but Not Required for Nonverbal Event Semantics
Ivanova, A. A., Mineroff, Z., Zimmerer, V., Kanwisher, N., Varley, R., & Fedorenko, E. (2021) · Neurobiology of Language · doi:10.1162/nol_a_00030 · Cited by 65
Metadata
- Authors
- Sitnikova, T., Holcomb, P. J., Kiyonaga, K. A., & Kuperberg, G. R.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press
- Published
- 2008-11-01
- Volume
- 20
- Issue
- 11
- Pages
- 2037-2057
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2108527697
- Cited by
- 261
- References
- 64
- FWCI
- 5.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.