Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
We introduce an approach that predicts neural representations of word meanings contained in sentences then superposes these to predict neural representations of new sentences. A neurobiological semantic model based on sensory, motor, social, emotional, and cognitive attributes was used as a foundation to define semantic content. Previous studies have predominantly predicted neural patterns for isolated words, using models that lack neurobiological interpretation. Fourteen participants read 240 sentences describing everyday situations while undergoing fMRI. To connect sentence-level fMRI activation patterns to the word-level semantic model, we devised methods to decompose the fMRI data into individual words. Activation patterns associated with each attribute in the model were then estimated using multiple-regression. This enabled synthesis of activation patterns for trained and new words, which were subsequently averaged to predict new sentences. Region-of-interest analyses revealed that prediction accuracy was highest using voxels in the left temporal and inferior parietal cortex, although a broad range of regions returned statistically significant results, showing that semantic information is widely distributed across the brain. The results show how a neurobiologically motivated semantic model can decompose sentence-level fMRI data into activation features for component words, which can be recombined to predict activation patterns for new sentences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940 · cited 1×
“It is now well established that different categories of visual stimuli (e.g., pictures of objects) are represented in the brain as spatially distributed neural activity patterns, with overlapping activation across categories (Haxby et al. 2001; Mitchell et al. 2008; Huth et al. 2012).”
BackgroundWhere do you know what you know? The representation of semantic knowledge in the human brain
Patterson, K., Nestor, P. J., & Rogers, T. T. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2277 · Cited by 2,706 · cited 1×
“This was motivated by theories that consider the anterior temporal lobe to play a central role in conceptual representation (e.g., Patterson et al. 2007) and furthermore by theories that it is central to conceptual combination (Bemis and Pylkkänen 2012; Brennan and Pylkkänen 2012; Westerlund and…”
The neurobiology of semantic memory
Binder, J. R., & Desai, R. H. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.10.001 · Cited by 2,114
Self-citationNatural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504 · cited 3×
“…2012; Silbert et al. 2014), almost all studies using models to predict neural semantic representations have focused on isolated concrete nouns (exceptions are Chang et al. 2009, Wehbe et al. 2014; and Huth et al. 2016; we return to differences between the current study and these in Discussion).”
BackgroundMethodPredicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180 · cited 9×
“In the first study of this kind, Mitchell et al. (2008) used word co-occurrence statistics derived from a large text corpus to model semantic content.”
BackgroundMethodInfluentialLesion analysis of the brain areas involved in language comprehension
Dronkers, N. F., Wilkins, D. P., Van Valin, R. D., Redfern, B. B., & Jaeger, J. J. (2004) · Cognition · doi:10.1016/j.cognition.2003.11.002 · Cited by 1,035 · cited 2×
“…et al. 2008; Binder et al. 2009; Friederici 2011; Pulvermüller 2013; Humphries et al. 2007; Pallier et al. 2011; Honey et al. 2012; Silbert et al. 2014), and lesions in this region are known to disrupt sentence processing (Dronkers et al. 2004; Magnusdottir et al. 2013; Thothathiri et al. 2012).”
BackgroundUsing Imagination to Understand the Neural Basis of Episodic Memory
Hassabis, D., Kumaran, D., & Maguire, E. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4549-07.2007 · Cited by 744 · cited 1×
“…in the current article does not account for detailed aspects of experiential simulation (such as mental imagery) that may be invoked in conceptual tasks (e.g. Louwerse and Hutchinson 2012), episodic memory (e.g. Hassabis et al. 2007), inferences and theory-of-mind (Hagoort and Indefrey 2014).”
BackgroundCortical representation of the constituent structure of sentences
Pallier, C., Devauchelle, A.-D., & Dehaene, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1018711108 · Cited by 691 · cited 6×
“Previous work has linked all of these regions with semantic and syntactic processes (e.g., Lau et al. 2008; Binder et al. 2009; Friederici 2011; Pulvermüller 2013; Humphries et al. 2007; Pallier et al. 2011; Honey et al. 2012; Silbert et al. 2014), and lesions in this region are known to disrupt sentence processing (D…”
BackgroundResultInfluentialHow neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics
Pulvermüller, F. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.004 · Cited by 631 · cited 4×
“…that (1) supported accurate predictions in the preceding analyses; (2) are frequently implicated in conceptual tasks; and (3) are spatially spread across the network of regions commonly implicated in semantic tasks (as per Lau et al. 2008; Binder et al. 2009; Friederici 2011; Pulvermüller 2013).”
BackgroundInfluential
Cited by
Broderick, M. P., Anderson, A. J., Di Liberto, G. M., Crosse, M. J., & Lalor, E. C. (2018) · Current Biology · doi:10.1016/j.cub.2018.01.080 · Cited by 421
Self-citationToward a universal decoder of linguistic meaning from brain activation
Pereira, F., Lou, B., Pritchett, B., Ritter, S., Gershman, S. J., Kanwisher, N., Botvinick, M., & Fedorenko, E. (2018) · Nature Communications · doi:10.1038/s41467-018-03068-4 · Cited by 324
The revolution will not be controlled: natural stimuli in speech neuroscience
Hamilton, L. S., & Huth, A. G. (2020) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2018.1499946 · Cited by 301
Anderson, A. J., Kiela, D., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Raizada, R. D. S., Grimm, S., & Lalor, E. C. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.1152-20.2021 · Cited by 70
Self-citationThe Language Network Is Recruited but Not Required for Nonverbal Event Semantics
Ivanova, A. A., Mineroff, Z., Zimmerer, V., Kanwisher, N., Varley, R., & Fedorenko, E. (2021) · Neurobiology of Language · doi:10.1162/nol_a_00030 · Cited by 65
Metadata
- Authors
- Anderson, A. J., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Aguilar, M., Wang, X., Doko, D., & Raizada, R. D. S.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-08-12
- Volume
- 27
- Issue
- 9
- Pages
- 4379-4395
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2511593322
- Cited by
- 102
- References
- 18
- FWCI
- 8.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation. https://app.cochat.ai/papers/10.1093/cercor/bhw240
- The paper
- Anderson, A. J., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Aguilar, M., Wang, X., Doko, D., & Raizada, R. D. S. (2016). Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation. Cerebral Cortex. https://doi.org/10.1093/cercor/bhw240
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.