The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Perspective changes in human listeners are aligned with the contextual transformation of the word embedding space
Abstract
Word embedding representations have been shown to be effective in predicting human neural responses to lingual stimuli. While these representations are sensitive to the textual context, they lack the extratextual sources of context such as prior knowledge, thoughts, and beliefs, all of which constitute the listener’s perspective. In this study, we propose conceptualizing the listeners’ perspective as a source that induces changes in the embedding space. We relied on functional magnetic resonance imaging data collected by Yeshurun Y, Swanson S, Simony E, Chen J, Lazaridi C, Honey CJ, Hasson U. Same story, different story: the neural representation of interpretive frameworks. Psychol Sci. 2017:28(3):307–319, in which two groups of human listeners (n = 40) were listening to the same story but with different perspectives. Using a dedicated fine-tuning process, we created two modified versions of a word embedding space, corresponding to the two groups of listeners. We found that each transformed space was better fitted with neural responses of the corresponding group, and that the spatial distances between these spaces reflect both interpretational differences between the perspectives and the group-level neural differences. Together, our results demonstrate how aligning a continuous embedding space to a specific context can provide a novel way of modeling listeners’ intrinsic perspectives.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Large Language Models (LLMs) have shown success in predicting neural signals associated with narrative processing”
From Incremental accumulation of linguistic context in artificial and biological neural networks (2025) · cites this paper as [9]
In the citing paper
“Previous studies in the neural encoding literature all used LLMs that were only aware of the short-term context, i.e., where the context window size was as large as several tens of words1–10.”
From Incremental accumulation of linguistic context in artificial and biological neural networks (2025) · cites this paper as [9]
In the citing paper
“This was the case even though the participants in these studies were exposed to language stimuli that encompassed hundreds and even thousands of words.”
From Incremental accumulation of linguistic context in artificial and biological neural networks (2025) · cites this paper as [9]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Co-planar stereotaxic atlas of the human brain
Laitinen, L. (1989) · Clinical Neurology and Neurosurgery · doi:10.1016/0303-8467(89)90128-5 · Cited by 7,565
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 1×
“…are massive artificial neural-network-based models of natural language capable of achieving human-level performances in many language tasks, including machine translation, text summarization, sentiment analysis, and more (Wu et al. 2016; Devlin et al. 2018, Peters et al. 2018; Aharoni et al. 2019).”
BackgroundIntersubject synchronization of cortical activity during natural vision
Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004) · Science · doi:10.1126/science.1089506 · Cited by 1,839
Self-citationThe Social Brain: Neural Basis of Social Knowledge
Adolphs, R. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163514 · Cited by 1,827
A primer in BERTology: What we know about how BERT works
Rogers, A., Kovaleva, O., & Rumshisky, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00349 · Cited by 1,552 · cited 1×
“It turns out that the word embedding space effectively encodes many aspects of language, such as syntax, semantics, and pragmatics (Rogers et al. 2020).”
BackgroundOther minds in the brain: a functional imaging study of “theory of mind” in story comprehension.
Fletcher, P. (1995) · Cognition · doi:10.1016/0010-0277(95)00692-r · Cited by 1,522
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504
Proceedings of the 2nd International Conference on Neural Information Processing Systems
Touretzky, D. S. (1989) · Cited by 1,439
Controlling the familywise error rate in functional neuroimaging: a comparative review
Nichols, T., & Hayasaka, S. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm341ra · Cited by 1,218
Learning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,011
The Neural Bases of Social Cognition and Story Comprehension
Mar, R. A. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145406 · Cited by 950 · cited 1×
“…(cheating vs. paranoia) affected the neural responses to the story in areas with a long processing timescale, including the default mode network (DMN; Mars et al. 2012, Yeshurun et al. 2021), and frontal areas related to high-level language processing (Fletcher et al.1995; Adolphs 2009; Mar 2011).”
BackgroundLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
On the relationship between the “default mode network” and the “social brain
Mars, R. B., Neubert, F.-X., Noonan, M. P., Sallet, J., Toni, I., & Rushworth, M. F. S. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00189 · Cited by 766
The default mode network: where the idiosyncratic self meets the shared social world
Yeshurun, Y., Nguyen, M., & Hasson, U. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00420-w · Cited by 682
Self-citationDynamic reconfiguration of the default mode network during narrative comprehension
Simony, E., Honey, C. J., Chen, J., Lositsky, O., Yeshurun, Y., Wiesel, A., & Hasson, U. (2016) · Nature Communications · doi:10.1038/ncomms12141 · Cited by 588
Self-citationThe neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
Shared computational principles for language processing in humans and deep language models
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01026-4 · Cited by 447
Self-citationToward a universal decoder of linguistic meaning from brain activation
Pereira, F., Lou, B., Pritchett, B., Ritter, S., Gershman, S. J., Kanwisher, N., Botvinick, M., & Fedorenko, E. (2018) · Nature Communications · doi:10.1038/s41467-018-03068-4 · Cited by 324
Same Story, Different Story: The Neural Representation of Interpretive Frameworks
Yeshurun, Y., Swanson, S., Simony, E., Chen, J., Lazaridi, C., Honey, C. J., & Hasson, U. (2017) · Psychological Science · doi:10.1177/0956797616682029 · Cited by 300
Self-citationBrain responses to nouns, verbs and class-ambiguous words in context
Federmeier, K. D. (2000) · Brain · doi:10.1093/brain/123.12.2552 · Cited by 228
Language Models are Few-shot Multilingual Learners
Winata, G. I., Madotto, A., Lin, Z., Liu, R., Yosinski, J., & Fung, P. (2021) · Workshop on Multilingual Representation Learning (MRL) · doi:10.18653/v1/2021.mrl-1.1 · Cited by 150
The neural architecture of language: Integrative modeling converges on predictive processing
(2020) · doi:10.1101/2020.06.26.174482 · Cited by 129
Understanding Sentences in Context: What Brain Waves Can Tell Us
Berkum, J. J. A. V. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00609.x · Cited by 118
“Who’s he?” Event-related brain potentials and unbound pronouns
Nieuwland, M. S. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.06.002 · Cited by 71
Goldstein, A., Grinstein-Dabush, A., Schain, M., Wang, H., Hong, Z., Aubrey, B., Nastase, S. A., Zada, Z., Ham, E., Feder, A., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-46631-y · Cited by 64
Self-citationInducing brain-relevant bias in natural language processing modelsPreprint
Schwartz, D., Toneva, M., & Wehbe, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03268 · Cited by 36
Goldstein, A., Grinstein-Dabush, A., Aubrey, B., Schain, M., Nastase, S. A., Zada, Z., Ham, E., Hong, Z., Feder, A., Gazula, H., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.03.01.482586 · Cited by 6
Self-citationA Cognitive Neuroscience Perspective on Language Comprehension in Context
Berkum, J. J. A. V., & Nieuwland, M. S. (2019) · The MIT Press eBooks · doi:10.7551/mitpress/10841.003.0037 · Cited by 3
CoreLM: Coreference-aware Language Model Fine-Tuning
Stylianou, N., & Vlahavas, I. P. (2021) · Workshop on Computational Models of Reference, Anaphora and Coreference (CRAC) · doi:10.18653/v1/2021.crac-1.8 · Cited by 2
Research works printed but not linked: 2
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
- The Journal of Machine Learning Research
Cited by
Large language models predict human sensory judgments across six modalities
Marjieh, R., Sucholutsky, I., van Rijn, P., Jacoby, N., & Griffiths, T. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-72071-1 · Cited by 73
Incremental accumulation of linguistic context in artificial and biological neural networks
Tikochinski, R., Goldstein, A., Meiri, Y., Hasson, U., & Reichart, R. (2025) · Nature Communications · doi:10.1038/s41467-025-56162-9 · Cited by 24
Self-citation
Metadata
- Authors
- Tikochinski, R., Goldstein, A., Yeshurun, Y., Hasson, U., & Reichart, R.
- Affiliations
- Technion – Israel Institute of Technology (IL)
- Princeton University (US)
- Tel Aviv University (IL)
- Corresponding author
- Tikochinski, Refael
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-03-20
- Volume
- 33
- Issue
- 12
- Pages
- 7830-7842
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W4327893302
- Cited by
- 14
- References
- 39
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 3 · 2023: 3
- FWCI
- 1.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- word embeddings, listener perspective, contextualized word representations, interpretive frameworks, narrative comprehension
- MeSH terms
- Auditory Perception, Humans, Speech Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.