The DOI matches its Crossref record; 194 of the 194 references it cites were found in a registry or an index.
Vector-Space Models of Semantic Representation From a Cognitive Perspective: A Discussion of Common Misconceptions
Open accessAbstract
Models that represent meaning as high-dimensional numerical vectors—such as latent semantic analysis (LSA), hyperspace analogue to language (HAL), bound encoding of the aggregate language environment (BEAGLE), topic models, global vectors (GloVe), and word2vec—have been introduced as extremely powerful machine-learning proxies for human semantic representations and have seen an explosive rise in popularity over the past 2 decades. However, despite their considerable advancements and spread in the cognitive sciences, one can observe problems associated with the adequate presentation and understanding of some of their features. Indeed, when these models are examined from a cognitive perspective, a number of unfounded arguments tend to appear in the psychological literature. In this article, we review the most common of these arguments and discuss (a) what exactly these models represent at the implementational level and their plausibility as a cognitive theory, (b) how they deal with various aspects of meaning such as polysemy or compositionality, and (c) how they relate to the debate on embodied and grounded cognition. We identify common misconceptions that arise as a result of incomplete descriptions, outdated arguments, and unclear distinctions between theory and implementation of the models. We clarify and amend these points to provide a theoretical basis for future research and discussions on vector models of semantic representation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
A spreading-activation theory of semantic processing.
Collins, A. M., & Loftus, E. F. (1975) · Psychological Review · doi:10.1037/0033-295x.82.6.407 · Cited by 8,141 · cited 1×
“…rely heavily on well-defined semantic features (see Bierwisch, 2011; Johnson, 2008; Nida, 1979), but many psychological theories of word meanings and concepts are also founded on interpretable features (e.g., Collins & Loftus, 1975; McRae, Cree, Seidenberg, & McNorgan, 2005; Smith & Medin, 1981).”
BackgroundMotivational processes affecting learning.
Dweck, C. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.10.1040 · Cited by 6,971
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
On the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202 · cited 1×
“…Bhatia demonstrated that DSMs can predict human performance (and biases) across a wide range of high-level judgment tasks, including the conjunction fallacy (Tversky & Kahneman, 1983), base-rate neglect (Kahneman & Tversky, 1973), and the recognition heuristic (Gigerenzer & Goldstein, 1996).”
BackgroundStatistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“…free-association tasks (Nematzadeh, Meylan, & Griffiths, 2017), semantic priming (Günther, Dudschig, & Kaup, 2016; Jones et al., 2006; Mandera et al., 2017), concept acquisition (Lazaridou et al., 2017; Ouyang, Boroditsky, & Frank, 2017), and text comprehension (Landauer, Foltz, & Laham, 1998).”
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness
Ford, M., & Johnson-Laird, P. N. (1985) · Language · doi:10.2307/414498 · Cited by 4,419
The role of knowledge in discourse comprehension: A construction-integration model.
Kintsch, W. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.163 · Cited by 4,363
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Software Framework for Topic Modelling with Large Corpora
Rek, R. R. U., & Sojka, P. (2010) · doi:10.13140/2.1.2393.1847 · Cited by 3,647
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Reasoning the fast and frugal way: Models of bounded rationality.
Gigerenzer, G., & Goldstein, D. G. (1996) · Psychological Review · doi:10.1037/0033-295x.103.4.650 · Cited by 3,504
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Advances in Neural Information Processing Systems 27 (NIPS 2014)
Zhong, M., Goddard, N., & Sutton, C. A. (2014) · Cited by 2,636
Glenberg, A. M., & Kaschak, M. P. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196313 · Cited by 2,361
Sapiens: a brief history of humankind
(2015) · Choice Reviews Online · doi:10.5860/choice.190494 · Cited by 2,136
(2009) · Cited by 1,900
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,811
Neural Word Embedding as Implicit Matrix Factorization
Levy, O., & Goldberg, Y. (2014) · neural information processing systems · Cited by 1,582
Handbook of Latent Semantic Analysis
(2007) · Psychology Press eBooks · doi:10.4324/9780203936399 · Cited by 1,554
Automatic retrieval and clustering of similar words
Lin, D. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980691.980696 · Cited by 1,545
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 1×
“…demonstrated that these prediction-based models are mathematically equivalent to psychologically plausible learning models (Hollis, 2017; Mandera et al., 2017), such as the Rescorla-Wagner model of reinforcement learning (Rescorla & Wagner, 1972; see also Gluck & Bower, 1988; Sutton & Barto, 1981).”
BackgroundIntegration of word meaning and world knowledge in language comprehension
Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. (2004) · Science · doi:10.1126/science.1095455 · Cited by 1,396
Baroni, M., Dinu, G., & Kruszewski, G. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1023 · Cited by 1,364
The nature and measurement of meaning.
Osgood, C. E. (1952) · Psychological Bulletin · doi:10.1037/h0055737 · Cited by 1,320
Computational linguistics in 1990
Karlgren, H. (1990) · Proceedings of the 13th conference on Computational linguistics - · doi:10.3115/992507.992531 · Cited by 1,243
De Houwer, J., Thomas, S., & Baeyens, F. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.6.853 · Cited by 1,181
Predicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180
The importance of shape in early lexical learning
Landau, B., Smith, L. B., & Jones, S. S. (1988) · Cognitive Development · doi:10.1016/0885-2014(88)90014-7 · Cited by 1,174
Proceedings of the 35th Annual Meeting of the Cognitive Science Society
Culbertson, J., & Wilson, C. (2013) · Cited by 1,139
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
Reflections of the Environment in Memory
Anderson, J. R., & Schooler, L. J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00174.x · Cited by 1,085
Visual statistical learning in infancy: evidence for a domain general learning mechanism
Kirkham, N. Z., Slemmer, J. A., & Johnson, S. P. (2002) · Cognition · doi:10.1016/s0010-0277(02)00004-5 · Cited by 1,072 · cited 1×
“This ability can be observed in many different domains, such as visual pattern recognition (Kirkham, Slemmer, & Johnson, 2002), procedural knowledge (Lewicki, Czyzewska, & Hoffman, 1987), or social cognition (Lewicki, 1986), but it has also been found to play a vital role in language acquisition…”
BackgroundSemantic feature production norms for a large set of living and nonliving things
McRae, K., Cree, G. S., Seidenberg, M. S., & Mcnorgan, C. (2005) · Behavior Research Methods · doi:10.3758/bf03192726 · Cited by 1,068
Proceedings of the 35th Annual Conference of the Cognitive Science Society
Dale, R. A. C., Yu, C., Nagai, Y., Coco, M. I., & Kopp, S. (2013) · Cited by 1,006
Composition in Distributional Models of Semantics
Mitchell, J., & Lapata, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01106.x · Cited by 960
Rogers, T. T., Lambon Ralph, M. A., Garrard, P., Bozeat, S., McClelland, J. L., Hodges, J. R., & Patterson, K. (2004) · Psychological Review · doi:10.1037/0033-295x.111.1.205 · Cited by 948
A theory for the storage and retrieval of item and associative information.
Murdock, B. B. (1982) · Psychological Review · doi:10.1037//0033-295x.89.6.609 · Cited by 932
Journal of the Association for Information Science and Technology
(2018) · Journal of the Association for Information Science and Technology · doi:10.1002/(issn)2330-1643 · Cited by 911
Multimodal Distributional Semantics
Bruni, E., Tran, N. K., & Baroni, M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4135 · Cited by 908
Firth, J. R. (1957) · Medical Entomology and Zoology · Cited by 886
Proceedings of the 39th Annual Conference of the Cognitive Science Society
Motamedi, Y., Schouwstra, M., Culbertson, J., Smith, K., & Kirby, S. (2017) · Cited by 870
Coming of age: A review of embodiment and the neuroscience of semantics
Meteyard, L., Cuadrado, S. R., Bahrami, B., & Vigliocco, G. (2012) · Cortex · doi:10.1016/j.cortex.2010.11.002 · Cited by 862
Implicit learning and statistical learning: one phenomenon, two approaches
Perruchet, P., & Pacton, S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.03.006 · Cited by 830
Extracting semantic representations from word co-occurrence statistics: A computational study
Bullinaria, J. A., & Levy, J. P. (2007) · Behavior Research Methods · doi:10.3758/bf03193020 · Cited by 805
Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning
Glenberg, A. M., & Robertson, D. A. (2000) · Journal of Memory and Language · doi:10.1006/jmla.2000.2714 · Cited by 755
Dependency-Based Construction of Semantic Space Models
Padó, S., & Lapata, M. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.2.161 · Cited by 695
Vanderwende, L., Daumé, H., & Kirchhoff, K. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 685
Distributional Memory: A General Framework for Corpus-Based Semantics
Baroni, M., & Lenci, A. (2010) · Computational Linguistics · doi:10.1162/coli_a_00016 · Cited by 659
Linguistic Regularities in Sparse and Explicit Word Representations
Levy, O., & Goldberg, Y. (2014) · Proceedings of the Eighteenth Conference on Computational Natural Language Learning · doi:10.3115/v1/w14-1618 · Cited by 628
Statistical Language Learning: Mechanisms and Constraints
Saffran, J. R. (2003) · Current Directions in Psychological Science · doi:10.1111/1467-8721.01243 · Cited by 624 · cited 2×
“And indeed, humans excel in capturing and learning statistical regularities and patterns in their environment across many different domains (Perruchet & Pacton, 2006; Saffran, 2003).”
BackgroundPerceptions of perceptual symbols
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99532147 · Cited by 620
Representing word meaning and order information in a composite holographic lexicon.
Jones, M. N., & Mewhort, D. J. K. (2007) · Psychological Review · doi:10.1037/0033-295x.114.1.1 · Cited by 613
Discovering word senses from text
Pantel, P., & Lin, D. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775138 · Cited by 591
From conditioning to category learning: An adaptive network model.
Gluck, M. A., & Bower, G. H. (1988) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.117.3.227 · Cited by 582
The challenge of abstract concepts.
Borghi, A. M., Binkofski, F., Castelfranchi, C., Cimatti, F., Scorolli, C., & Tummolini, L. (2017) · Psychological Bulletin · doi:10.1037/bul0000089 · Cited by 503
Sahlgren, M. (2008) · Diva portal (Dalarna University Library) · Cited by 473
Baroni, M., & Zamparelli, R. (2010) · Cited by 473
Integrating experiential and distributional data to learn semantic representations.
Andrews, M., Vigliocco, G., & Vinson, D. (2009) · Psychological Review · doi:10.1037/a0016261 · Cited by 454
Distributional Models of Word Meaning
Lenci, A. (2018) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-030514-125254 · Cited by 447
The Word Frequency Effect in Word Processing: An Updated Review
Brysbaert, M., Mandera, P., & Keuleers, E. (2018) · Current Directions in Psychological Science · doi:10.1177/0963721417727521 · Cited by 446
Unconscious acquisition of complex procedural knowledge.
Lewicki, P., Czyzewska, M., & Hoffman, H. (1987) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.13.4.523 · Cited by 432
Ontology Learning from Text: Methods, Evaluation and Applications
Magnini, B., Paul Buitelaar, C., & Cimiano, P. (2005) · Cited by 429
Mandera, P., Keuleers, E., & Brysbaert, M. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2016.04.001 · Cited by 428
AlSumait, L., Barbará, D., & Domeniconi, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.140 · Cited by 421
The Link between Brain Learning, Attention, and Consciousness
Grossberg, S. (1999) · Consciousness and Cognition · doi:10.1006/ccog.1998.0372 · Cited by 413
An Introduction to Random Indexing
Sahlgren, M. (2005) · Cited by 409
Activity and Imagined Activity Can Enhance Young Children's Reading Comprehension.
Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., & Kaschak, M. P. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.424 · Cited by 401
Symbol Interdependency in Symbolic and Embodied Cognition
Louwerse, M. M. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01106.x · Cited by 399 · cited 6×
“Follow-up research has since shown that they account quite well for human behavior across a variety of tasks without being explicitly designed for them (e.g., Bullinaria & Levy, 2012; Jones et al., 2006; Louwerse, 2011; Mandera et al., 2017).”
BackgroundInfluentialThe structure of the color space in naming and memory for two languages
Heider, E. R., & Olivier, D. C. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90011-4 · Cited by 395
Kaschak, M. P., & Glenberg, A. M. (2000) · Journal of Memory and Language · doi:10.1006/jmla.2000.2705 · Cited by 385
Embodied Sentence Comprehension
Zwaan, R. A., & Madden, C. J. (2005) · Grounding Cognition · doi:10.1017/cbo9780511499968.010 · Cited by 380
Quantifying incoherence in speech: An automated methodology and novel application to schizophrenia
Elvevåg, B., Foltz, P. W., Weinberger, D. R., & Goldberg, T. E. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.001 · Cited by 363
From Word To Sense Embeddings: A Survey on Vector Representations of Meaning
Camacho-Collados, J., & Pilehvar, M. T. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11259 · Cited by 363
Similarity of Semantic RelationsPreprint
Turney, P. D. (2006) · CogPrints (University of Southampton) · Cited by 359
Metaphor comprehension: A computational theory
Kintsch, W. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212981 · Cited by 353
Italian Journal of Linguistics
Cennamo, M. (2006) · Cited by 352
Précis of Foundations of Language: Brain, Meaning, Grammar, Evolution,
Jackendoff, R. (2003) · Behavioral and Brain Sciences · doi:10.1017/s0140525x03000153 · Cited by 329
Models of visual word recognition: Sampling the state of the art.
Jacobs, A. M., & Grainger, J. (1994) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.20.6.1311 · Cited by 319 · cited 1×
“As in any scientific field, theory and model development within the DSM framework would benefit from a cumulative and nested approach (cf. Jacobs & Grainger, 1994).”
MethodAccessing lexical ambiguity in different types of sentential contexts
Tabossi, P. (1988) · Journal of Memory and Language · doi:10.1016/0749-596x(88)90058-7 · Cited by 309
Latent Semantic Analysis: five methodological recommendations
Evangelopoulos, N., Zhang, X., & Prybutok, V. R. (2012) · European Journal of Information Systems · doi:10.1057/ejis.2010.61 · Cited by 306
Bullinaria, J. A., & Levy, J. P. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0183-8 · Cited by 303
Learning Topic Models -- Going beyond SVD
Arora, S., Ge, R., & Moitra, A. (2012) · 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2012.49 · Cited by 302
Perceptual Knowledge Retrieval Activates Sensory Brain Regions
Goldberg, R. F., Perfetti, C. A., & Schneider, W. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.5389-05.2006 · Cited by 299
Classical conditioning of human ‘evaluative’ responses
Levey, A. B., & Martin, I. (1975) · Behaviour Research and Therapy · doi:10.1016/0005-7967(75)90026-1 · Cited by 296
Combining Language and Vision with a Multimodal Skip-gram Model
Lazaridou, A., Pham, N. T., & Baroni, M. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1016 · Cited by 280
Distributional semantics in linguistic and cognitive research
Lenci, A., & Littell, J. F. (2008) · CINECA IRIS Institutial research information system (University of Pisa) · Cited by 263
Borghi, A. M., Glenberg, A. M., & Kaschak, M. P. (2004) · Memory & Cognition · doi:10.3758/bf03196865 · Cited by 253
Processing information about covariations that cannot be articulated.
Lewicki, P. (1986) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.12.1.135 · Cited by 242
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · cited 2×
“DSMs also usually have a number of free parameters (e.g., number of dimensions or context size) that also have differential effects on their performance for different tasks (Bullinaria & Levy, 2007, 2012).”
BackgroundFrege in Space: A Program for Compositional Distributional Semantics
Baroni, M., Bernardi, R., & Zamparelli, R. (2014) · Linguistic Issues in Language Technology · doi:10.33011/lilt.v9i.1321 · Cited by 241
Symbols and EmbodimentDebates on meaning and cognition
de Vega, M., Glenberg, A., & Graesser, A. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199217274.001.0001 · Cited by 239
Learning and Emotion: Perspectives for Theory and Research
Hascher, T. (2010) · European Educational Research Journal · doi:10.2304/eerj.2010.9.1.13 · Cited by 232
van Herten, M., Chwilla, D. J., & Kolk, H. H. J. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.7.1181 · Cited by 226
High-dimensional semantic space accounts of priming
Jones, M. N., Kintsch, W., & Mewhort, D. J. K. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.07.003 · Cited by 214
A brain perspective on language mechanisms: from discrete neuronal ensembles to serial order
Pulvermüller, F. (2002) · Progress in Neurobiology · doi:10.1016/s0301-0082(02)00014-x · Cited by 208
Kintsch, W. (2001) · Cognitive Science · doi:10.1207/s15516709cog2502_1 · Cited by 207
Summary Street: Interactive Computer Support for Writing
Wade-Stein, D., & Kintsch, E. (2004) · Cognition and Instruction · doi:10.1207/s1532690xci2203_3 · Cited by 203
Empirical distributional semantics: Methods and biomedical applications
Cohen, T., & Widdows, D. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.02.002 · Cited by 203
fMRI evidence for word association and situated simulation in conceptual processing
Simmons, W. K., Hamann, S. B., Harenski, C. L., Hu, X. P., & Barsalou, L. W. (2008) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2008.03.014 · Cited by 197
Similarity of Semantic Relations
Turney, P. D. (2006) · Computational Linguistics · doi:10.1162/coli.2006.32.3.379 · Cited by 193
Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society
Healey, P. G. T., Garrod, S., Lee, J. R., Oberlander, J., & Fay, N. (2002) · Conference Cognitive Science · Cited by 190
A Taste of Words: Linguistic Context and Perceptual Simulation Predict the Modality of Words
Louwerse, M., & Connell, L. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01157.x · Cited by 189
Few believe the world is flat: How embodiment is changing the scientific understanding of cognition.
Glenberg, A. M. (2015) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000056 · Cited by 188
Concepts, control, and context: A connectionist account of normal and disordered semantic cognition.
Hoffman, P., McClelland, J. L., & Lambon Ralph, M. A. (2018) · Psychological Review · doi:10.1037/rev0000094 · Cited by 184
Dreyer, F. R., & Friedemann Pulvermüller, A. (2017) · Cortex · doi:10.1016/j.cortex.2017.10.021 · Cited by 180
MEMORY-BASED LANGUAGE PROCESSING: Psycholinguistic Research in the 1990s
McKoon, G., & Ratcliff, R. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.25 · Cited by 179
Jones, M. N., Willits, J., & Dennis, S. (2015) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780199957996.013.11 · Cited by 179
Riordan, B., & Jones, M. N. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01111.x · Cited by 177
Predicting Semantic Priming at the Item Level
Hutchison, K. A., Balota, D. A., Cortese, M. J., & Watson, J. M. (2008) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210701438111 · Cited by 176
LSAfun - An R package for computations based on Latent Semantic Analysis
Günther, F., Dudschig, C., & Kaup, B. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0529-0 · Cited by 174
Self-citationContext-dependent Semantic Processing in the Human Brain: Evidence from Idiom Comprehension
Rommers, J., Dijkstra, T., & BASTIAANSEN, M. C. M. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00337 · Cited by 169
The semantic distance task: Quantifying semantic distance with semantic network path length.
Kenett, Y. N., Levi, E., Anaki, D., & Faust, M. (2017) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000391 · Cited by 165
Personality and reinforcement in associative and instrumental learning
Corr, P. J., Pickering, A. D., & Gray, J. A. (1995) · Personality and Individual Differences · doi:10.1016/0191-8869(95)00013-v · Cited by 164
Marelli, M., & Baroni, M. (2015) · Psychological Review · doi:10.1037/a0039267 · Cited by 161
Self-citationRecchia, G. L., & Jones, M. N. (2009) · Behavior Research Methods · doi:10.3758/brm.41.3.647 · Cited by 160
Hasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
Self-citationEvaluation of Word Vector Representations by Subspace Alignment
Tsvetkov, Y., Faruqui, M., Wang, L., Lample, G., & Dyer, C. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1243 · Cited by 156
Roy, D. K., Patel, R., DeCamp, P., Kubat, R., Fleischman, M., Roy, B., Mavridis, N., Tellex, S., Salata, A., Guinness, J., et al. (2006) · Lecture notes in computer science · doi:10.1007/11880172_15 · Cited by 151
Not All Contexts Are Created Equal: Better Word Representations with Variable Attention
Wang, L., Tsvetkov, Y., Amir, S., Fermandez, R., Dyer, C., Black, A. W., Trancoso, I. M., & Lin, C. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1161 · Cited by 147
Exploring lexical co-occurrence space using HiDEx
Shaoul, C., & Westbury, C. F. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.393 · Cited by 146
Measuring Distributional Similarity in Context
Dinu, G., & Lapata, M. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 140
Pereira, F., Gershman, S. J., Ritter, S., & Botvinick, M. (2016) · Cognitive Neuropsychology · doi:10.1080/02643294.2016.1176907 · Cited by 140
Strudel: A Corpus‐Based Semantic Model Based on Properties and Types
Baroni, M., Murphy, B., Barbu, E., & Poesio, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01068.x · Cited by 135
Landauer, T. K. (2007) · doi:10.4324/9780203936399-5 · Cited by 133
Mathematical Foundations Behind Latent Semantic Analysis
Martin, D. I., & Berry, M. W. (2015) · Routledge eBooks · doi:10.4324/9780203936399.ch2 · Cited by 130
Text: now in 2D! A framework for lexical expansion with contextual similarity
Biemann, C., & Riedl, M. J. (2013) · Journal of Language Modelling · doi:10.15398/jlm.v1i1.60 · Cited by 127
The principals of meaning: Extracting semantic dimensions from co-occurrence models of semantics
Hollis, G., & Westbury, C. F. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1053-2 · Cited by 124
Identifying hypernyms in distributional semantic spaces
Lenci, A., & Benotto, G. (2023) · doi:10.5281/zenodo.8158898 · Cited by 119
How specifically are action verbs represented in the neural motor system: An fMRI study
van Dam, W. O., Rueschemeyer, S., & Harold Bekkering, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.071 · Cited by 119
Proceedings of the 11th International Conference on Computational Semantics
Hunter, J., Asher, N. M., & Lascarides, A. (2015) · The Association for Computational Linguistics · Cited by 119
PROCEEDINGS OF THE TWENTY-SIXTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY
Goede, D. D., Wester, F., den Ouden, D., Bastiaanse, R., Shapiro, L. P., & Swinney, D. (2005) · Conference Cognitive Science · Cited by 119
Associative judgment and vector space semantics.
Bhatia, S. (2016) · Psychological Review · doi:10.1037/rev0000047 · Cited by 117
Perceptual Inference Through Global Lexical Similarity
Johns, B. T., & Jones, M. N. (2012) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2011.01176.x · Cited by 115
Language Encodes Geographical Information
Louwerse, M. M., & Zwaan, R. A. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2008.01003.x · Cited by 113
Monitoring polysemy: Word space models as a tool for large-scale lexical semantic analysis
Heylen, K., Wielfaert, T., Speelman, D., & Geeraerts, D. (2015) · Lingua · doi:10.1016/j.lingua.2014.12.001 · Cited by 102
An associative account of the development of word learning
Sloutsky, V. M., Yim, H., Yao, X., & Dennis, S. J. (2017) · Cognitive Psychology · doi:10.1016/j.cogpsych.2017.06.001 · Cited by 100
Is this a wampimuk? Cross-modal mapping between distributional semantics and the visual world
Lazaridou, A., Bruni, E., & Baroni, M. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1132 · Cited by 96
Howell, S. R., Jankowicz, D., & Becker, S. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2005.03.002 · Cited by 90
Latent semantic analysis cosines as a cognitive similarity measure: Evidence from priming studies
Günther, F., Dudschig, C., & Kaup, B. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2015.1038280 · Cited by 88
Self-citationMulti- and Cross-Modal Semantics Beyond Vision: Grounding in Auditory Perception
Kiela, D., & Clark, S. C. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1293 · Cited by 87
Marelli, M., Gagné, C. L., & Spalding, T. L. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.026 · Cited by 81
Self-citationMultimodal word meaning induction from minimal exposure to natural text
Lazaridou, A., Marelli, M., & Baroni, M. (2017) · Cognitive Science · doi:10.1111/cogs.12481 · Cited by 80
Self-citationThe neuro-cognitive representations of symbols: the case of concrete words
Borghesani, V., & Manuela Piazza, A. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.06.026 · Cited by 80
Individual variability in the semantic processing of English compound words.
Schmidtke, D., Dyke, J. A. V., & Kuperman, V. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000442 · Cited by 77
Combining feature norms and text data with topic models
Mark Steyvers, B. (2009) · Acta Psychologica · doi:10.1016/j.actpsy.2009.10.010 · Cited by 73
Sadeghi, Z., McClelland, J. L., & Hoffman, P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.08.031 · Cited by 71
Reading Comprehension is Embodied: Theoretical and Practical Considerations
Sadoski, M. (2017) · Educational Psychology Review · doi:10.1007/s10648-017-9412-8 · Cited by 68
Grounding Semantics in Olfactory Perception
Kiela, D., Bulat, L., & Clark, S. C. (2015) · doi:10.3115/v1/p15-2038 · Cited by 64
Herdağdelen, A., & Marelli, M. (2016) · Cognitive Science · doi:10.1111/cogs.12392 · Cited by 61
Self-citationThe non-strategic nature of linguistic long-term memory effects in verbal short-term memory
Kowialiewski, B., & Majerus, S. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.03.005 · Cited by 60
Learning is not decline: The mental lexicon as a window into cognition across the lifespan
Ramscar, M., Hendrix, P., Love, B. C., & Baayen, R. H. (2013) · The Mental Lexicon · doi:10.1075/ml.8.3.08ram · Cited by 56
Combining Heterogeneous Models for Measuring Relational Similarity
Zhila, A., Yih, W.-T., Meek, C., Zweig, G., & Mikolov, T. (2013) · Cited by 53
Louwerse, M. M., & Benesh, N. (2012) · Cognitive Science · doi:10.1111/cogs.12000 · Cited by 49
Lau, M. C., Goh, W. D., & Yap, M. J.-M. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021817739834 · Cited by 47
Günther, F., Smolka, E., & Marelli, M. (2018) · Cortex · doi:10.1016/j.cortex.2018.09.007 · Cited by 46
Self-citationPay no attention to that man behind the curtain: Explaining semantics without semantics
Westbury, C. F. (2016) · The Mental Lexicon · doi:10.1075/ml.11.3.02wes · Cited by 44
Open-ended Procedural Semantics
Spranger, M., Pauw, S., Loetzsch, M., & Steels, L. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3064-3_8 · Cited by 42
The semantic representation of prejudice and stereotypes
Bhatia, S. (2017) · Cognition · doi:10.1016/j.cognition.2017.03.016 · Cited by 42
Dudschig, C., Maienborn, C., & Kaup, B. (2016) · Brain and Cognition · doi:10.1016/j.bandc.2016.01.001 · Cited by 39
Estimating the average need of semantic knowledge from distributional semantic models
Hollis, G. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0732-1 · Cited by 38
Grounding co-occurrence: Identifying features in a lexical co-occurrence model of semantic memory
Durda, K., Buchanan, L., & Caron, R. J. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1210 · Cited by 35
Sommerauer, P., & Fokkens, A. S. (2018) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w18-5430 · Cited by 33
A Latent Semantic Analysis of Gender Stereotype-Consistency and Narrowness in American English
Lenton, A. P., Sedikides, C., & Bruder, M. (2008) · Sex Roles · doi:10.1007/s11199-008-9534-z · Cited by 31
An Overview of Lexical Semantics
Johnson, K. R. (2007) · Philosophy Compass · doi:10.1111/j.1747-9991.2007.00101.x · Cited by 30
Günther, F., & Marelli, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0163200 · Cited by 28
Self-citationSound-based distributional models.
Lopopolo, A., & van Miltenburg, E. (2015) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · doi:10.13140/rg.2.1.3458.5363 · Cited by 22
Semantic Coherence Facilitates Distributional Learning
Ouyang, L., Boroditsky, L., & Frank, M. C. (2016) · Cognitive Science · doi:10.1111/cogs.12360 · Cited by 20
Visualizing polysemy using LSA and the predication algorithm
Jorge‐Botana, G., León, J. A., Olmos, R., & Hassan‐Montero, Y. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21355 · Cited by 18
Similarity as a function of semantic distance and amount of knowledge.
Kintsch, W. (2014) · Psychological Review · doi:10.1037/a0037017 · Cited by 16
Zannino, G. D., Caltagirone, C., & Carlesimo, G. A. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.06.023 · Cited by 15
Conceptual knowledge representation: A cross-section of current research
Rogers, T. T., & Wolmetz, M. E. (2016) · Cognitive Neuropsychology · doi:10.1080/02643294.2016.1188066 · Cited by 12
Constraint on covariation: It's not meaning
Glenberg, A. M., & Mehta, S. (2008) · The Italian Journal of Linguistics · Cited by 11
Recchia, G. L., & Louwerse, M. M. (2015) · Cognitive Science · doi:10.1111/cogs.12311 · Cited by 9
Towards Compositional Tree Kernels
Annesi, P., Croce, D., & Basili, R. (2014) · Pisa University Press eBooks · doi:10.12871/clicit201412 · Cited by 4
A new statistical model for analyzing rating scale data pertaining to word meaning
Munoz‐Rubke, F., Kafadar, K., & James, K. H. (2017) · Psychological Research · doi:10.1007/s00426-017-0864-8 · Cited by 1
Cited by
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Semantic memory: A review of methods, models, and current challenges
Kumar, A. A. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01792-x · Cited by 314
Cultural Schemas: What They Are, How to Find Them, and What to Do Once You’ve Caught One
Boutyline, A., & Soter, L. K. (2021) · American Sociological Review · doi:10.1177/00031224211024525 · Cited by 216
“This also enables distributed networks to share humans’ ability to successfully learn new concepts from just a small number of examples (Günther et al. 2019; Lazaridou et al. 2017).”
BackgroundInfluentialDoes ChatGPT have semantic understanding? A problem with the statistics-of-occurrence strategy
Titus, L. M. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101174 · Cited by 82
How should the advancement of large language models affect the practice of science?
Binz, M., Alaniz, S., Roskies, A., Aczel, B., Bergstrom, C. T., Allen, C., Schad, D., Wulff, D., West, J. D., Zhang, Q., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2401227121 · Cited by 74
Self-citation
Metadata
- Authors
- Günther, F., Rinaldi, L., & Marelli, M.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-09-10
- Volume
- 14
- Issue
- 6
- Pages
- 1006-1033
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2972680241
- Cited by
- 341
- References
- 194
- FWCI
- 14.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.