Word meaning in minds and machines.
Open accessThe DOI matches its Crossref record; 130 of the 133 references it cites were found in a registry or an index.
Abstract
Machines have achieved a broad and growing set of linguistic competencies, thanks to recent progress in Natural Language Processing (NLP). Psychologists have shown increasing interest in such models, comparing their output to psychological judgments such as similarity, association, priming, and comprehension, raising the question of whether the models could serve as psychological theories. In this article, we compare how humans and machines represent the meaning of words. We argue that contemporary NLP systems are fairly successful models of human word similarity, but they fall short in many other respects. Current models are too strongly linked to the text-based patterns in large corpora, and too weakly linked to the desires, goals, and beliefs that people express through words. Word meanings must also be grounded in perception and action and be capable of flexible combinations in ways that current systems are not. We discuss promising approaches to grounding NLP systems and argue that they will be more successful, with a more human-like, conceptual basis for word meaning. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One way to build a trustworthy reasoning system using LLMs is to embed them in an algorithm that is similarly faithful to logic because it realizes the same causal structure.8,9”
From Talking about Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Because of the limits of current models, focusing research efforts on increasing the size of LLMs by multiplying the number of internal parameters will scarcely contribute to solving the critical problem of the lack of situated perception and causal interaction with the physical world (Lake & Murphy, 2023).”
From Are Large Language Models Intentional? The Limits of Referential Grounding (2026) · cites this paper as Lake & Murphy, 2023
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We can trust a deductive theorem prover because the sequences of sentences it generates are faithful to logic, in the sense that they are the result of an underlying computational process whose causal structure mirrors the truth-preserving inferential structure of the problem.8”
From Talking about Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Tversky, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.4.327 · Cited by 7,414
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
Speaking: from intention to articulation
(1989) · Choice Reviews Online · doi:10.5860/choice.27-1947 · Cited by 5,003
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Fodor, J. A. (1975) · Medical Entomology and Zoology · Cited by 4,588
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0017 · Cited by 3,953
Retrieval time from semantic memory
Collins, A. M., & Quillian, M. R. (1969) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(69)80069-1 · Cited by 3,109
Scripts, Plans, Goals, and Understanding: An Inquiry into Human Knowledge Structures
Hunt, E., Schank, R., & Abelson, R. (1979) · The American Journal of Psychology · doi:10.2307/1421499 · Cited by 2,944
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Self-citationThe role of theories in conceptual coherence.
Murphy, G. L., & Medin, D. L. (1985) · Psychological Review · doi:10.1037//0033-295x.92.3.289 · Cited by 2,792
Self-citationSchemata: The Building Blocks of Cognition
Rumelhart, D. E. (2017) · Theoretical Issues in Reading Comprehension · doi:10.4324/9781315107493-4 · Cited by 2,581
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Self-citationBuilding Machines That Learn and Think Like People
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2016) · arXiv · doi:10.48550/arxiv.1604.00289 · Cited by 2,550
Self-citationMurphy, G. L. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1602.001.0001 · Cited by 2,505
Self-citationViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Lu, J., Batra, D., Parikh, D., & Lee, S. (2019) · arXiv · doi:10.48550/arxiv.1908.02265 · Cited by 2,109
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,811
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.215 · Cited by 1,781
Concepts, kinds, and cognitive development
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3559 · Cited by 1,691
A Synopsis of Linguistic Theory, 1930-1955
Firth, J. R. (1957) · Medical Entomology and Zoology · Cited by 1,675
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9883 · Cited by 1,615
Microsoft COCO Captions: Data Collection and Evaluation Server
Chen, X., Fang, H., Lin, T.-Y., Vedantam, R., Gupta, S., Dollar, P., & Zitnick, C. L. (2015) · arXiv · doi:10.48550/arxiv.1504.00325 · Cited by 1,614
A primer in BERTology: What we know about how BERT works
Rogers, A., Kovaleva, O., & Rumshisky, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00349 · Cited by 1,552
Adversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410
Frege, G. (1975) · Logic and philosophy for linguists · doi:10.1515/9783111546216-003 · Cited by 1,390
The essential child: origins of essentialism in everyday thought
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1239 · Cited by 1,377
Baroni, M., Dinu, G., & Kruszewski, G. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1023 · Cited by 1,364
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177
SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation
Hill, F., Reichart, R., & Korhonen, A. (2015) · Computational Linguistics · doi:10.1162/coli_a_00237 · Cited by 1,175
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
Visual long-term memory has a massive storage capacity for object details
Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803390105 · Cited by 1,106
Introduction to Montague Semantics
Dowty, D. R., Wall, R. E., & Peters, S. (1980) · Studies in Linguistics and Philosophy · doi:10.1007/978-94-009-9065-4 · Cited by 1,097
Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
Bender, E. M., & Koller, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.463 · Cited by 1,082
Composition in Distributional Models of Semantics
Mitchell, J., & Lapata, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01106.x · Cited by 960
Semantic distance and the verification of semantic relations
Rips, L. J., Shoben, E. J., & Smith, E. E. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80056-8 · Cited by 946
Concepts: Where Cognitive Science Went Wrong
Bach, K., & Fodor, J. A. (2000) · The Philosophical Review · doi:10.2307/2693638 · Cited by 928
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction
Bosselut, A., Rashkin, H., Sap, M., Malaviya, C., Celikyilmaz, A., & Choi, Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1470 · Cited by 904
A Persona-Based Neural Conversation Model
Li, J., Galley, M., Brockett, C., Spithourakis, G., Gao, J., & Dolan, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1094 · Cited by 898
Zero-Shot Learning — The Good, the Bad and the Ugly
Xian, Y., Schiele, B., & Akata, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.328 · Cited by 891
POMDP-Based Statistical Spoken Dialog Systems: A Review
Young, S., Gasic, M., Thomson, B., & Williams, J. D. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2225812 · Cited by 882
What the Eyes Say About Speaking
Griffin, Z. M., & Bock, K. (2000) · Psychological Science · doi:10.1111/1467-9280.00255 · Cited by 877
Ethayarajh, K. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1006 · Cited by 841
Meaning and Grammar: An Introduction to Semantics
Carlson, G. N., Chierchia, G., & McConnell-Ginet, S. (1991) · Language · doi:10.2307/415078 · Cited by 807
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Sordoni, A., Galley, M., Auli, M., Brockett, C., Ji, Y., Mitchell, M., Nie, J.-Y., Gao, J., & Dolan, B. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1020 · Cited by 764
Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning
Glenberg, A. M., & Robertson, D. A. (2000) · Journal of Memory and Language · doi:10.1006/jmla.2000.2714 · Cited by 755
Carey, S. E. (1978) · Medical Entomology and Zoology · Cited by 670
Adversarial NLI: A New Benchmark for Natural Language Understanding
Nie, Y., Williams, A., Dinan, E., Bansal, M., Weston, J., & Kiela, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.441 · Cited by 656
The discovery of structural form
Kemp, C., & Tenenbaum, J. B. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802631105 · Cited by 650
Brachman, R. J. (1979) · Associative Networks · doi:10.1016/b978-0-12-256380-5.50007-4 · Cited by 625
Baroni, M., & Zamparelli, R. (2010) · Iris (University of Trento) · Cited by 616
WinoGrande: An Adversarial Winograd Schema Challenge at Scale
Sakaguchi, K., Le Bras, R., Bhagavatula, C., & Choi, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6399 · Cited by 579
VQA: Visual Question Answering: www.visualqa.org
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Parikh, D., & Batra, D. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0966-6 · Cited by 570
What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models
Ettinger, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00298 · Cited by 511
Representation of Structure in Similarity Data: Problems and Prospects
Shepard, R. N. (1974) · Psychometrika · doi:10.1007/bf02291665 · Cited by 484
A rational analysis of rule-based concept learning
Goodman, N. D., Tenenbaum, J. B., Feldman, J., & Griffiths, T. L. (2008) · Cognitive Science · doi:10.1080/03640210701802071 · Cited by 469
Inferring and Executing Programs for Visual Reasoning
Johnson, J., Hariharan, B., Van Der Maaten, L., Hoffman, J., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.325 · Cited by 467
(2019) · Cited by 467
Mao, J., Gan, C., Kohli, P., Tenenbaum, J. B., & Wu, J. (2019) · arXiv · doi:10.48550/arxiv.1904.12584 · Cited by 444
Mandera, P., Keuleers, E., & Brysbaert, M. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2016.04.001 · Cited by 428
Comprehending complex concepts
Murphy, G. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90012-2 · Cited by 427
Self-citationSemantic priming without association: A meta-analytic review
Lucas, M. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212999 · Cited by 408
Combining prototypes: A selective modification model
Smith, E. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90011-0 · Cited by 394
Vector Space Models of Word Meaning and Phrase Meaning: A Survey
Erk, K. (2012) · Language and Linguistics Compass · doi:10.1002/lnco.362 · Cited by 321
Das, A., Datta, S., Gkioxari, G., Lee, S., Parikh, D., & Batra, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00279 · Cited by 288
Wisniewski, E. J. (1997) · Psychonomic Bulletin & Review · doi:10.3758/bf03209392 · Cited by 281
Combining Language and Vision with a Multimodal Skip-gram Model
Lazaridou, A., Pham, N. T., & Baroni, M. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1016 · Cited by 280
Bisk, Y., Holtzman, A., Thomason, J., Andreas, J., Bengio, Y., Chai, J., Lapata, M., Lazaridou, A., May, J., Nisnevich, A., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.703 · Cited by 274
Generating Natural Questions About an Image
Mostafazadeh, N., Misra, I., Devlin, J., Mitchell, M., He, X., & Vanderwende, L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1170 · Cited by 270
Frege in Space: A Program for Compositional Distributional Semantics
Baroni, M., Bernardi, R., & Zamparelli, R. (2014) · Linguistic Issues in Language Technology · doi:10.33011/lilt.v9i.1321 · Cited by 241
Child-basic object categories and early lexical development.
Mervis, C. Β. (1987) · Cited by 197
Strudel: A Corpus‐Based Semantic Model Based on Properties and Types
Baroni, M., Murphy, B., Barbu, E., & Poesio, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01068.x · Cited by 174
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · arXiv · doi:10.48550/arxiv.1801.07243 · Cited by 165
Learning to Speak and Act in a Fantasy Text Adventure Game
Urbanek, J., Fan, A., Karamcheti, S., Jain, S., Humeau, S., Dinan, E., Rocktäschel, T., Kiela, D., Szlam, A., & Weston, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1062 · Cited by 156
Concepts do more than categorize
Solomon, K. O., Medin, D. L., & Lynch, E. B. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01288-7 · Cited by 152
Reconciling Embodied and Distributional Accounts of Meaning in Language
Andrews, M., Frank, S., & Vigliocco, G. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12096 · Cited by 147
Nelson, D. K. (1995) · Cognitive Development · doi:10.1016/0885-2014(95)90002-0 · Cited by 146
Inclusive yet Selective: Supervised Distributional Hypernymy Detection
Roller, S., Erk, K., & Boleda, G. (2014) · Cited by 144
Show and Tell: A Neural Image Caption Generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4555 · Cited by 136
Landauer, T. K. (2007) · doi:10.4324/9780203936399-5 · Cited by 133
Mathematical Foundations Behind Latent Semantic Analysis
Martin, D. I., & Berry, M. W. (2015) · Routledge eBooks · doi:10.4324/9780203936399.ch2 · Cited by 130
Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029649 · Cited by 121
Concepts in a Probabilistic Language of Thought
Goodman, N. D., Tenenbaum, J. B., & Gerstenberg, T. (2015) · The Conceptual Mind · doi:10.7551/mitpress/9383.003.0035 · Cited by 104
From words-as-mappings to words-as-cues: the role of language in semantic knowledge
Lupyan, G., & Lewis, M. (2019) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2017.1404114 · Cited by 101
Grounding Distributional Semantics in the Visual World
Baroni, M. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12170 · Cited by 99
A BERT Baseline for the Natural Questions
Alberti, C., Lee, K., & Collins, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08634 · Cited by 88
Image-Chat: Engaging Grounded Conversations
Shuster, K., Humeau, S., Bordes, A., & Weston, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.219 · Cited by 88
Marelli, M., Gagné, C. L., & Spalding, T. L. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.026 · Cited by 82
A Roadmap Towards Machine Intelligence
Mikolov, T., Joulin, A., & Baroni, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75477-2_2 · Cited by 80
Introduction To Natural Language Processing
Eisenstein, J. (2021) · Cited by 76
Distributional semantics as a source of visual knowledge
Lewis, M., Zettersten, M., & Lupyan, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910148116 · Cited by 73
Emergence of analogy from relation learning
Lu, H., Wu, Y. N., & Holyoak, K. J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814779116 · Cited by 70
A Benchmark for Systematic Generalization in Grounded Language Understanding
Ruis, L., Andreas, J., Baroni, M., Bouchacourt, D., & Lake, B. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05161 · Cited by 63
Self-citationParents' descriptions of objects: Potential data for children's inferences about category principles
Callanan, M. A. (1990) · Cognitive Development · doi:10.1016/0885-2014(90)90015-l · Cited by 62
Extending Machine Language Models toward Human-Level Language Understanding
McClelland, J. L., Hill, F., Rudolph, M., Baldridge, J., & Schütze, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05877 · Cited by 61
Murphy, G. L. (1991) · Cited by 58
Self-citationAssessing Phrasal Representation and Composition in Transformers
Yu, L., & Ettinger, A. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.397 · Cited by 58
Vecchi, E. M., Marelli, M., Zamparelli, R., & Baroni, M. (2016) · Cognitive Science · doi:10.1111/cogs.12330 · Cited by 55
Kintsch, W. (2015) · Routledge eBooks · doi:10.4324/9780203936399.ch5 · Cited by 46
Learning as the Unsupervised Alignment of Conceptual SystemsPreprint
Roads, B. D., & Love, B. (2019) · doi:10.17605/osf.io/ndrmg · Cited by 42
Understanding Early Word Learning in Situated Artificial AgentsPreprint
Hill, F., Clark, S. R. L., Hermann, K. M., & Blunsom, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09867 · Cited by 38
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text
Hill, F., Mokrá, S., Wong, N., & Harley, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09382 · Cited by 31
Phrase similarity in humans and machines.
Gershman, S. J., & Tenenbaum, J. B. (2015) · Cited by 30
Günther, F., & Marelli, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0163200 · Cited by 28
Grand, G., Blank, I., Pereira, F., & Fedorenko, E. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01241 · Cited by 24
Virtual Embodiment: A Scalable Long-Term Strategy for Artificial Intelligence Research
Kiela, D., Bulat, L., Verő, A. L., & Clark, S. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07432 · Cited by 22
Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings
Wiedemann, G., Remus, S., Chawla, A., & Biemann, C. (2019) · KONVENS · Cited by 17
Modeling question asking using neural program generationPreprint
Wang, Z., & Lake, B. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09899 · Cited by 12
Self-citation(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Research works printed but not linked: 21
- Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations (ICLR).
- Bender, E. M., Gebru, T., McMillan-Major, A., & Mitchell, M. (2021). On the dangers of stochastic parrots: Can language models be too big? In Conference on Fairness, Accountability, and Transparency (FAccT '21) (pp. 610-623). Association for Computing Machinery.
- Bordes, A., Boureau, Y.-L., & Weston, J. (2017). Learning end-to-end goal-oriented dialog. In International Conference on Learning Representations (ICLR).
- Brachman, R. J. (1979). On the epistemological status of semantic networks. In N. V. Findler (Ed.), Associative networks: Representation and use of knowledge by computers (p. 3-50). New York: Academic Press.
- Chen, H., Liu, X., Yin, D., & Tang, J. (2017). A survey on dialogue systems: Recent advances and new frontiers. ACM SIGKDD Explorations Newsletter . Retrieved from http://arxiv.org/ abs/1711.01731 · arXiv
- De Deyne, S., Navarro, D. J., & Collell, G. (2018). Visual and affective grounding in language and mind. PsyArXiv preprint . Retrieved from psyarxiv.com/q97f8/
- Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). ImageNet: A largescale hierarchical image database. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 248-255).
- Dennis, S. (2007). How to use the LSA website. In T. K. Landauer, D. S. McNamara, S. Dennis, & W. Kintsch (Eds.), Handbook of latent semantic analysis (pp. 57-70). Lawrence Erlbaum Associates.
- Elman, J. L. (2014). Systematicity in the lexicon: On having your cake and eating it too. In P. Calvo & J. Symons (Eds.), The architecture of cognition: Rethinking Fodor and Pylyshyn's systematicity challenge (pp. 115-146). Cambridge, MA: MIT Press.
- Fyshe, A., Wehbe, L., Talukdar, P., Murphy, B., & Mitchell, T. (2015). A compositional and interpretable semantic space. In Proceedings of the 2015 conference of the north american chapter of the association for computational linguistics: Human language technologies (pp. 32-41).
- Hill, F., Lampinen, A., Schneider, R., Clark, S., Botvinick, M., McClelland, J. L., & Santoro, A. (2020). Environmental drivers of systematicity and generalisation in a stiuated agent. In International Conference on Learning Representations (ICLR).
- Lake, B. M. (2019). Compositional generalization through meta sequence-to-sequence learning. In Advances in Neural Information Processing Systems.
- Linzen, T., Dupoux, E., & Goldberg, Y. (2016). Assessing the ability of LSTMs to learn syntaxsensitive dependencies. Transactions of the Association for Computational Linguistics , 4 , 521-535.
- Louwerse, M. M. (2007). Symbolic or embodied representations: A case for symbol interdependency. In T. K. Landauer, D. S. McNamara, S. Dennis, & W. Kintsch (Eds.), Handbook of latent semantic analysis (pp. 107-120). Lawrence Erlbaum Associates.
- Markman, E. M. (1989). Categorization and naming in children . Cambridge, MA: MIT Press.
- Mikolov, T., Grave, E., Bojanowski, P., Puhrsch, C., & Joulin, A. (2018). Advances in pre-training distributed word representations. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC).
- Murphy, G. L., & Andrew, J. M. (1993). The conceptual basis of antonymy and synonym in adjectives. Journal of Memory and Language , 32 , 301-319.
- Rogers, T. T., & McClelland, J. L. (2004). Semantic cognition . Cambridge, MA: MIT Press.
- Rothe, A., Lake, B. M., & Gureckis, T. M. (2017). Question asking as program generation. In Advances in Neural Information Processing Systems 30 (pp. 1046--1055).
- Sennrich, R., Haddow, B., & Birch, A. (2016). Neural machine translation of rare words with subword units. 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers , 3 , 1715-1725.
- Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019). GLUE: A multitask benchmark and analysis platform for natural language understanding. International Conference on Learning Representations, (ICLR) .
Cited by
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
Talking about Large Language Models
Shanahan, M. (2024) · Communications of the ACM · doi:10.1145/3624724 · Cited by 381
“BOT: This yields the full prompt to be submitted to the LLM, which will hopefully predict a con-4”
BackgroundThe debate over understanding in AI’s large language models
Mitchell, M., & Krakauer, D. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2215907120 · Cited by 340
Brains and algorithms partially converge in natural language processing
Caucheteux, C., & King, J.-R. (2022) · Communications Biology · doi:10.1038/s42003-022-03036-1 · Cited by 318
Metadata
- Authors
- Lake, B. M., & Murphy, G. L.
- Affiliations
- New York University (US)
- ORCID
- Lake, Brenden M.
- Venue
- Psychological Review
- Published
- 2023-03
- Volume
- 130
- Issue
- 2
- Pages
- 401-431
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W3047499204
- Cited by
- 131
- References
- 133
- Citations by year
- 2026: 11 · 2025: 28 · 2024: 23 · 2023: 28
- FWCI
- 21.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Psychological Review (publishedVersion, other-oa)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1922658)
- Defense Advanced Research Projects Agency (A000011479)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- word meaning, word similarity, natural language processing models, human-computer comparison, conceptual representation, priming, word association, language comprehension, embodiment, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.