Language Model Behavior: A Comprehensive Survey
Open accessThe DOI matches its Crossref record; 425 of the 425 references it cites were found in a registry or an index.
Abstract
Transformer language models have received widespread public attention, yet their generated text is often surprising even to NLP researchers. In this survey, we discuss over 250 recent studies of English language model behavior before task-specific fine-tuning. Language models possess basic capabilities in syntax, semantics, pragmatics, world knowledge, and reasoning, but these capabilities are sensitive to specific inputs and surface features. Despite dramatic increases in generated text quality as models scale to hundreds of billions of parameters, the models are still prone to unfactual responses, commonsense errors, memorized text, and social biases. Many of these weaknesses can be framed as over-generalizations or under-generalizations of learned patterns in text. We synthesize recent results to highlight what is currently known about large language model capabilities, thus providing a resource for applied work and for research in adjacent fields that use language models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“So far, quantitative comparisons have looked mainly at basic grammar and syntax (5) or features such as word choice, punctuation, sentence length, and so on, finding evidence of some differences between human- and LLM-written text (10–14).”
From Do LLMs write like humans? Variation in grammatical and rhetorical styles (2025) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–400 of 425
WinoQueer: A community-in-the-loop benchmark for anti-LGBTQ+ bias in large language models
Felkner, V., Chang, H.-C. H., Jang, E., & May, J. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.507 · Cited by 74
Czarnowska, P., Vyas, Y., & Shah, K. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00425 · Cited by 72
Towards Few-shot Fact-Checking via Perplexity
Lee, N., Bang, Y., Madotto, A., & Fung, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.158 · Cited by 71
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases
Cao, B., Lin, H., Han, X., Sun, L., Yan, L., Liao, M., Xue, T., & Xu, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.146 · Cited by 71
Examining the Inductive Bias of Neural Language Models with Artificial Languages
White, J. C., & Cotterell, R. (2021) · doi:10.18653/v1/2021.acl-long.38 · Cited by 70
BabyBERTa: Learning More Grammar With Small-Scale Child-Directed Language
Huebner, P. A., Sulem, E., Cynthia, F., & Roth, D. (2021) · Proceedings of the 25th Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.49 · Cited by 70
McCoy, R. T., Smolensky, P., Linzen, T., Gao, J., & Celikyilmaz, A. (2021) · arXiv · doi:10.48550/arxiv.2111.09509 · Cited by 70 · cited 1×
“2022), but its longer sequences are more novel than humangenerated text (despite occasional memorized passages; McCoy et al. 2021).”
BackgroundMcCoy, R. T., Smolensky, P., Linzen, T., Gao, J., & Celikyilmaz, A. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00567 · Cited by 70 · cited 1×
“2022), but its longer sequences are more novel than humangenerated text (despite occasional memorized passages; McCoy et al. 2021).”
BackgroundProbing Toxic Content in Large Pre-Trained Language Models
Ousidhoum, N., Zhao, X., Fang, T., Song, Y., & Yeung, D.-Y. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.329 · Cited by 69 · cited 2×
“and autoregressive models are substantially more likely to generate toxic content (Hassan, Huenerfauth, and Alm 2021; Ousidhoum et al. 2021).”
BackgroundSafeText: A Benchmark for Exploring Physical Safety in Language Models
Levy, S., Allaway, E., Subbiah, M., Chilton, L. B., Patton, D. U., McKeown, K. R., & Wang, W. Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.154 · Cited by 69
Language models, like humans, show content effects on reasoning tasks
Lampinen, A. K., Dasgupta, I., Chan, S. C. Y., Sheahan, H. R., Creswell, A., Kumaran, D., McClelland, J. L., & Hill, F. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae233 · Cited by 69
Quantifying and alleviating political bias in language models
Liu, R., Jia, C., Wei, J., Xu, G., & Vosoughi, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2021.103654 · Cited by 68 · cited 4×
“States states with different political leanings), although they tend to generate liberalleaning text overall (Liu et al. 2022c).”
InfluentialDeduplicating Training Data Mitigates Privacy Risks in Language Models
Kandpal, N., Wallace, E., & Raffel, C. (2022) · arXiv · doi:10.48550/arxiv.2202.06539 · Cited by 68
An Analysis of Negation in Natural Language Understanding Corpora
Hossain, M. M., Chinnappa, D., & Blanco, E. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.81 · Cited by 67
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
Peng, H. M., Wang, X., Hu, S., Jin, H., Hou, L., Li, J., Liu, Z., & Liu, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.335 · Cited by 67
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Tirumala, K., Markosyan, A., Zettlemoyer, L., & Aghajanyan, A. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2773 · Cited by 67
Quantity doesn’t buy quality syntax with neural language models
van Schijndel, M., Mueller, A., & Linzen, T. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1592 · Cited by 65
Ryu, S. H., & Lewis, R. L. (2021) · Workshop on Cognitive Modeling and Computational Linguistics (CMCL) · doi:10.18653/v1/2021.cmcl-1.6 · Cited by 64
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
Tay, Y., Dehghani, M., Rao, J., Fedus, W., Abnar, S., Chung, H. W., Narang, S., Yogatama, D., Vaswani, A., & Metzler, D. (2021) · arXiv · doi:10.48550/arxiv.2109.10686 · Cited by 63
Using Computational Models to Test Syntactic Learnability
Wilcox, E. G., Futrell, R., & Levy, R. (2024) · Linguistic Inquiry · doi:10.1162/ling_a_00491 · Cited by 62
Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning
Tamborrino, A., Pellicanò, N., Pannier, B., Voitot, P., & Naudin, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.357 · Cited by 61
SyntaxGym: An Online Platform for Targeted Evaluation of Language Models
Gauthier, J., Hu, J., Wilcox, E., Qian, P., & Levy, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/2020.acl-demos.10 · Cited by 61
The Grammar-Learning Trajectories of Neural Language Models
Choshen, L., Hacohen, G., Weinshall, D., & Abend, O. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.568 · Cited by 61
Is GPT-3 a Psychopath? Evaluating Large Language Models from a Psychological PerspectivePreprint
Li, X., Li, Y.-T., Liu, L., Bing, L., & Joty, S. R. (2022) · arXiv.org · doi:10.48550/arxiv.2212.10529 · Cited by 61 · cited 1×
“psychopathy scores and low self-satisfaction scores on psychometric surveys (Li et al. 2022b).”
BackgroundWhat does BERT know about books, movies and music? Probing BERT for Conversational Recommendation
Penha, G., & Hauff, C. (2020) · Fourteenth ACM Conference on Recommender Systems · doi:10.1145/3383313.3412249 · Cited by 60
Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models
de Vassimon Manela, D., Errington, D., Fisher, T., van Breugel, B., & Minervini, P. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.190 · Cited by 59
TIMEDIAL: Temporal Commonsense Reasoning in Dialog
Qin, L., Gupta, A., Upadhyay, S., He, L., Choi, Y., & Faruqui, M. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.549 · Cited by 59 · cited 1×
““My holiday is only _”) (Qin et al. 2021), although they are able to predict the telicity (completed vs.”
BackgroundWord Order Does Matter and Shuffled Language Models Know It
Abdou, M., Ravishankar, V., Kulmizev, A., & Søgaard, A. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.476 · Cited by 59
McCoy, R. T., Frank, R., & Linzen, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09091 · Cited by 58
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values
Arora, A., Kaffee, L.-A., & Augenstein, I. (2023) · Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP) · doi:10.18653/v1/2023.c3nlp-1.12 · Cited by 57
Protecting Intellectual Property of Language Generation APIs with Lexical Watermark
He, X., Xu, Q., Lyu, L., Wu, F., & Wang, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21321 · Cited by 56
BERT is Not a Knowledge Base (Yet): Factual Knowledge vs. Name-Based Reasoning in Unsupervised QA.Preprint
Poerner, N., Waltinger, U., & Schütze, H. (2019) · arXiv (Cornell University) · Cited by 55
Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias
Tal, Y., Magar, I., & Schwartz, R. (2022) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.13 · Cited by 55
Dugan, L., Ippolito, D., Kirubarajan, A., Shi, S., & Callison-Burch, C. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26501 · Cited by 54
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
Zhou, P., Khanna, R., Lee, S., Lin, B. Y., Ho, D., Pujara, J., & Ren, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.598 · Cited by 53
Investigating representations of verb bias in neural language models
Hawkins, R., Yamakoshi, T., Griffiths, T. L., & Goldberg, A. E. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.376 · Cited by 53
Event Knowledge in Large Language Models: The Gap Between the Impossible and the Unlikely
Kauf, C., Ivanova, A. A., Rambelli, G., Chersoni, E., She, J. S., Chowdhury, Z., Fedorenko, E., & Lenci, A. (2023) · Cognitive Science · doi:10.1111/cogs.13386 · Cited by 53
Language models show human-like content effects on reasoning tasks
Dasgupta, I., Lampinen, A. K., Chan, S. C. Y., Sheahan, H. R., Creswell, A., Kumaran, D., McClelland, J. L., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2207.07051 · Cited by 53 · cited 1×
“logical answer, although this effect is also present in people (Dasgupta et al. 2022).”
BackgroundPROST: Physical Reasoning about Objects through Space and Time
Aroca-Ouellette, S., Paik, C., Roncone, A., & Kann, K. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.404 · Cited by 52
Intersectional Bias in Causal Language ModelsPreprint
Magee, L., Ghahremanlou, L., Soldatić, K., & Robertson, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07691 · Cited by 51 · cited 1×
“Muslim people, with unpredictable effects of intersectionality (Magee et al. 2021).”
BackgroundDo Language Models Plagiarize?
Lee, J., Le, T., Chen, J., & Lee, D. (2023) · Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543507.3583199 · Cited by 51 · cited 1×
“2023), along with more paraphrased memorized text (Lee et al. 2023).”
BackgroundDo Language Models Plagiarize?
Lee, J., Le, T., Chen, J., & Lee, D. (2022) · arXiv · doi:10.48550/arxiv.2203.07618 · Cited by 51 · cited 1×
“2023), along with more paraphrased memorized text (Lee et al. 2023).”
BackgroundThe Ghost in the Machine has an American accent: value conflict in GPT-3
Johnson, R. L., Pistilli, G., Menédez-González, N., Duran, L. D. D., Panai, E., Kalpokiene, J., & Bertulfo, D. J. (2022) · arXiv · doi:10.48550/arxiv.2203.07785 · Cited by 50 · cited 1×
“values in the input text towards United States moral and political values as opposed to values from other countries (Johnson et al. 2022).”
ResultMeasuring Reliability of Large Language Models through Semantic ConsistencyPreprint
Raj, H., Rosati, D., & Majumdar, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.05853 · Cited by 50
Karpas, E., Abend, O., Belinkov, Y., Lenz, B., Lieber, O., Ratner, N., Shoham, Y., Bata, H., Levine, Y., Leyton-Brown, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.00445 · Cited by 49
Analyzing Transformers in Embedding Space
Dar, G., Geva, M., Gupta, A., & Berant, J. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.893 · Cited by 49
Can Large Language Models Truly Understand Prompts? A Case Study with Negated PromptsPreprint
Jang, J., Ye, S., & Seo, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.12711 · Cited by 49
Sinclair, A., Jumelet, J., Zuidema, W., & Fernández, R. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00504 · Cited by 48 · cited 1×
“to repeat syntactic structures from the input context (Sinclair et al. 2022), with grammatical vs.”
BackgroundLearning in the Rational Speech Acts Model
Monroe, W., & Potts, C. E. (2015) · Proceedings of the Amsterdam Colloquium · doi:10.53437/ph73fp56 · Cited by 47
The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color
Paik, C., Aroca-Ouellette, S., Roncone, A., & Kann, K. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.63 · Cited by 47 · cited 1×
““red ball”) than with human judgments (Paik et al. 2021), particularly”
BackgroundRuis, L., Khan, A., Biderman, S., Hooker, S., Rocktäschel, T., & Grefenstette, E. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-0913 · Cited by 47
Investigating African-American Vernacular English in Transformer-Based Text Generation
Groenwold, S., Ou, L., Parekh, A., Honnavalli, S., Levy, S., Mirza, D., & Wang, W. Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.473 · Cited by 46
Silva, A., Tambwekar, P., & Gombolay, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.189 · Cited by 46
Mahowald, K. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.20 · Cited by 46
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought
Saparov, A., & He, H. (2022) · arXiv · doi:10.48550/arxiv.2210.01240 · Cited by 46
Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and Negation
Geiger, A., Richardson, K., & Potts, C. (2020) · Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/2020.blackboxnlp-1.16 · Cited by 44
Measuring Harmful Sentence Completion in Language Models for LGBTQIA+ Individuals
Nozza, D., Bianchi, F., Lauscher, A., & Hovy, D. (2022) · Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion · doi:10.18653/v1/2022.ltedi-1.4 · Cited by 44 · cited 1×
“13% of the time in masked models (350M parameters), up to 87% for some identity groups (Nozza et al. 2022).”
BackgroundThe Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail
Bowman, S. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.516 · Cited by 44
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Suzgun, M., Scales, N., Schärli, N., Gehrmann, S., Tay, Y., Chung, H. W., Chowdhery, A., Le, Q. V., Chi, E. H., Zhou, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.09261 · Cited by 44
“You are grounded!”: Latent Name Artifacts in Pre-trained Language Models
Shwartz, V., Rudinger, R., & Tafjord, O. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.556 · Cited by 43
Pragmatic competence of pre-trained language models through the lens of discourse connectives
Pandia, L., Cong, Y., & Ettinger, A. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.29 · Cited by 43
Evaluating and Inducing Personality in Pre-trained Language ModelsPreprint
Jiang, G., Xu, M., Zhu, S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.07550 · Cited by 43 · cited 1×
“similar effects, answering personality questions similarly to personalities described in given prompts (Jiang et al. 2022).”
BackgroundFrequency Effects on Syntactic Rule Learning in Transformers
Wei, J., Garrette, D., Linzen, T., & Pavlick, E. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.72 · Cited by 42 · cited 2×
“(Wei et al. 2021), with further degradations if there is an intervening clause between the subject and verb as in Example 4 (Lasri, Lenci, and Poibeau 2022a).”
BackgroundMoral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identity
Simmons, G. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) · doi:10.18653/v1/2023.acl-srw.40 · Cited by 42
Causal Reasoning of Entities and Events in Procedural Texts
Zhang, L., Xu, H., Yang, Y., Zhou, S., You, W., Arora, M., & Callison-Burch, C. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.31 · Cited by 42
How Linguistically Fair Are Multilingual Pre-Trained Language Models?
Choudhury, M., & Deshpande, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17505 · Cited by 41
Choenni, R., Shutova, E., & van Rooij, R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.111 · Cited by 41
A taxonomy and review of generalization research in NLPPreprint
Hupkes, D., Giulianelli, M., Dankers, V., Artetxe, M., Elazar, Y., Pimentel, T., Christodoulopoulos, C., Lasri, K., Saphra, N., Sinclair, A., et al. (2022) · arXiv (Cornell University) · doi:10.3929/ethz-b-000638992 · Cited by 41
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2Preprint
Betz, G., Richardson, K., & Voigt, C. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.13033 · Cited by 40
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Finlayson, M., Mueller, A., Gehrmann, S., Shieber, S., Linzen, T., & Belinkov, Y. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.144 · Cited by 40 · cited 1×
“entries in the models’ vector representations) and language modeling predictions (Vig et al. 2020; Geva et al. 2021; Finlayson et al. 2021; Geva et al. 2022).”
BackgroundIdentifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models
Wang, T., Sridhar, R., Yang, D., & Wang, X. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.130 · Cited by 40
Analyzing BERT’s Knowledge of Hypernymy via Prompting
Hanna, M., & Mareček, D. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.20 · Cited by 40
Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT
Bhavya, B., Xiong, J., & Zhai, C. (2022) · Proceedings of the 15th International Conference on Natural Language Generation · doi:10.18653/v1/2022.inlg-main.25 · Cited by 40
Refining Targeted Syntactic Evaluation of Language Models
Newman, B., Ang, K.-S., Gong, J., & Hewitt, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.290 · Cited by 39
How BPE Affects Memorization in TransformersPreprint
Kharitonov, E., Baroni, M., & Hupkes, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02782 · Cited by 39
How Decoding Strategies Affect the Verifiability of Generated Text
Massarelli, L., Petroni, F., Piktus, A., Ott, M., Rocktäschel, T., Plachouras, V., Silvestri, F., & Riedel, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.22 · Cited by 38
“Nice Try, Kiddo”: Investigating Ad Hominems in Dialogue Responses
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.60 · Cited by 38 · cited 1×
“topics such as veganism or WFH (work from home) (Sheng et al. 2021a).”
BackgroundDo Neural Language Models Overcome Reporting Bias?
Shwartz, V., & Choi, Y. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.605 · Cited by 37
Robust Conversational Agents against Imperceptible Toxicity Triggers
Mehrabi, N., Beirami, A., Morstatter, F., & Galstyan, A. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.204 · Cited by 37
Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias
Chen, Y., Raghuram, V. C., Mattern, J., Mihalcea, R. F., & Jin, Z. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.281 · Cited by 37
Quantifying Social Biases Using Templates is UnreliablePreprint
Seshadri, P., Pezeshkpour, P., & Singh, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.04337 · Cited by 37
Arefyev, N., Sheludko, B., Podolskiy, A., & Panchenko, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.107 · Cited by 36
Assessing Political Prudence of Open-domain Chatbots
Bang, Y., Lee, N., Ishii, E., Madotto, A., & Fung, P. (2021) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2021.sigdial-1.57 · Cited by 36
Context Matters: A Pragmatic Study of PLMs’ Negation Understanding
Gubelmann, R., & Handschuh, S. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.315 · Cited by 36
Thinking Fast and Slow in Large Language Models
Hagendorff, T., Fabi, S., & Kosiński, M. (2022) · PubMed · doi:10.48550/arxiv.2212.05206 · Cited by 36
Probing Neural Language Models for Human Tacit AssumptionsPreprint
Weir, N., Poliak, A., & Durme, B. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04877 · Cited by 36
Are Pretrained Language Models Symbolic Reasoners over Knowledge?
Kassner, N., Krojer, B., & Schütze, H. (2020) · Proceedings of the 24th Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.45 · Cited by 35
What Context Features Can Transformer Language Models Use?
O’Connor, J., & Andreas, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.70 · Cited by 35
Probing Across Time: What Does RoBERTa Know and When?
Liu, Z., Wang, Y., Kasai, J., Hajishirzi, H., & Smith, N. A. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.71 · Cited by 35
FOLIO: Natural Language Reasoning with First-Order Logic
Han, S., Schoelkopf, H., Zhao, Y., Qi, Z., Riddell, M., Zhou, W., Coady, J., Peng, D., Qiao, Y., Benson, L., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.00840 · Cited by 35
How Large Language Models are Transforming Machine-Paraphrase Plagiarism
Wahle, J. P., Ruas, T., Kirstein, F., & Gipp, B. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.62 · Cited by 35 · cited 2×
“reported when people are asked to identify GPT-3 paraphrased Wikipedia paragraphs (Wahle et al. 2022) and GPT-3 generated tweets (Spitale, Biller-Andorno, and Germani”
BackgroundOn the Compositional Generalization Gap of In-Context Learning
Hosseini, A., Vani, A., Bahdanau, D., Sordoni, A., & Courville, A. C. (2022) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2022.blackboxnlp-1.22 · Cited by 34
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Tay, Y., Dehghani, M., Abnar, S., Chung, H., Fedus, W., Rao, J., Narang, S., Tran, V., Yogatama, D., & Metzler, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.825 · Cited by 34
Language model acceptability judgements are not always robust to context
Sinha, K., Gauthier, J., Mueller, A., Misra, K., Fuentes, K., Lévy, R., & Williams, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.333 · Cited by 33
Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge
Pedinotti, P., Rambelli, G., Chersoni, E., Santus, E., Lenci, A., & Blache, P. (2021) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2021.starsem-1.1 · Cited by 32
Hassan, S., Huenerfauth, M., & Alm, C. O. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.267 · Cited by 32
Lampinen, A. K. (2022) · arXiv · doi:10.48550/arxiv.2210.15303 · Cited by 32
On Measures of Biases and Harms in NLP
Dev, S., Sheng, E., Zhao, J., Amstutz, A., Sun, J., Hou, Y., Sanseverino, M., Kim, J., Nishi, A., Peng, N., et al. (2022) · Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022 · doi:10.18653/v1/2022.findings-aacl.24 · Cited by 32 · cited 1×
“Previous surveys discuss potential societal impacts and harms of language model biases (Dev et al. 2022), along with how previous language model bias studies relate to these harms (Blodgett et al.”
BackgroundLampinen, A. (2024) · Computational Linguistics · doi:10.1162/coli_a_00525 · Cited by 32
Are Prompt-based Models Clueless?
Kavumba, P., Ryo, T., & Oda, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.166 · Cited by 31
Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., & Wei, F. (2022) · arXiv · doi:10.48550/arxiv.2212.10559 · Cited by 31 · cited 1×
“3) without explicit parameter updates (Dai et al. 2022).”
Do language models learn typicality judgments from text?Preprint
Misra, K., Ettinger, A., & Rayz, J. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.02987 · Cited by 31
Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal Negation
Truong, T. H., Otmakhova, Y., Baldwin, T., Cohn, T., Lau, J. H., & Verspoor, K. M. (2022) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2022.aacl-main.65 · Cited by 31
A howling success or a working sea? Testing what BERT knows about metaphors
Pedinotti, P., Palma, E. D., Cerini, L., & Lenci, A. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.13 · Cited by 30 · cited 1×
“common) metaphors, then novel metaphors, then nonsense (Pedinotti et al. 2021a; Griciūtė, Tanti, and Donatelli 2022).”
BackgroundWhat do Large Language Models Learn about Scripts?
Sancheti, A., & Rudinger, R. (2022) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2022.starsem-1.1 · Cited by 30
Language model acceptability judgements are not always robust to contextPreprint
Sinha, K., Gauthier, J., Mueller, A., Misra, K., Fuentes, K., Levy, R., & Williams, A. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.08979 · Cited by 30 · cited 1×
“cality respectively in autoregressive models (Sinha et al. 2022a).”
Pretrained Language Model Embryology: The Birth of ALBERT
Chiang, C.-H., Huang, S.-F., & Lee, H.-Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.553 · Cited by 29
BLiMP: the benchmark of linguistic minimal pairs for English
Warstadt, A., Parrish, A., Liu, H., Mohananey, A., Peng, W., Wang, S.-F., & Bowman, S. R. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00321 · Cited by 28 · cited 1×
“with less accuracy than many syntactic tasks (Warstadt et al. 2020).”
BackgroundMosbach, M., Khokhlova, A., Hedderich, M. A., & Klakow, D. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.227 · Cited by 28
Relating Neural Text Degeneration to Exposure Bias
Chiang, T.-R., & Chen, Y.-N. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.16 · Cited by 28
Preventing generation of verbatim memorization in language models gives a false sense of privacy
Ippolito, D., Tramer, F., Nasr, M., Zhang, C., Jagielski, M., Lee, K., Choquette Choo, C., & Carlini, N. (2023) · Proceedings of the 16th International Natural Language Generation Conference · doi:10.18653/v1/2023.inlg-main.3 · Cited by 28
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language ModelsPreprint
Zhang, H., Song, H., Li, S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.05337 · Cited by 28 · cited 1×
“data using controlled text generation (Li et al. 2021; Zhang et al. 2023a).”
Jiang, C., Nian, Z., Guo, K., Chu, S., Zhao, Y., Shen, L., & Tu, K. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.235 · Cited by 27
Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models
Beyer, A., Loáiciga, S., & Schlangen, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.328 · Cited by 27
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning
Wang, C., Zheng, B., Niu, Y., & Zhang, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88480-2_61 · Cited by 27
How much pretraining data do language models need to learn syntax?
Pérez-Mayos, L., Ballesteros, M., & Wanner, L. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.118 · Cited by 26
Aina, L., & Linzen, T. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.4 · Cited by 26
Word Acquisition in Neural Language Models
Chang, T. A., & Bergen, B. K. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00444 · Cited by 26
Self-citationProbing GPT-3’s Linguistic Knowledge on Semantic Tasks
Zhang, L., Wang, M., Chen, L., & Zhang, W. (2022) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2022.blackboxnlp-1.24 · Cited by 26
Investigating Memorization of Conspiracy Theories in Text Generation
Levy, S., Saxon, M., & Wang, W. Y. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.416 · Cited by 25
Richer Countries and Richer Representations
Zhou, K., Ethayarajh, K., & Jurafsky, D. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.164 · Cited by 25
Buy Tesla, Sell Ford: Assessing Implicit Stock Market Preference in Pre-trained Language Models
Chuang, C., & Yang, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.12 · Cited by 25
Inverse Scaling Can Become U-Shaped
Wei, J., Kim, N., Tay, Y., & Le, Q. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.963 · Cited by 25
Kirk, H. R., Jun, Y., Iqbal, H., Benussi, E., Volpin, F., Dreyer, F. A., Shtedritski, A., & Asano, Y. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04130 · Cited by 25 · cited 1×
“labor statistics in the United States; occupational biases based on gender in language models are slightly less skewed than true labor statistics (Kirk et al. 2021).”
BackgroundPredicting Reference: What do Language Models Learn about Discourse Models?
Upadhye, S., Bergen, L., & Kehler, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.70 · Cited by 24
How Can the [MASK] Know? The Sources and Limitations of Knowledge in BERT
Podkorytov, M., Biś, D., & Liu, X. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534299 · Cited by 24
Sociolectal Analysis of Pretrained Language Models
Zhang, S., Zhang, X., Zhang, W., & Søgaard, A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.375 · Cited by 24
Can Pre-trained Language Models Interpret Similes as Smart as Human?
He, Q., Cheng, S., Li, Z., Xie, R., & Xiao, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.543 · Cited by 24
Scaling Laws and Interpretability of Learning from Repeated Data
Hernandez, D., Brown, T., Conerly, T., DasSarma, N., Drain, D., El-Showk, S., Elhage, N., Hatfield-Dodds, Z., Henighan, T., Hume, T., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.10487 · Cited by 24
On the Role of Bidirectionality in Language Model Pre-Training
Artetxe, M., Du, J., Goyal, N., Zettlemoyer, L., & Stoyanov, V. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.293 · Cited by 24
Discourse structure interacts with reference but not syntax in neural language models
Davis, F., & van Schijndel, M. (2020) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.32 · Cited by 23
Infinitely productive language can arise from chance under communicative pressure
Piantadosi, S. T., & Fedorenko, E. (2017) · Journal of Language Evolution · doi:10.1093/jole/lzw013 · Cited by 22
Assessing Discourse Relations in Language Generation from GPT-2
Ko, W.-J., & Li, J. J. (2020) · International Conference on Natural Language Generation · doi:10.18653/v1/2020.inlg-1.8 · Cited by 22
Look at that! BERT can be easily distracted from paying attention to morphosyntax
Chaves, R. P., & Richter, S. N. (2021) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/b92s-qd21 · Cited by 22
Probing for Bridging Inference in Transformer Language Models
Pandit, O., & Hou, Y. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.327 · Cited by 22
Pandia, L., & Ettinger, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.119 · Cited by 22
Inferring Implicit Relations in Complex Questions with Language Models
Katz, U., Geva, M., & Berant, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.188 · Cited by 22
Shortcut Learning of Large Language Models in Natural Language UnderstandingPreprint
Du, M., He, F., Zou, N., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.11857 · Cited by 22 · cited 1×
“During the fine-tuning process, language models are prone to overfitting to spurious correlations between text features and labels in the fine-tuning dataset (McCoy, Pavlick, and Linzen 2019; Kavumba et al. 2020; Wang et al. 2022b; Du et al. 2022a; Kavumba, Takahashi, and Oda 2022), and they can even “forget” syntacti…”
BackgroundCollateral facilitation in humans and language models
Michaelov, J. A., & Bergen, B. K. (2022) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2022.conll-1.2 · Cited by 21
Self-citation(2022) · doi:10.18653/v1/2022.emnlp-main.746 · Cited by 21
Ruis, L., Khan, A., Biderman, S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.14986 · Cited by 21
Emergent Analogical Reasoning in Large Language ModelsPreprint
Webb, T. W., Holyoak, K. J., & Lu, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.09196 · Cited by 21
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View
Cao, B., Lin, H., Han, X., Liu, F., & Sun, L. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.398 · Cited by 20
Manipulating the Perceived Personality Traits of Language Models
Caron, G., & Srivastava, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.156 · Cited by 20
Does BERT agree? Evaluating knowledge of structure dependence through agreement relationsPreprint
Bacon, G., & Regier, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09892 · Cited by 20
AND does not mean OR: Using Formal Languages to Study Language Models’ Representations
Traylor, A., Feiman, R., & Pavlick, E. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.21 · Cited by 19
Challenges in measuring bias via open-ended language generation
Akyürek, A. F., Kocyigit, M. Y., Paik, S., & Wijaya, D. T. (2022) · Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.9 · Cited by 19
Scientific and Creative Analogies in Pretrained Language Models
Czinczoll, T., Yannakoudakis, H., Mishra, P., & Shutova, E. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.153 · Cited by 19
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models
Chang, T. A., Xu, Y., Xu, W., & Tu, Z. (2021) · doi:10.18653/v1/2021.acl-long.333 · Cited by 18 · cited 1×
“with and without position embeddings, particularly if few tokens are masked per sequence (Chang et al. 2021; Lasri, Lenci, and Poibeau 2022b).”
BackgroundSelf-citationApidianaki, M., & Soler, A. G. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.7 · Cited by 18
Michaelov, J. A., & Bergen, B. K. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.891 · Cited by 18
Self-citationA Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models
Stolfo, A., Jin, Z., Shridhar, K., Schoelkopf, B., & Sachan, M. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.32 · Cited by 17
Studying word order through iterative shuffling
Malkin, N., Lanka, S., Goel, P., & Jojić, N. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.809 · Cited by 16
Using Natural Sentence Prompts for Understanding Biases in Language Models
Alnegheimish, S., Guo, A., & Sun, Y. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.203 · Cited by 16
How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns
Brandl, S., Cui, R., & Søgaard, A. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.265 · Cited by 16
Using Commonsense Knowledge to Answer Why-Questions
Lal, Y. K., Tandon, N., Aggarwal, T., Liu, H., Chambers, N., Mooney, R. J., & Balasubramanian, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.79 · Cited by 16
Deanthropomorphising NLP: Can a language model be conscious?
Shardlow, M., & Przybyła, P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0307521 · Cited by 16
How Reliable are Model Diagnostics?
Aribandi, V., Tay, Y., & Metzler, D. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.155 · Cited by 15
How to Query Language Models?Preprint
Adolphs, L., Dhuliawala, S., & Hofmann, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01928 · Cited by 15
Schuster, S., & Linzen, T. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.71 · Cited by 15
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
Elazar, Y., Kassner, N., Ravfogel, S., Feder, A., Ravichander, A., Mosbach, M., Belinkov, Y., Schütze, H., & Goldberg, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.14251 · Cited by 15
Misra, K., Rayz, J., & Ettinger, A. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.213 · Cited by 15
Black-box language model explanation by context length probing
Cífka, O., & Liutkus, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.92 · Cited by 15
Interpreting Language Models Through Knowledge Graph ExtractionPreprint
Swamy, V., Romanou, A., & Jaggi, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08546 · Cited by 15
Why Do Masked Neural Language Models Still Need Common Sense Knowledge?Preprint
Kwon, S., Kang, C., Han, J., & Choi, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03024 · Cited by 14 · cited 2×
““does not have property”) (Kwon et al. 2019), although this may be due to models’ difficulty processing negation (Section 4.”
BackgroundModeling the Influence of Verb Aspect on the Activation of Typical Event Locations with BERT
Cho, W. I., Chersoni, E., Hsu, Y.-Y., & Huang, C. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.258 · Cited by 14 · cited 1×
“Masked models are more likely to predict typical locations than atypical locations for verbs (Cho et al. 2021), but they”
BackgroundTuringAdvice: A Generative and Dynamic Evaluation of Language Use
Zellers, R., Holtzman, A., Clark, E., Qin, L., Farhadi, A., & Choi, Y. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.386 · Cited by 13 · cited 1×
“GPT-3 produces worse advice than people 95% of the time in situations described on Reddit (Zellers et al. 2021).”
BackgroundHeidenreich, H. S., & Williams, J. R. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462578 · Cited by 13
Probing Pre-trained Language Models for Semantic Attributes and their Values
Beloucif, M., & Biemann, C. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.218 · Cited by 13
The Curious Case of Absolute Position Embeddings
Sinha, K., Kazemnejad, A., Reddy, S., Pineau, J., Hupkes, D., & Williams, A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.326 · Cited by 13
Zong, M., & Krishnamachari, B. (2022) · arXiv · doi:10.48550/arxiv.2212.00857 · Cited by 13
Does BERT really agree ? Fine-grained Analysis of Lexical Dependence on a Syntactic Task
Lasri, K., Lenci, A., & Poibeau, T. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.181 · Cited by 12
Grammatical cues are largely, but not completely, redundant with word meanings in natural languagePreprint
Mahowald, K., Diachek, E., Gibson, E., Fedorenko, E., & Futrell, R. (2022) · arXiv.org · doi:10.48550/arxiv.2201.12911 · Cited by 12
“Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models
Patel, R., & Pavlick, E. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.790 · Cited by 11
Porada, I., Sordoni, A., & Cheung, J. C. K. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.337 · Cited by 11
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Tay, Y., Dehghani, M., Abnar, S., Chung, H. W., Fedus, W., Rao, J., Narang, S., Tran, V. Q., Yogatama, D., & Metzler, D. (2022) · arXiv · doi:10.48550/arxiv.2207.10551 · Cited by 11
A Closer Look at the Performance of Neural Language Models on Reflexive Anaphor Licensing
Hu, J., Chen, S. Y., & Lévy, R. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/67qw-mf84 · Cited by 11 · cited 1×
“correlated with syntactic ability, although this relationship is not clear within any given model size (Hu et al. 2020; Pérez-Mayos, Ballesteros, and Wanner 2021).”
BackgroundWord Frequency Does Not Predict Grammatical Knowledge in Language Models
Yu, C., Sie, R., Tedeschi, N., & Bergen, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.331 · Cited by 10
Kementchedjhieva, Y., Anderson, M., & Søgaard, A. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.429 · Cited by 10
Learning Prototypical Functions for Physical Artifacts
Jiang, T., & Riloff, E. (2021) · doi:10.18653/v1/2021.acl-long.540 · Cited by 10
Transformers Generalize Linearly
Petty, J., & Frank, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12036 · Cited by 10
Geeraerts, D. (2016) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199384655.013.29 · Cited by 10
Unpacking Large Language Models with Conceptual ConsistencyPreprint
Sahu, P., Cogswell, M., Gong, Y., & Divakaran, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.15093 · Cited by 10 · cited 1×
“knowledge to answer questions; accuracy on relevant facts is more predictive of a correct response to a target question in larger models (Sahu et al. 2022).”
BackgroundAI model GPT-3 (dis)informs us better than humans
Spitale, G., Biller‐Andorno, N., & Germani, F. (2023) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.2301.11924 · Cited by 10
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases
Cao, B., Lin, H., Han, X., Sun, L., Yan, L., Liao, M., Xue, T., & Xu, J. (2021) · arXiv · doi:10.48550/arxiv.2106.09231 · Cited by 10
Reevaluating pragmatic reasoning in language games
Sikos, L., Venhuizen, N. J., Drenhaus, H., & Crocker, M. W. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248388 · Cited by 9
Causally Testing Gender Bias in LLMs: A Case Study on Occupational BiasPreprint
Chen, Y., Raghuram, V. C., Mattern, J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.10678 · Cited by 9
Probing Script Knowledge from Pre-Trained Models
Jin, Z., Zhang, X., Yu, M., & Huang, L. (2022) · doi:10.18653/v1/2022.umios-1.10 · Cited by 9
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters
Wang, B., Min, S., Deng, X. B., Shen, J., Wu, Y., Zettlemoyer, L., & Sun, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.10001 · Cited by 9
Chen, K., Shao, A., Burapacheep, J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.13627 · Cited by 9
Do pretrained transformers infer telicity like humans?
Zhao, Y., Ngui, J. G., Hartley, L. H., & Bethard, S. J. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.6 · Cited by 8
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing
Qiu, L., Shaw, P., Pasupat, P., Shi, T., Herzig, J., Pitler, E., Sha, F., & Toutanova, K. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.624 · Cited by 8
Word Order Matters When You Increase Masking
Lasri, K., Lenci, A., & Poibeau, T. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.118 · Cited by 8
Tuckute, G., Sathe, A., Wang, M., Yoder, H., Shain, C., & Fedorenko, E. G. (2022) · doi:10.18653/v1/2022.naacl-demo.11 · Cited by 7 · cited 2×
“gressive language models includes more concrete and frequent words, along with shallower syntactic structures, than people (Tuckute et al. 2022).”
BackgroundSubject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERTPreprint
Lasri, K., Seminck, O., Lenci, A., & Poibeau, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.10538 · Cited by 7 · cited 1×
“also been observed in people, although to a lesser degree than in language models (Lasri et al. 2022).”
ResultExploring the Effects of Negation and Grammatical Tense on Bias Probes
Touileb, S. (2022) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2022.aacl-short.53 · Cited by 7
What Can a Generative Language Model Answer About a Passage?
Summers-Stay, D. A., Bonial, C., & Voss, C. R. (2021) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/2021.mrqa-1.7 · Cited by 6
Research works printed but not linked: 28
- Aher, 2022, Using large language models to simulate multiple humans, ArXiv
- Broyde, 2021, Build a medical sentence matching application using BERT and Amazon SageMaker, AWS Machine Learning Blog
- Jigsaw, 2017, Perspective API, Google Jigsaw
- Johnson, 2022, A.I. is mastering language. Should we trust what it says?, The New York Times
- Jones, 2022, Distributional semantics still can’t account for affordances, 482
- Kabbara, 2022, Investigating the performance of transformer-based NLI models on presuppositional inferences, 779
- Kalo, 2022, KAMEL: Knowledge analysis with multitoken entities in language models
- Kavumba, 2020, Balanced COPA: Countering superficial cues in causal reasoning, Association for Natural Language Processing, 1105
- Krawczyk, 2023, Bard is getting better at logic and reasoning, The Keyword: Google Blog
- Lakretz, 2022, Can transformers process recursive nested constructions, like humans?, 3226
- Lee, 2023, What are large language models used for?, NVIDIA Blog
- Li, 2022, Counterfactual reasoning: Do language models need world knowledge for causal inference?
- Lieber, 2021, Jurassic-1: Technical details and evaluation, White Paper. AI21 Labs
- Mahowald, 2022, Experimentally measuring the redundancy of grammatical cues in transitive clauses, ArXiv
- Nayak, 2019, Understanding searches better than ever before, The Keyword: Google Blog
- OpenAI, 2022, ChatGPT: Optimizing language models for dialogue, OpenAI Blog
- OpenAI, 2023, GPT-4 technical report, OpenAI
- OpenAI, 2023, Model index for researchers, OpenAI
- Radford, 2018, Improving language understanding by generative pre-training, OpenAI
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI
- Rae, 2021, Scaling language models: Methods, analysis & insights from training gopher, ArXiv
- Reif, 2019, Visualizing and measuring the geometry of BERT, 8594
- Shi, 2021, What Transformers might know about the physical world: T5 and the origins of knowledge, 2218
- Stevenson, 2022, Putting GPT-3’s creativity to the (alternative uses) test, 164
- Tejada, 2021, A study of BERT’s processing of negations to determine sentiment, 47
- Thewsey, 2021, Bring structure to diverse documents with Amazon Textract and transformer-based models on Amazon SageMaker, AWS Machine Learning Blog
- Trott, 2023, In cautious defense of LLM-ology, Blog Post
- Valmeekam, 2022, Large language models still can’t plan (a benchmark for LLMs on planning and reasoning about change)
Cited by
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
“[14] also discusses the capabilities and limitations of LLMs in various downstream tasks.”
BackgroundA Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925
“[14] also discusses the capabilities and limitations of LLMs in various downstream tasks.”
BackgroundSequence modeling and design from molecular to genome scale with Evo
Nguyen, E., Poli, M., Durrant, M. G., Kang, B., Katrekar, D., Li, D. B., Bartie, L. J., Thomas, A. W., King, S. H., Brixi, G., et al. (2024) · Science · doi:10.1126/science.ado9336 · Cited by 580
Yang, L., Chen, H., Li, Z., Ding, X., & Wu, X. (2023) · arXiv · doi:10.48550/arxiv.2306.11489 · Cited by 239
“Furthermore, they have limited capabilities in inferring relationships between actions and events [65].”
BackgroundYang, L., Chen, H., Li, Z., Ding, X., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3360454 · Cited by 238
“Furthermore, they have limited capabilities in inferring relationships between actions and events [65].”
Background
Metadata
- Authors
- Chang, T. A., & Bergen, B. K.
- Affiliations
- University of California San Diego (US)
- ORCID
- Bergen, Benjamin K.
- Venue
- Computational Linguistics
- Publisher
- MIT Press
- Published
- 2024
- Volume
- 50
- Issue
- 1
- Pages
- 293-350
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W4388691863
- Cited by
- 105
- References
- 379
- Citations by year
- 2026: 33 · 2025: 37 · 2024: 30
- FWCI
- 9.89
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Computational Linguistics (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- Medical Library Association
- University of California, San Diego
- Harvard Data Science Initiative, Harvard University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- large language models, transformer models, syntax, semantics, pragmatics, world knowledge, reasoning, factual errors, memorization, social bias, overgeneralization, undergeneralization, model scaling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.