Language Models as Knowledge Bases?
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander Miller. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Tracing back to the work [53], large language models have shown their impressive power in storing factual information, such as entities and common sense, and then commonsense knowledge can be reliably transferred to downtown tasks.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While pure generative LLMs are often capable of answering basic factual questions (Petroni et al., 2019), simply by reciting information memorized from their training sets and stored in the model parameters”
From Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models (2024) · cites this paper as Petroni et al., 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“It is well-accepted, even among skeptical researchers, that the parameters of modern LLMs encode a remarkable amount of world knowledge [2, 12, 23, 28, 31, 39, 62, 79], which can be leveraged by an LLM in flexible and robust ways [81, 83, 93].”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [62]
The cited source says what the claim attributes to it.
In the citing paper
“Pre-training of models on a large corpus is known to result in the model memorizing knowledge in its parameters [169, 201, 221].”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [201]
The cited source says what the claim attributes to it.
In the citing paper
“The aforementioned example shows that AI long-term memory can be implicitly stored in the parameters of AI models [248, 249].”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [248]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 7×
“BERT (base) (Devlin et al., 2018a) Transformer 110M Wikipedia (en) & BookCorpus 3.”
BackgroundMethodInfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“SQuAD (Rajpurkar et al., 2016) is a popular question answering dataset.”
Background(2013) · Cited by 5,726
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169 · cited 3×
“…2017), recurrent neural networks (Zaremba et al., 2014; Merity et al., 2016; Melis et al., 2017) or self-attention mechanisms (Radford et al., 2018; Dai et al., 2019; Radford et al., 2019). fairseq-fconv: Instead of commonly used recurrent neural networks, Dauphin et al. (2017) use multiple layers…”
BackgroundMethodInfluential
Research works printed but not linked: 3
- [1]1. Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Pushmeet Kohli, and Edward Grefenstette. 2019. Learning to understand goal specifications by 7 https://github.com/allenai/allennlp 8 https://github.com/pytorch/fairseq 9 https://github.com/huggingface/ pytorch-transformers modelling reward. In International Conference on Learning Representations (ICLR).
- [12]12. Hady Elsahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Frederique Laforest, and Elena Simperl. 2018. T-rex: A large scale alignment of natural language with knowledge base triples. In Proceedings of the Eleventh Interna- tional Conference on Language Resources and Eval- uation (LREC-2018).
- [24]24. Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018a. Deep contextualized word rep- resentations. In Proceedings of the 2018 Confer- ence of the North American Chapter of the Associ- ation for Computational Linguistics: Human Lan- guage Technologies, NAACL-HLT 2018, New Or- leans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers), pages 2227-2237.
Cited by
Items 601–700 of 1,061
PharmBERT: a domain-specific BERT model for drug labels
ValizadehAslani, T., Shi, Y., Ren, P., Wang, J., Zhang, Y., Hu, M., Zhao, L., & Liang, H. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad226 · Cited by 50
Doubly Right Object Recognition: A Why Prompt for Visual Rationales
Mao, C., Teotia, R., Sundar, A., Menon, S., Yang, J., Wang, X., & Vondrick, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00267 · Cited by 50
Language Models with Rationality
Kassner, N., Tafjord, O., Sabharwal, A., Richardson, K., Schuetze, H., & Clark, P. A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.877 · Cited by 51
Graduate Students' ChatGPT Experience and Perspectives during Thesis Writing
Rababah, L. M., Rababah, M. A., & Al-Khawaldeh, N. (2024) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v14i3.48395 · Cited by 50
Advanced Semantics for Commonsense Knowledge Extraction
Nguyen, T.-P., Razniewski, S., & Weikum, G. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449827 · Cited by 49
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing
Liu, Q., Yang, D., Zhang, J., Guo, J., Zhou, B., & Lou, J. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.100 · Cited by 50
Knowledge graphs 2021: a data odyssey
Weikum, G. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476311.3476393 · Cited by 50
Exploring Prompt-based Few-shot Learning for Grounded Dialog GenerationPreprint
Zheng, C., & Huang, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06513 · Cited by 50
Measuring Reliability of Large Language Models through Semantic ConsistencyPreprint
Raj, H., Rosati, D., & Majumdar, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.05853 · Cited by 50
Towards Continual Knowledge Learning of Language Models
Jang, J., Ye, S., Yang, S., Shin, J., Han, J., Kim, G., Choi, S. J., & Seo, M. (2021) · arXiv · doi:10.48550/arxiv.2110.03215 · Cited by 49
“INVARIANTLAMA We create INVARIANTLAMA, a subset of the LAMA (Petroni et al., 2019) task for measuring time-invariant knowledge which might be forgotten during CKL.”
BackgroundMethodResultInfluential(2020) · doi:10.18653/v1/2020.fever-1.5 · Cited by 49
AI-based Question Answering Assistance for Analyzing Natural-language Requirements
Ezzini, S., Abualhaija, S., Arora, C., & Sabetzadeh, M. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00113 · Cited by 49
Do PLMs Know and Understand Ontological Knowledge?
Wu, W., Jiang, C., Jiang, Y., Xie, P.-J., & Tu, K. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2023.acl-long.173 · Cited by 40
Knowledge-guided Aspect-based Summarization
Luo, Z. (2023) · International Conference on Communications, Computing and Artificial Intelligence (CCCAI) · doi:10.1109/cccai59026.2023.00012 · Cited by 52
Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection
Wu, J., Li, S., Deng, A., Xiong, M., & Hooi, B. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615015 · Cited by 49
Affective Faces for Goal-Driven Dyadic CommunicationPreprint
Geng, S., Teotia, R., Tendulkar, P., Menon, S., & Vondrick, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.10939 · Cited by 49
Generated Knowledge Prompting for Commonsense Reasoning
Liu, J., Liu, A., Lu, X., Welleck, S., West, P., Bras, R. J. L., Choi, Y., & Hajishirzi, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08387 · Cited by 48
Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
Xu, D., Zhang, Z., Zhu, Z., Lin, Z., Liu, Q., Wu, X., Xu, T., Wang, W., Ye, Y., Zhao, X., et al. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679673 · Cited by 48
Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge
Zhou, L., Karidi, T., Liu, W., Garneau, N., Cao, Y., Chen, W., Li, H., & Hershcovich, D. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.496 · Cited by 48
Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs
Alwajih, F., Mekki, A. E., Magdy, S. M., Elmadany, A., Nacar, O., Nagoudi, E. M. B., Abdel‐Salam, R., Atwany, H., Nafea, Y., Yahya, A. M., et al. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1579 · Cited by 48
What Does My QA Model Know? Devising Controlled Probes Using Expert Knowledge
Richardson, K., & Sabharwal, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00331 · Cited by 48
Constructing Taxonomies from Pretrained Language Models
Chen, C., Lin, K., & Klein, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.373 · Cited by 48
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge
Jiang, X., Liang, Y., Chen, W., & Duan, N. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21330 · Cited by 48
Entity-aware Transformers for Entity Search
Gerritse, E. J., Hasibi, F., & de Vries, A. P. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531971 · Cited by 48
Improving the Faithfulness of Abstractive Summarization via Entity Coverage Control
Zhang, H., Yavuz, S., Kryściński, W., Hashimoto, K., & Zhou, Y. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.40 · Cited by 48
TruthRL: Incentivizing Truthful LLMs via Reinforcement LearningPreprint
Wei, Z., Yang, X., Sun, K., Wang, J., Shao, R., Chen, J., Kachuee, M., Gollapudi, T., Liao, Y., Scheffer, N., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.25760 · Cited by 48
Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation
Mündler, N., He, J., Jenko, S., & Vechev, M. (2023) · arXiv · doi:10.48550/arxiv.2305.15852 · Cited by 47
Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation
Mündler, N., He, J., Jenko, S., & Vechev, M. (2023) · arXiv (Cornell University) · doi:10.3929/ethz-b-000719979 · Cited by 47
GreaseLM: Graph REASoning Enhanced Language Models for Question Answering
Zhang, X., Bosselut, A., Yasunaga, M., Ren, H., Liang, P., Manning, C. D., & Leskovec, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.08860 · Cited by 47
A Survey of Knowledge Enhanced Pre-trained Language Models
Yang, J., Hu, X., Xiao, G., & Shen, Y. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3631392 · Cited by 47
Multi-Task Retrieval for Knowledge-Intensive Tasks
Maillard, J., Karpukhin, V., Petroni, F., Yih, W.-T., Oguz, B., Stoyanov, V., & Ghosh, G. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.89 · Cited by 47
Self-citationRetrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters
Xu, Y., Ishii, E., Cahyawijaya, S., Liu, Z., Winata, G. I., Madotto, A., Su, D., & Fung, P. (2022) · DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering (DialDoc) · doi:10.18653/v1/2022.dialdoc-1.10 · Cited by 47
History Matters: Temporal Knowledge Editing in Large Language Model
Yin, X., Jin, J., Yang, L., & Wan, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29912 · Cited by 47
Urban Mobility Assessment Using LLMs
Bhandari, P., Anastasopoulos, A., & Pfoser, D. (2024) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/3678717.3691221 · Cited by 48
Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps
Attanasio, G., Savoldi, B., Fucci, D., & Hovy, D. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.1188 · Cited by 47
The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color
Paik, C., Aroca-Ouellette, S., Roncone, A., & Kann, K. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.63 · Cited by 47
Systematic Assessment of Factual Knowledge in Large Language Models
Luo, L., Vu, T.-T., Phung, D., & Haf, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.885 · Cited by 47
Large Language Models with Controllable Working Memory
Li, D., Rawat, A. S., Zaheer, M., Wang, X., Lukasik, M., Veit, A., Yu, F., & Kumar, S. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.112 · Cited by 46
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Ji, K., Lian, Y., Gao, J., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.164 · Cited by 46
Shortcut Learning Explanations for Deep Natural Language Processing: A Survey on Dataset Biases
Dogra, V., Verma, S., Kavita, K., Woźniak, M., Shafi, J., & Ijaz, M. F. (2024) · IEEE Access · doi:10.1109/access.2024.3360306 · Cited by 46
SA²VP: Spatially Aligned-and-Adapted Visual Prompt
Pei, W., Xia, T., Chen, F., Li, J., Tian, J., & Lu, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28243 · Cited by 46
Practices, opportunities and challenges in the fusion of knowledge graphs and large language models
Cai, L., Yu, C., Kang, Y., Fu, Y., Zhang, H., & Zhao, Y. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1590632 · Cited by 48
Few-Shot Stance Detection via Target-Aware Prompt Distillation
Jiang, Y., Gao, J., Shen, H., & Cheng, X. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531979 · Cited by 47
Shao, H., Huang, J., Zheng, S., & Chang, K. C. (2024) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2024.findings-eacl.54 · Cited by 46
DKPLM: Decomposable Knowledge-Enhanced Pre-trained Language Model for Natural Language Understanding
Zhang, T., Wang, C., Hu, N., Qiu, M., Tang, C., He, X., & Huang, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21425 · Cited by 45
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
Jang, J., Ye, S., Lee, C., Yang, S., Shin, J., Han, J., Kim, G., & Seo, M. (2022) · arXiv · doi:10.48550/arxiv.2204.14211 · Cited by 45
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Xu, L., Chen, Y., Cui, G., Gao, H., & Liu, Z. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.137 · Cited by 45
Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA
Heineman, D., Dou, Y., Maddela, M., & Xu, W. H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.211 · Cited by 45
AutoTrial: Prompting Language Models for Clinical Trial Design
Wang, Z., Xiao, C., & Sun, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.766 · Cited by 45
Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization
Chrysostomou, G., Zhao, Z., Williams, M., & Aletras, N. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00695 · Cited by 18
Exploring the application of LLM-based AI in UX design: an empirical case study of ChatGPT
Zhou, Z., Li, Y., & Yu, J. (2024) · Human-Computer Interaction · doi:10.1080/07370024.2024.2420991 · Cited by 45
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models
Ignat, O., Jin, Z., Abzaliev, A., Biester, L., Castro, S., Deng, N., Gao, X., Gunal, A. E., He, J., Kazemi, A., et al. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2bw7xfcwyeq3 · Cited by 45
CARE: Commonsense-Aware Emotional Response Generation with Latent Concepts
Zhong, P., Wang, D., Li, P., Zhang, C., Wang, H., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17713 · Cited by 45
Improving Math Word Problems with Pre-trained Knowledge and Hierarchical Reasoning
Yu, W., Wen, Y., Zheng, F., & Xiao, N. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.272 · Cited by 45
Knowledge graph extension with a pre-trained language model via unified learning method
Choi, B., & Ko, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110245 · Cited by 45
Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality PerspectivesPreprint
Liu, H., Chaudhary, M., & Wang, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.16851 · Cited by 45
How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and ConsistencyPreprint
Zheng, D., Lapata, M., & Pan, J. Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.13578 · Cited by 45
PMET: Precise Model Editing in a Transformer
Li, X., Li, S., Song, S., Yang, J., Ma, J., & Yu, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29818 · Cited by 44
Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models
Jiang, P., Agarwal, S., Jin, B., Wang, X., Sun, J., & Han, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.709 · Cited by 44
Knowledge-based dynamic prompt learning for multi-label disease diagnosis
Xie, J., Li, X., Yuan, Y., Guan, Y., Jiang, J., Guo, X., & Peng, X. X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111395 · Cited by 44
Wysocka, M., Wysocki, O., Delmas, M., Mutel, V., & Freitas, A. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104724 · Cited by 45
Monotonic Representation of Numeric Attributes in Language Models
Heinzerling, B., & Inui, K. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-short.18 · Cited by 46
Huang, W., Zhou, G., Lapata, M., Vougiouklis, P., Montella, S., & Pan, J. Z. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113648 · Cited by 44
The Art of Prompting: Event Detection based on Type Specific Prompts
Wang, S., Yu, M., & Huang, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.111 · Cited by 44
Querying Large Language Models with SQLPreprint
Saeed, M., Cao, N. D., & Papotti, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.00472 · Cited by 44
Weakly Supervised Veracity Classification with LLM-Predicted Credibility SignalsPreprint
Leite, J. A., Razuvayevskaya, O., Bontcheva, K., & Scarton, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.07601 · Cited by 44
“You are grounded!”: Latent Name Artifacts in Pre-trained Language Models
Shwartz, V., Rudinger, R., & Tafjord, O. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.556 · Cited by 43
Context-Aware Robust Fine-Tuning
Mao, X., Chen, Y., Jia, X., Zhang, R., Xue, H., & Zhao, L. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01951-2 · Cited by 43
On the Challenges of Fuzzing Techniques via Large Language Models
Huang, L., Zhao, P., Ma, L., & Chen, H. (2025) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse67621.2025.00028 · Cited by 43
CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey
Li, J., Li, Y., Fu, Y., Liu, J., Liu, Y., Yang, M., & King, I. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3651700 · Cited by 44
Practical LLM-Based Function-Level Automated Program Repair: How Far Are We?
Xiang, J., Xu, X., Kong, F., Wu, M., Zhan, Z., Zhang, H., & Zhang, Y. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3812804 · Cited by 43
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network
Lovelace, J., Newman-Griffis, D. R., Vashishth, S., Lehman, J. F., & Rosé, C. P. (2021) · doi:10.18653/v1/2021.acl-long.82 · Cited by 44
RuleBERT: Teaching Soft Rules to Pre-Trained Language Models
Saeed, M., Ahmadi, N., Nakov, P., & Papotti, P. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.110 · Cited by 44
Explaining Toxic Text via Knowledge Enhanced Text Generation
Sridhar, R., & Yang, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.59 · Cited by 43
Fine-Grained Visual–Text Prompt-Driven Self-Training for Open-Vocabulary Object Detection
Long, Y., Han, J., Huang, R., Xu, H., Zhu, Y., Xu, C., & Liang, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3293484 · Cited by 43
A Measure-Theoretic Characterization of Tight Language Models
Du, L., Hennigen, L. T., Pimentel, T., Meister, C., Eisner, J. M., & Cotterell, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.543 · Cited by 43
Pre-training Text-to-Text Transformers for Concept-centric Common SensePreprint
Zhou, W., Lee, D., Selvam, R. K., Lee, S., & Ren, X. (2021) · arXiv (Cornell University) · Cited by 43
Chain-of-Verification Reduces Hallucination in Large Language Models
Dhuliawala, S., Komeili, M., Xu, J., Raileanu, R., Li, X., Celikyilmaz, A., & Weston, J. (2023) · arXiv · doi:10.48550/arxiv.2309.11495 · Cited by 42
“It has been shown that as the number of model parameters is increased, performance at tasks such as closed book QA improve in accuracy, and larger models can generate more correct factual statements (Radford et al., 2019; Petroni et al., 2019).”
BackgroundGraph Reasoning for Question Answering with Triplet Retrieval
Li, S., Gao, Y., Jiang, H., Yin, Q., Li, Z., Yan, X., Zhang, C., & Yin, B. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.208 · Cited by 42
On the Evolution of Knowledge Graphs: A Survey and Perspective
Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J. (2023) · arXiv · doi:10.48550/arxiv.2310.04835 · Cited by 42
“Previous studies have shown that such paradigms can perform well on some knowledge probing benchmarks like LAMA [193].”
Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestion
Baek, J., Chandrasekaran, N., Cucerzan, S., Herring, A., & Jauhar, S. K. (2024) · Proceedings of the ACM Web Conference 2024 · doi:10.1145/3589334.3645404 · Cited by 42
Huang, Q., Yuan, Z., Xing, Z., Xu, X., Zhu, L., & Lu, Q. (2022) · Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3551349.3556912 · Cited by 42
Roy, R. S., & Anand, A. (2021) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s0113ed1v01y202109icr076 · Cited by 42
Domain-Specific Text Generation for Machine Translation
Moslem, Y., Haque, R., Kelleher, J. D., & Way, A. (2022) · NORMA · doi:10.48550/arxiv.2208.05909 · Cited by 42
I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learning
Liu, Y., Sun, Z., Li, G., & Hu, W. P. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557355 · Cited by 42
What Is a Multi-Modal Knowledge Graph: A Survey
Peng, J., Hu, X., Huang, W., & Yang, J. K. (2023) · Big Data Research · doi:10.1016/j.bdr.2023.100380 · Cited by 42
Zero-Shot Generative Model Adaptation via Image-Specific Prompt Learning
Guo, J., Wang, C., Wu, Y., Zhang, E., Wang, K., Xu, X., Song, S., Shi, H., & Huang, G. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01106 · Cited by 42
Self-citationPrompting Strategies for Citation Classification
Kunnath, S. N., Pride, D., & Knoth, P. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615018 · Cited by 42
Learning General Policies for Planning through GPT Models
Rossetti, N., Tummolo, M., Gerevini, A., Putelli, L., Serina, I., Chiari, M., & Olivato, M. (2024) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v34i1.31510 · Cited by 42
Neuron-Level Sequential Editing for Large Language Models
Jiang, H., Fang, J., Zhang, T., Bi, B., Zhang, A., Wang, R., Liang, T., & Wang, X. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.815 · Cited by 44
Chen, C., Zheng, F., Cui, J., Cao, Y., Liu, G., Wu, J. X., & Zhou, J. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02106-6 · Cited by 42
Penguins Don’t Fly: Reasoning about Generics through Instantiations and Exceptions
Allaway, E., Hwang, J. D., Bhagavatula, C., McKeown, K. R., Downey, D., & Choi, Y. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.192 · Cited by 42
Logical Message Passing Networks with One-hop Inference on Atomic FormulasPreprint
Wang, Z., Song, Y., Wong, G. Y., & See, S. C. W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.08859 · Cited by 42
Wu, J., Wu, X., Qiu, Z., Li, M., Lin, S., Zhang, Y., Zheng, Y., Yuan, C., & Yang, J. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae079 · Cited by 41
Discrete and Soft Prompting for Multilingual Models
Zhao, M., & Schütze, H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.672 · Cited by 41
Adaptable and Interpretable Neural MemoryOver Symbolic Knowledge
Verga, P., Sun, H., Baldini Soares, L., & Cohen, W. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.288 · Cited by 41
Multi-Stage Prompting for Knowledgeable Dialogue Generation
Liu, Z., Patwary, M., Prenger, R., Prabhumoye, S., Ping, W., Shoeybi, M., & Catanzaro, B. (2022) · Findings of the Association for Computational Linguistics: ACL 2022 · doi:10.18653/v1/2022.findings-acl.104 · Cited by 41
Large Language Models and Multimodal Retrieval for Visual Word Sense Disambiguation
Kritharoula, A., Lymperaiou, M., & Stamou, G. B. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.807 · Cited by 41
Large language models and their possible uses in law
Homoki, P., & Ződi, Z. (2024) · Hungarian Journal of Legal Studies · doi:10.1556/2052.2023.00475 · Cited by 41
Metadata
- Authors
- Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A.
- Affiliations
- Meta (United States) (US)
- Venue
- Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
- Published
- 2019
- Pages
- 2463-2473
- OpenAlex
- W2970476646
- Cited by
- 1,834
- References
- 42
- Citations by year
- 2026: 129 · 2025: 230 · 2024: 300 · 2023: 469 · 2022: 334 · 2021: 246 · 2020: 121 · 2019: 5
- FWCI
- 67.54
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- language models, knowledge base, knowledge representation, knowledge extraction, question answering, commonsense knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.