RealTime QA: What's the Answer Right Now?
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer questions about novel events or information. It therefore challenges static, conventional assumptions in open-domain QA datasets and pursues instantaneous applications. We build strong baseline models upon large pretrained language models, including GPT-3 and T5. Our benchmark is an ongoing effort, and this paper presents real-time evaluation results over the past year. Our experimental results show that GPT-3 can often properly update its generation results, based on newly-retrieved documents, highlighting the importance of up-to-date information retrieval. Nonetheless, we find that GPT-3 tends to return outdated answers when retrieved documents do not provide sufficient information to find an answer. This suggests an important avenue for future research: can an open-domain QA system identify such unanswerable cases and communicate with the user or even the retrieval module to modify the retrieval results? We hope that REALTIME QA will spur progress in instantaneous applications of question answering and beyond.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, the static nature of parametric memory can lead to information lag, posing challenges in maintaining the relevance of the stored data as it may not reflect the most current information [27, 166].”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [166]
In the citing paper
“Abstention is an active area of LLM-related research (Kasai et al. 2023;Röttger et al. 2024;Ahdritz et al. 2024;Kim and Thorne 2024;Madhusudhan et al. 2024) and is central to Islamic tradition.”
From Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions (2025) · cites this paper as Kasai et al. 2023
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 4,688
Gemini: A Family of Highly Capable Multimodal Models
Gemini Team, Anil, R., Borgeaud, S., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A. M., Hauth, A., Millican, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.11805 · Cited by 990
Jeong, S., Baek, J., Cho, S., Hwang, S. J., & Park, J. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.389 · Cited by 299
Evaluation of Retrieval-Augmented Generation: A Survey
Yu, H., Gan, A., Zhang, K., Tong, S., Liu, Q., & Liu, Z. (2025) · Communications in Computer and Information Science · doi:10.1007/978-981-96-1024-2_8 · Cited by 173
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · arXiv · doi:10.48550/arxiv.2212.10509 · Cited by 349
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.557 · Cited by 349
Mallen, A., Asai, A., Zhong, V., Das, R., Khashabi, D., & Hajishirzi, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.546 · Cited by 340
Self-citationMeasuring and Narrowing the Compositionality Gap in Language Models
Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N., & Lewis, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.378 · Cited by 303
Self-citationMeasuring and Narrowing the Compositionality Gap in Language Models
Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N. A., & Lewis, M. (2022) · arXiv · doi:10.48550/arxiv.2210.03350 · Cited by 294
Self-citationPrompting GPT-3 To Be Reliable
Si, C., Gan, Z., Yang, Z., Wang, S., Wang, J., Boyd-Graber, J. L., & Wang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.09150 · Cited by 62
Ask Me Anything: A simple strategy for prompting language models
Arora, S., Narayan, A., Chen, M. F., Orr, L., Guha, N., Bhatia, K., Chami, I., Sala, F., & Ré, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.02441 · Cited by 72
Certifiably Robust RAG against Retrieval Corruption
Xiang, C., Wu, T., Zhong, Z., Wagner, D., Chen, D., & Mittal, P. (2026) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00029 · Cited by 198
(2024) · doi:10.1145/3704435 · Cited by 184
From Matching to Generation: A Survey on Generative Information Retrieval
Li, X., Jin, J., Zhou, Y., Zhang, Y., Zhang, P., Zhu, Y., & Dou, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722552 · Cited by 172
ToolQA: A Dataset for LLM Question Answering with External Tools
Zhuang, Y., Yu, Y., Wang, K., Sun, H., & Zhang, C. (2023) · neural information processing systems · doi:10.52202/075280-2180 · Cited by 59
Hallucination Mitigation for Retrieval-Augmented Large Language Models: A Review
Zhang, W., & Zhang, J. (2025) · Mathematics · doi:10.3390/math13050856 · Cited by 145
Context-faithful Prompting for Large Language Models
Zhou, W., Zhang, S., Poon, H., & Chen, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.968 · Cited by 46
DecodingTrust: A comprehensive assessment of trustworthiness in GPT models
Wang, B., Chen, W., Pei, H., Xie, C., Kang, M., Zhang, C., Xu, C., Xiong, Z., Dutta, R., Schaeffer, R., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1361 · Cited by 107
Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Models
Tan, Q., Ng, H. T., & Bing, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.828 · Cited by 215
Reliable, Adaptable, and Attributable Language Models with RetrievalPreprint
Asai, A., Zhong, Z., Chen, D., Koh, P. W., Zettlemoyer, L., Hajishirzi, H., & Yih, W.-T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.03187 · Cited by 125
Self-citationInteractive Natural Language ProcessingPreprint
Wang, Z., Zhang, G., Yang, K., Shi, N., Zhou, W., Hao, S., Xiong, G., Li, Y., Sim, M. Y., Chen, X., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.13246 · Cited by 112
Retrieval-based Language Models and Applications
Asai, A., Min, S., Zhong, Z., & Chen, D. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts) · doi:10.18653/v1/2023.acl-tutorials.6 · Cited by 81
Self-citationFreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
Vu, T., Iyyer, M., Wang, X., Constant, N., Wei, J., Wei, J., Tar, C., Sung, Y.-H., Zhou, D., Le, Q., et al. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.813 · Cited by 73
Jeon, J., Sim, Y., Lee, H., Han, C., Yun, D., Kim, E., Nagendra, S. L., Jun, M. B., Kim, Y. ‐., Lee, J., et al. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.01.018 · Cited by 87
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances
Zhang, Z., Fang, M., Chen, L., Namazi‐Rad, M., & Wang, Y.-X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.516 · Cited by 117
DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs
Mousavi, S. M., Alghisi, S., & Riccardi, G. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.471 · Cited by 11
Know Your Limits: A Survey of Abstention in Large Language Models
Wen, B., Yao, J., Feng, S., Xu, C., Tsvetkov, Y., Howe, B., & Wang, L. L. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00754 · Cited by 56
HalluLens: LLM Hallucination Benchmark
Bang, Y., Ji, Z., Schelten, A., Hartshorn, A., Fowler, T., Zhang, C., Cancedda, N., & Fung, P. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1176 · Cited by 41
A Causal View of Entity Bias in (Large) Language Models
Wang, F., Mo, W., Wang, Y., Zhou, W., & Chen, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1013 · Cited by 77
Corpus-Steered Query Expansion with Large Language Models
Lei, Y., Cao, Y. H., Zhou, T., Shen, T., & Yates, A. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-short.34 · Cited by 80
Wei, Y., Su, Y., Ma, H., Yu, X., Lei, F., Zhang, Y., Zhao, J., & Liu, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.100 · Cited by 71
Self-citationLiving in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?
Su, Z., Li, J., Zhang, J., Zhu, T., Qu, X., Zhou, P., Bowen, Y., Cheng, Y., & Zhang, M. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.703 · Cited by 48
A Survey on Responsible Generative AI: What to Generate and What NotPreprint
Gu, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.05783 · Cited by 38
Is Your LLM Outdated? A Deep Look at Temporal Generalization
Zhu, C., Chen, N., Gao, Y., Zhang, Y., Tiwari, P., & Wang, B. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.381 · Cited by 33
Synthesizing scientific literature with retrieval-augmented language models
Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K., Soldaini, L., Feldman, S., D’Arcy, M., et al. (2026) · Nature · doi:10.1038/s41586-025-10072-4 · Cited by 38
Self-citationYu, X., Cheng, H., Liu, X., Roth, D., & Gao, J. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.85 · Cited by 47
Self-citationKoLA: Carefully Benchmarking World Knowledge of Large Language Models
Yu, J., Wang, X., Tu, S., Cao, S., Zhang-Li, D., Lv, X., Peng, H., Yao, Z., Zhang, X., Li, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.09296 · Cited by 29
A comprehensive survey on answer generation methods using NLP
Upadhyay, P., Agarwal, R., Dhiman, S., Sarkar, A., & Chaturvedi, S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100088 · Cited by 37
AA-Omniscience: Evaluating Cross-Domain Knowledge Reliability in Large Language ModelsPreprint
Jackson, D., Keating, W. G., Cameron, G., & Hill-Smith, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.13029 · Cited by 28
Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models
Feng, S., Shi, W., Bai, Y., Balachandran, V., He, T., & Tsvetkov, Y. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2305.09955 · Cited by 38
The Web Can Be Your Oyster for Improving Large Language ModelsPreprint
Li, J., Tang, T., Zhao, W. X., Wang, J., Nie, J., & Wen, J.-R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.10998 · Cited by 26
Özkurt, C. (2024) · Chaos and fractals. · doi:10.69882/adba.chf.2024073 · Cited by 28
Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation
Pan, R., Cao, B., Lin, H., Han, X., Zheng, J., Wang, S., Cai, X., & Sun, L. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.1109 · Cited by 40
Kozhipuram, A. V., Shailendra, S., & Kadel, R. (2025) · Information · doi:10.3390/info16090766 · Cited by 24
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions
Yu, W., Jiang, M., Clark, P., & Sabharwal, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.515 · Cited by 42
WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models
Liu, J., Ning, K., Su, Y., Han, W., Xu, J., & Zhang, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889153 · Cited by 26
Memorization vs. Reasoning: Updating LLMs with New Knowledge
Li, A., & Goyal, T. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1326 · Cited by 23
It's About Time: Incorporating Temporality in Retrieval Augmented Language ModelsPreprint
Gade, A., & Jetcheva, J. G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.13222 · Cited by 21
Emptying the Ocean with a Spoon: Should We Edit Models?
Pinter, Y., & Elhadad, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1012 · Cited by 34
SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems
Bodea, A.-E., Meisenbacher, S., Klymenko, A., & Matthes, F. (2026) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00039 · Cited by 20
Unnatural Error Correction: GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text
Cao, Q., Kojima, T., Matsuo, Y., & Iwasawa, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.550 · Cited by 42
Mitigating Temporal Misalignment by Discarding Outdated Facts
Zhang, M., & Choi, E. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.879 · Cited by 36
Synthetic Cross-language Information Retrieval Training DataPreprint
Mayfield, J., Yang, E., Lawrie, D., Barham, S., Weller, O., Mason, M., Nair, S., & Miller, S. J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.00331 · Cited by 17
Knowledge Crosswords: Geometric Knowledge Reasoning with Large Language Models
Ding, W., Feng, S., Liu, Y., Tan, Z., Balachandran, V., He, T., & Tsvetkov, Y. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.154 · Cited by 27
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory MechanismsPreprint
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.06716 · Cited by 25
PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answering
Meem, J. A., Rashid, M., Dong, Y., & Hristidis, V. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.777 · Cited by 25
Assessing Knowledge Editing in Language Models via Relation PerspectivePreprint
Wei, Y., Yu, X., Ma, H., Lei, F., Weng, Y., Song, R., & Liu, K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.09053 · Cited by 19
Self-citationThe Web Can Be Your Oyster for Improving Language Models
Li, J., Tang, T., Zhao, W. X., Wang, J., Nie, J., & Wen, J.-R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.46 · Cited by 20
ToolComp: A Multi-Tool Reasoning & Process Supervision BenchmarkPreprint
Nath, V., Raja, P., Yoon, C., & Hendryx, S. M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.01290 · Cited by 15
Peng, G., Ge, T., Luo, W., Li, W., & Wang, H. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1385 · Cited by 11
Context Quality Matters in Training Fusion-in-Decoder for Extractive Open-Domain Question Answering
Akimoto, K., Takeoka, K., & Oyamada, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.784 · Cited by 12
FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
Vu, T., Iyyer, M., Wang, X., Constant, N., Wei, J., Wei, J., Tar, C., Sung, Y.-H., Zhou, D., Le, Q., et al. (2023) · arXiv · Cited by 7
When Facts Change: Probing LLMs on Evolving Knowledge with evolveQA
Nakshatri, N. S., Roy, S., Arivazhagan, M. G., Zhou, H., Kumar, V. B., & Gangadharaiah, R. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2373 · Cited by 8
Cho, S., Seo, J., Jeong, S., & Park, J. C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.207 · Cited by 20
GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge?
Ko, D., Kim, J., Choi, H., & Kim, G. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.181 · Cited by 16
BESPOKE: Benchmark for Search-Augmented Large Language Model Personalization via Diagnostic FeedbackPreprint
Kim, H., Lee, S., Seo, K., & Lee, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.21106 · Cited by 8
Propagating Knowledge Updates to LMs Through Distillation
Padmanabhan, S., Onoe, Y., Zhang, M., Durrett, G., & Choi, E. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2041 · Cited by 6
Ravishankara, M., & Maharaj, V. V. P. (2025) · IEEE Access · doi:10.1109/access.2025.3649182 · Cited by 8
DynaRAG: Bridging Static and Dynamic Knowledge in Retrieval-Augmented Generation
Liang, P., Yuan, M., Liu, J., Yang, J., Li, X., Yan, W., & Wu, Y. (2026) · International Symposium on Big Data and Applied Statistics (ISBDAS) · doi:10.1109/isbdas69350.2026.11484130 · Cited by 6
Towards Data-Effective Educational Question Generation with Prompt-Based Learning
Wu, Y., Nouri, J., Megyesi, B. B., Henriksson, A., Duneld, M., & Li, X. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-37717-4_11 · Cited by 7
MeMo: Memory as a ModelPreprint
Quek, R. W. H., Lee, S., Leong, A. W. L., Verma, A., Prakash, A., Chen, N. F., Low, B. K. H., Rus, D. L., & Solar-Lezama, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.15156 · Cited by 6
Memcurrency: Memory Decay and Refresh Mechanism for Long-Running LLM Agents
Su, B., Wang, S., Pi, S., Liu, Y., & Jiang, Z. (2026) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis70504.2026.11633479 · Cited by 5
MLSDET: Multi-LLM Statistical Deep Ensemble for Chinese AI-Generated Text Detection
Mao, D., Zhang, D., Zhang, A., & Zhao, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888686 · Cited by 10
Contrastive Language-knowledge Graph Pre-training
Yuan, X.-W., Liu, K., & Wang, Y.-Q. (2024) · ACM Trans. Asian Low Resour. Lang. Inf. Process. · doi:10.1145/3644820 · Cited by 5
Drama : Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries
Hu, C., Yang, M., Weiland, J., Lim, Y., Palawala, S., & Kang, D. D. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3769781 · Cited by 5
Pletenev, S., Marina, M., Ivanov, N., Galimzianova, D., Krayko, N., Salnikov, M., Konovalov, V., Panchenko, A., & Moskvoretskii, V. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.434 · Cited by 9
Achievements and Challenges in Japanese Question Answering: Insights from Quiz Competition Results
Ariyama, T., Suzuki, J., Suzuki, M., Tanaka, R., Akama, R., & Nishida, K. (2024) · Journal of Natural Language Processing · doi:10.5715/jnlp.31.47 · Cited by 4
da Costa, L. Y., & Filho, J. B. D. O. E. S. (2024) · Simpósio Brasileiro de Tecnologia da Informação e da Linguagem Humana (STIL) · doi:10.5753/stil.2024.245443 · Cited by 6
Enhancing RAG Performance by Representing Hierarchical Nodes in Headers for Tabular Data
Song, M. (2025) · IEEE Access · doi:10.1109/access.2025.3569872 · Cited by 6
Fan, Y., Li, R., Zhang, G., Shi, C., & Wang, X. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888877 · Cited by 7
MRAG: a modular retrieval framework for time-sensitive question answering
Zhang, S., Xue, Y., Zhang, Y., Wu, X., Luu, A. T., & Zhao, C. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.167 · Cited by 3
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.2069 · Cited by 3
Xu, X., & Wu, J. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2026.3655508 · Cited by 10
Epistemic Limits of Hallucination Mitigation in Large Language Models
Zhang, Y. (2026) · Foundations of Science · doi:10.1007/s10699-026-10030-x · Cited by 3
OwlerLite: Scope- and Freshness-Aware Web Retrieval for LLM Assistants
Zerhoudi, S., Dinzinger, M., Granitzer, M., & Mitrović, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3793140 · Cited by 4
Towards Better Generalization in Open-Domain Question Answering by Mitigating Context Memorization
Zhang, Z., Reddy, R. G., Small, K., Zhang, T., & Ji, H. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.48 · Cited by 5
Xia, S.-J., Zhang, H., Jiang, Y., Chen, X., Chen, Y., Li, Z., Wan, Z., & Sun, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5731427 · Cited by 4
Ning, J., & Li, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.22856 · Cited by 3
norregel: a preregistered benchmark of dated numeric values in Norwegian lawPreprint
Nicolaysen, E. B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.29207 · Cited by 4
Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions
Atif, F., Askarbekuly, N., Darwish, K., & Choudhury, M. (2025) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v8i1.36543 · Cited by 2
A Systematic Analysis on the Temporal Generalization of Language Models in Social Media
Ushio, A., & Camacho-Collados, J. (2024) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2024.wassa-1.5 · Cited by 2
LedgerRAG: Governance-Driven Agentic Chain of Retrieval for Dynamic Knowledge Scenarios
Wang, S., Zhang, Y., Guo, Y., & Kang, J. (2026) · Electronics · doi:10.3390/electronics15071376 · Cited by 3
LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs
Guo, P.-F., Tsai, Y.-D., Hsu, C.-C., Chen, K.-X., Tsai, Y. A., Chang, K.-W., Peng, N., Yeh, M.-Y., & Lin, S.-D. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.694 · Cited by 2
Novel-WD: Exploring acquisition of Novel World Knowledge in LLMs Using Prefix-TuningPreprint
Méloux, M., & Cerisara, C. (2024) · arXiv.org · doi:10.48550/arxiv.2408.17070 · Cited by 1
NewsEdits 2.0: Learning the Intentions Behind Updating NewsPreprint
Spangher, A., Huang, K.-C., Cho, H., & May, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.18811 · Cited by 2
The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators
Iacob, A., Jovanović, A., Shen, W. F., Burkhardt, D., Kurmanji, M., Tastan, N., Sani, L., Venanzi, N. A. E., Nie, J., Odonnat, A., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.26294 · Cited by 1
Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
Krishna, S., Krishna, K., Mohananey, A., Schwarcz, S., Stambler, A., Upadhyay, S., & Faruqui, M. (2024) · arXiv · doi:10.48550/arxiv.2409.12941 · Cited by 1
Metadata
- Authors
- Kasai, J., Sakaguchi, K., Takahashi, Y., Bras, R. L., Asai, A., Yu, X., Radev, D., Smith, N., Choi, Y., & Inui, K.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 49025-49043
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133215177
- Cited by
- 52
- References
- 0
- Citations by year
- 2026: 17 · 2025: 11 · 2024: 6 · 2023: 18
- FWCI
- 13.38
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- Allen Institute for Artificial Intelligence
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Expert finding and Q&A systems
- Keywords
- real-time question answering, current events
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.