The DOI matches its Crossref record; 29 of the 30 references it cites were found in a registry or an index.
Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models
Open accessAbstract
This paper explores the impact of extending input lengths on the capabilities of Large Language Models (LLMs).Despite LLMs advancements in recent times, their performance consistency across different input lengths is not well understood.We investigate this aspect by introducing a novel QA reasoning framework, specifically designed to assess the impact of input length.We isolate the effect of input length using multiple versions of the same sample, each being extended with padding of different lengths, types and locations.Our findings show a notable degradation in LLMs' reasoning performance at much shorter input lengths than their technical maximum.We show that the degradation trend appears in every version of our dataset, although at different intensities.Additionally, our study reveals that the traditional metric of next word prediction correlates negatively with performance of LLMs' on our reasoning dataset.We analyse our results and identify failure modes that can serve as useful guides for future research, potentially informing strategies to address the limitations observed in LLMs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the viability of this future remains largely uncertain given the many engineering hurdles involved and the apparent limitations of long-context LLMs, even within current context lengths [41, 45, 96, 21].”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [41]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Longcontext studies have shown that language models struggle to utilize relevant information within lengthy inputs, with performance often degrading well below the nominal context-window limit (Liu et al., 2024; Levy et al., 2024; Fraga, 2024; He et al., 2024; Hsieh et al., 2024; Tian et al., 2025).”
From Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents (2026) · cites this paper as Levy et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Models can be sensitive to the position of relevant evidence and can exhibit reasoning degradation as input length increases (Liu et al., 2024; Levy et al., 2024).”
From Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents (2026) · cites this paper as Levy et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Long-context studies show that increasing the available context does not ensure reliable use of all included information.”
From Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents (2026) · cites this paper as Levy et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Third, it possible that such very long context windows will continue to lead to degraded performance, as has been seen in current models [33].”
From Episodic Memory in AI Agents Poses Risks that Should be Studied and Mitigated (2025) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 6
- Hong Liu, Sang Michael Xie, Zhiyuan Li, and Tengyu Ma. 2023a. Same pre-training loss, better down- stream: Implicit bias matters for language models. In International Conference on Machine Learning, pages 22188-22214.
- PMLR.
- Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, and Weizhu Chen. 2020. Generation-augmented retrieval for open- domain question answering. In Annual Meeting of the Association for Computational Linguistics.
- Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed H Chi, Nathanael Schärli, and Denny Zhou. 2023. Large language models can be easily distracted by irrelevant context. In Inter- national Conference on Machine Learning, pages 31210-31227.
- PMLR.
- Jason Weston, Antoine Bordes, Sumit Chopra, Alexan- der M Rush, Bart Van Merriënboer, Armand Joulin, and Tomas Mikolov. 2016. Towards ai-complete question answering: A set of prerequisite toy tasks. In 4th International Conference on Learning Repre- sentations, ICLR 2016.
Cited by
Sorted by citations
Items 101–188 of 188
A Multi-Agent Framework for Accessible Web Code Generation
Aljedaani, W., Shaik, M. A., & Aljohani, A. (2026) · Proceedings of the 23rd International Web for All Conference · doi:10.1145/3800424.3800453 · Cited by 1
Ravari, S. B., Guzmán, A. A., Menon, S. K., Sandfeld, S., Hickel, T., & Stricker, M. (2026) · Advanced Engineering Materials · doi:10.1002/adem.202600008 · Cited by 2
Information Seeking Behavior in LLM-Based RAG: Mental Models and Missing Information
Sotic, B. N., & Kamps, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808537 · Cited by 1
Improving OpenDevin: Boosting code generation LLM through advanced memory management
He, R., Ying, A., & Hu, X. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/68/20241506 · Cited by 1
Optimizing Contextual Speech Recognition Using Vector Quantization for Efficient Retrieval
Flemotomos, N., Hsiao, R. W.-H., Świętojański, P., Hori, T., Can, D., & Zhuang, X. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3594955 · Cited by 2
Oomoto, S., Enoki, M., & Oguchi, M. (2025) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac65507.2025.00047 · Cited by 1
VidCtx: Context-aware Video Question Answering with Image Models
Goulas, A., Mezaris, V., & Patras, I. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11210080 · Cited by 1
Evaluating Metrics for Safety with LLM-as-Judges
Clegg, K., Hawkins, R., Habli, I., & Lawton, T. (2025) · arXiv · doi:10.48550/arxiv.2512.15617 · Cited by 1
Mittal, S. (2026) · arXiv · doi:10.48550/arxiv.2609.01660 · Cited by 1
Can an LLM Induce a Graph? Investigating Memory Drift and Context Length
Yousuf, R. B., Khatri, A., Xu, S., Sharma, M., & Ramakrishnan, N. (2025) · 2025 IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg66886.2025.00056
Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents
Dao, Q., Kathalkar, P., & Eaton, K. (2026) · arXiv · doi:10.48550/arxiv.2608.20631 · Cited by 1
DataRecipe --- How to Cook the Data for CodeLLM?
Kim, K., Kim, J., Park, B., Kim, D., Chong, C. Y., Wang, Y., Sun, T., Tang, X., Klein, J., & Bissyandé, T. F. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695593 · Cited by 2
Cluster-Based Effective Generation of AI-Driven Literature Surveys
Li, Z., Lu, X., Chen, J., Wang, H., Wang, X., Shi, Q., Xue, D., Bi, Y., & Huang, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9443-0_37
Where am I? Large Language Models Wandering between Semantics and Structures in Long Contexts
Koo, S., Kim, J., Jang, Y., Park, C., & Lim, H. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.783 · Cited by 1
Semantic Pagewise Augmented Knowledge Retrieval System: SPARKS
Sharma, P., & Sharma, Y. D. (2024) · International Conference on Electrical and Computer Engineering Researches (ICECER) · doi:10.1109/icecer62944.2024.10920365
Discussion on “statistical solutions for interdisciplinary problem-solving”
Guo, Q., Xie, K., & Deng, X. (2025) · Quality Engineering · doi:10.1080/08982112.2025.2512777
A Novel Computational Modeling Foundation for Automatic Coherence Assessment
Maimon, A. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.277
Nomoto, L., & Takuma, H. (2025) · Studies in computational intelligence · doi:10.1007/978-3-031-82606-1_7
da Silva, R. P., & Pazin‐Filho, A. (2025) · Data in Brief · doi:10.1016/j.dib.2025.111804
EVOCA: Explainable Verification of Claims by Graph Alignment
Felice, C. D., Longo, F., Mongiovı̀, M., Santamaria, D. F., & Tuccari, G. G. (2025) · Information · doi:10.3390/info16070597
Key-Augmented Neural Triggers for Knowledge SharingPreprint
Wolf, A., Palma, M. A., Rani, P., & Gall, H. C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5376750
Exploring Zero-Shot Data Drift Detection with Large Language Models
Park, M., Nam, J., & Cho, H. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-03550-9_24
Lee, J., Lee, E., & Kim, K. (2025) · Institute of Brain-based Education Korea National University of Education · doi:10.31216/bdl.2025.15.3.4
PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation
Habba, E., Dahan, N., Lior, G., & Stanovsky, G. (2025) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2025.emnlp-demos.19 · Cited by 2
Cognitive Support in Aviation Operations Utilizing Multimodal Large Language Models
Huang, R., Feng, S., Li, F., Chen, C., & Ong, Y.-S. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229131
Identifying Citizens’ Major Concerns: The Case of the People’s Daily “Leaders’ Message Board”
Wei, Z., & Tang, X. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4990-0_15
A Unifying Scheme for Extractive Content Selection Tasks
Amar, S., Shapira, O., Slobodkin, A., & Dagan, I. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.53 · Cited by 1
PROPOSAL OF A HUMAN-CENTRIC AIR CONDITIONING SYSTEM WITH SEAT CHANGES :
KAMIYA, Y., Taniguchi, K., Murakami, H., Daisuke, S. A. T. O., Matsui, N., & Akashi, Y. (2025) · Journal of Environmental Engineering (Transactions of AIJ) · doi:10.3130/aije.90.617
Künstliche Intelligenz in der Fremdsprachendidaktik: Sprachgefühl und Sprachmodell im Fokus
Arabacıoğlu, B., & Tunçyüz, S. N. (2025) · Diyalog Interkulturelle Zeitschrift Für Germanistik · doi:10.37583/diyalog.1824338
Reasoning Capabilities of Large Language Models in Games
Poglitsch, C., Giner, A., & Pirker, J. (2025) · IEEE Transactions on Games · doi:10.1109/tg.2025.3645858
Toward Explaining Large Language Models in Software Engineering Tasks
Vitale, A., Nguyen, K.-N., Poshyvanyk, D., Oliveto, R., Scalabrino, S., & Mastropaolo, A. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3837084
Evaluating Question Answering Performance of SQuAD-Based LLMs Across Varying Text Lengths
Raj, S., & Srivastava, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-10940-8_3
A Novel Competency Tagging Method Through Semantic Search Using Fine-Tuned LLM
Jemal, I., Armand, N. S. W., & Chikhaoui, B. (2025) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa66935.2025.11315432
Hidden State Poisoning Attacks against Mamba-based Language Models
Mercier, A. L., Develder, C., & Demeester, T. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.556 · Cited by 4
Predicting the Fictional Time and Space of French Theatre Plays by Using Large Language Models
Romanello, M., Gabay, S., & Carboni, N. (2025) · IEEE International Conference on Cyber Humanities (IEEE-CH) · doi:10.1109/ieee-ch65308.2025.11279315
Reply: Methodological clarifications of AI-powered research trend analytics in bronchiectasis
Narayana, J. K., & Chotirmall, S. H. (2026) · European Respiratory Journal · doi:10.1183/13993003.01968-2025
Bayesian Optimization for Biochemical Discovery with LLMsPreprint
Gómez‐Bombarelli, R., Akke, M., Yang, S., Ruža, J., Song, J., & Pan, E. (2026) · Research Square · doi:10.21203/rs.3.rs-8216063/v1
Wayne, M., Ginardi, R. V. H., & Iyer, G. N. (2025) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale66047.2025.11346665
Multi-Layered Defense Proxy for Home Assistant utilizing Large Language Models
Yazdani, F., Antezana, S., Gebril, M., & Abdelhamid, S. E. (2026) · IEEE International Conference on AI in Cybersecurity (ICAIC) · doi:10.1109/icaic67076.2026.11395708
Trace: Test Repair via Agent-based Context Extraction with LLMs
Tu, J., Lin, B., Qin, Y., Wang, S., Chen, L., & Mao, X. (2025) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec66846.2025.00017
Dependence Minimization for Multi-Label Classification: An Alternative to Human Labeling
Metzger, A., Dantu, R., Blackwell, A., & McCullough, T. (2025) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi67134.2025.00027
Attention Overflow: Language Model Input Blur during Long-Context Missing Items Identification
Sileo, D. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.findings-ijcnlp.44
Mining Multimodal Fatigue Data Using Reasoning Foundation Models and Formalized Domain Knowledge
Mohanty, J. P., Thomas, A., Pollock, T. M., & Durmaz, A. R. (2026) · Integrating materials and manufacturing innovation · doi:10.1007/s40192-026-00442-9
Detecting Winning Arguments with Large Language Models and Persuasion Strategies
Labruna, T., Modzelewski, A., Satta, G., & Martino, G. D. S. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.97
Sileo, D. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-short.3 · Cited by 1
Schoonen, C., Pirenne, L., Bergez, A., Cleemput, I., Obyn, C., de Noordhout, C. M., & Boucher, V. (2026) · doi:10.57598/r416c
Parker, M. J., & Zavala-Cerna, M. G. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-13902-8
Bulla, M. C., Lavinsky, D., Rosa, A. A. M., & Carricondo, P. C. (2026) · doi:10.2196/preprints.97408
Source Code Metrics and LLMs Summaries: Do Correlations Exist?
Marinescu, C. (2025) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc69064.2025.00053
Min, E. (2026) · International journal of high school research · doi:10.36838/ijhsr87.20
Abkenar, M. Y., Wang, W., Stede, M., Finlayson, M. A., Picca, D., & Ioannidis, P. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2e6be7q3bnzh
Vinograd, O., Avisar, E., Essa, A., Debi, R., & Tal, O. (2026) · doi:10.2196/preprints.99512
Gupta, A. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.80665
Token-Efficient Binary Vulnerability Prioritization via Function Pre-filtering with LLMs
Niu, Z., Wang, C., & Wu, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7820-7_10
Song, X., Pei, L., Wu, J., Zeng, Y., He, G., Zuo, C., Liu, X., Zhao, Q., Guo, S., & Liu, X. (2026) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2026.240521
Garg, S., Karnatak, H. C., Pandey, K., & Garg, R. (2026) · Research Square · doi:10.21203/rs.3.rs-9436033/v1
CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs
Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/3801489.3806917
CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs
Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3805631
Gioia, S. (2026) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds70563.2026.00015
Relationship Evaluation for Developer Recommendation in Open Source Communities
Zhao, X., Liu, X., & Lu, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-9694-2_14
Du, L., Zhong, R., 朱鎭晩, Dong, S., & ShuYuan, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29755-6_42
Near-Zero Cost KV Cache Compression for Large Language Model Inference
Zhang, B., Zhou, D., Huang, Y., Song, S., Feng, H., Jia, J., Zhang, C., & Zhang, Z. (2026) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps65963.2026.00058
ImReasoner: Improving Memory-based Language Models for Reasoning-in-a-Haystack Tasks
Ko, C.-Y., Das, P., Dai, S., Κόλλιας, Γ., Chaudhury, S., Lozano, A. C., & Chen, P.-Y. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.26
Ghost Context: Measuring Cross-Context Interference in Long-Context Language Models
Namboothiri, R. (2026) · Workshop on Trustworthy NLP (TrustNLP) · doi:10.18653/v1/2026.trustnlp-main.19
LLM-Driven Semantic Consistency Analysis for TRDP Implementations in Train Networks
Du, J., Ai, B., Lu, Y., Li, J. F., Liang, J., Liu, S., & Wu, H. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3710539
CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs
Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3820171.3806917
Agentology: Ontology-Driven Operational Environments for Multi-Agent SystemsPreprint
Ortaç, A., Tosun, E., Özbek, A. K., Terzioglu, F., & Bayraktar, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6919461
Context Relay for Long-Running Penetration-Testing Agents
Vangeli, M., Brynielsson, J., Cohen, M., & Kamrani, F. (2026) · Proceedings 2026 Workshop on LLM Assisted Security and Trust Exploration · doi:10.14722/last-x.2026.23042
Context Engineering for AI ‐Assisted Pharmacometrics: A Practical Tutorial
Pritchard‐Bell, A., Lin, C., Holmes, W. R., & Doshi, S. (2026) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.70317
Can Structural Cues Save LLMs? Evaluating Language Models in Massive Document Streams
Lee, Y., Lim, Y., Jung, W., Choi, W., & Yoon, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817994
Wan, T., Wang, X. Y., Chen, H., Huang, L., & Zhu, W. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817924
Hirosawa, T., Harada, Y., Kawamura, R., & Shimizu, T. (2026) · JMIR Formative Research · doi:10.2196/98819
Task-Aligned Contrastive Learning for Filtering Noise in Multi-label Text Classification
Metzger, A., Dantu, R., Quach, V., & Blackwell, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-35078-7_6
AI and book indexing: trajectory data
Bartmess, E., & Combs, M. R. (2026) · The Indexer · doi:10.3828/index.2026.31
From AI Agents to Agentic Applications: An Architectural Case Study in Inventory Management
Kilpua, J., Khajavi, S., Laakso, S., & Tanskanen, K. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-38614-4_42
NCFuzz: Configuration-Guided Network Service Fuzzing
Bai, X., Ye, H., Zheng, S., Zhang, F., Hu, H. P., & Li, Z. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832249
The Developer as Curator: A Canvas for Coding Agent Context
Böhme, L., Beckmann, T., Perscheid, M., & Hirschfeld, R. (2026) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3840586.3843212
Evaluating Gemma 3 27B for local undergraduate physics tutoring
Völschow, M., Buczek, P., Riefer, P., Jasko, A., & Steinbach, P. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02296-8
Extender: A Multi-agent System for Code Extensibility Review
Chen, J., & Shen, J. (2026) · International Workshop on Agentic AI for Next-Generation Software Development · doi:10.1145/3843282.3844424
Needle in a Knowledge Graph: Generating Scalable Long-Context Benchmarks for KG Question Answering
Sturm, J., Ellinger, L., Luckow, A., & Groh, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-42224-8_4
A Reactive System for Inappropriate Content Moderation: An Open Source Prototype
Zambrano, P., Torres, J., Anchundia, C. E., Illicachi, J., & Paguay, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28457-0_21
Bulla, M. C., Lavinsky, D., Rosa, A. A. M., & Carricondo, P. C. (2026) · JMIR Formative Research · doi:10.2196/97408
Zheng, S., Zhang, H., & Wang, Z. (2026) · International Conference on Artificial Intelligence Technologies and Applications (ICAITA) · doi:10.1109/icaita71179.2026.11737128
Vajda, S. (2026) · Research Square · doi:10.21203/rs.3.rs-11312211/v1
Large language models rate human happiness higher than humans do
Fang, L., Zhang, T., Brockmeier, L. C., Zhang, S., Fei, R., Ma, Y., Teng, S., D’Alfonso, S., Koval, P., Jia, H., et al. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00049-z
Democratizing Extensive Reading by Tailoring Web Content
Kim, Y., Kim, M. H., Hwang, S., Kim, G., Jung, S., Jeon, H., & Seo, J. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3830398.3830676
Puchakayala, S. S. (2026) · Universal library of engineering technology. · doi:10.70315/uloap.ulete.2026.0304006
Metadata
- Authors
- Levy, M., Jacoby, A., & Goldberg, Y.
- Affiliations
- Bar-Ilan University (IL)
- Venue
- Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2024
- Pages
- 15339-15353
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W4402683949
- Cited by
- 119
- References
- 0
- Citations by year
- 2026: 48 · 2025: 57 · 2024: 14
- FWCI
- 35.12
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- European Commission (HORIZON2020)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- large language models, reasoning performance, question answering, padding, next-word prediction, performance degradation, failure modes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
