ContextCite: Attributing Model Generation to Context
Open accessAbstract
How do language models use information provided as context when generating a response? Can we infer whether a particular generated statement is actually grounded in the context, a misinterpretation, or fabricated? To help answer these questions, we introduce the problem of context attribution: pinpointing the parts of the context (if any) that led a model to generate a particular statement. We then present ContextCite, a simple and scalable method for context attribution that can be applied on top of any existing language model. Finally, we showcase the utility of ContextCite through three applications: (1) helping verify generated statements (2) improving response quality by pruning the context and (3) detecting poisoning attacks. We provide code for ContextCite at https://github.com/MadryLab/context-cite.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
It is difficult to make data attribution robust in itself.
“Although it is difficult to make such an attribution robust in itself (Cohen-Wang et al., 2024), similar issues as above arise where users may ignore additional information if it exceeds their expectation or becomes too tedious to review (Micallef et al., 2017).”
From Design Patterns for Securing LLM Agents against Prompt Injections (2025) · cites this paper as Cohen-Wang et al., 2024
The “Potential failure modes” section (page unavailable) says ContextCite’s attributions may be unfaithful in some cases and recommends checking whether they should be trusted. That supports a concern about reliability, but the paper does not establish the broader claim that making attribution robust is inherently difficult. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482 · cited 1× · see citing works
“C ONTEXT C ITE also attains high LDS across benchmarks and models, indicating that its attributions accurately predict the effects of ablating sources.”
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 2× · see citing works
“If a prompt injection attack successfully causes the model to generate an undesirable response, the attribution score of the context source(s) containing the injected poison should be high.”
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698 · see citing works
Scikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539 · see citing works
The proof and measurement of association between two things.
Spearman, C. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyq191 · Cited by 7,777 · cited 1× · see citing works
“Formally, in the definitions above, we replace ) .”
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1× · see citing works
“For example, if a system like ChatGPT browses the web to answer a question about the news, it may end up retrieving a poisoned article and adding it to the language model’s context.”
Design and analysis of computer experiments
Deng, X.-W., Hung, Y., & Lin, C. D. (2005) · doi:10.4018/978-1-5225-2498-4.ch013 · Cited by 5,353
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond
Nallapati, R., Zhou, B., dos Santos, C., Gulcehre, C., & Xiang, B. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1028 · Cited by 2,361 · see citing works
Jain, S., & Wallace, B. C. (2019) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n19-1357 · Cited by 2,287 · cited 1× · see citing works
“We focus on indirect prompt injection attacks [18, 19] that can override a language model’s response to a given query by “poisoning”, or adversarially modifying, external information provided as context.”
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 2,142 · see citing works
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · see citing works
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1259 · Cited by 1,804 · see citing works
Young, G. (2020) · International Statistical Review · doi:10.1111/insr.12370 · Cited by 1,700
Lost in the Middle: How Language Models Use Long Contexts
Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., & Liang, P. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00638 · Cited by 1,612 · see citing works
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467 · see citing works
MS MARCO: A Human Generated MAchine Reading COmprehension DatasetPreprint
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T. G., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.giscience.2025.5 · Cited by 1,190 · see citing works
Quantifying Attention Flow in Transformers
Abnar, S., & Zuidema, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.385 · Cited by 995 · cited 3× · see citing works
“Answer: [NA] Justification: We do not release data or models that have a high risk for misuse.”
LaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778 · see citing works
Not Just a Black Box: Learning Important Features Through Propagating Activation DifferencesPreprint
Shrikumar, A., Greenside, P., Shcherbina, A., & Kundaje, A. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01713 · Cited by 704 · see citing works
Serrano, S., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1282 · Cited by 690 · cited 1× · see citing works
“Finally, we explore whether context attribution can help surface poisoning attacks [15–17].”
Visualizing and Understanding Neural Models in NLP
Li, J., Chen, X., Hovy, E. H., & Jurafsky, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1082 · Cited by 673 · see citing works
Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., & Fritz, M. (2023) · Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3605764.3623985 · Cited by 667 · see citing works
Universal Adversarial Triggers for Attacking and Analyzing NLP
Wallace, E., Feng, S., Kandpal, N., Gardner, M., & Singh, S. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1221 · Cited by 642 · see citing works
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505 · see citing works
Clark, J. H., Choi, E., Collins, M., Garrette, D., Kwiatkowski, T., Nikolaev, V., & Palomaki, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00317 · Cited by 432 · see citing works
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dua, D., Wang, Y., Dasigi, P., Stanovsky, G., Singh, S., & Gardner, M. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1246 · Cited by 393 · see citing works
TRAK: Attributing Model Behavior at Scale
Park, S. M., Georgiev, K., Ilyas, A., et al. (2023) · International Conference on Machine Learning · doi:10.48550/arxiv.2303.14186 · Cited by 367
Self-citationJiang, A. Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D. S., Casas, D. D. L., Bressand, F., Lengyel, G., Lample, G., Saulnier, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.06825 · Cited by 340 · see citing works
WebGPT: Browser-assisted question-answering with human feedback
Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., Saunders, W., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.09332 · Cited by 272 · see citing works
Datamodels: Predicting Predictions from Training Data
Ilyas, A., Park, S. M., Engstrom, L., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2202.00622 · Cited by 232
Self-citationEnabling Large Language Models to Generate Text with Citations
Gao, T., Yen, H., Yu, J., & Chen, D. (2023) · arXiv · doi:10.48550/arxiv.2305.14627 · Cited by 223 · see citing works
Universal and Transferable Adversarial Attacks on Aligned Language Models
Zou, A., Wang, Z., Carlini, N., Nasr, M., Kolter, J. Z., & Fredrikson, M. (2023) · arXiv · doi:10.48550/arxiv.2307.15043 · Cited by 197 · see citing works
Wagner, W. (2010) · Language Resources and Evaluation · doi:10.1007/s10579-010-9124-x · Cited by 172 · cited 2× · see citing works
“Given the C ONTEXT C ITE attributions for a context and generated statement, we extract the top-k most relevant sources to verify the generated statement.”
Visualizing and Understanding Neural Machine Translation
Ding, Y., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1106 · Cited by 168 · see citing works
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Abdin, M., Aneja, J., Awadalla, H., Awadallah, A., Awan, A. A., Bach, N., Bahree, A., Bakhtiari, A., Bao, J., Behl, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.14219 · Cited by 166 · see citing works
Complex Claim Verification with Evidence Retrieved in the WildPreprint
Chen, J.-F., Kim, G., Sriram, A., et al. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2305.11859 · Cited by 149 · see citing works
DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models
Kwon, Y., Wu, E., Wu, K., et al. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.00902 · Cited by 145
Evaluating Verifiability in Generative Search Engines
Liu, N. F., Zhang, T., & Liang, P. (2023) · arXiv · Cited by 143 · cited 1× · see citing works
“Unlike citations generated by language models, which can be difficult to validate [6, 7], in principle it is easy to evaluate the efficacy of context attributions.”
RARR: Researching and revising what language models say, using language models
Gao, L., Dai, Z., Pasupat, P., Chen, A., Chaganty, A. T., Fan, Y., Zhao, V., Lao, N., Lee, H., Juan, D.-C., et al. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.910 · Cited by 141 · see citing works
Explaining by Removing: A Unified Framework for Model ExplanationPreprint
Covert, I., Lundberg, S., & Lee, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14878 · Cited by 136 · see citing works
DsDm: Model-Aware Dataset Selection with Datamodels
Engstrom, L., Feldmann, A., & Ma̧dry, A. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2401.12926 · Cited by 133
Self-citationAtP*: An efficient and scalable method for localizing LLM behaviour to components
Kram'ar, J., Lieberum, T., Shah, R., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2403.00745 · Cited by 125
Ignore Previous Prompt: Attack Techniques For Language Models
Perez, F., & Ribeiro, I. (2022) · arXiv · doi:10.48550/arxiv.2211.09527 · Cited by 110 · cited 3× · see citing works
“We write p LM ( R | C, Q ) to denote the probability of generating the entire response R —the product of the probabilities of generating the individual response tokens—given the tokens of a context C and the tokens of a query Q .”
In-context Example Selection with Influences
Tai, N., & Wong, E. (2023) · arXiv.org · doi:10.48550/arxiv.2302.11042 · Cited by 93
Calibrated Language Models Must Hallucinate
Kalai, A. T., & Vempala, S. S. (2024) · Proceedings of the 56th Annual ACM Symposium on Theory of Computing · doi:10.1145/3618260.3649777 · Cited by 91 · cited 1× · see citing works
“We consider a variety of datasets to evaluate C ONTEXT C ITE spanning question answering and summarization tasks and different context structures and lengths.”
Interactive Visualization and Manipulation of Attention-based Neural Machine Translation
Lee, J., Shin, J.-H., & Kim, J. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-2021 · Cited by 87 · cited 1× · see citing works
“Finally, we explore whether context attribution can help surface poisoning attacks [15–17].”
Sequential Integrated Gradients: a simple but effective method for explaining language models
Enguehard, J. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2305.15853 · Cited by 77
Measuring Attribution in Natural Language Generation Models
Rashkin, H., Nikolaev, V., Lamm, M., Aroyo, L., Collins, M., Das, D., Petrov, S., Tomar, G. S., Turc, I., & Reitter, D. (2023) · Computational Linguistics · doi:10.1162/coli_a_00486 · Cited by 71 · see citing works
Effective Large Language Model Adaptation for Improved Grounding and Citation GenerationPreprint
Ye, X., Sun, R., Arik, S. Ö., et al. (2023) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2311.09533 · Cited by 60 · see citing works
Teaching language models to support answers with verified quotes
Menick, J., Trebacz, M., Mikulik, V., Aslanides, J., Song, F., Chadwick, M., Glaese, M., Young, S., Campbell-Gillingham, L., Irving, G., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.11147 · Cited by 53 · see citing works
Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models
Bohnet, B., Tran, V. Q., Verga, P., Aharoni, R., Andor, D., Soares, L. B., Ciaramita, M., Eisenstein, J., Ganchev, K., Herzig, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.08037 · Cited by 30 · see citing works
Chern, I.-C., Chern, S., Chen, S., Yuan, W., Feng, K., Zhou, C., He, J., Neubig, G., & Liu, P. (2023) · arXiv · doi:10.48550/arxiv.2307.13528 · Cited by 29 · see citing works
bLIMEy: Surrogate Prediction Explanations Beyond LIMEPreprint
Sokol, K., Hepburn, A., Santos‐Rodríguez, R., & Flach, P. A. (2019) · Bristol Research (University of Bristol) · doi:10.48550/arxiv.1910.13016 · Cited by 28 · see citing works
Decomposing and Editing Predictions by Modeling Model Computation
Shah, H., Ilyas, A., & Ma̧dry, A. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2404.11534 · Cited by 28
Self-citationNeural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks
Pasquini, D., Strohmeier, M., & Troncoso, C. (2024) · AISec@CCS · doi:10.1145/3689932.3694764 · Cited by 27 · cited 3× · see citing works
“L i n e a r d a t a m o d e li n g s c o r e ( L D S , m o r e a cc u r a t e ) Llama-3-8B (b) We report the linear datamodeling score (LDS) (2), which measures the extent to which a context attribution can predict the effect of random context ablations.”
Studying Large Language Model Generalization with Influence Functions
Grosse, R., Bae, J., Anil, C., Elhage, N., Tamkin, A., Tajdini, A., Steiner, B., Li, D., Durmus, E., Perez, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.03296 · Cited by 26 · see citing works
Data Curation Alone Can Stabilize In-context Learning
Chang, T.-Y., & Jia, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.452 · Cited by 19 · see citing works
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P. W., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · arXiv · doi:10.48550/arxiv.2305.14251 · Cited by 14 · see citing works
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation
Qi, J., Sarti, G., Fernández, R., et al. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.347 · Cited by 11 · see citing works
Quantifying the Plausibility of Context Reliance in Neural Machine Translation
Sarti, G., Chrupała, G., Nissim, M., et al. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.01188 · Cited by 9
PURR: Efficiently Editing Language Model Hallucinations by Denoising Language Model Corruptions
Chen, A., Pasupat, P., Singh, S., Lee, H., & Guu, K. (2023) · arXiv · doi:10.48550/arxiv.2305.14908 · Cited by 7 · see citing works
Attention Sorting Combats Recency Bias In Long Context Language Models
Peysakhovich, A., & Lerer, A. (2023) · arXiv · doi:10.48550/arxiv.2310.01427 · Cited by 6 · cited 2× · see citing works
“We write p LM ( R | C, Q ) to denote the probability of generating the entire response R —the product of the probabilities of generating the individual response tokens—given the tokens of a context C and the tokens of a query Q .”
(2017) · doi:10.9728/dcs.2024.25.7.1847 · Cited by 2 · see citing works
Unifying Corroborative and Contributive Attributions in Large Language Models
Worledge, T., Shen, J. H., Meister, N., Winston, C., & Guestrin, C. (2024) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00039 · Cited by 2 · see citing works
Backtracing: Retrieving the Cause of the Query
Wang, R. E., Wirawarn, P., Khattab, O., et al. (2024) · Findings · doi:10.48550/arxiv.2403.03956 · Cited by 2
Flagged first, then by citations
9 of the 74 references couldn’t be matched to a known paper.
Research works printed but not linked: 8
- Jonathan H Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, and Jennimaria Palomaki. "Tydi qa: A benchmark for information-seeking ques- tion answering in ty pologically di verse languages". In: Transactions of the Association for Computational Linguistics 8 (2020), pp. 454-470.
- Enja Kokalj, Blaž Škrlj, Nada Lavrač, Senja Pollak, and Marko Robnik-Šikonja. "BERT meets shapley: Extending SHAP explanations to transformer-based classifiers". In: Proceedings of the EACL hackashop on news media content analysis and automated report generation. 2021, pp. 16-21.
- Behnam Mohammadi. "Wait, It's All Token Noise? Always Has Been: Interpreting LLM Behavior Using Shapley Value". In: arXiv preprint arXiv:2404.01332 (2024). · arXiv
- Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. ""Why Should I Trust You?": Explain- ing the Predictions of Any Classifier". In: International Conference on Knowledge Discovery and Data Mining (KDD). 2016.
- Martin J Wainwright. High-dimensional statistics: A non-asymptotic viewpoint. Vol. 48. Cambridge university press, 2019.
- Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. "Transformers: State-of- the-art natural language processing". In: Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations. 2020, pp. 38-45.
- Sarah Wiegreffe and Yuval Pinter. "Attention is not not explanation". In: arXiv preprint arXiv:1908.04626 (2019). · arXiv
- Kayo Yin and Graham Neubig. "Interpreting language models with contrastive explanations". In: arXiv preprint arXiv:2202.10419 (2022). · arXiv
Cited by
Sorted by citations
Xu, Q., Wu, T., Wang, Y., Li, X., Yu, H., Cen, S., & Li, Z. (2025) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2025.101406 · Cited by 7 · see citing works
Design Patterns for Securing LLM Agents against Prompt Injections
Beurer-Kellner, L., Buesser, B., Creţu, A.-M., Debenedetti, E., Dobos, D., Fabian, D., Fischer, M., Froelicher, D., Grosse, K., Naeff, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.08837 · Cited by 2 · see citing works
van Dort, I., & Heuss, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21324-2_35 · Cited by 1 · see citing works
“Techniques like gradient-based saliency [23], Jensen-Shannon Divergence [12], hidden-state analysis [22] and perturbation analyses [4] identify which parts of the context most influence the final output.”
Rule-Based Explanations for Retrieval-Augmented LLM Systems
Rorseth, J., Godfrey, P., Golab, L., Srivastava, D., & Szlichta, J. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10737-z · Cited by 1 · see citing works
Improving multimodal entity linking through modalities feature disentangling
Zhang, R., Jin, R., Huang, J., et al. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132602 · Cited by 1 · see citing works
RUBEN: Rule-Based Explanations for Retrieval-Augmented LLM Systems
Rorseth, J., Godfrey, P., Golab, L., et al. (2026) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde65706.2026.00325 · Cited by 1 · see citing works
“For LLMs using RAG, feature attribution meth-ods can score the relative influence that each RAG source has on the LLM’s response [2].”
A Framework for Explaining LLM Reasoning with Knowledge GraphsPreprint
Shirdel, M., Rorseth, J., Godfrey, P., Golab, L., Srivastava, D., & Szlichta, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6256513
Wang, H., Wang, Z., Zhou, W., & Deng, Y. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3675784
Enhancing Attention-Based Context Attribution via Token Selection and Think-Twice Mechanism
Hsu, T.-H., Huang, S.-Y., Lin, C.-Y., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_40
Fan, Z., Wang, D., Chen, P., et al. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-29788-4_2
AttnTrace: Contextual Attribution of Prompt Injection and Knowledge Corruption
Wang, Y., Geng, R., Chen, Y., & Jia, J. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00198 · Cited by 1 · see citing works
“This is also termed context traceback [36], [37], [35], [34], which has many real-world applications.”
InfluentialYe, J., Hu, Z., Li, Y., et al. (2026) · Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and Privacy · doi:10.1109/sp63933.2026.00131
“Various attribution methods have been proposed, with two major categories being gradient-based [87], [88], [89] and permutation-based [90], [91], [92], [93], [94] attribution.”
Urooj, M., Banerjee, A., & Gupta, S. (2026) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw68408.2026.00007
Recovering Structure in Unstructured LLM Outputs
Rorseth, J., Godfrey, P., Golab, L., Srivastava, D., & Szlichta, J. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00360
“For example, LLMs using retrieval-augmented generation (RAG) condition on external knowledge sources, but it is unclear how these sources shape their reasoning and responses [4], [10].”
CORAL: COncept-Based Explanations for RAG LLMS
Ling, K., Rorseth, J., Godfrey, P., et al. (2026) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde65706.2026.00320
“While there is some work on a “mechanical” understanding of LLMs (e.g., mapping facts to neurons) [2] and on understanding the influence of RAG sources on the output [3], [4], we propose instead how to describe response variations in simple terms, using semantically meaningful concepts.”
RADE: Responsibility-aware decoding of evidence for robust retrieval-augmented generation
Yin, L., Cheng, Y., Du, X., et al. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133898
- Authors
- Cohen-Wang, B., Shah, H., Georgiev, K., & Madry, A.
- ORCID
- Georgiev, Kristian
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 95764-95807
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2409.00729
- OpenAlex
- W4415796230
- Cited by
- 16
- References
- 74
- Citations by year
- 2026: 15 · 2025: 1
- FWCI
- 6.08
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2134108)
- Open Philanthropy Project
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Software › Model-Driven Software Engineering Techniques
- Keywords
- model generation, attribution, context, explainable AI, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
