The DOI matches its DataCite record; the references it cites are not checked yet.
Locating and Editing Factual Associations in GPT
Open accessAbstract
We analyze the storage and recall of factual associations in autoregressive transformer language models, finding evidence that these associations correspond to localized, directly-editable computations. We first develop a causal intervention for identifying neuron activations that are decisive in a model's factual predictions. This reveals a distinct set of steps in middle-layer feed-forward modules that mediate factual predictions while processing subject tokens. To test our hypothesis that these computations correspond to factual association recall, we modify feed-forward weights to update specific factual associations using Rank-One Model Editing (ROME). We find that ROME is effective on a standard zero-shot relation extraction (zsRE) model-editing task, comparable to existing methods. To perform a more sensitive evaluation, we also evaluate ROME on a new dataset of counterfactual assertions, on which it simultaneously maintains both specificity and generalization, whereas other methods sacrifice one or another. Our results confirm an important role for mid-layer feed-forward modules in storing factual associations and suggest that direct manipulation of computational mechanisms may be a feasible approach for model editing. The code, dataset, visualizations, and an interactive demo notebook are available at https://rome.baulab.info/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“FT-EWC [20], ROME [18], MEMIT [19], and MEND [31] edit the long-term memory stored in the LLMs' model parameters, but they either do not support continual editing or have negative effects on irrelevant knowledge (poor locality).”
From WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models (2024) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Representations in later hidden layers propagate through residual connections without drastic changes [38, 18], enabling effective early exit in LLMs [39, 40].”
From WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models (2024) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, some neurons exhibit task-specific activations and can be predictive of model performance on these tasks [28,30-32].”
From From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task (2025) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research has shown that neurons across different layers tend to specialize, with middle layers often containing neurons that represent higher-level contextual features [26-29].”
From From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task (2025) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Notably, these units are mostly located in intermediate and deeper layers, matching results from previous research that show higher-level reasoning and conceptual encodings in LLMs can be found in these layers [26-29].”
From From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task (2025) · cites this paper as [28]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These methods compute rank-one updates that modify model behavior for specific factual associations while preserving performance on unrelated tasks.”
From Subspace Collisions in Knowledge Editing: Orthogonal Low-Rank Updates for Scalable, Stable Model Edits (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Following prior work [6,7], we target mid-to-late MLP layers where factual knowledge is most directly encoded.”
From Subspace Collisions in Knowledge Editing: Orthogonal Low-Rank Updates for Scalable, Stable Model Edits (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“ROME [6] introduced causal tracing to identify key layers and applied rank-one updates to MLP weights, while MEMIT [7] extended this to mass editing by applying multiple rank-one updates sequentially.”
From Subspace Collisions in Knowledge Editing: Orthogonal Low-Rank Updates for Scalable, Stable Model Edits (2026) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“The ZsRE question-answering task [46] is extensively studied within the model editing literature [18, 19, 31, 15, 11]”
From WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models (2024) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“ROME [18] uses causal analysis to pinpoint knowledge within specific MLP layers and modifies the entire matrix through least squares approximation.”
From WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models (2024) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“ROME identifies factual associations and edits efficiently using MLP-based memories [18], extended by MEMIT for mass-editing [19].”
From WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models (2024) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“[55] Presents a related study which intervenes on specific parts of the Transformer architecture [56] in order to make counterfactual edits to the model’s encoding of factual knowledge (what if Pierre Curie’s area of work is medicine?). They then observe that the model’s subsequent inferences (e.g. expectations about Pierre Curie’s professional accomplishments) are updated accordingly.”
From Symbols and grounding in large language models (2023) · cites this paper as [55]
The cited source says what the claim attributes to it.
In the citing paper
“These 286 units were predominantly located in the middle layers of the model (approximately layers 12-22), consistent with the distribution of units encoding the agent's position (Fig. 3) and with previous studies reporting that higher-level conceptual processing in LLMs tends to emerge in intermediate layers [26-29].”
From From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task (2025) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“Early approaches, such as ROME [6] and MEMIT [7], demonstrated that factual edits can be performed efficiently using low-rank weight updates applied to specific layers.”
From Subspace Collisions in Knowledge Editing: Orthogonal Low-Rank Updates for Scalable, Stable Model Edits (2026) · cites this paper as [6]
In the citing paper
“these edits should affect some other bits of knowledge (e.g., that the previously current president is now the past president) but leave many other facts unaffected [160].”
From Dissociating language and thought in large language models (2024) · cites this paper as [160]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 28
- Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., and Goldberg, Y. Fine-grained analysis of sentence embeddings using auxiliary prediction tasks. In International Conference on Learning Representations (ICLR) , April 2017.
- Anderson, J. A. A simple neural network generating an interactive memory. Mathematical biosciences , 14(3-4):197-220, 1972.
- Bau, D., Liu, S., Wang, T., Zhu, J.-Y., and Torralba, A. Rewriting a deep generative model. In Proceedings of the European Conference on Computer Vision (ECCV) , 2020.
- Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., and Amodei, D. Language models are few-shot learners. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M. F., and Lin, H. (eds.), Advances in Neural Information Processing Systems , volume 33, pp. 1877-1901. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/ 2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf .
- Dai, D., Dong, L., Hao, Y., Sui, Z., Chang, B., and Wei, F. Knowledge neurons in pretrained transformers. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pp. 8493-8502, 2022.
- De Cao, N., Aziz, W., and Titov, I. Editing factual knowledge in language models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pp. 6491-6506, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics. URL https://aclanthology.org/2021.emnlp-main.522 .
- Elazar, Y., Kassner, N., Ravfogel, S., Ravichander, A., Hovy, E., Sch¨ utze, H., and Goldberg, Y. Measuring and Improving Consistency in Pretrained Language Models. Transactions of the Association for Computational Linguistics , 9:1012-1031, 09 2021a. ISSN 2307-387X. doi: 10.1162/tacl a 00410. URL https://doi.org/10.1162/tacl\_a\_00410 . · DOI
- Elazar, Y., Ravfogel, S., Jacovi, A., and Goldberg, Y. Amnesic probing: Behavioral explanation with amnesic counterfactuals. Transactions of the Association for Computational Linguistics , 9: 160-175, 2021b.
- Feder, A., Oved, N., Shalit, U., and Reichart, R. CausaLM: Causal model explanation through counterfactual language models. Computational Linguistics , 47(2):333-386, 2021.
- Geva, M., Schuster, R., Berant, J., and Levy, O. Transformer feed-forward layers are key-value memories. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pp. 5484-5495, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics. URL https://aclanthology.org/2021.emnlp-main.446 .
- Hase, P., Diab, M., Celikyilmaz, A., Li, X., Kozareva, Z., Stoyanov, V., Bansal, M., and Iyer, S. Do language models have beliefs? methods for detecting, updating, and visualizing model beliefs. arXiv preprint arXiv:2111.13654 , 2021. · arXiv
- Hupkes, D., Veldhoen, S., and Zuidema, W. Visualisation and 'diagnostic classifiers' reveal how recurrent and recursive neural networks process hierarchical structure. Journal of Artificial Intelligence Research , 61:907-926, 2018.
- Jiang, Z., Xu, F. F., Araki, J., and Neubig, G. How can we know what language models know? Transactions of the Association for Computational Linguistics , 8:423-438, 2020. doi: 10.1162/ tacl a 00324. URL https://aclanthology.org/2020.tacl-1.28 .
- Kingma, D. P. and Ba, J. Adam: A method for stochastic optimization. In Bengio, Y. and LeCun, Y. (eds.), 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , 2015. URL http://arxiv.org/abs/1412. 6980 .
- Kohonen, T. Correlation matrix memories. IEEE transactions on computers , 100(4):353-359, 1972.
- Meng, K., Sen Sharma, A., Andonian, A., Belinkov, Y., and Bau, D. Mass-editing memory in a transformer. arXiv preprint arXiv:2210.07229 , 2022. · arXiv
- Mitchell, E., Lin, C., Bosselut, A., Finn, C., and Manning, C. D. Fast model editing at scale. In International Conference on Learning Representations , 2021.
- Pearl, J. Direct and indirect effects. In Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence , pp. 411-420, 2001.
- Pearl, J. Causality: Models, Reasoning and Inference . Cambridge University Press, USA, 2nd edition, 2009. ISBN 052189560X.
- Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., et al. Language models are unsupervised multitask learners. OpenAI blog , pp. 9, 2019.
- Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research , 21(140):1-67, 2020.
- Sundararajan, M., Taly, A., and Yan, Q. Axiomatic attribution for deep networks. In International conference on machine learning , pp. 3319-3328. PMLR, 2017.
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. Attention is all you need. In Advances in neural information processing systems , pp. 5998-6008, 2017.
- Vig, J., Gehrmann, S., Belinkov, Y., Qian, S., Nevo, D., Sakenis, S., Huang, J., Singer, Y ., and Shieber, S. Causal mediation analysis for interpreting neural NLP: The case of gender bias. arXiv preprint arXiv:2004.12265 , 2020a. · arXiv
- Vig, J., Gehrmann, S., Belinkov, Y., Qian, S., Nevo, D., Singer, Y., and Shieber, S. M. Investigating gender bias in language models using causal mediation analysis. In NeurIPS , 2020b.
- Zhang, Y., Galley, M., Gao, J., Gan, Z., Li, X., Brockett, C., and Dolan, W. B. Generating informative and diverse conversational responses via adversarial information maximization. In NeurIPS , 2018.
- Zhao, S., Pascual, D., Brunner, G., and Wattenhofer, R. Of non-linearity and commutativity in BERT. In 2021 International Joint Conference on Neural Networks (IJCNN) , pp. 1-8. IEEE, 2021.
- Zhu, C., Rawat, A. S., Zaheer, M., Bhojanapalli, S., Li, D., Yu, F., and Kumar, S. Modifying memories in transformer models. arXiv preprint arXiv:2012.00363 , 2020. · arXiv
Cited by
Sorted by citations
Items 101–200 of 253
A Causal Explainable Guardrails for Large Language Models
Chu, Z., Wang, Y., Li, L., Wang, Z., Qin, Z., & Ren, K. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3690217 · Cited by 27
Hewitt, J., Thickstun, J., Manning, C. D., & Liang, P. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.506 · Cited by 10
Testing methods of neural systems understanding
Lindsay, G. W., & Bau, D. (2023) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101156 · Cited by 15
Self-citationA divide and conquer framework for Knowledge Editing
Han, X., Li, R., Li, X., & Pan, J. Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110826 · Cited by 12
Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
Pal, K., Sun, J., Yuan, A., Wallace, B., & Bau, D. (2023) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2023.conll-1.37 · Cited by 81
Self-citationAuthentic Learning Approach for Data Poisoning Vulnerability in LLMs
Akter, M. S., Rahman, M., Rahman, M. D. H., Rodriguez-Cardenas, J., Shahriar, H., Wu, F., & Rahman, M. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00210 · Cited by 10
Infusion: Preventing Customized Text-to-Image Diffusion from Overfitting
Zeng, W., Yan, Y., Zhu, Q., Chen, Z., Chu, P., Zhao, W., & Yang, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680894 · Cited by 10
Artificial intelligence and human decision making: Exploring similarities in cognitive bias
Campbell, H., Goldman, S., & Markey, P. M. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100138 · Cited by 9
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models
Youssef, P., Koraş, O. A., Li, M., Schlötterer, J., & Seifert, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1043 · Cited by 18
Characterizing Mechanisms for Factual Recall in Language Models
Yu, Q., Merullo, J., & Pavlick, E. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.615 · Cited by 48
Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision
Hudson, N., Pauloski, J. G., Baughman, M., Kamatar, A., Sakarvadia, M., Ward, L. T., Chard, R., Bauer, A., Levental, M., Wang, W., et al. (2023) · IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) · doi:10.1145/3632366.3632396 · Cited by 13
Editing Common Sense in Transformers
Gupta, A., Mondal, D., Sheshadri, A. K., Zhao, W., Li, X., Wiegreffe, S., & Tandon, N. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.511 · Cited by 29
A Brief Survey on Safety of Large Language Models
Gao, Z., Liu, X., Lan, Y.-S., & Yang, Z. (2024) · Journal of Computing and Information Technology · doi:10.20532/cit.2024.1005778 · Cited by 11
Mixture of causal experts: A causal perspective to build dual-level mixture-of-experts models
Gao, Y., Xu, N., Tian, H., Zheng, B., Cao, J., & Liu, A.-A. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127422 · Cited by 10
Wang, T., Jiao, X., Zhu, Y., Chen, Z., He, Y., Chu, X., Gao, J., Wang, Y., & Ma, L. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714640 · Cited by 37
Li, S., Han, C., Yu, P., Edwards, C., Li, M., Wang, X., Fung, Y. R., Yu, C., Tetreault, J., Hovy, E. H., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.799 · Cited by 11
Do Multi-Document Summarization Models Synthesize?
DeYoung, J., Martinez, S. C., Marshall, I. J., & Wallace, B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00687 · Cited by 12
“…and analysis of neural models for NLP This work is also related to the emerging body of work on analyzing neural NLP models, their behaviors, “knowledge”, and “abilities” in general e.g., (Linzen et al., 2016; Tenney et al., 2019; Petroni et al., 2019; Niven and Kao, 2019; Meng et al., 2022).”
MethodGolgoon, A., Filom, K., & Kannan, A. R. (2024) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3677052.3698612 · Cited by 11
Emptying the Ocean with a Spoon: Should We Edit Models?
Pinter, Y., & Elhadad, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1012 · Cited by 17
Meta-Learning Online Adaptation of Language Models
Hu, N., Mitchell, E., Manning, C. D., & Finn, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.268 · Cited by 25
Wang, H., & Shu, K. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679821 · Cited by 15
Large Language Models as Psychological Simulators: A Methodological Guide
Lin, Z. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251410153 · Cited by 17
Kunz, J. (2024) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180754712 · Cited by 7
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models
Hagström, L., Saynova, D., Norlund, T., Johansson, M., & Johansson, R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.332 · Cited by 6
Mitigating Temporal Misalignment by Discarding Outdated Facts
Zhang, M., & Choi, E. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.879 · Cited by 15
DocTER: Evaluating document-based knowledge editing
Wu, S., Wang, A., Peng, M., Lin, Y., Li, W., Sun, M., & Su, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104299 · Cited by 34
Model Editing for LLMs4Code: How Far are we?
Li, X., Wang, S., Li, S., Ma, J., Yu, J., Liu, X., Wang, J., Ji, B., & Zhang, W. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00049 · Cited by 18
Lizarraga, A., Honig, E., & Wu, Y. N. (2025) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.70035 · Cited by 10
Zou, H., & Wang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129589 · Cited by 5
(2022) · doi:10.18653/v1/2022.conll-1.8 · Cited by 5
Evaluating Complex Entity Knowledge Propagation for Knowledge Editing in LLMs
Shafqat, W., & Na, S. (2024) · Applied Sciences · doi:10.3390/app14041508 · Cited by 5
Zhang, B., Chen, Q., Zhou, J., Jin, J., & He, L. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651331 · Cited by 7
Mitigating Hallucination Issues in Small-Parameter LLMs through Inter-Layer Contrastive Decoding
Li, F., zhang, X., & Zhang, P. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650644 · Cited by 5
An Overview of Artificial Intelligence's Accuracy
Kollar, J., & Alshibli, M. (2024) · IEEE Long Island Systems, Applications and Technology Conference (LISAT) · doi:10.1109/lisat63094.2024.10808042 · Cited by 10
Edited Knowledge Fusion with Large Language Models
Wen, Y. (2025) · 2025 5th International Conference on Neural Networks, Information and Communication Engineering (NNICE) · doi:10.1109/nnice64954.2025.11063722 · Cited by 3
Dumb Meaning: Machine Learning and Artificial Semantics
Bajohr, H. (2024) · Digitale Gesellschaft · doi:10.1515/9783839469224-003 · Cited by 12
Experience-guided multi-agent interpretable framework for radiology report summarization
Li, J., Zhou, T., Zhou, Z., Wei, X., Song, H., Wang, Z., Chen, Y., & Lv, H. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.109078 · Cited by 4
WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models
Wang, P., Li, Z., Zhang, N., Xu, Z., Yao, Y., Jiang, Y., Xie, P., Huang, F., & Chen, H. (2024) · arXiv · doi:10.48550/arxiv.2405.14768 · Cited by 19
Episodic Memory in AI Agents Poses Risks that Should be Studied and Mitigated
DeChant, C. (2025) · 2025 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00024 · Cited by 5
LLM-Eraser: Optimizing Large Language Model Unlearning through Selective Pruning
Zhang, S., Zhang, L., Zhou, J., Zheng, Z., & Xiong, H. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709312 · Cited by 7
Liu, J., Yang, M., Bi, Y., Zhang, J., Yang, Y., Li, Y., Shen, H., Chen, K., & Li, X. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102332 · Cited by 4
Revision Transformers: Instructing Language Models to Change Their Values
Friedrich, F., Stammer, W., Schramowski, P., & Kersting, K. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230341 · Cited by 6
Taming Simulators: Challenges, Pathways and Vision for the Alignment of Large Language Models
Bereska, L., & Gavves, E. (2023) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v1i1.27478 · Cited by 6
Sakarvadia, M., Ajith, A., Khan, A., Grzenda, D., Hudson, N., Bauer, A., Chard, K., & Foster, I. T. (2023) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2023.blackboxnlp-1.26 · Cited by 9
Net2Brain: a toolbox to compare artificial vision models with human brain responses
Bersch, D., Vilas, M. G., Saba-Sadiya, S., Schaumlöffel, T., Dwivedi, K., Sartzetaki, C., Cichy, R. M., & Roig, G. (2025) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2025.1515873 · Cited by 5
Fairness Mediator: Neutralize Stereotype Associations to Mitigate Bias in Large Language Models
Xiao, Y., Liu, A., Liang, S., Liu, X., & Tao, D. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728881 · Cited by 10
Decouple knowledge from paramters for plug-and-play language modeling
Cheng, X., Lin, Y., Chen, X., Zhao, D., & Yan, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.901 · Cited by 9
Rigorously assessing natural language explanations of neurons
Huang, J., Geiger, A., D’Oosterlinck, K., Wu, Z., & Potts, C. (2023) · Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/2023.blackboxnlp-1.24 · Cited by 3
When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
Wang, P., Viberg, O., Law, E. L.-C., & Greiff, S. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10202-y · Cited by 3
Hu, C., Cao, P., Chen, Y., Liu, K., & Zhao, J. (2024) · arXiv · doi:10.48550/arxiv.2408.07413 · Cited by 3
Zweiger, A., Pari, J., Guo, H., Akyürek, E., Kim, Y., & Agrawal, P. (2025) · arXiv · Cited by 3
Tao, R., Chen, H., Guo, Y., Wang, J., Wang, B., Ni, R., & Zhao, Y. J. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107909 · Cited by 3
Explainable and Transparent AI Architectures
Gupta, D., Nigora, A., Gulkhayo, G., Gayratovich, E. N., Karimov, S., Otabek, M., & Kenesbaevich, S. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8252-4.ch011 · Cited by 3
Schuerkamp, R., Ahlstrom, H., & Giabbanelli, P. J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113151 · Cited by 4
SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering
Li, X., Li, S., Song, S., Liu, H., Ji, B., Wang, X., Ma, J., Yu, J., Liu, X., Wang, J., et al. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i23.34628 · Cited by 3
Santra, P., Ghosh, M., Ganguly, D., Basuchowdhuri, P., & Naskar, S. K. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70021 · Cited by 5
IRepair: An Intent-Aware Approach to Repair Data-Driven Errors in Large Language Models
Imtiaz, S. M., Singh, A., Batole, F., & Rajan, H. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715775 · Cited by 3
Misalignment or misuse? The AGI alignment tradeoff
Hellrigel-Holderbaum, M., & Dung, L. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02403-y · Cited by 6
Causal interventions expose implicit situation models for commonsense language understanding
Yamakoshi, T., McClelland, J. L., Goldberg, A. E., & Hawkins, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.839 · Cited by 7
Improving Data-Efficient Fossil Segmentation via Model Editing
Panigrahi, I., Manzuk, R. A., Maloof, A. C., & Fong, R. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00511 · Cited by 3
DUnE: Dataset for Unified Editing
Akyürek, A. F., Pan, E., Kuwanto, G., & Wijaya, D. T. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.114 · Cited by 14
Artificial Intelligence - Intelligent Art?
Voigts, E., Auer, R. M., Elflein, D., Kunas, S., Röhnert, J., & Seelinger, C. (2024) · Digitale Gesellschaft · doi:10.1515/9783839469224 · Cited by 14
Dissociable frequency effects attenuate as large language model surprisal predictors improve
Oh, B.-D., & Schuler, W. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104645 · Cited by 8
Neutralizing Backdoors through Information Conflicts for Large Language ModelsPreprint
Chen, Z., Sun, Y., Gong, X., Gao, J., & Lam, K. (2024) · Qeios · doi:10.32388/fv951p · Cited by 6
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
Li, Z., Song, S., Wang, H., Niu, S., Chen, D., Yang, J., Xi, C., Lai, H., Zhao, J., Wang, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.22101 · Cited by 2
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models
Fang, J., Jiang, H., Wang, K., Ma, Y., Jie, S., Wang, X., He, X., & Chua, T.-S. (2024) · arXiv · doi:10.48550/arxiv.2410.02355 · Cited by 170
Guiding Evolutionary AutoEncoder Training with Activation-Based Pruning Operators
Jorgensen, S., Hemberg, E., Toutouh, J., & O’Reilly, U.-M. (2025) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3712256.3726449 · Cited by 2
A Robust Information-Masking Approach for Domain Counterfactual Generation
Hong, P., Bhardwaj, R., Majumder, N., Aditya, S., & Poria, S. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.231 · Cited by 2
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Chung, J., & Yu, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.46 · Cited by 2
Mode combinability: Exploring convex combinations of permutation aligned models
Csiszárik, A., Kiss, M. F., Kőrösi-Szabó, P., Muntag, M., Papp, G., & Varga, D. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106204 · Cited by 2
Local Explanations for Large Language Models: a Brief Review of Methods
Volkov, E. N., & Averkin, A. N. (2024) · IEEE International Conference on Soft Computing and Measurements (SCM) · doi:10.1109/scm62608.2024.10554222 · Cited by 3
Which Neurons Matter in IR? Applying Integrated Gradients-based Methods to Understand Cross-Encoders
Vast, M., Cooten, B. V., Soulier, L., & Piwowarski, B. (2024) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3664190.3672528 · Cited by 2
Wei, Y., Yu, X., Weng, Y., Ma, H., Zhang, Y., Zhao, J., & Liu, K. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679900 · Cited by 2
Villuri, G., & Doboli, A. (2024) · IEEE Conference on Information Technology and Data Science (CITDS) · doi:10.1109/citds62610.2024.10791359 · Cited by 2
Mollo, D. C. (2025) · THEORIA An International Journal for Theory History and Foundations of Science · doi:10.1387/theoria.25837 · Cited by 2
Example-Based Concept Analysis Framework for Deep Weather Forecast Models
Kim, S., Choi, J., Lee, S., & Choi, J. (2025) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-24-0079.1 · Cited by 2
Improving Sequential Model Editing with Fact Retrieval
Han, X., Li, R., Tan, H., Wang, Y., Chai, Q., & Pan, J. Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.749 · Cited by 5
Kalinowski, A., Datta, D., & An, Y. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386670 · Cited by 2
Mechanistic interpretability for steering vision-language-action models
Häon, B., Stocking, K., Chuang, I., & Tomlin, C. (2025) · arXiv · doi:10.48550/arxiv.2509.00328 · Cited by 1
Explaining Relation Classification Models with Semantic Extents
Klöser, L., Büsgen, A., Kohl, P., Kraft, B., & Zündorf, A. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-39059-3_13 · Cited by 1
Can LLMs Facilitate Interpretation of Pre-trained Language Models?
Mousi, B., Durrani, N., & Dalvi, F. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.196 · Cited by 8
An Efficient Approach for Enhancing GenAI Trustworthiness
Yehezkel, A. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00292 · Cited by 1
The Missing Piece in Model Editing: A Deep Dive into the Hidden Damage Brought By Model Editing
Wang, J., Gu, Z., Zhu, X., Zhang, L., Ye, H., Xiong, Z., Jiang, S., Feng, H., & Xiao, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890406 · Cited by 14
Chen, Y.-C., & Huang, H. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i22.34534 · Cited by 1
Qiao, S., Liu, X., & Na, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i23.34686 · Cited by 1
RelBERT: Embedding relations with language models
Ushio, A., Camacho-Collados, J., & Schockaert, S. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2025.104359 · Cited by 4
Debugging and Runtime Analysis of Neural Networks with VLMs (A Case Study)
Hu, B. C., Gopinath, D., Păsăreanu, C. S., Narodytska, N., Mangal, R., & Jha, S. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00027 · Cited by 1
Reverse-Engineering the Retrieval Process in GenIR Models
Reusch, A., & Belinkov, Y. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730076 · Cited by 3
Self-citationDynamic Asymmetric Attention for Enhanced Reasoning and Interpretability in LLMs
Wen, F., Lu, X., Yu, H., Lu, C., Li, H., & Shi, X. (2025) · Symmetry · doi:10.3390/sym17081303 · Cited by 1
A Survey of Metrics to Enhance Training Dependability in Large Language Models
Fang, W., Zhang, H., Gong, Z., Zeng, L., Lu, X., Liu, B., Wu, X., Zheng, Y., Hu, Z., & Zhang, X. (2023) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew60843.2023.00071 · Cited by 1
Qin, N. (2023) · IEEE Access · doi:10.1109/access.2023.3340527 · Cited by 2
Chintam, A., Beloch, R., Zuidema, W. H., Hanna, M., & van der Wal, O. (2023) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2023.blackboxnlp-1.29 · Cited by 10
Unnatural language processing: How do language models handle machine-generated prompts?
Kervadec, C., Franzon, F., & Baroni, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.959 · Cited by 1
Figênio, M. R., Santanchè, A., & Gomes-Jr, L. (2024) · doi:10.5753/erbd.2024.238868 · Cited by 1
Uncovering the Interpretation of Large Language Models
Akter, M. S., Shahriar, H., Cuzzocrea, A., & Wu, F. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00143 · Cited by 1
Towards Analysis and Interpretation of Large Language Models for Arithmetic Reasoning
Akter, M. S., Shahriar, H., & Cuzzocrea, A. (2024) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds60720.2024.00049 · Cited by 1
Woodman, O., Wen, Z., Lu, H., Ren, Y., Zhu, M., & Chen, W. (2024) · Graphical Models · doi:10.1016/j.gmod.2024.101238 · Cited by 1
Causal Tracing to Identify Hacking Knowledge in Large Language Models
Marinelli, R. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825125 · Cited by 1
AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
Agarwal, A., Karanam, S., & Srinivasan, B. V. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00478 · Cited by 2
Identifying Query-Relevant Neurons in Large Language Models for Long-Form Texts
Chen, L., Dejl, A., & Toni, F. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i22.34529 · Cited by 12
Metadata
- Authors
- Meng, K., Bau, D., Andonian, A., & Belinkov, Y.
- Affiliations
- Northeastern University (US)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Technion – Israel Institute of Technology (IL)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2202.05262
- OpenAlex
- W4281657280
- Cited by
- 230
- References
- 0
- Citations by year
- 2026: 7 · 2025: 67 · 2024: 75 · 2023: 79 · 2022: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Open Philanthropy Project
- Azrieli Foundation
- Defense Advanced Research Projects Agency (HR0011, FA8750)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model editing, Rome, causal intervention, neuronal activation, zero-shot relation extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
