Belinkov, Yonatan

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

What do Neural Machine Translation Models Learn about Morphology?

Belinkov, Y., Durrani, N., Dalvi, F., Sajjad, H., & Glass, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Natural Language Processing TechniquesTopic Modeling

Cited by 307

Analyzing the Structure of Attention in a Transformer Language Model

Vig, J., & Belinkov, Y. (2019) · Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP

Topic ModelingNatural Language Processing Techniques

Cited by 301

Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

Marks, S., Rager, C., Michaud, E. J., Belinkov, Y., Bau, D., & Mueller, A. (2024) · arXiv

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 295

Locating and Editing Factual Associations in GPT

Meng, K., Bau, D., Andonian, A., & Belinkov, Y. (2022) · arXiv

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 230

Locating and Editing Factual Associations in GPT

Meng, K., Bau, D., Andonian, A., & Belinkov, Y. (2022) · Advances in Neural Information Processing Systems 35

Topic ModelingNatural Language Processing Techniques

Cited by 149

Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?

Ravichander, A., Belinkov, Y., & Hovy, E. (2020) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 133

Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?

Ravichander, A., Belinkov, Y., & Hovy, E. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume

Topic ModelingNatural Language Processing Techniques

Cited by 132

Parallel Context Windows for Large Language Models

Ratner, N., Levine, Y., Belinkov, Y., Ram, O., Magar, I., Abend, O., Karpas, E., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 111

Linearity of Relation Decoding in Transformer Language Models

Hernandez, E., Sharma, A. S., Haklay, T., Meng, K., Wattenberg, M., Andreas, J., Belinkov, Y., & Bau, D. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 98

Mass-Editing Memory in a Transformer

Meng, K., Sharma, A. S., Andonian, A., Belinkov, Y., & Bau, D. (2022) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 76

A Constructive Prediction of the Generalization Error Across Scales

Rosenfeld, J. S., Rosenfeld, A., Belinkov, Y., & Shavit, N. (2019) · arXiv

Domain Adaptation and Few-Shot LearningStochastic Gradient Optimization Techniques

Cited by 74

Don’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference

Belinkov, Y., Poliak, A., Shieber, S., Van Durme, B., & Rush, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics

Topic ModelingNatural Language Processing Techniques

Cited by 73

Jamba: A Hybrid Transformer-Mamba Language Model

Lieber, O., Lenz, B., Bata, H., Cohen, G., Osin, J., Dalmedigos, I., Safahi, E., Meirom, S., Belinkov, Y., Shalev-Shwartz, S., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 70

Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking

Prakash, N., Shaham, T. R., Haklay, T., Belinkov, Y., & Bau, D. (2024) · arXiv

Topic ModelingExplainable Artificial Intelligence (XAI)

Cited by 63

Effect of Tokenization on Transformers for Biological Sequences

Dotan, E., Jaschek, G., Pupko, T., & Belinkov, Y. (2023) · Bioinformatics

Machine Learning in BioinformaticsGenomics and Phylogenetic Studies

Cited by 50

MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning

Karpas, E., Abend, O., Belinkov, Y., Lenz, B., Lieber, O., Ratner, N., Shoham, Y., Bata, H., Levine, Y., Leyton-Brown, K., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 49

Effect of tokenization on transformers for biological sequences

Dotan, E., Jaschek, G., Pupko, T., & Belinkov, Y. (2024) · Bioinformatics

Machine Learning in BioinformaticsGenomics and Phylogenetic Studies

Cited by 49

Analysis of sentence embedding models using prediction tasks in natural language processing

Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2017) · IBM Journal of Research and Development

Topic ModelingSentiment Analysis and Opinion Mining

Cited by 21

Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answer

Simhi, A., Itzhak, I., Barez, F., Stanovsky, G., & Belinkov, Y. (2025) · arXiv

Topic ModelingAdversarial Robustness in Machine Learning

Cited by 8

Generating benchmarks for factuality evaluation of language models

Muhlgay, D., Ram, O., Magar, I., Levine, Y., Ratner, N., Belinkov, Y., Abend, O., Leyton-Brown, K., Shashua, A., & Shoham, Y. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 8

Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics

Nikankin, Y., Reusch, A., Mueller, A., & Belinkov, Y. (2024) · arXiv

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 4

Growing a Tail: Increasing Output Diversity in Large Language Models

Shur-Ofry, M., Horowitz-Amsalem, B., Rahamim, A., & Belinkov, Y. (2026) · Machine Learning with Applications

Topic ModelingEthics and Social Impacts of AI

Cited by 3

Confidence Regulation Neurons in Language Models

Stolfo, A., Wu, B., Gurnee, W., Belinkov, Y., Song, X., Sachan, M., & Nanda, N. (2024) · Advances in Neural Information Processing Systems 37

Neurobiology of Language and BilingualismTopic Modeling

Cited by 2