Merrill, William

Competency Problems: On Finding and Removing Artifacts in Language Data

Gardner, M., Merrill, W., Dodge, J., Peters, M., Ross, A., Singh, S., & Smith, N. A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

Sentiment Analysis and Opinion MiningTopic Modeling

Cited by 81

How Language Model Hallucinations Can Snowball

Zhang, M., Press, O., Merrill, W., Liu, A., & Smith, N. A. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 77

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, E., Bhagia, A., Kinney, R., Tafjord, O., Jha, A., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 70

Humanity's Last Exam

Phan, L., Gatti, A., Han, Z., Li, N., Hu, J., Zhang, H., Zhang, C. B. C., Shaaban, M., Ling, J., Shi, S., et al. (2025) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 65

Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?

Merrill, W., Goldberg, Y., Schwartz, R., & Smith, N. A. (2021) · Transactions of the Association for Computational Linguistics

Syntax, Semantics, Linguistic VariationLogic, Reasoning, and Knowledge

Cited by 44

Saturated Transformers are Constant-Depth Threshold Circuits

Merrill, W., Sabharwal, A., & Smith, N. A. (2022) · Transactions of the Association for Computational Linguistics

semigroups and automata theoryComplexity and Algorithms in Graphs

Cited by 25

The Parallelism Tradeoff: Limitations of Log-Precision Transformers

Merrill, W., & Sabharwal, A. (2023) · Transactions of the Association for Computational Linguistics

semigroups and automata theoryComplexity and Algorithms in Graphs

Cited by 22

On the Linguistic Capacity of Real-Time Counter Automata

Merrill, W. (2020) · arXiv

semigroups and automata theoryComputability, Logic, AI Algorithms

Cited by 12

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

Let's Think Dot by Dot: Hidden Computation in Transformer Language Models

Pfau, J., Merrill, W., & Bowman, S. R. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 6

The Illusion of State in State-Space Models

Merrill, W., Petty, J., & Sabharwal, A. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 5

The expressive power of transformers with chain of thought

Merrill, W., & Sabharwal, A. (2023) · arXiv

semigroups and automata theoryComputability, Logic, AI Algorithms

Cited by 4

2 OLMo 2 Furious

OLMo, T., Walsh, P., Soldaini, L., Groeneveld, D., Lo, K., Arora, S., Bhagia, A., Gu, Y., Huang, S., Jordan, M., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 2