Sclar, Melanie

Faith and Fate: Limits of Transformers on Compositionality

Dziri, N., Lu, X., Sclar, M., Li, X. (., Jiang, L., Lin, B. Y., Welleck, S., West, P., Bhagavatula, C., Bras, R. L., et al. (2023) · Advances in Neural Information Processing Systems 36

Syntax, Semantics, Linguistic VariationPhilosophy and Theoretical Science

Cited by 335

Faith and Fate: Limits of Transformers on Compositionality

Dziri, N., Lu, X., Sclar, M., Li, X. L., Jiang, L., Lin, B. Y., West, P., Bhagavatula, C., Bras, R. L., Hwang, J. D., et al. (2023) · arXiv

Syntax, Semantics, Linguistic VariationPhilosophy and Theoretical Science

Cited by 124

Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting

Sclar, M., Choi, Y., Tsvetkov, Y., & Suhr, A. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 52

FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions

Kim, H., Sclar, M., Zhou, X., Bras, R., Kim, G., Choi, Y., & Sap, M. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Child and Animal Learning DevelopmentTopic Modeling

Cited by 27

Minding Language Models’ (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker

Sclar, M., Kumar, S., West, P., Suhr, A., Choi, Y., & Tsvetkov, Y. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Child and Animal Learning DevelopmentLogic, Reasoning, and Knowledge

Cited by 27

The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning

Lin, B. Y., Ravichander, A., Lu, X., Dziri, N., Sclar, M., Chandu, K., Bhagavatula, C., & Choi, Y. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 11

Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detection

Ahuja, K., Sclar, M., & Tsvetkov, Y. (2025) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 1