The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reason

Liang, Shanchao; Garg, Spandan; Moghaddam, Roshanak Zilouchian

doi:10.1145/3786583.3786882

The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reason

Liang, Shanchao, Garg, Spandan, Moghaddam, Roshanak Zilouchian · Proceedings of the IEEE/ACM 48th International Conference on Software Engineering: Software Engineering in Practice · 2026