Hupkes, Dieuwke

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

The Llama 3 Herd of Models

Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv

Fault Detection and Control SystemsAnomaly Detection Techniques and Applications

Cited by 505

Compositionality Decomposed: How do Neural Networks Generalise?

Hupkes, D., Dankers, V., Mul, M., & Bruni, E. (2020) · Journal of Artificial Intelligence Research

Natural Language Processing TechniquesTopic Modeling

Cited by 194

Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?

Singh, A. K., Kocyigit, M. Y., Poulton, A., Esiobu, D., Lomeli, M., Szilvasy, G., & Hupkes, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 16

MLGym: A New Framework and Benchmark for Advancing AI Research Agents

Nathani, D., Madaan, L., Roberts, N., Bashlykov, N., Menon, A., Moens, V., Budhiraja, A., Magka, D., Vorotilov, V., Chaurasia, G., et al. (2025) · arXiv

Artificial Intelligence ApplicationsReinforcement Learning in Robotics

Cited by 15

Visualisation and 'Diagnostic Classifiers' Reveal How Recurrent and Recursive Neural Networks Process Hierarchical Structure

Hupkes, D., Veldhoen, S., & Zuidema, W. (2018) · Journal of Artificial Intelligence Research

Explainable Artificial Intelligence (XAI)Neural Networks and Applications

Cited by 14

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges

Thakur, A. S., Choudhary, K., Ramayapally, V. S., Vaidyanathan, S., & Hupkes, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 8

Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans

Lakretz, Y., Desbordes, T., Hupkes, D., & Dehaene, S. (2021) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 4

Quantifying Variance in Evaluation Benchmarks

Madaan, L., Singh, A. K., Schaeffer, R., Poulton, A., Koyejo, S., Stenetorp, P., Narang, S., & Hupkes, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 2