Singh, Aaditya K.

Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?

Singh, A. K., Kocyigit, M. Y., Poulton, A., Esiobu, D., Lomeli, M., Szilvasy, G., & Hupkes, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 16

Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs

Singh, A. K., & Strouse, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 11

Quantifying Variance in Evaluation Benchmarks

Madaan, L., Singh, A. K., Schaeffer, R., Poulton, A., Koyejo, S., Stenetorp, P., Narang, S., & Hupkes, D. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 2