Tirumala, Kushal

Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models

Tirumala, K., Markosyan, A., Zettlemoyer, L., & Aghajanyan, A. (2022) · Advances in Neural Information Processing Systems 35

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 67

An Introduction to Vision-Language Modeling

Bordes, F., Pang, R. Y., Ajay, A., Li, A. C., Bardes, A., Petryk, S., Mañas, O., Lin, Z., Mahmoud, A., Jayaraman, B., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsGenerative Adversarial Networks and Image Synthesis

Cited by 47

D4: Improving LLM Pretraining via Document De-Duplication and Diversification

Tirumala, K., Simig, D., Aghajanyan, A., & Morcos, A. (2023) · Advances in Neural Information Processing Systems 36

Topic ModelingNatural Language Processing Techniques

Cited by 28

OpenAI GPT-5 System Card

Singh, A., Fry, A., Perelman, A., Tart, A., Ganesh, A., El-Kishky, A., McLaughlin, A., Low, A., Ostrow, A., Ananthram, A., et al. (2026) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 26