Lee, Jaehoon

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Gemini Team, Georgiev, P., Lei, V. I., Burnell, R., Bai, L., Gulati, A., Tanzer, G., Vincent, D., Pan, Z., Wang, S., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 306

Measuring the Effects of Data Parallelism on Neural Network Training

Shallue, C. J., Lee, J., Antognini, J., Sohl-Dickstein, J., Frostig, R., & Dahl, G. E. (2018) · arXiv

Stochastic Gradient Optimization TechniquesNeural Networks and Applications

Cited by 229

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models

Singh, A., Co-Reyes, J. D., Agarwal, R., Anand, A., Patil, P., Garcia, X., Liu, P. J., Harrison, J., Lee, J., Xu, K., et al. (2023) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 10

Small-scale proxies for large-scale Transformer training instabilities

Wortsman, M., Liu, P. J., Xiao, L., Everett, K., Alemi, A., Adlam, B., Co-Reyes, J. D., Gur, I., Kumar, A., Novak, R., et al. (2023) · arXiv

Stochastic Gradient Optimization TechniquesTopic Modeling

Cited by 5