Rangadurai, Kaushik

A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale

Shi, H.-J. M., Lee, T.-H., Iwasaki, S., Gallego-Posada, J., Li, Z., Rangadurai, K., Mudigere, D., & Rabbat, M. (2023) · arXiv

Stochastic Gradient Optimization TechniquesParallel Computing and Optimization Techniques

Cited by 70