Huang, Chien-Chin

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Zhao, Y., Gu, A., Varma, R., Luo, L., Huang, C.-C., Xu, M., Wright, L., Shojanazeri, H., Ott, M., Shleifer, S., et al. (2023) · arXiv

Parallel Computing and Optimization TechniquesCloud Computing and Resource Management

Cited by 227

SwapAdvisor: Pushing Deep Learning Beyond the GPU Memory Limit via Smart Swapping

Huang, C.-C., Jin, G., & Li, J. (2020) · Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems

Parallel Computing and Optimization TechniquesAdvanced Neural Network Applications

Cited by 158