DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Aminabadi, Reza Yazdani; Rajbhandari, Samyam; Awan, Ammar Ahmad; Li, Cheng; Li, Du; Zheng, Elton; Ruwase, Olatunji; Smith, Shaden; Zhang, Minjia; Rasley, Jeff; He, Yuxiong

doi:10.1109/sc41404.2022.00051

DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Aminabadi, Reza Yazdani, Rajbhandari, Samyam, Awan, Ammar Ahmad · SC22: International Conference for High Performance Computing, Networking, Storage and Analysis · 2022