SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Wang, Jianyu, Tantia, Vinayak, Ballas, Nicolas · arXiv · 2019