Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts

Wang, Lean, Gao, Huazuo, Zhao, Chenggang · arXiv · 2024