Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

Allen-Zhu, Zeyuan, Li, Yuanzhi · arXiv · 2020