AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models

Yin, Yichun, Chen, Cheng, Shang, Lifeng · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021