Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining

Li, Houyi, Zheng, Wenzhen, Wang, Qiufeng · arXiv · 2025