WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training

Tian, Changxin, Wang, Jiapeng, Zhao, Qian · arXiv · 2025