Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs

Zhang, Kairun, Li, Haoyu, Zhao, Yanjun · arXiv · 2025