Efficient LLM Scheduling by Learning to Rank

Fu, Yichao, Zhu, Siqi, Su, Runlong · arXiv · 2024