P/D-Serve: Serving Disaggregated Large Language Model at Scale

Jin, Yibo, Wang, Tao, Lin, Huimin · arXiv · 2024