BlendServe: Optimizing Offline Inference with Resource-Aware Batching

Zhao, Yilong; Yang, Shuo; Zhu, Kan; Zheng, Lianmin; Kasikci, Baris; Qiao, Yifan; Zhou, Yang; Xing, Jiarong; Stoica, Ion

doi:10.1145/3779212.3790133

BlendServe: Optimizing Offline Inference with Resource-Aware Batching

Zhao, Yilong, Yang, Shuo, Zhu, Kan · Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 · 2026