SGLang: Efficient Execution of Structured Language Model Programs

Zheng, Lianmin, Yin, Liangsheng, Xie, Zhiqiang · Advances in Neural Information Processing Systems 37 · 2024