Arfeen, Daiyaan

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification

Miao, X., Oliaro, G., Zhang, Z., Cheng, X., Wang, Z., Zhang, Z., Wong, R. Y. Y., Zhu, A., Yang, L., Shi, X., et al. (2024) · Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3

Natural Language Processing TechniquesTopic Modeling

Cited by 114

HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks

Dong, Z., Yao, Z., Cai, Y., Arfeen, D., Gholami, A., Mahoney, M. W., & Keutzer, K. (2019) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 110