Xiao, Guangxuan

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration

Lin, J., Tang, J., Tang, H., Yang, S., Xiao, G., & Han, S. (2025) · GetMobile: Mobile Computing and Communications

Advanced Neural Network ApplicationsIoT and Edge/Fog Computing

Cited by 274

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Xiao, G., Lin, J., Seznec, M., Wu, H., Demouth, J., & Han, S. (2022) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 247

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Lin, J., Tang, J., Tang, H., Yang, S., Chen, W.-M., Wang, W.-C., Xiao, G., Dang, X., Gan, C., & Han, S. (2023) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 103

Efficient Streaming Language Models with Attention Sinks

Xiao, G., Tian, Y., Chen, B., Han, S., & Lewis, M. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 55

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory

Xiao, C., Zhang, P., Han, X., Xiao, G., Lin, Y., Zhang, Z., Liu, Z., & Sun, M. (2024) · Advances in Neural Information Processing Systems 37

Topic ModelingNatural Language Processing Techniques

Cited by 14

Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

Tang, J., Zhao, Y., Zhu, K., Xiao, G., Kasikci, B., & Han, S. (2024) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 2