Gholami, Amir

A Survey of Quantization Methods for Efficient Neural Network Inference

Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision

Advanced Neural Network ApplicationsNeural Networks and Applications

Cited by 1,219

HAWQ: Hessian AWare Quantization of Neural Networks With Mixed-Precision

Dong, Z., Yao, Z., Gholami, A., Mahoney, M., & Keutzer, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV)

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 492

Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

Shen, S., Dong, Z., Ye, J., Ma, L., Yao, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence

Advanced Neural Network ApplicationsTopic Modeling

Cited by 437

ZeroQ: A Novel Zero Shot Quantization Framework

Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 381

SqueezeNext: Hardware-Aware Neural Network Design

Gholami, A., Kwon, K., Wu, B., Tai, Z., Yue, X., Jin, P., Zhao, S., & Keutzer, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Advanced Neural Network ApplicationsParallel Computing and Optimization Techniques

Cited by 350

I-BERT: Integer-only BERT Quantization

Kim, S., Gholami, A., Yao, Z., Mahoney, M. W., & Keutzer, K. (2021) · arXiv

Advanced Neural Network ApplicationsNumerical Methods and Algorithms

Cited by 186

Learned Token Pruning for Transformers

Kim, S., Shen, S., Thorsley, D., Gholami, A., Kwon, W., Hassoun, J., & Keutzer, K. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining

Advanced Neural Network ApplicationsTopic Modeling

Cited by 139

HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks

Dong, Z., Yao, Z., Cai, Y., Arfeen, D., Gholami, A., Mahoney, M. W., & Keutzer, K. (2019) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 110

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Hooper, C., Kim, S., Mohammadzadeh, H., Mahoney, M. W., Shao, Y. S., Keutzer, K., & Gholami, A. (2024) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 69

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Hooper, C., Kim, S., Mohammadzadeh, H., Mahoney, M., Shao, Y., Keutzer, K., & Gholami, A. (2024) · Advances in Neural Information Processing Systems 37

Advanced Neural Network ApplicationsTopic Modeling

Cited by 69

Hessian-Aware Pruning and Optimal Neural Implant

Yu, S., Yao, Z., Gholami, A., Dong, Z., Kim, S., Mahoney, M. W., & Keutzer, K. (2021) · arXiv

Advanced Neural Network ApplicationsMachine Learning and Data Classification

Cited by 50

An LLM Compiler for Parallel Function Calling

Kim, S., Moon, S., Tabrizi, R., Lee, N., Mahoney, M. W., Keutzer, K., & Gholami, A. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 12

Characterizing Prompt Compression Methods for Long Context Inference

Jha, S., Erdogan, L. E., Kim, S., Keutzer, K., & Gholami, A. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1