CoChat

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Open access
Guo, Cong, Tang, Jiaming, Hu, Weiming, Leng, Jingwen, Zhang, Chen, Yang, Fan, Liu, Yunxin, Guo, Minyi, Zhu, Yuhao · 2023 · Proceedings of the 50th Annual International Symposium on Computer Architecture
Cited by 152

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Abstract

Transformer-based large language models (LLMs) have achieved great success with the growing model size. LLMs' size grows by 240× every two years, which outpaces the hardware progress and makes model inference increasingly costly. Model quantization is a promising approach to mitigate the widening gap between LLM size and hardware capacity. However, the existence of outliers, values with significant magnitudes, in LLMs makes existing quantization methods less effective. Prior outlier-aware quantization schemes adopt sparsity encoding techniques to separate outliers from normal values where the process requires global coordination (e.g., a global sparsity coordination list). This incurs complex encoding/decoding hardware logics and an extra orchestration controller for the computation between outlier and normal values. As such, it is not hardware-efficient and hence only achieves sub-optimal quantization benefits.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3579371.3589038

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 26 references

Research works printed but not linked: 66

  1. 10.1145/3007787.3001138 · DOI · Paper page
  2. 10.1109/ISPASS.2009.4919648 · DOI · Paper page
  3. Ron Banner , Yury Nahshan , and Daniel Soudry . 2019. Post training 4-bit quantization of convolutional networks for rapid-deployment. Advances in Neural Information Processing Systems 32 ( 2019 ). Ron Banner, Yury Nahshan, and Daniel Soudry. 2019. Post training 4-bit quantization of convolutional networks for rapid-deployment. Advances in Neural Information Processing Systems 32 (2019).
  4. 10.1145/3037697.3037700 · DOI
  5. 10.1145/2872362.2872368 · DOI
  6. 10.1145/2654822.2541967 · DOI · Paper page
  7. Yunji Chen , Tao Luo , Shaoli Liu , Shijin Zhang , Liqiang He , Jia Wang , Ling Li , Tianshi Chen , Zhiwei Xu , Ninghui Sun , 2014 . Dadiannao: A machine-learning supercomputer . In 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture. IEEE, 609--622 . Yunji Chen, Tao Luo, Shaoli Liu, Shijin Zhang, Liqiang He, Jia Wang, Ling Li, Tianshi Chen, Zhiwei Xu, Ninghui Sun, et al. 2014. Dadiannao: A machine-learning supercomputer. In 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture. IEEE, 609--622.
  8. 10.1109/ICCD46524.2019.00075 · DOI
  9. Weihao Cui , Han Zhao , Quan Chen , Hao Wei , Zirui Li , Deze Zeng , Chao Li , and Minyi Guo . 2022 . DVABatch: Diversity-aware Multi-Entry Multi-Exit Batching for Efficient Processing of DNN Services on GPUs. In 2022 USENIX Annual Technical Conference (USENIX ATC 22) . 183--198. Weihao Cui, Han Zhao, Quan Chen, Hao Wei, Zirui Li, Deze Zeng, Chao Li, and Minyi Guo. 2022. DVABatch: Diversity-aware Multi-Entry Multi-Exit Batching for Efficient Processing of DNN Services on GPUs. In 2022 USENIX Annual Technical Conference (USENIX ATC 22). 183--198.
  10. 10.1145/2749469.2750389 · DOI · Paper page
  11. Amir Gholami , Zhewei Yao , Sehoon Kim , Michael W Mahoney , and Kurt Keutzer . 2021. AI and Memory Wall. RiseLab Medium Post ( 2021 ). Amir Gholami, Zhewei Yao, Sehoon Kim, Michael W Mahoney, and Kurt Keutzer. 2021. AI and Memory Wall. RiseLab Medium Post (2021).
  12. 10.1109/CVPRW.2014.106 · DOI · Paper page
  13. Yue Guan , Jingwen Leng , Chao Li , Quan Chen , and Minyi Guo . 2020. How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT ' s Attention. arXiv preprint arXiv:2011.00943 ( 2020 ). Yue Guan, Jingwen Leng, Chao Li, Quan Chen, and Minyi Guo. 2020. How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT ' s Attention. arXiv preprint arXiv:2011.00943 (2020). · arXiv
  14. Yue Guan , Zhengyi Li , Jingwen Leng , Zhouhan Lin , and Minyi Guo . 2022 . Transkimmer: Transformer Learns to Layer-wise Skim. arXiv preprint arXiv:2205.07324 (2022). Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, and Minyi Guo. 2022. Transkimmer: Transformer Learns to Layer-wise Skim. arXiv preprint arXiv:2205.07324 (2022). · arXiv
  15. Yue Guan , Zhengyi Li , Zhouhan Lin , Yuhao Zhu , Jingwen Leng , and Minyi Guo . 2022 . Block-skim: Efficient question answering for transformer . In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 36 . 10710--10719. Yue Guan, Zhengyi Li, Zhouhan Lin, Yuhao Zhu, Jingwen Leng, and Minyi Guo. 2022. Block-skim: Efficient question answering for transformer. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 10710--10719.
  16. 10.5555/3433701.3433722 · doi:10.5555/3433701.3433722
  17. Cong Guo , Yuxian Qiu , Jingwen Leng , Xiaotian Gao , Chen Zhang , Yunxin Liu , Fan Yang , Yuhao Zhu , and Minyi Guo . 2022 . SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation . In International Conference on Learning Representations. https://openreview.net/forum?id=JXhROKNZzOc Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, and Minyi Guo. 2022. SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation. In International Conference on Learning Representations. https://openreview.net/forum?id=JXhROKNZzOc
  18. Cong Guo , Yuxian Qiu , Jingwen Leng , Chen Zhang , Ying Cao , Quanlu Zhang , Yunxin Liu , Fan Yang , and Minyi Guo . 2022 . Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training. In 2022 IEEE 40th International Conference on Computer Design (ICCD). IEEE, 738--745 . Cong Guo, Yuxian Qiu, Jingwen Leng, Chen Zhang, Ying Cao, Quanlu Zhang, Yunxin Liu, Fan Yang, and Minyi Guo. 2022. Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training. In 2022 IEEE 40th International Conference on Computer Design (ICCD). IEEE, 738--745.
  19. Cong Guo , Chen Zhang , Jingwen Leng , Zihan Liu , Fan Yang , Yunxin Liu , Minyi Guo , and Yuhao Zhu . 2022 . ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization. In 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 1414--1433 . Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, and Yuhao Zhu. 2022. ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization. In 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 1414--1433.
  20. Cong Guo , Yangjie Zhou , Jingwen Leng , Yuhao Zhu , Zidong Du , Quan Chen , Chao Li , Bin Yao , and Minyi Guo . 2020 . Balancing Efficiency and Flexibility for DNN Acceleration via Temporal GPU-Systolic Array Integration . In 2020 57th ACM/IEEE Design Automation Conference (DAC). 1--6. Cong Guo, Yangjie Zhou, Jingwen Leng, Yuhao Zhu, Zidong Du, Quan Chen, Chao Li, Bin Yao, and Minyi Guo. 2020. Balancing Efficiency and Flexibility for DNN Acceleration via Temporal GPU-Systolic Array Integration. In 2020 57th ACM/IEEE Design Automation Conference (DAC). 1--6.
  21. Song Han , Huizi Mao , and William J Dally . 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 ( 2015 ). Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015). · arXiv
  22. Shubham Jain , Swagath Venkataramani , Vijayalakshmi Srinivasan , Jungwook Choi , Kailash Gopalakrishnan , and Leland Chang . 2019 . BiScaled-DNN: Quantizing long-tailed datastructures with two scale factors for deep neural networks . In 2019 56th ACM/IEEE Design Automation Conference (DAC). IEEE, 1--6. Shubham Jain, Swagath Venkataramani, Vijayalakshmi Srinivasan, Jungwook Choi, Kailash Gopalakrishnan, and Leland Chang. 2019. BiScaled-DNN: Quantizing long-tailed datastructures with two scale factors for deep neural networks. In 2019 56th ACM/IEEE Design Automation Conference (DAC). IEEE, 1--6.
  23. 10.1145/3341301.3359630 · DOI · Paper page
  24. 10.1109/ISCA52012.2021.00010 · DOI · Paper page
  25. 10.1109/ISCA45697.2020.00047 · doi:10.1109/isca45697.2020.00047
  26. 10.1109/ISCA45697.2020.00047 · doi:10.1109/isca45697.2020.00047
  27. Pran Kurup and Taher Abbasi . 2012. Logic synthesis using Synopsys® . Springer Science & Business Media . Pran Kurup and Taher Abbasi. 2012. Logic synthesis using Synopsys®. Springer Science & Business Media.
  28. 10.1145/2508148.2485964 · DOI · Paper page
  29. Zhengyi Li , Cong Guo , Zhanda Zhu , Yangjie Zhou , Yuxian Qiu , Xiaotian Gao , Jingwen Leng , and Minyi Guo . 2022. Efficient Activation Quantization via Adaptive Rounding Border for Post-Training Quantization. arXiv preprint arXiv:2208.11945 ( 2022 ). Zhengyi Li, Cong Guo, Zhanda Zhu, Yangjie Zhou, Yuxian Qiu, Xiaotian Gao, Jingwen Leng, and Minyi Guo. 2022. Efficient Activation Quantization via Adaptive Rounding Border for Post-Training Quantization. arXiv preprint arXiv:2208.11945 (2022). · arXiv
  30. 10.1145/2694344.2694358 · DOI · Paper page
  31. 10.1145/3503222.3507752 · DOI
  32. 10.1145/2749469.2749475 · DOI · Paper page
  33. 10.1145/2155620.2155650 · DOI · Paper page
  34. Naveen Muralimanohar , Rajeev Balasubramonian , and Norman P Jouppi . 2009. CACTI 6.0 : A tool to model large caches. HP laboratories 27 ( 2009 ), 28. Naveen Muralimanohar, Rajeev Balasubramonian, and Norman P Jouppi. 2009. CACTI 6.0: A tool to model large caches. HP laboratories 27 (2009), 28.
  35. 10.1109/ISCA.2018.00063 · DOI · Paper page
  36. Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , 2019 . Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019), 8026--8037. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019), 8026--8037.
  37. 10.1109/ICCD.2013.6657019 · DOI · Paper page
  38. 10.1109/HPCA47549.2020.00015 · DOI · Paper page
  39. Yuxian Qiu , Jingwen Leng , Cong Guo , Quan Chen , Chao Li , Minyi Guo , and Yuhao Zhu . 2019 . Adversarial Defense Through Network Profiling Based Path Extraction . In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Yuxian Qiu, Jingwen Leng, Cong Guo, Quan Chen, Chao Li, Minyi Guo, and Yuhao Zhu. 2019. Adversarial Defense Through Network Profiling Based Path Extraction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  40. 10.1109/ISPASS.2019.00016 · DOI
  41. Satyabrata Sarangi and Bevan Baas . 2021 . DeepScaleTool: A Tool for the Accurate Estimation of Technology Scaling in the Deep-Submicron Era. In 2021 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 1--5. Satyabrata Sarangi and Bevan Baas. 2021. DeepScaleTool: A Tool for the Accurate Estimation of Technology Scaling in the Deep-Submicron Era. In 2021 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 1--5.
  42. Teven Le Scao , Angela Fan , Christopher Akiki , Ellie Pavlick , Suzana Ilić , Daniel Hesslow , Roman Castagné , Alexandra Sasha Luccioni , François Yvon, Matthias Gallé, et al. 2022 . BLOOM : A 176B-Parameter Open-Access Multilingual Language Model . arXiv preprint arXiv:2211.05100 (2022). Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, et al. 2022. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. arXiv preprint arXiv:2211.05100 (2022). · arXiv
  43. 10.1109/MICRO.2016.7783720 · DOI · Paper page
  44. 10.1109/ISCA.2018.00069 · DOI · Paper page
  45. 10.1109/ISCA45697.2020.00086 · DOI · Paper page
  46. Thierry Tambe , En-Yu Yang , Zishen Wan , Yuntian Deng , Vijay Janapa Reddi , Alexander Rush , David Brooks , and Gu-Yeon Wei . 2020 . Algorithm-hardware co-design of adaptive floating-point encodings for resilient deep learning inference . In 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE, 1--6. Thierry Tambe, En-Yu Yang, Zishen Wan, Yuntian Deng, Vijay Janapa Reddi, Alexander Rush, David Brooks, and Gu-Yeon Wei. 2020. Algorithm-hardware co-design of adaptive floating-point encodings for resilient deep learning inference. In 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE, 1--6.
  47. Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Łukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. Advances in neural information processing systems 30 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
  48. 10.1109/CVPR.2019.00881 · DOI · Paper page
  49. Yang Wang , Chen Zhang , Zhiqiang Xie , Cong Guo , Yunxin Liu , and Jingwen Leng . 2021 . Dual-side sparse tensor core . In 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA). IEEE, 1083--1095 . Yang Wang, Chen Zhang, Zhiqiang Xie, Cong Guo, Yunxin Liu, and Jingwen Leng. 2021. Dual-side sparse tensor core. In 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA). IEEE, 1083--1095.
  50. Ziwei Wang , Jiwen Lu , Chenxin Tao , Jie Zhou , and Qi Tian . 2019 . Learning channel-wise interactions for binary convolutional neural networks . In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 568--577 . Ziwei Wang, Jiwen Lu, Chenxin Tao, Jie Zhou, and Qi Tian. 2019. Learning channel-wise interactions for binary convolutional neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 568--577.
  51. Xiuying Wei Yunchen Zhang Xiangguo Zhang Ruihao Gong Shanghang Zhang Qi Zhang Fengwei Yu and Xianglong Liu. 2022. Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models. In Advances in Neural Information Processing Systems Alice H. Oh Alekh Agarwal Danielle Belgrave and Kyunghyun Cho (Eds.). https://openreview.net/forum?id=yW5zeRSFdZ Xiuying Wei Yunchen Zhang Xiangguo Zhang Ruihao Gong Shanghang Zhang Qi Zhang Fengwei Yu and Xianglong Liu. 2022. Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models. In Advances in Neural Information Processing Systems Alice H. Oh Alekh Agarwal Danielle Belgrave and Kyunghyun Cho (Eds.). https://openreview.net/forum?id=yW5zeRSFdZ
  52. Wikipedia contributors. 2022. 68-95-99.7 rule --- Wikipedia , The Free Encyclopedia. [Online] . Wikipedia contributors. 2022. 68-95-99.7 rule --- Wikipedia, The Free Encyclopedia. [Online].
  53. 10.1145/2485922.2485974 · DOI · Paper page
  54. 10.1109/MICRO50266.2020.00071 · DOI · Paper page
  55. 10.1109/EMC2-NIPS53020.2019.00016 · DOI · Paper page
  56. 10.1007/978-3-030-01237-3_23 · DOI · Paper page
  57. 10.1109/MICRO.2016.7783723 · DOI · Paper page
  58. Susan Zhang , Stephen Roller , Naman Goyal , Mikel Artetxe , Moya Chen , Shuohui Chen , Christopher Dewan , Mona Diab , Xian Li , Xi Victoria Lin, et al . 2022 . Opt : Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068 (2022). Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022. Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068 (2022). · arXiv
  59. 10.5555/3488766.3488815 · doi:10.5555/3488766.3488815
  60. 10.1145/3373376.3378508 · DOI · Paper page
  61. 10.1109/MICRO.2018.00011 · DOI · Paper page
  62. Yangjie Zhou , Jingwen Leng , Yaoxu Song , Shuwen Lu , Mian Wang , Chao Li , Minyi Guo , Wenting Shen , Yong Li , Wei Lin , 2023 . uGrapher: High-Performance Graph Operator Computation via Unified Abstraction for Graph Neural Networks . In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems , Volume 2 . 878--891. Yangjie Zhou, Jingwen Leng, Yaoxu Song, Shuwen Lu, Mian Wang, Chao Li, Minyi Guo, Wenting Shen, Yong Li, Wei Lin, et al. 2023. uGrapher: High-Performance Graph Operator Computation via Unified Abstraction for Graph Neural Networks. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 878--891.
  63. Yangjie Zhou , Mengtian Yang , Cong Guo , Jingwen Leng , Yun Liang , Quan Chen , Minyi Guo , and Yuhao Zhu . 2021 . Characterizing and demystifying the implicit convolution algorithm on commercial matrix-multiplication accelerators . In 2021 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 214--225 . Yangjie Zhou, Mengtian Yang, Cong Guo, Jingwen Leng, Yun Liang, Quan Chen, Minyi Guo, and Yuhao Zhu. 2021. Characterizing and demystifying the implicit convolution algorithm on commercial matrix-multiplication accelerators. In 2021 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 214--225.
  64. Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue , Lingxiao Ma , Yuqing Xia , Wei Cui , Fan Yang , Mao Yang , Lidong Zhou , Asaf Cidon , and Gennady Pekhimenko . 2022 . ROLLER: Fast and Efficient Tensor Compilation for Deep Learning. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) . 233--248. Hongyu Zhu, Ruofan Wu, Yijia Diao, Shanbin Ke, Haoyu Li, Chen Zhang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon, and Gennady Pekhimenko. 2022. ROLLER: Fast and Efficient Tensor Compilation for Deep Learning. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22). 233--248.
  65. 10.1145/3352460.3358269 · DOI · Paper page
  66. Bohan Zhuang , Mingkui Tan , Jing Liu , Lingqiao Liu , Ian Reid , and Chunhua Shen . 2021. Effective training of convolutional neural networks with low-bitwidth weights and activations . IEEE Transactions on Pattern Analysis and Machine Intelligence ( 2021 ). Bohan Zhuang, Mingkui Tan, Jing Liu, Lingqiao Liu, Ian Reid, and Chunhua Shen. 2021. Effective training of convolutional neural networks with low-bitwidth weights and activations. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).

Cited by

See all 152

Metadata

Authors
Guo, C., Tang, J., Hu, W., Leng, J., Zhang, C., Yang, F., Liu, Y., Guo, M., & Zhu, Y.
Venue
Proceedings of the 50th Annual International Symposium on Computer Architecture
Publisher
ACM
Published
2023-06-17
Pages
1-15
ISSN
1063-6897 (ISSN-L)
OpenAlex
W4366341968
Cited by
152
References
26
FWCI
17.28
Type
conference paper
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization. https://app.cochat.ai/papers/10.1145/3579371.3589038
The paper
Guo, C., Tang, J., Hu, W., Leng, J., Zhang, C., Yang, F., Liu, Y., Guo, M., & Zhu, Y. (2023). OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization. Proceedings of the 50th Annual International Symposium on Computer Architecture. https://doi.org/10.1145/3579371.3589038

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.