PSAQ-ViT V2: Toward Accurate and General Data-Free Quantization for Vision Transformers
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
Data-free quantization can potentially address data privacy and security concerns in model compression and thus has been widely investigated. Recently, patch similarity aware data-free quantization for vision transformers (PSAQ-ViT) designs a relative value metric, patch similarity, to generate data from pretrained vision transformers (ViTs), achieving the first attempt at data-free quantization for ViTs. In this article, we propose PSAQ-ViT V2, a more accurate and general data-free quantization framework for ViTs, built on top of PSAQ-ViT. More specifically, following the patch similarity metric in PSAQ-ViT, we introduce an adaptive teacher-student strategy, which facilitates the constant cyclic evolution of the generated samples and the quantized model (student) in a competitive and interactive fashion under the supervision of the full-precision (FP) model (teacher), thus significantly improving the accuracy of the quantized model. Moreover, without the auxiliary category guidance, we employ the task- and model-independent prior information, making the general-purpose scheme compatible with a broad range of vision tasks and models. Extensive experiments are conducted on various models on image classification, object detection, and semantic segmentation tasks, and PSAQ-ViT V2, with the naive quantization strategy and without access to real-world data, consistently achieves competitive results, showing potential as a powerful baseline on data-free quantization for ViTs. For instance, with Swin-S as the (backbone) model, 8-bit quantization reaches 82.13 top-1 accuracy on ImageNet, 50.9 box AP and 44.1 mask AP on COCO, and 47.2 mean Intersection over Union (mIoU) on ADE20K. We hope that accurate and general PSAQ-ViT V2 can serve as a potential and practice solution in real-world applications involving sensitive data. Code is released and merged at: https://github.com/zkkli/PSAQ-ViT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous works do not explicitly incorporate task-specific loss into their QAT training objectives [10, 32, 48].”
From Task-Specific Zero-Shot Quantization-Aware Training for Object Detection (2025) · cites this paper as [32]
In the citing paper
“However, existing methods use unlabeled task-agnostic synthetic images that lack the specific information required for object detection, leading to suboptimal performance.”
From Task-Specific Zero-Shot Quantization-Aware Training for Object Detection (2025) · cites this paper as [32]
In the citing paper
“Previous zero-shot quantization works in object detection primarily employ task-agnostic training methods for both image generation and quantization-aware training [10, 32, 48].”
From Task-Specific Zero-Shot Quantization-Aware Training for Object Detection (2025) · cites this paper as [32]
In the citing paper
“We are the first to introduce task-specific loss at both stages.”
From Task-Specific Zero-Shot Quantization-Aware Training for Object Detection (2025) · cites this paper as [32]
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Cascade R-CNN: Delving into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2017) · arXiv · doi:10.48550/arxiv.1712.00726 · Cited by 7,408
Cascade R-CNN: Delving Into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00644 · Cited by 7,370
Deformable DETR: Deformable Transformers for End-to-End Object Detection
Zhu, X., Su, W., Lu, L., Li, B., Wang, X., & Dai, J. (2020) · arXiv · doi:10.48550/arxiv.2010.04159 · Cited by 6,027
Han (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595 · cited 1×
“footprints, computational overheads, and power consumption are challenging for real-world applications [5], [6], [7], especially for the deployment and efficient inference on resource-constrained edge devices [8], [9].”
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
ViViT: A Video Vision Transformer
Arnab, A., Dehghani, M., Heigold, G., Sun, C., Lucic, M., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00676 · Cited by 2,767 · cited 1×
“With the success in natural language processing applications, transformers, which enjoy the global receptive field offered by the self-attention mechanism, have recently achieved significant performance gains on a range of computer vision applications [28], [29], [30], [31], [32].”
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308 · cited 1×
“In addition to the image classification task, ViTs are also emerging as popular solutions for other high-level vision tasks, such as object detection [36], [37], semantic segmentation [38], and video recognition [39].”
MMDetection: Open MMLab Detection Toolbox and Benchmark
Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Xu, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.07155 · Cited by 2,227
Unified Perceptual Parsing for Scene Understanding
Xiao, T., Liu, Y., Zhou, B., Jiang, Y., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_26 · Cited by 2,201
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910 · cited 1×
“A selection of notable works performs quantization-aware training (QAT) to improve the accuracy of the quantized model [12], [42], [43], [44], where the straight-through estimator (STE) [45] is used to approximate the gradient backpropagation of discrete parameters.”
Semantic Understanding of Scenes Through the ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1140-0 · Cited by 1,831
Hubara, I., Soudry, D., & Yaniv, R. E. (2016) · arXiv · doi:10.48550/arxiv.1602.02505 · Cited by 1,667
Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00803 · Cited by 1,588 · cited 1×
“With the success in natural language processing applications, transformers, which enjoy the global receptive field offered by the self-attention mechanism, have recently achieved significant performance gains on a range of computer vision applications [28], [29], [30], [31], [32].”
Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., & Wang, Y. (2021) · arXiv · doi:10.48550/arxiv.2103.00112 · Cited by 1,394 · cited 1×
“With the success in natural language processing applications, transformers, which enjoy the global receptive field offered by the self-attention mechanism, have recently achieved significant performance gains on a range of computer vision applications [28], [29], [30], [31], [32].”
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
Mehta, S., & Rastegari, M. (2021) · arXiv · doi:10.48550/arxiv.2110.02178 · Cited by 1,110 · cited 2×
“To this end, several works recently focus on lightweight ViTs, such as MobileViT [41] and TinyViT [42], whose model complexity, however, is still far from satisfactory, especially for the deployment on the resourceconstrained edge devices.”
Quantizing deep convolutional networks for efficient inference: A whitepaper
Krishnamoorthi, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08342 · Cited by 753
PACT: Parameterized Clipping Activation for Quantized Neural Networks
Choi, J., Wang, Z., Venkataramani, S., Chuang, P. I.-J., Srinivasan, V., & Gopalakrishnan, K. (2018) · arXiv · doi:10.48550/arxiv.1805.06085 · Cited by 703
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_23 · Cited by 693
Neimark, D., Bar, O., Zohar, M., & Asselmann, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00355 · Cited by 551 · cited 1×
“In addition to the image classification task, ViTs are also emerging as popular solutions for other high-level vision tasks, such as object detection [37], [38], semantic segmentation [39], and video recognition [40].”
Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion
Yin, H., Molchanov, P., Alvarez, J. M., Li, Z., Mallya, A., Hoiem, D., Jha, N. K., & Kautz, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00874 · Cited by 540
Self-citationTinyViT: Fast Pretraining Distillation for Small Vision Transformers
Wu, K., Zhang, J., Peng, H., Liu, M., Xiao, B., Fu, J., & Yuan, L. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19803-8_5 · Cited by 426
Learned Step Size Quantization
Esser, S. K., McKinstry, J. L., Bablani, D., Appuswamy, R., & Modha, D. S. (2019) · arXiv · doi:10.48550/arxiv.1902.08153 · Cited by 415
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404
DeepViT: Towards Deeper Vision Transformer
Zhou, D., Kang, B., Jin, X., Yang, L., Lian, X., Jiang, Z., Hou, Q., & Feng, J. (2021) · arXiv · doi:10.48550/arxiv.2103.11886 · Cited by 398 · cited 1×
“With the success in natural language processing applications, transformers, which enjoy the global receptive field offered by the self-attention mechanism, have recently achieved significant performance gains on a range of computer vision applications [28], [29], [30], [31], [32].”
ZeroQ: A Novel Zero Shot Quantization Framework
Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01318 · Cited by 381
Rethinking and Improving Relative Position Encoding for Vision Transformer
Wu, K., Peng, H., Chen, M., Fu, J., & Chao, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00988 · Cited by 371
Self-citationUp or Down? Adaptive Rounding for Post-Training Quantization
Nagel, M., Amjad, R. A., van Baalen, M., Louizos, C., & Blankevoort, T. (2020) · arXiv · doi:10.48550/arxiv.2004.10568 · Cited by 252
Fully Quantized Network for Object Detection
Li, R., Wang, Y., Liang, F., Qin, H., Yan, J., & Fan, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00292 · Cited by 214
Patch Slimming for Efficient Vision Transformers
Tang, Y., Han, K., Wang, Y., Xu, C., Guo, J., Xu, C., & Tao, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01185 · Cited by 201
FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer
Lin, Y., Zhang, T., Sun, P., Li, Z., & Zhou, S. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/164 · Cited by 198 · cited 2×
“FQ-ViT [7] designs specific quantization strategies for Softmax and LN components to obtain the fully quantized ViTs.”
Self-citationPost-Training Quantization for Vision Transformer
Liu, Z., Wang, Y., Han, K., Ma, S., & Gao, W. (2021) · arXiv · doi:10.48550/arxiv.2106.14156 · Cited by 192
BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstruction
Li, Y., Gong, R., Tan, X., Yang, Y., Hu, P., Zhang, Q., Yu, F., Wang, W., & Gu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.05426 · Cited by 190
Generative Low-Bitwidth Data Free Quantization
Xu, S., Li, H., Zhuang, B., Liu, J., Cao, J., Liang, C., & Tan, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_1 · Cited by 187
Training data-efficient image transformers & distillation through attention
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., & Jégou, H. (2020) · arXiv · doi:10.48550/arxiv.2012.12877 · Cited by 182
PTQ4ViT: Post-Training Quantization for Vision Transformers with Twin Uniform Quantization
Yuan, Z., Xue, C., Chen, Y., Wu, Q., & Sun, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_12 · Cited by 163 · cited 1×
“PTQ4ViT [52] proposes the twin uniform quantization method to reduce the quantization error on the activation values after Softmax and GELU functions.”
Kaselimi, M., Voulodimos, A. S., Daskalopoulos, I., Doulamis, N. D., & Doulamis, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3144791 · Cited by 145
I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
Li, Z., & Gu, Q. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01565 · Cited by 141
Self-citationLearning Efficient Vision Transformers Via Fine-Grained Manifold Distillation
Hao, Z., Guo, J., Jia, D., Han, K., Tang, Y., Zhang, C., Hu, H., & Wang, Y. (2022) · neural information processing systems · doi:10.52202/068431-0666 · Cited by 134
Diversifying Sample Generation for Accurate Data-Free Quantization
Zhang, X., Qin, H., Ding, Y., Gong, R., Yan, Q., Tao, R., Li, Y., Yu, F., & Liu, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01540 · Cited by 131
Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks
Li, Y., Dong, X., & Wang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13144 · Cited by 111
Annealing Knowledge Distillation
Jafari, A., Rezagholizadeh, M., Sharma, P., & Ghodsi, A. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.212 · Cited by 105
SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian ApproximationPreprint
Guo, C., Qiu, Y., Leng, J., Gao, X., Zhang, C., Liu, Y., Yang, F., Zhu, Y., & Guo, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.07471 · Cited by 97
IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization
Zhong, Y., Lin, M., Nan, G., Liu, J., Zhang, B., Tian, Y., & Ji, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01202 · Cited by 80
Qimera: Data-free Quantization with Synthetic Boundary Supporting SamplesPreprint
Choi, K., Hong, D., Park, N., Kim, Y., & Lee, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.02625 · Cited by 78
Bayesian Bits: Unifying Quantization and Pruning
van Baalen, M., Louizos, C., Nagel, M., Amjad, R. A., Wang, Y., Blankevoort, T., & Welling, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07093 · Cited by 76
Patch Similarity Aware Data-Free Quantization for Vision Transformers
Li, Z., Ma, L., Chen, M., Xiao, J., & Gu, Q. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20083-0_10 · Cited by 61
Self-citationAlfasly, S., Chui, C. K., Jiang, Q., Lu, J. J., & Chen, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190367 · Cited by 60
General Bitwidth Assignment for Efficient Deep Convolutional Neural Network Quantization
Fei, W., Dai, W., Li, C., Zou, J., & Xiong, H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3069886 · Cited by 50
EasyQuant: Post-training Quantization via Scale Optimization
Wu, D., Tang, Q., Zhao, Y., Zhang, M., Fu, Y., & Zhang, D. (2020) · arXiv · doi:10.48550/arxiv.2006.16669 · Cited by 44 · cited 1×
“To reduce the computational cost of QAT, other efforts propose posttraining quantization (PTQ) methods [46], [47], [48], [49], [50], [51], which focus on the calibration of quantization parameters.”
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation
Hao, Z., Guo, J., Jia, D., Han, K., Tang, Y., Zhang, C., Hu, H., & Wang, Y. (2021) · arXiv · doi:10.48550/arxiv.2107.01378 · Cited by 44
Exploiting Retraining-Based Mixed-Precision Quantization for Low-Cost DNN Accelerator Design
Kim, N., Shin, D., Choi, W., Kim, G., & Park, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3008996 · Cited by 39
One Weight Bitwidth to Rule Them All
Chin, T.-W., Chuang, P., Chandra, V., & Marculescu, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-68238-5_7 · Cited by 30
Unsupervised Network Quantization via Fixed-Point Factorization
Wang, P., He, X., Chen, Q., Cheng, A., Liu, Q., & Cheng, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007749 · Cited by 22
Elthakeb, A. T., Pilligundla, P., Mireshghallah, F., Elgindi, T. M., Deledalle, C., & Esmaeilzadeh, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00146 · Cited by 14
Research works printed but not linked: 4
- Dosovitskiy, An image is worth 16×16 words: Transformers for image recognition at scale, 1
- 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
- Wightman, 2019, PyTorch Image Models
- 2020, MMSegmentation: Openmmlab Semantic Segmentation Toolbox and Benchmark
Cited by
A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends
Younesi, A., Ansari, M., Fazli, M., Ejlali, A., Shafique, M., & Henkel, J. (2024) · IEEE Access · doi:10.1109/access.2024.3376441 · Cited by 197
A Survey of Techniques for Optimizing Transformer Inference
Chitty-Venkata, K. T., Mittal, S., Emani, M., Vishwanath, V., & Somani, A. K. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102990 · Cited by 154
I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
Li, Z., & Gu, Q. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01565 · Cited by 141
“PSAQViT [24, 25] pushes the quantization of ViTs to data-free scenarios based on patch similarity.”
MethodSelf-citationRepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers
Li, Z., Xiao, J., Yang, L., & Gu, Q. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01580 · Cited by 127
“PSAQ-ViT [19, 17] designs a relative value metric to invert images and pushes PTQ for ViTs to datafree scenarios.”
BackgroundSelf-citationSaha, S., & Xu, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130417 · Cited by 117
Metadata
- Authors
- Li, Z., Chen, M., Xiao, J., & Gu, Q.
- Affiliations
- Chinese Academy of Sciences (CN)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2024-12
- Volume
- 35
- Issue
- 12
- Pages
- 17227-17238
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W4385819842
- Cited by
- 41
- References
- 60
- Citations by year
- 2026: 8 · 2025: 23 · 2024: 7
- FWCI
- 3.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Key Research and Development Program of China (2022ZD0119402)
- National Natural Science Foundation of China (62276255)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- data-free quantization, vision transformer, patch similarity, model compression, data privacy, 8-bit quantization, Swin Transformer, image classification, object detection, semantic segmentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.