The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Learned Image Compression with Mixed Transformer-CNN Architectures
Open accessAbstract
Learned image compression (LIC) methods have exhibited promising progress and superior rate-distortion performance compared with classical image compression standards. Most existing LIC methods are Convolutional Neural Networks-based (CNN-based) or Transformer-based, which have different advantages. Exploiting both advantages is a point worth exploring, which has two challenges: 1) how to effectively fuse the two methods? 2) how to achieve higher performance with a suitable complexity? In this paper, we propose an efficient parallel Transformer-CNN Mixture (TCM) block with a controllable complexity to incorporate the local modeling ability of CNN and the non-local modeling ability of transformers to improve the overall architecture of image compression models. Besides, inspired by the recent progress of entropy estimation models and attention modules, we propose a channel-wise entropy model with parameter-efficient swin-transformer-based attention (SWAtten) modules by using channel squeezing. Experimental results demonstrate our proposed method achieves state-of-the-art rate-distortion performances on three different resolution datasets (i.e., Kodak, Tecnick, CLIC Professional Validation) compared to existing LIC methods. The code is at https://github.com/jmliu206/LIC_TCM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Calcuation of average PSNR differences between RD-curves
Bjøntegaard, G. (2001) · Medical Entomology and Zoology · Cited by 6,090
SwinIR: Image Restoration Using Swin Transformer
Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., & Timofte, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00210 · Cited by 4,734
The JPEG still picture compression standard
Wallace, G. K. (1992) · IEEE Transactions on Consumer Electronics · doi:10.1109/30.125072 · Cited by 2,851
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Luo, W., Li, Y., Urtasun, R., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1701.04128 · Cited by 1,575
Variational image compression with a scale hyperprior
Ballé, J., Minnen, D. C., Singh, S., Hwang, S. J., & Johnston, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01436 · Cited by 1,318
End-to-end Optimized Image Compression
Ballé, J., Laparra, V., & Simoncelli, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01704 · Cited by 1,275
Learned Image Compression With Discretized Gaussian Mixture Likelihoods and Attention Modules
Cheng, Z., Sun, H., Takeuchi, M., & Katto, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00796 · Cited by 1,161
Self-citationChannel-Wise Autoregressive Entropy Models for Learned Image Compression
Minnen, D. C., & Singh, S. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190935 · Cited by 517
He, D., Yang, Z., Peng, W., Ma, R., Qin, H., & Wang, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00563 · Cited by 455
Checkerboard Context Model for Efficient Learned Image Compression
He, D., Zheng, Y., Sun, B., Wang, Y., & Qin, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01453 · Cited by 349
The Devil Is in the Details: Window-based Attention for Image Compression
Zou, R., Song, C., & Zhang, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01697 · Cited by 300
Enhanced Invertible Encoding for Learned Image Compression
Xie, Y., Cheng, K. L., & Chen, Q. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475213 · Cited by 195
Transformer-based Image Compression
Lu, M., Guo, P., Shi, H., Cao, C., & Ma, Z. (2022) · DCC · doi:10.1109/dcc52660.2022.00080 · Cited by 189
Causal Contextual Prediction for Learned Image Compression
Guo, Z., Zhang, Z., Feng, R., & Chen, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3089491 · Cited by 164
Joint Global and Local Hierarchical Priors for Learned Image Compression
Kim, J.-H., Heo, B., & Lee, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00590 · Cited by 147
Koyuncu, A. B., Gao, H., Boev, A., Gaikov, G., Alshina, E. A., & Steinbach, E. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19800-7_26 · Cited by 144
Fu, H., Liang, F., Lin, J., Li, B., Akbari, M. A., Liang, J., Zhang, G., Liu, D., Tu, C., & Han, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3263099 · Cited by 132
Non-local Attention Optimized Deep Image CompressionPreprint
Liu, H., Chen, T., Guo, P., Shen, Q., Cao, X., Wang, Y., & Ma, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09757 · Cited by 112
Learned Block-Based Hybrid Image Compression
Wu, Y., Li, X., Zhang, Z., Jin, X., & Chen, Z. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3119660 · Cited by 86
Neural Data-Dependent Transform for Learned Image Compression
Wang, D., Yang, W., Hu, Y., et al. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01686 · Cited by 59
Two-Stage Octave Residual Network for End-to-End Image Compression
Chen, F., Xu, Y., & Wang, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20308 · Cited by 39
Memory-Efficient Learned Image Compression with Pruned Hyperprior Module
Luo, A., Sun, H., Liu, J., & Katto, J. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897854 · Cited by 22
Self-citation
Cited by
scTCA: a hybrid Transformer-CNN architecture for imputation and denoising of scDNA-seq data
Yu, Z., Liu, F., & Li, Y. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae577 · Cited by 1
“Hybrid Transformer-CNN architectures have shown high performance in fusing multi-view features [33], especially in computer vision tasks [34, 35].”
Background
Metadata
- Authors
- Liu, J., Sun, H., & Katto, J.
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 14388-14397
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386075611
- Cited by
- 410
- References
- 25
- FWCI
- 46.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.