Wireless Image Transmission Using Deep Source Channel Coding With Attention Modules
Open accessThe DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Recent research on joint source channel coding (JSCC) for wireless communications has achieved great success owing to the employment of deep learning (DL). However, the existing work on DL based JSCC usually trains the designed network to operate under a specific signal-to-noise ratio (SNR) regime, without taking into account that the SNR level during the deployment stage may differ from that during the training stage. A number of networks are required to cover the scenario with a broad range of SNRs, which is computational inefficiency (in the training stage) and requires large storage. To overcome these drawbacks our paper proposes a novel method called Attention DL based JSCC (ADJSCC) that can successfully operate with different SNR levels during transmission. This design is inspired by the resource assignment strategy in traditional JSCC, which dynamically adjusts the compression ratio in source coding and the channel coding rate according to the channel SNR. This is achieved by resorting to attention mechanisms because these are able to allocate computing resources to more critical tasks. Instead of applying the resource allocation strategy in traditional JSCC, the ADJSCC uses the channel-wise soft attention to scaling features according to SNR conditions. We compare the ADJSCC method with the state-of-the-art DL based JSCC method through extensive experiments to demonstrate its adaptability, robustness and versatility. Compared with the existing methods, the proposed method takes less storage and is more robust in the presence of channel mismatch.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 1×
“We address this challenge by employing attention mechanism, which is a technique of DL widely used in natural language processing [41]–[43] and computer vision [44]– [47].”
MethodSqueeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
(2016) · Cited by 11,679
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · cited 1×
“We use Tensorflow [50] and its high-level API Keras to implement the BDJSCC and ADJSCC3 models.”
MethodEffective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Information Theory and Reliable Communication.
Lee, P. M., & Gallager, R. T. (1970) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344305 · Cited by 5,399
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Information Theory and Reliable Communication
Bell, D. A. (1969) · Electronics and Power · doi:10.1049/ep.1969.0319 · Cited by 4,012
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908
Deep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Burth Kurka, D., & Gunduz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,476
Elements of Information Theory
Phoenix, S. J. D. (1992) · Journal of Modern Optics · doi:10.1080/09500349214551641 · Cited by 1,380
End-to-end Optimized Image Compression
Ballé, J., Laparra, V., & Simoncelli, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01704 · Cited by 1,275
Information Theory and Reliable Communication
Gallager, R. (1972) · Springer eBooks · doi:10.1007/978-3-7091-2945-6 · Cited by 1,204
Deep Learning for Massive MIMO CSI Feedback
Wen, C.-K., Shih, W.-T., & Jin, S. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2018.2818160 · Cited by 1,174
Deep Learning for Audio Signal Processing
Purwins, H., Li, B., Virtanen, T., Schluter, J., Chang, S.-Y., & Sainath, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2908700 · Cited by 855
Channel-Wise Autoregressive Entropy Models for Learned Image Compression
Minnen, D. C., & Singh, S. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190935 · Cited by 700
On deep learning-based channel decoding
Gruber, T., Cammerer, S., Hoydis, J., & Brink, S. T. (2017) · 2017 51st Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2017.7926071 · Cited by 545
DeepJSCC-f: Deep Joint Source-Channel Coding of Images With Feedback
Kurka, D. B., & Gunduz, D. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2987203 · Cited by 470
Deep Learning for Joint Source-Channel Coding of Text
Farsad, N., Rao, M., & Goldsmith, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461983 · Cited by 438
Joint Autoregressive and Hierarchical Priors for Learned Image Compression
Minnen, D. C., Ballé, J., & Toderici, G. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02736 · Cited by 310
Density Modeling of Images using a Generalized Normalization Transformation
Ballé, J., Laparra, V., & Simoncelli, E. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06281 · Cited by 308
Variational inference for Monte Carlo objectivesPreprint
Mnih, A., & Rezende, D. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06725 · Cited by 293
Channel Agnostic End-to-End Learning Based Communication Systems with Conditional GAN
Ye, H., Li, G. Y., Juang, B.-H. F., & Sivanesan, K. (2018) · 2018 IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2018.8644250 · Cited by 244
An End-to-End Compression Framework Based on Convolutional Neural Networks
Jiang, F., Tao, W., Liu, S., Ren, J., Guo, X., & Zhao, D. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2734838 · Cited by 232
End-to-End Learning of Communications Systems Without a Channel Model
Aoudia, F. A., & Hoydis, J. (2018) · arXiv · doi:10.48550/arxiv.1804.02276 · Cited by 225
End-to-End Learning of Communications Systems Without a Channel Model
Aoudia, F. A., & Hoydis, J. (2018) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2018.8645416 · Cited by 220
Neural Joint Source-Channel CodingPreprint
Choi, K., Tatwawadi, K., Grover, A., Weissman, T., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07557 · Cited by 203
Turbo Autoencoder: Deep learning based channel codes for point-to-point communication channels
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2019) · neural information processing systems · doi:10.48550/arxiv.1911.03038 · Cited by 194
Deep Learning-Constructed Joint Transmission-Recognition for Internet of Things
Lee, C.-H., Lin, J.-W., Chen, P.-H., & Chang, Y.-C. (2019) · IEEE Access · doi:10.1109/access.2019.2920929 · Cited by 126
Wavelet-Based Deep Auto Encoder-Decoder (WDAED)-Based Image Compression
Mishra, D., Singh, S. K., & Singh, R. K. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3010627 · Cited by 101
Variable Rate Image Compression with Recurrent Neural Networks
Toderici, G. D., O’Malley, S. M., Hwang, S. J., Vincent, D., Minnen, D. C., Baluja, S., Covell, M., & Sukthankar, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06085 · Cited by 94
LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2988577 · Cited by 87
Deep Joint Source-Channel Coding for Wireless Image Retrieval
Jankowski, M., Gündüz, D., & Mikolajczyk, K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054078 · Cited by 70
Successive Refinement of Images with Deep Joint Source-Channel Coding
Kurka, D. B., & Gündüz, D. (2019) · 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815416 · Cited by 67
Multiple Description Convolutional Neural Networks for Image Compression
Zhao, L., Bai, H., Wang, A., & Zhao, Y. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2867067 · Cited by 54
Deep Joint Source-Channel Coding of Images with Feedback
Kurka, D. B., & Gündüz, D. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054216 · Cited by 42
An End-to-End Compression Framework Based on Convolutional Neural Networks
Wen, T., Jiang, F., Zhang, S., Ren, J., Shi, W., Zuo, W., Guo, X., & Zhao, D. (2017) · DCC · doi:10.1109/dcc.2017.54 · Cited by 32
Joint Source-Channel Coding and Unequal Error Protection for Video Plus Depth
Vosoughi, A., Cosman, P. C., & Milstein, L. B. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2346739 · Cited by 25
SSIM-based error-resilient cross-layer optimization for wireless video streaming
Zhao, P., Liu, Y., Liu, J., Argyriou, A., & Ci, S. (2015) · Signal Processing Image Communication · doi:10.1016/j.image.2015.11.005 · Cited by 11
Yang, M., Ai, B., He, R., Huang, C., Li, J., Ma, Z., Chen, L., Li, X., & Zhong, Z. D. (2020) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2020-spring48590.2020.9128378 · Cited by 10
Self-citationCross-Layer Link Adaptation for Wireless Video
Loiacono, M., Johnson, J. P., Rosca, J., et al. (2010) · International Conference on Communications · doi:10.1109/icc.2010.5502650 · Cited by 9
Performance Evaluation of Autoencoder for Coding and Modulation in Wireless Communications
Xu, J., Chen, W., Ai, B., He, R., Li, Y., Wang, J., Juhana, T., & Kurniawan, A. (2019) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp.2019.8928071 · Cited by 9
Self-citation
Cited by
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges
Yang, W., Du, H., Liew, Z. Q., Lim, W. Y. B., Xiong, Z., Niyato, D., Chi, X., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3223224 · Cited by 670
Nonlinear Transform Source-Channel Coding for Semantic Communications
Dai, J., Wang, S., Tan, K., Si, Z., Qin, X., Niu, K., & Zhang, P. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180802 · Cited by 364
Toward Semantic Communications: Deep Learning-Based Image Semantic Coding
Huang, D., Gao, F., Tao, X., Du, Q., & Lu, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3221999 · Cited by 331
Robust Semantic Communications With Masked VQ-VAE Enabled Codebook
Hu, Q., Zhang, G., Qin, Z., Cai, Y., Yu, G., & Li, G. Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3265201 · Cited by 282
Metadata
- Authors
- Xu, J., Ai, B., Chen, W., Yang, A., Sun, P., & Rodrigues, M.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2022-04
- Volume
- 32
- Issue
- 4
- Pages
- 2315-2328
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W3107617916
- Cited by
- 511
- References
- 58
- FWCI
- 16.93
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.