The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
DeepJSCC-f: Deep Joint Source-Channel Coding of Images With Feedback
Abstract
We consider wireless transmission of images in the presence of channel output feedback. From a Shannon theoretic perspective feedback does not improve the asymptotic end-to-end performance, and separate source coding followed by capacity-achieving channel coding, which ignores the feedback signal, achieves the optimal performance. It is well known that separation is not optimal in the practical finite blocklength regime; however, there are no known practical joint source-channel coding (JSCC) schemes that can exploit the feedback signal and surpass the performance of separation-based schemes. Inspired by the recent success of deep learning methods for JSCC, we investigate how noiseless or noisy channel output feedback can be incorporated into the transmission system to improve the reconstruction quality at the receiver. We introduce an autoencoder-based JSCC scheme, which we call DeepJSCC-f , that exploits the channel output feedback, and provides considerable improvements in terms of the end-to-end reconstruction quality for fixed-length transmission, or in terms of the average delay for variable-length transmission. To the best of our knowledge, this is the first practical JSCC scheme that can fully exploit channel output feedback, demonstrating yet another setting in which modern machine learning techniques can enable the design of new and efficient communication methods that surpass the performance of traditional structured coding-based designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980
Deep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Burth Kurka, D., & Gunduz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,476
Self-citationThe zero error capacity of a noisy channel
Shannon, C. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056798 · Cited by 1,468
Variational image compression with a scale hyperprior
Ballé, J., Minnen, D. C., Singh, S., Hwang, S. J., & Johnston, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01436 · Cited by 1,318
End-to-end Optimized Image Compression
Ballé, J., Laparra, V., & Simoncelli, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01704 · Cited by 1,275
To code, or not to code: lossy source-channel communication revisited
Gastpar, M., Rimoldi, B., & Vetterli, M. (2003) · IEEE Transactions on Information Theory · doi:10.1109/tit.2003.810631 · Cited by 550
Deep Learning Methods for Improved Decoding of Linear Codes
Nachmani, E., Marciano, E., Lugosch, L., Gross, W. J., Burshtein, D., & Be'ery, Y. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2788405 · Cited by 545
A study of vector quantization for noisy channels
Farvardin, N. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.53739 · Cited by 479
Deep Learning for Joint Source-Channel Coding of Text
Farsad, N., Rao, M., & Goldsmith, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461983 · Cited by 438
End-to-End Deep Learning of Optical Fiber Communications
Karanov, B., Chagnon, M., Thouin, F., Eriksson, T. A., Bulow, H., Lavery, D., Bayvel, P., & Schmalen, L. (2018) · Journal of Lightwave Technology · doi:10.1109/jlt.2018.2865109 · Cited by 417
Johnston, N., Vincent, D., Minnen, D., Covell, M., Singh, S., Chinen, T., Jin Hwang, S., Shor, J., & Toderici, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00461 · Cited by 366
Neural Network Detection of Data Sequences in Communication Systems
Farsad, N., & Goldsmith, A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2868322 · Cited by 358
Joint Autoregressive and Hierarchical Priors for Learned Image Compression
Minnen, D. C., Ballé, J., & Toderici, G. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02736 · Cited by 310
Density Modeling of Images using a Generalized Normalization Transformation
Ballé, J., Laparra, V., & Simoncelli, E. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06281 · Cited by 308
On the performance and complexity of channel-optimized vector quantizers
Farvardin, N., & Vaishampayan, V. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61130 · Cited by 276
Context-adaptive Entropy Model for End-to-end Optimized Image Compression
Lee, J., Cho, S.-H., & Beack, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10452 · Cited by 249
The source-channel separation theorem revisited
Vembu, S., Verdu, S., & Steinberg, Y. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.370119 · Cited by 236
Lossy Image Compression with Compressive Autoencoders
Theis, L., Shi, W., Cunningham, A., & Huszár, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00395 · Cited by 230
Hybrid digital-analog (HDA) joint source-channel codes for broadcasting and robust communications
Mittal, U., & Phamdo, N. (2002) · IEEE Transactions on Information Theory · doi:10.1109/18.995544 · Cited by 223
Deep Joint Source-channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Kurka, D. B., & Gündüz, D. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683463 · Cited by 167
Self-citationDeepcode: Feedback Codes via Deep Learning
Kim, H., Jiang, Y., Kannan, S., Oh, S., & Viswanath, P. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2986752 · Cited by 150
LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2988577 · Cited by 87
Source and Channel Coding for Correlated Sources Over Multiuser Channels
Gündüz, D., Erkip, E., Goldsmith, A. J., & Poor, H. V. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2025566 · Cited by 85
Successive Refinement of Images with Deep Joint Source-Channel Coding
Kurka, D. B., & Gündüz, D. (2019) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815416 · Cited by 65
Self-citationJiang, Y., Kannan, S., Kim, H., Oh, S., Asnani, H., & Viswanath, P. (2019) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815400 · Cited by 62
Design and performance of VQ-based hybrid digital-analog joint source-channel codes
Skoglund, M., Phamdo, N., & Alajaji, F. (2002) · IEEE Transactions on Information Theory · doi:10.1109/18.986011 · Cited by 60
Deep Learning-Based Polar Code Design
Ebada, M., Cammerer, S., Elkelesh, A., & ten Brink, S. (2019) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2019.8919804 · Cited by 41
NECST: Neural Joint Source-Channel Coding.
Choi, K., Tatwawadi, K., Weissman, T., & Ermon, S. (2018) · Cited by 32
Perceptual Quality Study on Deep Learning Based Image Compression
Cheng, Z., Akyazi, P., Sun, H., Katto, J., & Ebrahimi, T. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803824 · Cited by 30
Joint Source-Channel Coding with Neural Networks for Analog Data Compression and Storage
Zarcone, R. V., Paiton, D. M., Anderson, A. S., Engel, J., Wong, H. ‐. P., & Olshausen, B. A. (2018) · DCC · doi:10.1109/dcc.2018.00023 · Cited by 21
Cited by
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Self-citationSemantic Communication Systems for Speech Transmission
Weng, Z., & Qin, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087240 · Cited by 663
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Self-citationWireless Image Transmission Using Deep Source Channel Coding With Attention Modules
Xu, J., Ai, B., Chen, W., Yang, A., Sun, P., & Rodrigues, M. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3082521 · Cited by 511
Task-Oriented Multi-User Semantic Communications
Xie, H., Qin, Z., Tao, X., & Letaief, K. B. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3191326 · Cited by 458
Metadata
- Authors
- Kurka, D. B., & Gunduz, D.
- Venue
- IEEE Journal on Selected Areas in Information Theory
- Published
- 2020-05
- Volume
- 1
- Issue
- 1
- Pages
- 178-193
- ISSN
- 2641-8770 (ISSN-L)
- OpenAlex
- W3016715915
- Cited by
- 470
- References
- 36
- FWCI
- 12.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.