Deep Learning Enabled Semantic Communication Systems
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Recently, deep learned enabled end-to-end communication systems have been developed to merge all physical layer blocks in the traditional communication systems, which make joint transceiver optimization possible. Powered by deep learning, natural language processing has achieved great success in analyzing and understanding a large amount of language texts. Inspired by research results in both areas, we aim to provide a new view on communication systems from the semantic level. Particularly, we propose a deep learning based semantic communication system, named DeepSC, for text transmission. Based on the Transformer, the DeepSC aims at maximizing the system capacity and minimizing the semantic errors by recovering the meaning of sentences, rather than bit- or symbol-errors in traditional communications. Moreover, transfer learning is used to ensure the DeepSC applicable to different communication environments and to accelerate the model training process. To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity. Compared with the traditional communication system without considering semantic information exchange, the proposed DeepSC is more robust to channel variation and is able to achieve better performance, especially in the low signal-to-noise (SNR) regime, as demonstrated by the extensive simulation results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, the DL based end-to-end semantic communication system was developed in [21] via joint semantic source and wireless channel coding for recovering the meaning of sentences instead of the original transmitted data samples.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 13×
“In the communication area, some pioneering works have been carried on DL based E2E physical layer communication systems, which merge the blocks in traditional communication systems [17]–[23].”
BackgroundInfluentialExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“There are three types of neural networks used for NLP tasks, including recurrent neural networks (RNNs), convolutional neural networks (CNNs) and fully-connected neural networks (FCNs) [28].”
BackgroundBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“There are three types of neural networks used for NLP tasks, including recurrent neural networks (RNNs), convolutional neural networks (CNNs) and fully-connected neural networks (FCNs) [28].”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 1×
“The adopted dataset is the proceedings of the European Parliament [33], which consists of around 2.”
MethodNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
The Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613
Fundamentals of Wireless Communication
Tse, D., & Viswanath, P. (2005) · doi:10.1017/cbo9780511807213 · Cited by 13,162 · cited 1×
“Recently, various new applications appear, such as autonomous transportation, consumer robotics, environmental monitoring, and tele-health [3], [4].”
BackgroundDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 5×
“In [27], a general word representation model, named bidirectional encoder representations from transformers (BERT), has been developed to provide word vectors for various NLP tasks without requiring redesign of word representations.”
MethodInfluentialBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“By introducing RNNs, language models can learn the whole sentences and capture the syntax information effectively [29].”
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Polynomial Codes Over Certain Finite Fields
Reed, I. S., & Solomon, G. (1960) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0108018 · Cited by 3,662
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601 · cited 1×
“From [31], we have the following theorem, Theorem 1: The KL divergence admits the following dual representation”
Background(2005) · Cited by 3,125
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980 · cited 14×
“In the communication area, some pioneering works have been carried on DL based E2E physical layer communication systems, which merge the blocks in traditional communication systems [17]–[23].”
BackgroundInfluentialGenerating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894 · cited 1×
“CNNs were born with the capability of parallel computing [30].”
BackgroundEstimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910
Deep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Burth Kurka, D., & Gunduz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,476 · cited 2×
“In the communication area, some pioneering works have been carried on DL based E2E physical layer communication systems, which merge the blocks in traditional communication systems [17]–[23].”
BackgroundImproved backing-off for M-gram language modeling
Kneser, R., & Ney, H. (2002) · 1995 International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1995.479394 · Cited by 1,473
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
Cambria, E., & White, B. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2307227 · Cited by 1,102
Mutual Information Neural Estimation.
Belghazi, M. I., Baratin, A., Rajeshwar, S., Ozair, S., Bengio, Y., Courville, A. C., & Hjelm, D. (2018) · International Conference on Machine Learning · Cited by 920
Learning to Optimize: Training Deep Neural Networks for Interference Management
Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866382 · Cited by 874 · cited 1×
“Recent advancements on deep learning (DL) based natural language processing (NLP) and communication systems inspire us to investigate semantic communication to realize the second level communications as aforementioned [10]–[15].”
BackgroundDeep Learning Based Communication Over the Air
Dorner, S., Cammerer, S., Hoydis, J., & Brink, S. T. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2784180 · Cited by 859 · cited 1×
“Reinforcement learning has been exploited in [19] to acquire the channel gradient under an unknown channel model, which achieves better performance than the differential quadrature phase-shift keying (DQPSK) over real channels.”
BackgroundDeep Image Retrieval: Learning Global Representations for Image Search
Gordo, A., Almazán, J., Revaud, J., & Larlus, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_15 · Cited by 787
Deep Learning in Physical Layer Communications
Qin, Z., Ye, H., Li, G. Y., & Juang, B.-H. F. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800601 · Cited by 692
Self-citationAutonomous Cars: Research Results, Issues, and Future Challenges
Hussain, R., & Zeadally, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2869360 · Cited by 631
A Lite Distributed Semantic Communication System for Internet of Things
Xie, H., & Qin, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036968 · Cited by 497 · cited 1×
“Following the concept of semantic communications proposed in this paper, we have developed L-DeepSC [36] and DeepSCS [37] for text and speech transmission.”
MethodSelf-citationJumping NLP Curves: A Review of Natural Language Processing Research
Cambria, E., & White, B. (2014) · Cited by 455
Model-Driven Deep Learning for MIMO Detection
He, H., Wen, C.-K., Jin, S., & Li, G. Y. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2976585 · Cited by 454
Self-citationDeep Learning for Joint Source-Channel Coding of Text
Farsad, N., Rao, M., & Goldsmith, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461983 · Cited by 438
Ye, H., Liang, L., Li, G. Y., & Juang, B.-H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2970707 · Cited by 413
Self-citationA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.2188 · Cited by 407 · cited 1×
“From [31], we have the following theorem, Theorem 1: The KL divergence admits the following dual representation”
BackgroundNeural Network Detection of Data Sequences in Communication Systems
Farsad, N., & Goldsmith, A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2868322 · Cited by 358
Heegard, C., & Wicker, S. B. (1998) · Cited by 311
Elias, P. (1954) · Journal of Symbolic Logic · doi:10.2307/2268645 · Cited by 300
Towards a theory of semantic communication
Bao, J., Basu, P., Dean, M., Partridge, C., Swami, A., Leland, W., & Hendler, J. A. (2011) · 2011 IEEE Network Science Workshop · doi:10.1109/nsw.2011.6004632 · Cited by 281
Model-Free Training of End-to-End Communication Systems
Aoudia, F. A., & Hoydis, J. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933891 · Cited by 236 · cited 2×
“While for the fading channels, more complicated neural networks are required [20].”
BackgroundMethodThe Semantic Communication Game
Güler, B., Yener, A., & Swami, A. (2018) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2018.2872596 · Cited by 174
Deep Joint Source-channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Kurka, D. B., & Gündüz, D. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683463 · Cited by 167
(2020) · doi:10.1007/978-3-030-58586-0_27 · Cited by 156
Semantic Communications for Speech Signals
Weng, Z., Qin, Z., & Li, G. Y. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500590 · Cited by 115 · cited 1×
“Following the concept of semantic communications proposed in this paper, we have developed L-DeepSC [36] and DeepSC-S [37] for text and speech transmission.”
MethodSelf-citationThe Internet of Things - A Survey
Abdalkafor, A. S., Al-ani, K. W., & Nassar, A. M. (2018) · مؤتمرات الآداب والعلوم الانسانية والطبيعية · doi:10.24897/acn.64.68.187 · Cited by 106
Internet of Autonomous Vehicles: Architecture, Features, and Socio-Technological Challenges
Jameel, F., Chang, Z., Huang, J., & Ristaniemi, T. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800522 · Cited by 83 · cited 1×
“[5] were the first to introduce the semantic information theory (SIT) based on logical probabilities ranging over the contents.”
BackgroundOn deep learning-based communication over the air
Dörner, S., Cammerer, S., Hoydis, J., & ten Brink, S. (2017) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2017.8335670 · Cited by 70
Deep Learning based Semantic Communications: An Initial Investigation
Xie, H., Qin, Z., Li, G. Y., & Juang, B.-H. F. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322296 · Cited by 65 · cited 1×
“Part of this work was presented at the IEEE Global Communications Conference 2020 [1].”
BackgroundSelf-citationPreserving quality of information by using semantic relationships
Basu, P., Bao, J., Dean, M., & Hendler, J. (2013) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2013.07.013 · Cited by 57 · cited 2×
“framework integrates the semantic inference and physical layer communication problems, where the transceiver is optimized to reach the Nash equilibrium while minimizing the average semantic errors [9].”
BackgroundMethodEnd-to-End Fast Training of Communication Links Without a Channel Model via Online Meta-Learning
Park, S., Simeone, O., & Kang, J. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154322 · Cited by 49 · cited 9×
“Considering the types of sources, the joint source-channel coding for texts [22] and images [23] aims to recover the source”
BackgroundMethodInfluentialQuantification and Transmission of Information and Intelligence—History and Outlook [DSP History]
Juang, B. H. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.941134 · Cited by 14 · cited 1×
“It was pointed out that the analysis and design of a communication system for optimal transmission of intelligence are faced several challenges [7].”
BackgroundSelf-citationThe semantic communication game
Güler, B., Yener, A., & Swami, A. (2016) · International Conference on Communications · doi:10.1109/icc.2016.7510797 · Cited by 8 · cited 1×
“Recent advancements on deep learning (DL) based natural language processing (NLP) and communication systems inspire us to investigate semantic communication to realize the second level communications as aforementioned [10]–[15].”
Background
Cited by
On the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“For example, the DL based end-to-end semantic communication system was developed in [21] via joint semantic source and wireless channel coding for recovering the meaning of sentences instead of the original transmitted data samples.”
BackgroundMethodSemantic Communications: Overview, Open Issues, and Future Research Directions
Luo, X., Chen, H.-H., & Guo, Q. (2022) · IEEE Wireless Communications · doi:10.1109/mwc.101.2100269 · Cited by 690
Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges
Yang, W., Du, H., Liew, Z. Q., Lim, W. Y. B., Xiong, Z., Niyato, D., Chi, X., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3223224 · Cited by 670
“The authors in [138] first develop models with semantic encoder from [37] and Reed Solomon (RS) channel coding [139] with HARQ.”
InfluentialSemantic Communication Systems for Speech Transmission
Weng, Z., & Qin, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087240 · Cited by 663
“Note that transfer learning can be adopted as a promising technique to yield efficient retraining task when coping with dynamic environment [24].”
BackgroundSelf-citation
Metadata
- Authors
- Xie, H., Qin, Z., Li, G. Y., & Juang, B.-H.
- Affiliations
- Queen Mary University of London (GB)
- Imperial College London (GB)
- Georgia Institute of Technology (US)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2021
- Volume
- 69
- Pages
- 2663-2675
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W3036851434
- Cited by
- 1,602
- References
- 46
- Citations by year
- 2026: 378 · 2025: 476 · 2024: 363 · 2023: 253 · 2022: 101 · 2021: 29
- FWCI
- 54.85
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Transactions on Signal Processing (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Wireless Signal Modulation Classification
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Wireless Communication Security Techniques
- Keywords
- semantic communication, textual transmission, transformer models, transfer learning, low SNR performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.