The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Robust Semantic Communications With Masked VQ-VAE Enabled Codebook
Open accessAbstract
Although semantic communications have exhibited satisfactory performance on a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading between the intended semantic symbols and received ones, thus causes the failure of tasks. In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise. In particular, we analyze sample-dependent and sample-independent semantic noise. To combat the semantic noise, the adversarial training with weight perturbation is developed to incorporate the samples with semantic noise in the training dataset. Then, we propose to mask a portion of the input, where the semantic noise appears frequently, and design the masked vector quantized-variational autoencoder (VQ-VAE) with the noise-related masking strategy. We use a discrete codebook shared by the transmitter and the receiver for encoded feature representation. To further improve the system robustness, we develop a feature importance module (FIM) to suppress the noise-related and task-unrelated features. Thus, the transmitter simply needs to transmit the indices of these important task-related features in the codebook. Simulation results show that the proposed method can be applied in many downstream tasks and significantly improve the robustness against semantic noise with remarkable reduction on the transmission overhead.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fundamentals of Wireless Communication
Tse, D., & Viswanath, P. (2005) · doi:10.1017/cbo9780511807213 · Cited by 13,162
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Masked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollar, P., & Girshick, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01553 · Cited by 8,489
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Towards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
Adversarial examples in the physical world
Kurakin, A., Goodfellow, I. J., & Bengio, S. (2018) · Artificial Intelligence Safety and Security · doi:10.1201/9781351251389-8 · Cited by 5,375
DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks
Moosavi-Dezfooli, S.-M., Fawzi, A., & Frossard, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.282 · Cited by 5,317 · cited 2×
“In particular, the methods on the first category include the fast gradient sign method (FGSM) [26], projected gradient descent (PGD) [27], Jacobian-based saliency map attack (JSMA) [28], and deepfool algorithm [29].”
MethodThe Limitations of Deep Learning in Adversarial Settings
Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2016) · 2016 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2016.36 · Cited by 3,993
Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks
Papernot, N., McDaniel, P., Wu, X., Jha, S., & Swami, A. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.41 · Cited by 2,982
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980 · cited 1×
“With the development of deep neural networks (DNNs) [3] and end-to-end learning [4], [5], [6], semantic communications, which extract and transmit the task-related meanings of data [7], [8], [9], [10], have emerged as a key technology and received great attention.”
BackgroundNeural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Universal Adversarial Perturbations
Moosavi-Dezfooli, S.-M., Fawzi, A., Fawzi, O., & Frossard, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.17 · Cited by 2,680
The Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
Deep Learning Enabled Semantic Communication Systems
Xie, H., Qin, Z., Li, G. Y., & Juang, B.-H. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3071210 · Cited by 1,602
Self-citationDeep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Burth Kurka, D., & Gunduz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,476
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Defense Against Adversarial Attacks Using High-Level Representation Guided Denoiser
Liao, F., Liang, M., Dong, Y., Pang, T., Hu, X., & Zhu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00191 · Cited by 902
Semantic Communication Systems for Speech Transmission
Weng, Z., & Qin, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087240 · Cited by 663
Self-citationTowards Deep Neural Network Architectures Robust to Adversarial Examples
Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 622
Wireless Image Transmission Using Deep Source Channel Coding With Attention Modules
Xu, J., Ai, B., Chen, W., Yang, A., Sun, P., & Rodrigues, M. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3082521 · Cited by 511
DeepJSCC-f: Deep Joint Source-Channel Coding of Images With Feedback
Kurka, D. B., & Gunduz, D. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2987203 · Cited by 470
Task-Oriented Multi-User Semantic Communications
Xie, H., Qin, Z., Tao, X., & Letaief, K. B. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3191326 · Cited by 458
Self-citationYe, H., Liang, L., Li, G. Y., & Juang, B.-H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2970707 · Cited by 413
Self-citationFrom Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems
Shi, G., Xiao, Y., Li, Y., & Xie, X. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2001239 · Cited by 406
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach
Shao, J., Mao, Y., & Zhang, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126087 · Cited by 338
Semantics-Empowered Communication for Networked Intelligent Systems
Kountouris, M., & Pappas, N. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000604 · Cited by 334
Semantic Communications: Principles and Challenges
Qin, Z., Tao, X., Lü, J., Tong, W., & Li, G. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.01389 · Cited by 254
Self-citationA Unified Multi-Task Semantic Communication System for Multimodal Data
Zhang, G., Hu, Q., Qin, Z., Cai, Y., Yu, G., & Tao, X. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3364990 · Cited by 219
Self-citationDeep Source-Channel Coding for Sentence Semantic Transmission With HARQ
Jiang, P., Wen, C.-K., Jin, S., & Li, G. Y. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3180997 · Cited by 199
Self-citationTowards a Robust Deep Neural Network against Adversarial Texts: A Survey
Wang, W., Wang, R., Wang, L., Wang, Z., & Ye, A. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3117608 · Cited by 198
Channel-Aware Adversarial Attacks Against Deep Learning-Based Wireless Signal Classifiers
Kim, B., Sagduyu, Y. E., Davaslioglu, K., Erpek, T., & Ulukus, S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3124855 · Cited by 188
Deep Learning-Constructed Joint Transmission-Recognition for Internet of Things
Lee, C., Lin, J.-W., Chen, P.-H., & Chang, Y.-C. (2019) · IEEE Access · doi:10.1109/access.2019.2920929 · Cited by 137
Improving Adversarial Robustness via Channel-wise Activation SuppressingPreprint
Bai, Y., Zeng, Y., Jiang, Y., Xia, S., Ma, X., & Wang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08307 · Cited by 108
Towards goal-oriented semantic signal processing: Applications and future challenges
Kalfa, M., Gok, M., Atalık, A., Tegin, B., Duman, T. M., & Arıkan, O. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103134 · Cited by 94
Reinforcement Learning-powered Semantic Communication via Semantic SimilarityPreprint
Lu, K., Li, R., Chen, X., Zhao, Z., & Zhang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.12121 · Cited by 74
Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding
Hu, Q., Cai, Y., Kang, K., Yu, G., Hoydis, J., & Eldar, Y. C. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126050 · Cited by 41
Self-citationWireless Image Retrieval at the Edge
Jankowski, M., Gunduz, D., & Mikolajczyk, K. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036955 · Cited by 3 · cited 2×
“The existing works on semantic communications can be divided into two categories: data reconstruction [10], [11], [12], [13], [14], [15], [16] and task execution [17], [18], [19], [20], [21].”
Background
Cited by
Semantic Communication: A Survey on Research Landscape, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3520707 · Cited by 110
Metadata
- Authors
- Hu, Q., Zhang, G., Qin, Z., Cai, Y., Yu, G., & Li, G. Y.
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2023-12
- Volume
- 22
- Issue
- 12
- Pages
- 8707-8722
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W4365420366
- Cited by
- 282
- References
- 37
- FWCI
- 20.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.