End-to-End Learning of Communications Systems Without a Channel Model
Open accessAbstract
The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates this problem. The algorithm iterates between supervised training of the receiver and reinforcement learning -based training of the transmitter. We demonstrate that this approach works as well as fully supervised methods on additive white Gaussian noise (AWGN) and Rayleigh block-fading (RBF) channels. Surprisingly, while our method converges slower on AWGN channels than supervised training, it converges faster on RBF channels. Our results are a first step towards learning of communications systems over any type of channel without prior assumptions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For FDD M-MIMO systems, a dictionary learning-based channel estimation method has been proposed.
“For such an FDD M-MIMO system, a dictionary learning-based channel estimation method has been proposed in [225].”
From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [225]
The Introduction describes end-to-end transmitter and receiver learning, and the Transmitter and Receiver Architectures section describes estimating a Rayleigh block-fading channel response. Searches for dictionary learning and FDD channel estimation found no passage proposing the claimed method for FDD massive-MIMO systems; the channel-response estimate alone does not establish that claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 14
- T. O'Shea and J. Hoydis, "An introduction to deep learning for the physical layer," IEEE Trans. on Cogn. Commun. Netw., vol. 3, no. 4, pp. 563-575, Dec. 2017.
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT Press, 2016. [Online]. Available: http://www.deeplearningbook.org
- S. Dörner, S. Cammerer, J. Hoydis, and S. ten Brink, "Deep learning- based communication over the air," IEEE J. Sel. Topics Signal Process., vol. 12, no. 1, pp. 132-143, Feb. 2018.
- R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. Cambridge: MIT Press, 1998, vol. 1, no. 1.
- R. S. Sutton, D. A. McAllester, S. P. Singh, and Y. Mansour, "Policy gra- dient methods for reinforcement learning with function approximation," Adv. Neural Inf. Process. Syst., vol. 12, 2000.
- T. J. O'Shea, K. Karra, and T. C. Clancy, "Learning to communicate: Channel auto-encoders, domain specific regularizers, and attention," in Proc. IEEE Int. Symp. Signal Proc. and Inf. Tech. (ISSPIT), Dec. 2016, pp. 223-228.
- M. Kim, W. Lee, and D. H. Cho, "A novel PAPR reduction scheme for OFDM system based on deep learning," IEEE Commun. Lett., vol. 22, no. 3, pp. 510-513, Mar. 2018.
- A. Felix, S. Cammerer, S. Dörner, J. Hoydis, and S. ten Brink, "OFDM-Autoencoder for end-to-end learning of communications systems," in Proc. IEEE Int. Workshop Signal Proc. Adv. Wireless Commun. (SPAWC), Jun. 2018. [Online]. Available: https://arxiv.org/ abs/1803.05815 · arXiv
- T. J. O'Shea, T. Erpek, and T. C. Clancy, "Physical layer deep learning of encodings for the MIMO fading channel," in Annu. Allerton Conf. Commun., Control, Comput. (Allerton), Oct. 2017, pp. 76-80.
- N. Farsad, M. Rao, and A. Goldsmith, "Deep learning for joint source- channel coding of text," in Proc. IEEE. Int. Conf. Acoust., Speech, Signal Proc. (ICASSP), Apr. 2018.
- C. de Vrieze, S. Barratt, D. Tsai, and A. Sahai, "Cooperative multi- agent reinforcement learning for low-level wireless communication," arXiv preprint arXiv:1801.04541, Jan. 2018. · arXiv
- A. Goldsmith, "Joint source/channel coding for wireless channels," in IEEE Proc. Veh. Tech. Conf. (VTC), vol. 2, Jul. 1995, pp. 614-618.
- D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," in Proc. Int. Conf. Learn. Represent. (ICLR), 2015, pp. 1-15.
- P. L'Ecuyer, "Note: On the interchange of derivative and expectation for likelihood ratio derivative estimators," Management Science, vol. 41, no. 4, pp. 738-747, 1995.
Cited by
Sorted by citations
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658 · see citing works
- Authors
- Aoudia, F. A., & Hoydis, J.
- Affiliations
- Nokia (France) (FR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Pages
- 298-303
- ISSN
- 1058-6393 (ISSN-L)
- arXiv
- 1804.02276
- OpenAlex
- W2796257214
- Cited by
- 225
- References
- 0
- Citations by year
- 2026: 17 · 2025: 20 · 2024: 28 · 2023: 32 · 2022: 23 · 2021: 31 · 2020: 34 · 2019: 35 · 2018: 5
- FWCI
- 10.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Asilomar Conference on Signals, Systems and Computers (ACSSC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Wireless Signal Modulation Classification
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- end-to-end learning, reinforcement learning, supervised exercise, Rayleigh block-fading channels, AWGN channel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
