CoChat
Sign Up
PreprintCited by 4

RNN Decoding of Linear Block Codes

Nachmani, Eliya, Marciano, Elad, Burshtein, David, Be'ery, Yair·2017·arXiv
DOI 10.48550/arxiv.1702.07560arXiv 1702.07560
Open this paper in CoChat — free account

Abstract

Designing a practical, low complexity, close to optimal, channel decoder for powerful algebraic codes with short to moderate block length is an open research problem. Recently it has been shown that a feed-forward neural network architecture can improve on standard belief propagation decoding, despite the large example space. In this paper we introduce a recurrent neural network architecture for decoding linear block codes. Our method shows comparable bit error rate results compared to the feed-forward neural network with significantly less parameters. We also demonstrate improved performance over belief propagation on sparser Tanner graph representations of the codes. Furthermore, we demonstrate that the RNN decoder can be used to improve the performance or alternatively reduce the computational complexity of the mRRD algorithm for low complexity, close to optimal, decoding of short BCH codes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1702.07560

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Deep unfolding has been recently applied in channel decoding and MIMO detection.

    “It has been recently applied in the context of channel decoding and MIMO detection [22], [23], [24].”

    From An Introduction to Deep Learning for the Physical Layer (2017) · cites this paper as [23]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 21

  1. A. Graves, A.-r. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks," in 2013 IEEE international conference on acoustics, speech and signal processing. IEEE, 2013, pp. 6645-6649.
  2. D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot et al., "Mastering the game of go with deep neural networks and tree search," Nature, vol. 529, no. 7587, pp. 484-489, 2016.
  3. R. G. Gallager, Low Density Parity Check Codes. Cambridge, Massachusetts: M.I.T. Press, 1963.
  4. J. Jiang and K. R. Narayanan, "Iterative soft-input soft-output decoding of reed-solomon codes by adapting the parity-check matrix," IEEE Transactions on Information Theory, vol. 52, no. 8, pp. 3746-3756, 2006.
  5. I. Dimnik and Y. Be'ery, "Improved random redundant iterative hdpc decoding," IEEE Transactions on Communications, vol. 57, no. 7, pp. 1982-1985, 2009.
  6. A. Yufit, A. Lifshitz, and Y. Be'ery, "Efficient linear programming decoding of hdpc codes," IEEE Transactions on Communications, vol. 59, no. 3, pp. 758-766, 2011.
  7. X. Zhang and P. H. Siegel, "Adaptive cut generation algorithm for improved linear programming decoding of binary linear codes," IEEE Transactions on Information Theory, vol. 58, no. 10, pp. 6581-6594, 2012.
  8. M. Helmling, E. Rosnes, S. Ruzika, and S. Scholl, "Efficient maximum-likelihood decoding of linear block codes on binary mem- oryless channels," in 2014 IEEE International Symposium on Infor- mation Theory. IEEE, 2014, pp. 2589-2593.
  9. E. Nachmani, Y. Beery, and D. Burshtein, "Learning to decode linear codes using deep learning," 54'th Annual Allerton Conf. On Communication, Control and Computing, Mouticello, IL, September 2016. arXiv preprint arXiv:1607.04793, 2016. · arXiv
  10. L. Lugosch and W. J. Gross, "Neural offset min-sum decoding," arXiv preprint arXiv:1701.05931, 2017. · arXiv
  11. T. Gruber, S. Cammerer, J. Hoydis, and S. t. Brink, "On deep learning- based channel decoding," accepted for CISS 2017, arXiv preprint arXiv:1701.07738, 2017. · arXiv
  12. T. J. O'Shea and J. Hoydis, "An introduction to machine learning communications systems," arXiv preprint arXiv:1702.00832, 2017. · arXiv
  13. M. P. Fossorier, "Iterative reliability-based decoding of low-density parity check codes," IEEE Journal on selected Areas in Communica- tions, vol. 19, no. 5, pp. 908-917, 2001.
  14. T. Richardson and R. Urbanke, Modern Coding Theory. Cambridge, UK: Cambridge University Press, 2008.
  15. T. R. Halford and K. M. Chugg, "Random redundant soft-in soft-out decoding of linear block codes," in Information Theory, 2006 IEEE International Symposium on. IEEE, 2006, pp. 2230-2234.
  16. T. Hehn, J. B. Huber, S. Laendner, and O. Milenkovic, "Multiple-bases belief-propagation for decoding of short block codes," in Information Theory, 2007. ISIT 2007. IEEE International Symposium on. IEEE, 2007, pp. 311-315.
  17. T. Tieleman and G. Hinton, "Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude," COURSERA: Neural Networks for Machine Learning, vol. 4, no. 2, 2012.
  18. J. Van Wonterghem, A. Alloumf, J. Boutros, and M. Moeneclaey, "Performance comparison of short-length error-correcting codes," in Communications and Vehicular Technologies (SCVT), 2016 Sympo- sium on. IEEE, 2016, pp. 1-6.
  19. M. P. Fossorier and S. Lin, "Soft-decision decoding of linear block codes based on ordered statistics," IEEE Transactions on Information Theory, vol. 41, no. 5, pp. 1379-1396, 1995.
  20. I. Hubara, M. Courbariaux, D. Soudry, R. El-Yaniv, and Y. Bengio, "Quantized neural networks: Training neural networks with low preci- sion weights and activations," arXiv preprint arXiv:1609.07061, 2016. · arXiv
  21. M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi, "Xnor-net: Imagenet classification using binary convolutional neural networks," in European Conference on Computer Vision. Springer, 2016, pp. 525-542.

Cited by

Sorted by citations

Authors
Nachmani, E., Marciano, E., Burshtein, D., & Be'ery, Y.
Venue
arXiv
Publisher
arXiv
Published
2017
DOI
10.48550/arxiv.1702.07560
arXiv
1702.07560
References
3
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review