CoChat
Sign Up
PreprintCited by 685Advanced Wireless Communication TechnologiesSoftware-Defined Networks and 5GWireless Signal Modulation Classification

Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?

Open access
Zappone, Alessio, Di Renzo, Marco, Debbah, Mérouane·2019·arXiv
DOI 10.48550/arxiv.1902.02647arXiv 1902.02647
Open this paper in CoChat — free accountOpen PDF

Abstract

This work deals with the use of emerging deep learning techniques in future wireless communication networks. It will be shown that data-driven approaches should not replace, but rather complement traditional design techniques based on mathematical models. Extensive motivation is given for why deep learning based on artificial neural networks will be an indispensable tool for the design and operation of future wireless communications networks, and our vision of how artificial neural networks should be integrated into the architecture of future wireless communication networks is presented. A thorough description of deep learning methodologies is provided, starting with the general machine learning paradigm, followed by a more in-depth discussion about deep learning and artificial neural networks, covering the most widely-used artificial neural network architectures and their training methods. Deep learning will also be connected to other major learning frameworks such as reinforcement learning and transfer learning. A thorough survey of the literature on deep learning for wireless communication networks is provided, followed by a detailed description of several novel case-studies wherein the use of deep learning proves extremely useful for network design. For each case-study, it will be shown how the use of (even approximate) mathematical models can significantly reduce the amount of live data that needs to be acquired/measured to implement data-driven approaches. For each application, the merits of the proposed approaches will be demonstrated by a numerical analysis in which the implementation and training of the artificial neural network used to solve the problem is discussed. Finally, concluding remarks describe those that in our opinion are the major directions for future research in this field.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1902.02647

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Applications of DL in communication networks include network planning, deployment, resources management, operations control, and maintenance.

    “applications of DL in communication networks have been indicated in the literature, which includes network planning, deployment, resources management, operations control, and maintenance etc.”

    From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [17]

  • ANNs are considered as the most notable enablers of DL mechanism, in which understanding of data's distribution and important features are automatically learned to simulate an effective mapping function.

    “ANNs are considered as the most notable enablers of DL mechanism [17], in which the understanding of the data's distribution and important features are automatically learned to simulate an effective mapping function.”

    From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [17]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 190

  1. [1][1] J. Andrews, S. Buzzi, W. Choi, S. Hanly, A. Lozano, A. C. K. Soong, and J. C. Zhang, 'What will 5G be?' IEEE Journal on Selected Areas in Communications , vol. 32, no. 6, pp. 1065-1082, June 2014. -
  2. [3][3] A. Zappone and E. Jorswieck, 'Energy efficiency in wireless networks via fractional programming theory,' Foundations and Trends R © in Communications and Information Theory , vol. 11, no. 3-4, pp. 185396, 2015. -
  3. [2][2] S. Buzzi, C.-L. I, T. E. Klein, H. V. Poor, C. Yang, and A. Zappone, 'A survey of energy-efficient techniques for 5G networks and challenges ahead,' IEEE Journal on Selected Areas in Communications , vol. 34, no. 5, 2016. -
  4. [5][5] C. G. Aliu et al. , 'A survey of self organisation in future cellular networks,' IEEE Communications Surveys and Tutorials , vol. 15, no. 1, pp. 336-361, 2013. -
  5. [9][9] S. Abdelwahab, B. Hamdaoui, M. Guizani, and T. Znati, 'Network function virtualization in 5G,' IEEE Communications Magazine , vol. 54, no. 4, pp. 84-91, 2016. -
  6. [8][8] D. Kreutz, F. M. V. Ramos, P. Verissimo, C. E. Rothenberg, S. Azodolmolky, and S. Uhlig, 'Software-defined networking: A comprehensive survey,' Proceedings of the IEEE , vol. 103, no. 1, pp. 14-76, 2015. -
  7. [10][10] M. Alzenad, A. El-Keyi, F. Lagum, and H. Yanikomeroglu, '3-D placement of an unmanned aerial vehicle base station for energyefficient maximal coverage,' IEEE Wireless Communications Letters , vol. 6, no. 4, pp. 434-437, August 2017. -
  8. [11][11] M. Di Renzo et al. , 'Smart radio environments empowered by ai reconfigurable meta-surfaces: An idea whose time has come,' Eurasip Journal on Wireless Communications and Networking , vol. https://arxiv.org/abs/1903.08925, 2019. - · arXiv
  9. [13][13] C. M. Bishop, Pattern Recognition and Machine Learning . Springer, 2006. -
  10. [14][14] O. Simeone, 'A brief introduction to machine learning for engineers,' Foundations and Trends R © in Communications and Information Theory , pp. 1-191, 2017. -
  11. [15][15] --, 'A very brief introduction to machine learning with applications to communication systems,' https://arxiv.org/pdf/1808.02342.pdf , 2018. - · arXiv
  12. [16][16] S. Shalev-Shwartz, 'Online learning and online convex optimization,' Foundations and Trends R © in Communications and Information Theory , vol. 4, no. 2, pp. 107-194, 2012. -
  13. [17][17] M. Bkassiny, Y. Li, and S. K. Jayaweera, 'A survey on machinelearning techniques in cognitive radios,' IEEE Communications Surveys and Tutorials , vol. 15, no. 3, pp. 1136-1159, 2013. -
  14. [18][18] S. Lasaulce and H. Tembine, Game Theory and Learning for Wireless Networks . Elsevier, 2011. -
  15. [19][19] J. Moysen and L. Giupponi, 'From 4G to 5G: Selforganized network management meets machine learning,' https://arxiv.org/pdf/1707.09300.pdf , 2018. - · arXiv
  16. [20][20] I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning . MIT Press, 2016. -
  17. [21][21] Y. Bengio, 'Learning deep architectures for AI,' Foundations and Trends R © in Machine Learning , vol. 2, no. 1, pp. 1-127, 2009. -
  18. [22][22] L. Deng and D. Yu, 'Deep learning methods and applications,' Foundations and Trends R © in Signal Processing , vol. 7, no. 3-4, pp. 197-387, 2014. -
  19. [24][24] M. Chen, U. Challita, W. Saad, C. Yin, and M. Debbah, 'Machine learning for wireless networks with artificial intelligence: A tutorial on neural networks,' https://arxiv.org/pdf/1710.02913.pdf , 2017. - · arXiv
  20. [25][25] A. Imran, A. Zoha, and A. Abu-Dayya, 'Challenges in 5G: how to empower SON with big data for enabling 5G,' IEEE Network , vol. 28, no. 6, pp. 27-33, 2014. -
  21. [26][26] S. Bi, R. Zhang, Z. Ding, and S. Cui, 'Wireless communications in the era of big data,' IEEE Communications Magazine , vol. 53, no. 10, pp. 190-199, October 2015. -
  22. [27][27] X. Cheng, L. Fang, L. Yang, and S. Cui, 'Mobile big data: The fuel for data-driven wireless,' IEEE Internet of Things Journal , vol. 4, no. 5, pp. 1489-1516, October 2017. -
  23. [31][31] P. H. Pathak, X. Feng, P. Hu, and P. Mohapatra, 'Visible light communication, networking, and sensing: A survey, potential and challenges,' IEEE Communications Surveys and Tutorials , vol. 17, no. 4, pp. 20472077, 2015. -
  24. [32][32] D. Karunatilaka, F. Zafar, V. Kalavally, and R. Parthiban, 'LED based indoor visible light communications: State of the art,' IEEE Communications Surveys and Tutorials , vol. 17, no. 3, pp. 1649-1678, 2015. -
  25. [33][33] T. Nakano, M. J. Moore, F. Wei, A. V. Vasilakos, and J. Shuai, 'Molecular communication and networking: Opportunities and challenges,' IEEE Transactions on NanoBioscience , vol. 11, no. 2, pp. 135-148, 2012. -
  26. [34][34] N. Farsad, H. B. Yilmaz, A. Eckford, C.-B. Chae, and W. Guo, 'A comprehensive survey of recent advancements in molecular communication,' IEEE Communications Surveys and Tutorials , vol. 18, no. 3, pp. 1887-1919, 2016. -
  27. [35][35] C. H¨ ager and H. D. Pfister, 'Deep learning of the nonlinear schr¨ odinger equation in fiber-optic communications,' https://export.arxiv.org/pdf/1804.02799 , 2018. - · arXiv
  28. [36][36] Y. LeCun, Y. Bengio, and G. Hinton, 'Deep learning,' Nature , vol. 521, no. 7553, pp. 436-444, 2015. -
  29. [37][37] J. Schmidhuber, 'Deep learning in neural networks: An overview,' https://arxiv.org/abs/1404.7828 , 2014. - · arXiv
  30. [38][38] C. Jiang, H. Zhang, Y. Ren, Z. Han, K. C. Chen, and L. Hanzo, 'Machine learning paradigms for next-generation wireless networks,' IEEE Wireless Communications , vol. 24, no. 2, pp. 98-105, April 2017. -
  31. [39][39] M. A. Alsheikh, S. Lin, D. Niyato, and H.-P. Tan, 'Machine learning in wireless sensor networks: Algorithms, strategies, and applications,' IEEE Communications Surveys and Tutorials , vol. 16, no. 4, pp. 19962018, 2014. -
  32. [40][40] P. V. Klaine, M. A. Imran, O. Onireti, and R. D. Souza, 'A survey of machine learning techniques applied to self organizing cellular networks,' IEEE Communications Surveys and Tutorials , vol. 19, no. 4, pp. 2392-2431, 2017. -
  33. [42][42] C. Zhang, P. Patras, and H. Haddadi, 'Deep learning in mobile and wireless networking: A survey,' https://arxiv.org/abs/1803.04311 , 2018. - · arXiv
  34. [44][44] P. Hu, P. Zhang, M. Rostami, and D. Ganesan, 'An integrated activepassive radio for mobile devices with asymmetric energy budgets,' in ACM SIGCOMM , 2016. -
  35. [45][45] C. Liaskos, S. Nie, A. Tsioliaridou, A. Pitsillides, S. Ioannidis, and I. F. Akyildiz, 'Realizing wireless communication through softwaredefined hypersurface environments,' in IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks , 2018. -
  36. [47][47] C. Liaskos, S. Nie, A. Tsioliaridou, A. Pitsillides, S. Ioannidis, and I. F. Akyildiz, 'A new wireless communication paradigm through softwarecontrolled metasurfacesˆ a, ieee communications magazine, vol. 56, no. 9, pp. 162-169, sep. 2018.' IEEE Communications Magazine , vol. 56, no. 9, pp. 162-169, 2018. -
  37. [48][48] C. E. Shannon, 'A mathematical theory of communication,' Bell System Technical Journal , vol. 27, no. 3, pp. 379-423, 1948. -
  38. [50][50] L. Subrt and P. Pechac, 'Controlling propagation environments using intelligent walls,' in European Conference on Antennas and Propagation , 2012. -
  39. [49][49] N. Wiener, Cybernetics, or Control and Communication in the Animal and the Machine . MIT Press, 1948. -
  40. [51][51] C. Liaskos, A. Tsioliaridou, A. Pitsillides, S. Ioannidis, and I. F. Akyildiz, 'Using any surface to realize a new paradigm for wireless communications,' Communications of the ACM , vol. 61, no. 11, pp. 30-33, 2018. -
  41. [53][53] N. Yu, P. Genevet, M. A. Kats, F. Aieta, J.-P. Tetienne, F. Capasso, and Z. Gaburro, 'Light propagation with phase discontinuities: Generalized laws of reflection and refraction,' Science , vol. 334, no. 6504, pp. 333337, 2011. -
  42. [52][52] A. Tsioliaridou, C. Liaskos, and S. Ioannidis, 'Towards a circular economy via intelligent metamaterials,' in IEEE International Conference on Computer-Aided Modeling Analysis and Design of Communication Links and Networks , 2018. -
  43. [54][54] C. L. Holloway, E. F. Kuester, J. A. Gordon, J. O'Hara, J. Booth, and D. R. Smith, 'An overview of the theory and applications of metasurfaces: The two-dimensional equivalents of metamaterials,' IEEE Antennas and Propagation Magazine , vol. 54, no. 2, pp. 10-35, April 2012. -
  44. [56][56] T. Nakanishi, T. Otani, Y. Tamayama, and M. Kitano, 'Storage of electromagnetic waves in a metamaterial that mimics electromagnetically induced transparency,' Physical Review B , vol. 87, no. 161110, 2013. -
  45. [55][55] L. Spada, 'Metamaterials for advanced sensing platforms,' Research Journal on Optical Photonics , vol. 1, no. 1, October 2017. -
  46. [57][57] A. Silva, F. Monticone, G. Castaldi, V. Galdi, A. Alu, and N. Engheta, 'Performing mathematical operations with metamaterials,' Science , vol. 343, no. 6167, pp. 160-163, 2014. -
  47. [59][59] H. Claussen, L. T. W. Ho, H. R. Karimi, F. J. Mullany, and L. G. Samuel, 'Base station: Cognisant robots and future wireless access networks,' in IEEE Consumer Communications and Networking Conference , 2006. -
  48. [60][60] H. Claussen, 'Autonomous self-deployment of wireless access networks,' Bell Labs Technical Journal , vol. 14, no. 1, pp. 55-71, 2009. -
  49. [62][62] J. G. Andrews, X. Zhang, G. D. Durgin, and A. K. Gupta, 'Are we approaching the fundamental limits of wireless network densification?' IEEE Communications Magazine , vol. 54, no. 10, pp. 184-190, October 2016. -
  50. [61][61] S. Singh, H. S. Dhillon, and J. G. Andrews, 'Offloading in heterogeneous networks: Modeling, analysis, offloading in heterogeneous networks: Modeling, analysis, and design insights,' IEEE Transactions on Wireless Communications , vol. 12, no. 5, pp. 2484-2497, May 2013. -
  51. [63][63] M. Di Renzo, W. Lu, and P. Guan, 'The intensity matching approach: A tractable stochastic geometry approximation to system-level analysis of cellular networks,' IEEE Transactions on Wireless Communications , vol. 15, no. 9, pp. 5963-5983, 2016. -
  52. [64][64] M. Di Renzo, A. Zappone, T. T. Lam, and M. Debbah, 'Systemlevel modeling and optimization of the energy efficiency in cellular networks-a stochastic geometry framework,' IEEE Transactions on Wireless Communications , vol. 17, no. 4, pp. 2539-2556, 2018. -
  53. [65][65] --, 'Spectral-energy efficiency pareto front in cellular networks: A stochastic geometry frameworks,' IEEE Wireless Communications Letters , 2018. -
  54. [66][66] C. Mollen, 'High-end performance with low-end hardware: Analysis of massive mimo base station transceivers,' Doctoral Thesis, Linkoping University, Sweden , 2017. -
  55. [67][67] R. W. Heath, N. Gonzalez-Prelcic, S. Rangan, W. Roh, and A. Sayeed, 'An overview of signal processing techniques for millimeter wave MIMO systems,' IEEE Journal of Selected Topics in Signal Processing , vol. 10, no. 3, April 2016. -
  56. [68][68] J. G. Andrews, T. Bai, M. N. Kulkarni, A. Alkhateeb, A. K. Gupta, and R. W. Heath, 'Modeling and analyzing millimeter wave cellular systems,' IEEE Transactions on Communications , vol. 65, no. 1, pp. 403-430, 2017. -
  57. [69][69] O. Abari, D. Bharadia, A. Duffield, and D. Katabi, 'Enabling highquality untethered virtual reality,' in USENIX Symposium on Networked Systems Design and Implementation , 2017. -
  58. [70][70] W. Lu and M. Di Renzo, 'Stochastic geometry modeling and systemlevel analysis and optimization of relay-aided downlink cellular networks,' IEEE Transactions on Communications , vol. 63, no. 11, pp. 4063-4085, 2015. -
  59. [71][71] A. Shojaeifard, K.-K. Wong, M. Di Renzo, G. Zheng, K. A. Hamdi, and J. Tang, 'Massive MIMO-enabled full-duplex cellular networks,' IEEE Transactions on Communications , vol. 65, no. 11, pp. 4734-4750, 2 2017. -
  60. [72][72] S. Abadal et al. , 'Computing and communications for the softwaredefined metamaterial paradigm: A context analysis,' IEEE Access , vol. 5, pp. 6225-6235, 2017. -
  61. [73][73] F. Liu et al. , 'Programmable metasurfaces: State of the art and prospects,' in IEEE International Symposium on Circuits and Systems , 2018. -
  62. [74][74] A. Welkie, L. Shangguan, J. Gummeson, W. Hu, and K. Jamieson, 'Programmable radio environments for smart spaces,' in ACM Workshop on Hot Topics in Networks , 2017. -
  63. [75][75] H. Claussen, 'Autonomous self-deployment of wireless access networks in an airport environment,' Autonomic Communication, Lecture Notes in Computer Science, Springer , vol. 3854, pp. 86-98, 2006. -
  64. [76][76] C. Huang, A. Zappone, G. C. Alexandropoulos, M. Debbah, and C. Yuen, 'Large intelligent surfaces for energy efficiency in wireless communications,' IEEE Transactions on Wireless Communications, in press , 2019. -
  65. [77][77] C. Huang, A. Zappone, M. Debbah, and C. Yuen, 'Achievable rate maximization by passive intelligent mirrors,' 2018 IEEE ICASSP , April 2018. -
  66. [78][78] Z.-Q. Luo and S. Zhang, 'Dynamic spectrum management: Complexity and duality,' IEEE Journal on Selected Areas in Communications , vol. 2, no. 1, pp. 57-73, February 2008. -
  67. [79][79] C. Huang, G. C. Alexandropoulos, A. Zappone, C. Yuen, and M. Debbah, 'Deep learning for UL/DL channel calibration in generic massive MIMO systems,' International Conference on Communications, ICC 2019, https://arxiv.org/abs/1903.02875 , 209. - · arXiv
  68. [80][80] W. Stalling, Cryptography and Network Security: Principles and Practice . Pearson, 7th Edition, 2016. -
  69. [81][81] D. Fudenberg and J. Tirole, Game Theory . MIT Press, 1993. -
  70. [83][83] R. B. Myerson, Game theory: analysis of conflict . Harvard University Press, 1997. -
  71. [84][84] Z. Han, D. Niyato, W. Saad, T. Basar, and A. Hjorungnes, Game Theory in Wireless and Communication Networks: Theory, Models, and Applications . Cambridge University Press, 2011. -
  72. [85][85] A. MacKenzie and L. DaSilva, 'Game theory for wireless engineers,' Synthesis Lectures on Communications , vol. 1, no. 1, pp. 1-86, 2006. -
  73. [86][86] H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. Ag¨ uera y Arcas, 'Communication-efficient learning of deep networks from decentralized data,' in 20 th International Conference on Artificial Intelligence and Statistics (AISTATS) , vol. 54, 2017. -
  74. [87][87] J. Koneˇ cn´ y, H. B. McMahan, F. X. Yu, A. T. Suresh, D. Bacon, and P. Richt´ arik, 'Federated learning: Strategies for improving communication efficiency,' https://arxiv.org/abs/1610.05492 , 2017. - · arXiv
  75. [89][89] X. Wei, Q. Wang, T. Wang, and J. Fan, 'Jammer localization in multihop wireless network: A comprehensive survey,' IEEE Communications Surveys and Tutorials , vol. 19, no. 2, pp. 765-799, 2017. -
  76. [88][88] F. Chen, Z. Dong, Z. Li, and X. He, 'Federated meta-learning for recommendation,' https://arxiv.org/abs/1802.07876 , 2018. - · arXiv
  77. [90][90] G. Han, J. Jiang, C. Zhang, T. Q. Duong, M. Guizani, and G. K. Karagiannidis, 'A survey on mobile anchor node assisted localization in wireless sensor networks,' IEEE Communications Surveys and Tutorials , vol. 18, no. 3, pp. 2220-2243, 2016. -
  78. [92][92] J. Granjal, E. Monteiro, and J. S´ a Silva, 'Security for the internet of things: A survey of existing protocols and open research issues,' IEEE Communications Surveys and Tutorials , vol. 17, no. 3, pp. 1294-1312, 2015. -
  79. [91][91] Y. Zhang, N. Meratnia, and P. Havinga, 'Outlier detection techniques for wireless sensor networks: A survey,' IEEE Communications Surveys and Tutorials , vol. 12, no. 2, pp. 1-12, 2010. -
  80. [93][93] T. M. Mitchell, Machine Learning . McGraw-Hill, 1997. -
  81. [95][95] Y. Li, 'Deep reinforcement learning: An overview,' https://arxiv.org/abs/1701.07274 , 2017. - · arXiv
  82. [94][94] R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd Edition Draft . MIT Press, 2017. -
  83. [96][96] K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, 'Deep reinforcement learning: A brief survey,' IEEE Signal Processing Magazine , vol. 34, no. 6, pp. 26-38, November 2017. -
  84. [98][98] A. Blumer, A. Ehrenfeucht, and D. H. M. K. Warmuth, 'Learnability and the Vapnik-Chervonenkis dimension,' Journal of the ACM , vol. 36, no. 4, pp. 865-929, 1989. -
  85. [97][97] V. N. Vapnik and A. Y. Chervonenkis, 'On the uniform convergence of relative frequencies of events to their probabilities,' Theory of Probability and Its Applications , vol. 16, pp. 264-280, 1971. -
  86. [99][99] V. N. Vapnik, Estimation of Dependences Based on Empirical Data . Springer-Verlag, 1982. -
  87. [101][101] J. Bergstra and Y. Bengio, 'Random search for hyperparameter optimization,' Journal of Machine Learning Research , vol. 13, pp. 281305, 2012. -
  88. [100][100] --, The nature of Statistical Learning Theory . Springer, 1995. -
  89. [102][102] Y. Bengio, H. Larochelle, and P. Vincent, 'Non-local manifold parzen windows,' NIPS, MIT Press , 2005. -
  90. [104][104] A. Krizhevsky, I. Sutskever, and G. E. Hinton, 'Imagenet classification with deep convolutional neural networks,' in Advances in neural information processing systems , 2012. -
  91. [105][105] K. Jarret, K. Kavukcuoglu, M. Ranzato, and Y. LeCun, 'What is the best multi-stage architecture for object recogntion?' in International Conference on Computer Vision , 2009. -
  92. [107][107] X. Glorot, A. Bordes, and Y. Bengio, 'Deep sparse rectifier neural networks,' in International Conference on International Conference of Artificial Intelligence and Statistics , 2011. -
  93. [106][106] V. Nair and G. E. Hinton, 'Rectified linear units improve restricted boltzmann machines,' in International Conference on Machine Learning , 2010. -
  94. [108][108] A. L. Maas, A. Y. Hannun, and A. Y. Ng, 'Rectifier non linearities improve neural network acoustic models,' in International Conference on Machine Learning , 2013. -
  95. [110][110] D.-A. Clevert, T. Unterthiner, and S. Hochreiter, 'Fast and accurate deep network learning by exponential linear units (ELUs),' https://arxiv.org/abs/1511.07289 , 2015. - · arXiv
  96. [109][109] K. He, X. Zhang, S. Ren, and J. Sun, 'Delving deep into rectifiers: surpassing human-level performance on ImageNet classification,' https://arxiv.org/abs/1502.01852 , 2015. - · arXiv
  97. [111][111] K. Hornik, M. Stinchcombe, and H. White, 'Multilayer feedforward networks are universal approximators,' Neural Networks , vol. 2, pp. 359-366, 1989. -
  98. [113][113] A. E. Barron, 'Universal approximation bounds for superpositions of a sigmoidal function,' IEEE Transactions on Information Theory , vol. 39, no. 3, pp. 930-945, 1993. -
  99. [112][112] M. Leshno, V. Y. Lin, A. Pinkus, and S. Schocken, 'Multilayer feedforward networks with a nonpolynomial activation function can approximate any function,' Neural Networks 6 , vol. 6, pp. 861-867, 1993. -
  100. [114][114] G. F. Montufar, R. Pascanu, K. Cho, and Y. Bengio, 'On the number of linear regions of deep neural networks,' in Neural Information Processing Systems , 2014. -
  101. [115][115] T. Cover and J. Thomas, Elements of information theory . Wiley, 2006. -
  102. [116][116] S. P. Boyd and L. Vandenberghe, Convex optimization . Cambridge University Press, 2004. -
  103. [120][120] Y. Dauphin, R. Pascanu, C. Gulcehre, K. Cho, S. Ganguli, and Y. Bengio, 'Identifying and attacking the saddle point problem in high-dimensional non-convex optimization,' in Neural Information Processing Systems , 2014. -
  104. [119][119] A. M. Saxe, J. L. McClelland, and S. Ganguli, 'Exact solutions to the nonlinear dynamics of learning in deep linear neural networks,' in International Conference on Learning Representation , 2013. -
  105. [121][121] I. J. Goodfellow, O. Vinyals, and A. M. Saxe, 'Qualitatively characterizing neural network optimization problems,' in International Conference on Learning Representations , 2015. -
  106. [123][123] P. Baldi and K. Hornik, 'Neural networks and principal component analysis: Learning from examples without local minima,' Neural Networks , vol. 2, pp. 53-58, 1989. -
  107. [124][124] K. Levenberg, 'A method for the solution of certain non-linear problems in least squares,' Journal of Applied Mathematics, Second Quarter , no. 2, pp. 164-168, 1944. -
  108. [126][126] D. E. Rumelhart, G. E. Hinton, and R. J. Williams, 'Learning representations by back-propagating errors,' Nature , vol. 323, 1986. -
  109. [125][125] D. W. Marquardt, 'An algorithm for least-squares estimation of nonlinear parameters,' Journal of the Society of Industrial and Applied Mathematics , vol. 11, no. 2, pp. 431-441, 1963. -
  110. [127][127] L. Bottou, Online algorithms and stochastic approximations , D. Saad, Ed. Cambridge University Press, Cambridge, UK, 1998. -
  111. [129][129] I. Sutskever, J. Martens, G. Dahl, and G. Hinton, 'On the importance of initialization and momentum in deep learning,' in International Conference on Machine Learning 2013 , 2013. -
  112. [128][128] B. T. Polyak, 'Some methods of speeding up the convergence of iteration methods,' USSR Computational Mathematics and Mathematical Physics , vol. 4, no. 5, pp. 1-17, 1964. -
  113. [132][132] D. P. Kingma and J. L. Ba, 'Adam: A method for stochastic optimization,' in International Conference on Learning Representation , 2015. -
  114. [131][131] J. Duchi, E. Hazan, and Y. Singer, 'Adaptive subgradient methods for online learning and stochastic optimization,' Journal of Machine Learning Research , 2011. -
  115. [134][134] D. Sussillo and L. F. Abbott, 'Random walks: Training very deep nonlinear feed-forward networks with smart initialization,' https://arxiv.org/abs/1412.6558v3 , 2015. 21. feedforward neural networks,' in AISTATS'2010 , 2010. - · arXiv
  116. [135][135] J. Martens, 'Deep learning via Hessian-free optimization,' in Twentyseventh International Conference on Machine Learning , 2010. -
  117. [137][137] J. Sj¨ oberg and L. Ljung, 'Overtraining, regularization and searching for a minimum, with application to neural networks,' International Journal of Control , vol. 62, no. 6, pp. 1391-1407, 1995. -
  118. [136][136] C. M. Bishop, 'Regularization and complexity control in feed-forward networks,' in International Conference on Artificial Neural Networks , 1995. -
  119. [138][138] N. Srivastava, G. Hinton, A. K. I. Sutskever, and R. Salakhutdinov, 'Dropout: A simple way to prevent neural networks from overfitting,' Journal of Machine Learning Research , vol. 15, pp. 1929-1958, 2014. -
  120. [140][140] R. J. Williams, 'Simple statistical gradient-following algorithms for connectionist reinforcement learning,' Machine Learning , vol. 8, no. 3-4, pp. 229-256, 1992. -
  121. [139][139] S. Ioffe and C. Szegedy, 'Batch normalization: Accelerating deep network training by reducing internal covariate shift,' in 32nd International Conference on Machine Learning , vol. 37, 2015. -
  122. [141][141] J. Schulman, P. Moritz, S. Levine, M. Jordan, and P. Abbeel, 'Highdimensional continuous control using generalized advantage estimation,' https://arxiv.org/abs/1506.02438 , 2018. - · arXiv
  123. [142][142] V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. P. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu, 'Asynchronous methods for deep reinforcement learning,' International Conference on Machine Learning , 2016. -
  124. [143][143] T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, 'Continuous control with deep reinforcement learning,' International Conference on Learning Representations , 2016. -
  125. [144][144] R. Lowe, Y. Wu, A. Tamar, J. Harb, P. Abbeel, and I. Mordatch, 'Multiagent actor-critic for mixed cooperative-competitive environments,' https://arxiv.org/abs/1706.02275 , 2018. - · arXiv
  126. [145][145] D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, 'Deterministic policy gradient algorithms,' International Conference on Machine Learning , 2014. -
  127. [146][146] J. R. Hershey, J. Le Ru, and F. Weninger, 'Deep unfolding: Model-based inspiration of novel deep architectures,' https://arxiv.org/pdf/1409.2574.pdf , 2014. - · arXiv
  128. [147][147] H. He, S. Jin, C.-K. Wen, F. Gao, G. Y. Li, and Z. Xu, 'Model-driven deep learning for physical layer communications,' https://arxiv.org/pdf/1809.06059.pdf , 2018. - · arXiv
  129. [148][148] C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, 'A survey on deep transfer learning,' https://arxiv.org/abs/1808.01974 , 2018. - · arXiv
  130. [149][149] Y. Yao and G. Doretto, 'Boosting for transfer learning with multiple sources,' in 2010 IEEE conference on Computer vision and pattern recognition (CVPR) , 2010. -
  131. [150][150] D. Pardoe and P. Stone, 'Boosting for regression transfer,' in Proceedings of the 27th International Conference on International Conference on Machine Learning , 2010. -
  132. [151][151] E. Tzeng et al. , 'Deep domain confusion: Maximizing for domain invariance,' https://arxiv.org/pdf/1412.3474.pdf , 2014. - · arXiv
  133. [152][152] M. Long, Y. Cao, J. Wang, and M. Jordan, 'Learning transferable features with deep adaptation networks,' International Conference on Machine Learning , pp. 97-105, 2015. -
  134. [153][153] M. Long, H. Zhu, J. Wang, and M. I. Jordan, 'Deep transfer learning with joint adaptation networks,' https://arxiv.org/abs/1605.06636 , 2017. - · arXiv
  135. [154][154] M. Arjovsky, S. Chintala, and L. Bottou, 'Wasserstein GAN,' https://arxiv.org/abs/1701.07875 , 2017. - · arXiv
  136. [155][155] J. T. Huang, J. Li, D. Yu, L. Deng, and Y. Gong, 'Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers,' in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing Conference (ICASSP) , 2013. -
  137. [156][156] A. Zappone, M. Di Renzo, M. Debbah, T. T. Lam, and X. Qian, 'Model-aided wireless artificial intelligence: Embedding expert knowledge in deep neural networks towards wireless systems optimization,' IEEE Vehicular Technology Magazine, in press, https://arxiv.org/abs/1808.01672 , 2019. - · arXiv
  138. [157][157] Y. Shen, Y. Shi, J. Zhang, and K. B. Letaief, 'Transfer learning for mixed-integer resource allocation problems in wireless networks,' https://arxiv.org/abs/1811.07107 , 2018. - · arXiv
  139. [158][158] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, 'Generative adversarial nets,' Advances in neural information processing systems , pp. 2672-2680, 2014. -
  140. [159][159] Y. Ganin et al. , 'Domain-adversarial training of neural networks,' Journal of Machine Learning Research , vol. 17, pp. 1-35, 2016. -
  141. [160][160] Z. Cao, M. Long, J. Wang, and M. I. Jordan, 'Partial transfer learning with selective adversarial networks,' https://arxiv.org/pdf/1707.07901.pdf , 2017. - · arXiv
  142. [161][161] T. O'Shea and J. Hoydis, 'An introduction to deep learning for the physical layer,' IEEE Transactions on Cognitive Communications and Networking , vol. 3, no. 4, pp. 563-575, 2017. -
  143. [162][162] M. Kim, W. Lee, and D.-H. Cho, 'A novel PAPR reduction scheme for OFDM system based on deep learning,' IEEE Communications Letters , vol. 22, no. 3, pp. 510-513, 2018. -
  144. [163][163] N. Samuel, T. Diskin, and A. Wiesel, 'Learning to detect,' https://arxiv.org/pdf/1805.07631.pdf , 2018. - · arXiv
  145. [164][164] S. Xue, Y. Ma, N. Yi, and R. Tafazolli, 'Unsupervised deep learning for MU-SIMO joint transmitter and noncoherent receiver design,' IEEE Wireless Communications Letters , 2018. -
  146. [165][165] X. Jin and H.-N. Kim, 'Deep learning detection networks in MIMO decode-forward relay channels,' https://arxiv.org/abs/1807.09571 , 2018. - · arXiv
  147. [166][166] A. Felix, S. Cammerer, S. D¨ orner, J. Hoydis, and S. ten Brink, 'OFDMautoencoder for end-to-end learning of communications systems,' https://arxiv.org/pdf/1803.05815.pdf , 2018. - · arXiv
  148. [167][167] S. D¨ orner, S. Cammerer, J. Hoydis, and S. ten Brink, 'Deep learningbased communication over the air,' IEEE Journal of Selected Topics in Signal Processing , vol. 12, no. 1, pp. 132-143, 2018. -
  149. [168][168] T. J. O'Shea, T. Roy, N. West, and B. C. Hilburn, 'Physical layer communications system design over-the-air using adversarial networks,' https://arxiv.org/abs/1803.03145v1 , 2018. - · arXiv
  150. [170][170] H. Ye, G. Y. Li, B. H. F. Juang, and K. Sivanesan, 'Channel agnostic end-to-end learning based communication systems with conditional gan,' https://arxiv.org/abs/1807.00447 , 2018. - · arXiv
  151. [169][169] T. J. O'Shea, T. Roy, and N. West, 'Approximating the void: Learning stochastic channel models from observation with variational generative adversarial networks,' https://arxiv.org/abs/1805.06350 , 2018. - · arXiv
  152. [171][171] F. A. Aoudia and J. Hoydis, 'End-to-end learning of communications systems without a channel model,' https://arxiv.org/pdf/1804.02276.pdf , 2018. - · arXiv
  153. [173][173] N. Farsad and A. Goldsmith, 'Detection algorithms for communication systems using deep learning,' https://arxiv.org/abs/1705.08044 , 2017. - · arXiv
  154. [172][172] V. Raj and S. Kalyani, 'Backpropagating through the air: Deep learning at physical layer without channel models,' IEEE Communications Letters , 2018. -
  155. [174][174] X. Qian and M. Di Renzo, 'Receiver design in molecular communications: An approach based on artificial neural networks,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  156. [176][176] J. Vieira, E. Leitinger, M. Sarajlic, X. Li, and F. Tufvesson, 'Deep convolutional neural networks for massive MIMO fingerprint-based positioning,' https://arxiv.org/pdf/1708.06235.pdf , 2017. - · arXiv
  157. [175][175] D. Neumann, T. Wiese, and W. Utschick, 'Learning the MMSE channel estimator,' https://arxiv.org/abs/1707.05674v2 , 2017. - · arXiv
  158. [177][177] S. Navabi, C. Wang, O. Y. Bursalioglu, and H. Papadopoulos, 'Predicting wireless channel features using neural networks,' https://arxiv.org/abs/1802.00107 , 2018. - · arXiv
  159. [179][179] A. Decurninge et al. , 'CSI-based outdoor localization for massive MIMO: Experiments with a learning approach,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  160. [178][178] Y. Ding and B. D. Rao, 'Dictionary learning based sparse channel representation and estimation for FDD massive MIMO systems,' https://arxiv.org/abs/1612.06553 , 2018. - · arXiv
  161. [180][180] S. Schibisch et al. , 'Online label recovery for deep learning-based communication through error correcting codes,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  162. [182][182] X. Ma, H. Ye, and G. Y. Li, 'Learning assisted estimation for timevarying channels,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  163. [181][181] M. Koller et al. , 'Machine learning for channel estimation from compressed measurements,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  164. [183][183] W. Xu et al. , 'Joint neural network equalizer and decoder,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  165. [185][185] Z. Qin, H. Ye, G. Y. Li, and B.-H. F. Juang, 'Deep learning in physical layer communications,' https://arxiv.org/abs/1807.11713 , 2018. - · arXiv
  166. [184][184] T. Wang, C.-K. Wen, H. Wang, F. Gao, T. Jiang, and S. Jin, 'Deep learning for wireless physical layer: Opportunities and challenges,' https://arxiv.org/pdf/1710.05312.pdf , 2017. - · arXiv
  167. [186][186] A. Javid, S. Chatterjee, and M. Skoglund, 'Mutual information preserving analysis of a single layer feedforward network,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  168. [188][188] R. Li, Z. Zhao, X. Zhou, G. Ding, Y. Chen, Z. Wang, and H. Zhang, 'Intelligent 5G: When cellular networks meet artificial intelligence,' IEEE Wireless Communications , vol. 24, no. 5, pp. 175-183, October 2017. -
  169. [187][187] H. Ye, G. Y. Li, and B.-H. Juang, 'Power of deep learning for channel estimation and signal detection in OFDM systems,' IEEE Wireless Communications Letters , vol. 7, no. 1, pp. 114-117, 2018. -
  170. [189][189] F. D. Calabrese, L. Wang, E. Ghadimi, G. Peters, and P. Soldati, 'Learning radio resource management in 5G networks: Framework, opportunities and challenges,' https://arxiv.org/abs/1611.10253 , 2017. - · arXiv
  171. [191][191] M. Chen, W. Saad, C. Yin, and M. Debbah, 'Echo state networks for proactive caching in cloud-based radio access networks with mobile users,' IEEE Transactions on Wireless Communications , vol. 16, no. 6, pp. 3520-3535, June 2017. -
  172. [190][190] J. Fang, X. Li, W. Cheng, Z. Chen, and H. Li, 'Intelligent power control for spectrum sharing: A deep reinforcement learning approach,' https://arxiv.org/pdf/1712.07365.pdf , 2018. - · arXiv
  173. [192][192] H. Sun, X. Chen, Q. Shi, M. Hong, X. Fu, and N. D. Sidiropoulos, 'Learning to optimize: Training deep neural networks for wireless resource management,' IEEE Transactions on Signal Processing , vol. 66, no. 20, pp. 5438-5453, 2018. -
  174. [193][193] A. Zappone, M. Debbah, and Z. Alltman, 'Online energy-efficient power control in wireless networks by deep neural networks,' in IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications , 2018. -
  175. [195][195] L. Sanguinetti, A. Zappone, and M. Debbah, 'A deep-learning framework for energy-efficient resource allocation in massive MIMO systems,' in Asilomar Conference on Signals, Systems, and Computers , 2018. -
  176. [194][194] A. Zappone, L. Sanguinetti, and M. Debbah, 'User association and load balacing for massive MIMO through deep learning,' in Asilomar Conference on Signals, Systems, and Computers , 2018. -
  177. [196][196] Y. S. Nasir and D. Guo, 'Deep reinforcement learning for distributed dynamic power allocation in wireless networks,' https://arxiv.org/abs/1808.00490 , 2018. - · arXiv
  178. [198][198] P. De Kerret and D. Gesbert, 'Robust decentralized joint precoding using team deep neural network,' in IEEE International Symposium on Wireless Communication Systems (ISWCS) , 2018. -
  179. [197][197] F. Liang, C. Shen, W. Yu, and F. Wu, 'Towards optimal power control via ensembling deep neural networks,' https://arxiv.org/abs/1807.10025 , 2018. - · arXiv
  180. [199][199] Q. Shi, M. Razaviyayn, Z. Q. Luo, and C. He, 'An Iteratively Weighted MMSE Approach to Distributed Sum-Utility Maximization for a MIMO Interfering Broadcast Channel,' IEEE Transactions on Signal Processing , vol. 59, no. 9, pp. 4331-4340, September 2011. -
  181. [201][201] M. K. Sharma, A. Zappone, M. Assaad, M. Debbah, and S. Vassilaras, 'Distributed power control for large energy harvesting networks: A multi-agent deep reinforcement learning approach,' https://arxiv.org/abs/1904.00601 , 2019. - · arXiv
  182. [200][200] B. Matthiesen, A. Zappone, E. A. Jorswieck, and M. Debbah, 'Deep learning for optimal energy-efficient power control in wireless interference networks,' https://arxiv.org/abs/1812.06920 , 2019. - · arXiv
  183. [202][202] T. Inoue, S. Chaudhury, G. De Magistris, and S. Dasgupta, 'Transfer learning from synthetic to real images using variational autoencoders for robotic applications,' https://arxiv.org/pdf/1709.06762.pdf , 2017. - · arXiv
  184. [204][204] N. Farsad, H. B. Yilmaz, A. Eckford, C.-B. Chae, and W. Guo, 'A comprehensive survey of recent advancements in molecular communication,' IEEE Communications Surveys and Tutorials , vol. 18, no. 3, pp. 1887-1919, 2016. -
  185. [203][203] C. Kim, E. Variani, A. Narayanan, and M. Bacchiani, 'Efficient implementation of the room simulator for training deep neural network acoustic models,' https://arxiv.org/pdf/1712.03439.pdf , 2017. - · arXiv
  186. [205][205] N. Farsad and A. Goldsmith, 'Sliding bidirectional recurrent neural networks for sequence detection in communication systems,' in IEEE International Conference on Acoustics, Speech and Signal Processing , 2018. -
  187. [207][207] G. Calcev, D. Chizhik, B. Goransson, S. Howard, H. Huanga, A. Kogiantis, A. Molisch, A. Moustakas, D. Reed, and H. Xu, 'A wideband spatial channel model for system-wide simulations,' IEEE Transactions on Vehicular Technology , vol. 56, no. 2, March 2007. -
  188. [206][206] X. Qian and M. Di Renzo, 'Receiver design in molecular communications: An approach based on artificial neural networks,' in IEEE International Symposium on Wireless Communications Systems , 2018. -
  189. [213][213] J. G. Andrews, F. Baccelli, and R. K. Ganti, 'A tractable approach to coverage and rate in cellular networks,' IEEE Transactions on Communications , vol. 59, no. 11, pp. 3122-3134, 2011. -
  190. [212][212] M. Di Renzo, S. Wang, and X. Xi, 'Modeling and analysis of cellular networks by using inhomogeneous poisson point processes,' IEEE Transactions on Wireless Communications , vol. 17, no. 8, pp. 51625182, August 2018. -

Cited by

Sorted by citations

Authors
Zappone, A., Di Renzo, M., & Debbah, M.
Affiliations
Supélec (FR)
ORCID
Zappone, Alessio
Venue
arXiv
Publisher
arXiv
Published
2019
Volume
67
Issue
10
Pages
7331-7376
ISSN
0090-6778 (ISSN-L)
DOI
10.48550/arxiv.1902.02647
arXiv
1902.02647
OpenAlex
W2912931692
Cited by
685
References
0
Citations by year
2026: 46 · 2025: 77 · 2024: 84 · 2023: 91 · 2022: 109 · 2021: 147 · 2020: 98 · 2019: 32 · 2018: 1
FWCI
34.65
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE Transactions on Communications (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • HAL (submittedVersion, other-oa)
  • Archivio Istituzionale della Ricerca - Università degli Studi di Cassino (submittedVersion)
  • arXiv (Cornell University)
  • Zenodo (CERN European Organization for Nuclear Research) (cc-by)
Topics
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Technologies
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software-Defined Networks and 5G
  • Physical Sciences › Computer Science › Artificial Intelligence › Wireless Signal Modulation Classification
Keywords
deep learning, wireless network design, artificial neural networks, neural network architecture, neural network training, reinforcement learning, transfer learning, network architecture

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review