Learning to optimize: Training deep neural networks for wireless resource management
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
For decades, optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, these algorithms often require a considerable number of iterations for convergence, which poses challenges for real-time processing. In this work, we propose a new learning-based approach for wireless resource management. The key idea is to treat the input and output of a resource allocation algorithm as an unknown non-linear mapping and to use a deep neural network (DNN) to approximate it. If the nonlinear mapping can be learned accurately and effectively by a DNN of moderate size, then such DNN can be used for resource allocation in almost real time, since passing the input through a DNN to get the output only requires a small number of simple operations. In this work, we first characterize a class of `learnable algorithms' and then design DNNs to approximate some algorithms of interest in wireless communications. We use extensive numerical simulations to demonstrate the superior ability of DNNs for approximating two considerably complex algorithms that are designed for power allocation in wireless transmit signal design, while giving orders of magnitude speedup in computational time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728 · cited 1×
“…consider a finite step iterative algorithm, in which the relationship between y t and y t +1 is given by where f t is a continuous mapping representing t th iteration; x ∈ X is the problem parameter; We have following result as an extension of the well-known universal approximation theorem [22].”
MethodBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
(2010) · International Conference on Machine Learning · Cited by 13,995
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
Verdú, S. (1998) · Cited by 4,682
Semidefinite Relaxation of Quadratic Optimization Problems
Luo, Z.-Q., Ma, W.-K., So, A., Ye, Y., & Zhang, S. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936019 · Cited by 3,715
Learning Fast Approximations of Sparse Coding
Gregor, K., & LeCun, Y. (2010) · International Conference on Machine Learning · Cited by 2,401
Dynamic Spectrum Management: Complexity and Duality
Luo, Z.-Q., & Zhang, S. (2008) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.914876 · Cited by 929
Shi, Q., Razaviyayn, M., Luo, Z.-Q., & He, C. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5946304 · Cited by 873
Self-citationDistributed multiuser power control for digital subscriber lines
Yu, W., Ginis, G., & Cioffi, J. M. (2002) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2002.1007390 · Cited by 855
Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures
Hershey, J. R., Roux, J. L., & Weninger, F. (2014) · arXiv · doi:10.48550/arxiv.1409.2574 · Cited by 412 · cited 4×
“The authors of [18] proposed a few improved network architectures and applied the resulting DNN to approximate algorithms for other tasks such as non-negative matrix factorization (NMF).”
BackgroundMethodInfluentialSCALE: A Low-Complexity Distributed Protocol for Spectrum Balancing in Multiuser DSL Networks
Papandriopoulos, J., & Evans, J. S. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2023751 · Cited by 395
Optimal Resource Allocation in Coordinated Multi-Cell Systems
Björnson, E., & Jorswieck, E. (2013) · Foundations and Trends® in Communications and Information Theory · doi:10.1561/0100000069 · Cited by 349
Scutari, G., Palomar, D. P., & Barbarossa, S. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.907807 · Cited by 316
Coding Techniques for Repairability in Networked Distributed Storage Systems
Oggier, F., & Datta, A. (2013) · Foundations and Trends in Communications and Information Theory · doi:10.1561/0100000068 · Cited by 305
Binary Power Control for Sum Rate Maximization over Multiple Interfering Links
Gjendemsjo, A., Gesbert, D., Oien, G. E., & Kiani, S. G. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2008.070227 · Cited by 304
Optimal Resource Allocation for MIMO Ad Hoc Cognitive Radio Networks
Kim, S.-J., & Giannakis, G. B. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2120270 · Cited by 301
Hong, M., Sun, R., Baligh, H., & Luo, Z.-Q. (2013) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2013.130211 · Cited by 271
Self-citationFDMA capacity of Gaussian multiple-access channels with ISI
Yu, W., & Cioffi, J. M. (2002) · IEEE Transactions on Communications · doi:10.1109/26.975766 · Cited by 249
Convex approximation techniques for joint multiuser downlink beamforming and admission control
Matskani, E., Sidiropoulos, N., Luo, Z.-Q., & Tassiulas, L. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2008.070104 · Cited by 207
Self-citationDeep Learning Based MIMO Communications
O'Shea, T. J., Erpek, T., & Clancy, T. C. (2017) · arXiv · doi:10.48550/arxiv.1707.07980 · Cited by 205
Distributed resource allocation schemes
Schmidt, D. M., Shi, C., Berry, R., Honig, M. L., & Utschick, W. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msrp.2009.933371 · Cited by 163
Li, K., & Malik, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01885 · Cited by 142
Detection Algorithms for Communication Systems Using Deep Learning
Farsad, N., & Goldsmith, A. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08044 · Cited by 115
Gradient Descent Converges to Minimizers
Lee, J. D., Simchowitz, M., Jordan, M. I., & Recht, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04915 · Cited by 103
Liao, W.-C., Hong, M., Liu, Y.-F., & Luo, Z.-Q. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2331611 · Cited by 97
Self-citationSignal Processing and Optimal Resource Allocation for the Interference Channel
Hong, M., & Luo, Z.-Q. T. (2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-396500-4.00008-9 · Cited by 88
Self-citationJoint Power and Admission Control via Linear Programming Deflation
Liu, Y., Dai, Y., & Luo, Z.-Q. T. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2236319 · Cited by 70
Recurrent Neural Radio Anomaly Detection
O’Shea, T. J., Clancy, T. C., & McGwier, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00301 · Cited by 43
Cross-Layer Provision of Future Cellular Networks: A WMMSE-based approach
Baligh, H., Hong, M., Liao, W.-C., Luo, Z.-Q., Razaviyayn, M., Sanjabi, M., & Sun, R. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2335237 · Cited by 41
Self-citation
Research works printed but not linked: 2
- maas, 0, Rectifier Nonlinearities Improve Neural Network Acoustic Models
- hinton, 2012, Lecture 6a overview of mini-batch gradient descent, Coursera Lecture slides
Cited by
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980
“The idea of learning to solve complex optimization tasks for wireless resource allocation is investigated in [29].”
BackgroundDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Huang, L., Bi, S., & Zhang, Y.-J. A. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2928811 · Cited by 1,040
Learning to Optimize: Training Deep Neural Networks for Interference Management
Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866382 · Cited by 874
Self-citation
Metadata
- Authors
- Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D.
- Affiliations
- Iowa State University (US)
- Zhejiang Sci-Tech University (CN)
- University of Minnesota (US)
- Venue
- 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 1-6
- OpenAlex
- W2964021722
- Cited by
- 308
- References
- 30
- Citations by year
- 2026: 11 · 2025: 19 · 2024: 20 · 2023: 35 · 2022: 43 · 2021: 54 · 2020: 48 · 2019: 44 · 2018: 29 · 2017: 4
- FWCI
- 48.35
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) (publishedVersion)
- Iowa State University Digital Repository (Iowa State University) (submittedVersion)
- Funders
- Nvidia
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced MIMO Systems Optimization
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- wireless resource management, deep neural network, power control, beamforming, resource allocation, real-time optimization, computational complexity reduction, transmit signal design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.