Deep-Reinforcement-Learning-Based Optimization for Cache-Enabled Opportunistic Interference Alignment Wireless Networks
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Both caching and interference alignment (IA) are promising techniques for next-generation wireless networks. Nevertheless, most of the existing works on cache-enabled IA wireless networks assume that the channel is invariant, which is unrealistic considering the time-varying nature of practical wireless environments. In this paper, we consider realistic time-varying channels. Specifically, the channel is formulated as a finite-state Markov channel (FSMC). The complexity of the system is very high when we consider realistic FSMC models. Therefore, in this paper, we propose a novel deep reinforcement learning approach, which is an advanced reinforcement learning algorithm that uses a deep Q network to approximate the Q value-action function. We use Google TensorFlow to implement deep reinforcement learning in this paper to obtain the optimal IA user selection policy in cache-enabled opportunistic IA wireless networks. Simulation results are presented to show that the performance of cache-enabled opportunistic IA networks in terms of the network's sum rate and energy efficiency can be significantly improved by using the proposed approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Fundamentals of Wireless Communication
Tse, D., & Viswanath, P. (2005) · doi:10.1017/cbo9780511807213 · Cited by 13,162
Interference Alignment and Degrees of Freedom of the $K$-User Interference Channel
Cadambe, V. R., & Jafar, S. A. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2008.926344 · Cited by 2,970
A Statistical Theory of Mobile-Radio Reception
Clarke, R. H. (1968) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1968.tb00069.x · Cited by 2,042
Finite-state Markov channel-a useful model for radio communication channels
Wang, H. S., & Moayeri, N. (1995) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.350282 · Cited by 1,647
Cache in the air: exploiting content caching and delivery techniques for 5G systems
Wang, X., Chen, M., Taleb, T., Ksentini, A., & Leung, V. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6736753 · Cited by 1,063 · cited 1×
“By effectively reducing the duplicate content transmissions in networks, caching has been recognized as one of the promising techniques for future wireless networks to improve spectral ef-ficiency, shorten latency, and reduce energy consumption [3]– [5].”
BackgroundSelf-citationGomadam, K., Cadambe, V. R., & Jafar, S. A. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2142270 · Cited by 871
On verifying the first-order Markovian assumption for a Rayleigh fading channel model
Wang, H. S., & Chang, P.-C. (1996) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.492909 · Cited by 531
Caching at the wireless edge: design aspects, challenges, and future directions
Liu, D., Chen, B., Yang, C., & Molisch, A. F. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7565183 · Cited by 457
He, Y., Yu, F. R., Zhao, N., Leung, V. C. M., & Yin, H. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1700246 · Cited by 358
Self-citationWireless caching: technical misconceptions and business barriers
Paschos, G., Bastug, E., Land, I., Caire, G., & Debbah, M. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7537172 · Cited by 321
Continuous Deep Q-Learning with Model-based Acceleration
Gu, S., Lillicrap, T., Sutskever, I., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00748 · Cited by 304
A Survey of Green Information-Centric Networking: Research Issues and Challenges
Fang, C., Yu, F. R., Huang, T., Liu, J., & Liu, Y. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2394307 · Cited by 268
Self-citationInformation-centric network function virtualization over 5g mobile wireless networks
Liang, C., Yu, F. R., & Zhang, X. (2015) · IEEE Network · doi:10.1109/mnet.2015.7113228 · Cited by 247
Self-citationA survey on predicting the popularity of web content
Tatar, A., de Amorim, M. D., Fdida, S., & Antoniadis, P. (2014) · Journal of Internet Services and Applications · doi:10.1186/s13174-014-0008-y · Cited by 240
The practical challenges of interference alignment
Ayach, O. E., Peters, S. W., & Heath, R. W. (2013) · IEEE Wireless Communications · doi:10.1109/mwc.2013.6472197 · Cited by 199
Cache-aided interference channels
Maddah-Ali, M. A., & Niesen, U. (2015) · 2015 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2015.7282567 · Cited by 197
Zhao, N., Yu, F. R., Sun, H., & Li, M. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2015.2440428 · Cited by 194
Self-citationA Q-learning-based dynamic channel assignment technique for mobile communication systems
Nie, J., & Haykin, S. (1999) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.790549 · Cited by 181
Big Data Analytics in Mobile Cellular Networks
He, Y., Yu, F. R., Zhao, N., Yin, H., Yao, H., & Qiu, R. C. (2016) · IEEE Access · doi:10.1109/access.2016.2540520 · Cited by 171
Self-citationXie, R., Yu, F. R., & Ji, H. (2011) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2011.2181966 · Cited by 146
Self-citationCross-Layer Design for TCP Performance Improvement in Cognitive Radio Networks
Luo, C., Yu, F. R., Ji, H., & Leung, V. C. M. (2010) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2041802 · Cited by 145
Self-citationWei, Y., Yu, F. R., & Song, M. N. (2010) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2041803 · Cited by 138
Self-citationChua, M. Y.-K., Yu, F. R., Liang, C., Sun, B., & Yan, Q. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2015.2483558 · Cited by 81
Self-citationHe, Y., Liang, C., Yu, F. R., Zhao, N., & Yin, H. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996332 · Cited by 60
Self-citationOng, H. Y., Chavez, K., & Hong, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.04186 · Cited by 59
On the benefits of edge caching for MIMO interference alignment
Deghel, M., Baştuǧ, E., Assaad, M., & Debbah, M. A. (2015) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2015.7227119 · Cited by 48
Power Allocation for Cache-Aided Small-Cell Networks With Limited Backhaul
Cheng, F., Yu, Y. P., Zhao, Z., Zhao, N., Chen, Y., & Lin, H. F. (2017) · IEEE Access · doi:10.1109/access.2017.2656384 · Cited by 32
Self-citation
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
“In [113], deep reinforcement learning is used to select transmitter-receiver pairs to form a cluster, within which”
BackgroundMethodInfluentialXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
He, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Self-citation
Metadata
- Authors
- He, Y., Zhang, Z., Yu, F. R., Zhao, N., Yin, H., Leung, V. C. M., & Zhang, Y.
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2017-11
- Volume
- 66
- Issue
- 11
- Pages
- 10433-10445
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2756144809
- Cited by
- 288
- References
- 28
- FWCI
- 16.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.