The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
Abstract
This paper investigates a deep reinforcement learning (DRL)-based MAC protocol for heterogeneous wireless networking, referred to as a Deep-reinforcement Learning Multiple Access (DLMA). Specifically, we consider the scenario of a number of networks operating different MAC protocols trying to access the time slots of a common wireless medium. A key challenge in our problem formulation is that we assume our DLMA network does not know the operating principles of the MACs of the other networks-i.e., DLMA does not know how the other MACs make decisions on when to transmit and when not to. The goal of DLMA is to be able to learn an optimal channel access strategy to achieve a certain pre-specified global objective. Possible objectives include maximizing the sum throughput and maximizing α-fairness among all networks. The underpinning learning process of DLMA is based on DRL. With proper definitions of the state space, action space, and rewards in DRL, we show that DLMA can easily maximize the sum throughput by judiciously selecting certain time slots to transmit. Maximizing general α-fairness, however, is beyond the means of the conventional reinforcement learning (RL) framework. We put forth a new multi-dimensional RL framework that enables DLMA to maximize general α-fairness. Our extensive simulation results show that DLMA can maximize sum throughput or achieve proportional fairness (two special classes of α-fairness) when coexisting with TDMA and ALOHA MAC protocols without knowing they are TDMA or ALOHA. Importantly, we show the merit of incorporating the use of neural networks into the RL framework (i.e., why DRL and not just traditional RL): specifically, the use of DRL allows DLMA (i) to learn the optimal strategy with much faster speed and (ii) to be more robust in that it can still learn a near-optimal strategy even when the parameters in the RL framework are not optimally set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Fair end-to-end window-based congestion control
Mo, J., & Walrand, J. (2000) · IEEE/ACM Transactions on Networking · doi:10.1109/90.879343 · Cited by 2,095
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Residual Networks Behave Like Ensembles of Relatively Shallow Networks
Veit, A., Wilber, M., & Belongie, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06431 · Cited by 705
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678 · cited 1×
“Readers are referred to [12], [13] for a general survey of applications of DRL in communications and networking.”
Deep Multi-User Reinforcement Learning for Distributed Dynamic Spectrum Access
Naparstek, O., & Cohen, K. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2879433 · Cited by 477
Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks
Wang, S., Liu, H., Gomes, P. H., & Krishnamachari, B. (2018) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2018.2809722 · Cited by 477
Multiobjective Reinforcement Learning: A Comprehensive Overview
Liu, C., Xu, X., & Hu, D. (2015) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2014.2358639 · Cited by 361
Empirical evaluation methods for multiobjective reinforcement learning algorithms
Vamplew, P., Dazeley, R., Berry, A., Issabekov, R., & Dekker, E. (2011) · Machine Learning · doi:10.1007/s10994-010-5232-5 · Cited by 275
Chang, H.-H., Song, H., Yi, Y., Zhang, J., He, H., & Liu, L. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872441 · Cited by 213
Zhang, L., Tan, J., Liang, Y., Feng, G., & Niyato, D. T. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2912754 · Cited by 153
RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks
Liu, Z., & Elhanany, I. (2006) · International Journal of Sensor Networks · doi:10.1504/ijsnet.2006.012027 · Cited by 130
ALOHA and Q-Learning based medium access control for Wireless Sensor Networks
Chu, Y., Mitchell, P., & Grace, D. (2012) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2012.6328420 · Cited by 92
Spectrum management of cognitive radio using multi-agent reinforcement learning
Wu, C., Chowdhury, K. R., Felice, M. D., & Meleis, W. M. (2010) · doi:10.5555/1838194.1838199 · Cited by 85
Multiagent -Learning for Aloha-Like Spectrum Access in Cognitive Radio Systems
Li, H. (2010) · EURASIP Journal on Wireless Communications and Networking · doi:10.1155/2010/876216 · Cited by 69
Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
Yu, Y., Wang, T., & Liew, S. C. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422168 · Cited by 62
Self-citationYau, K. A., Komisarczuk, P., & Paul, D. T. (2010) · doi:10.1109/lcn.2010.5735689 · Cited by 48
Distributed Reinforcement Learning based MAC protocols for autonomous cognitive secondary users
Bkassiny, M., Jayaweera, S. K., & Avery, K. A. (2011) · Wireless and Optical Communications Conference · doi:10.1109/wocc.2011.5872298 · Cited by 42
Deep Learning for Proactive Resource Allocation in LTE-U Networks
Challita, U., Dong, L., & Saad, W. (2017) · European Wireless Conference · Cited by 31
Cited by
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
“Another advantage of deep reinforcement learning is its ability to infer a good action under an unfamiliar state [146].”
BackgroundMulti-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
Holistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
AI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Machine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 288
Metadata
- Authors
- Yu, Y., Wang, T., & Liew, S. C.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2019-06
- Volume
- 37
- Issue
- 6
- Pages
- 1277-1290
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W2922273628
- Cited by
- 319
- References
- 22
- FWCI
- 26.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.