The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning
Open accessAbstract
Recently, the reconfigurable intelligent surface (RIS), benefited from the breakthrough on the fabrication of programmable meta-material, has been speculated as one of the key enabling technologies for the future six generation (6G) wireless communication systems scaled up beyond massive multiple input multiple output (Massive-MIMO) technology to achieve smart radio environments. Employed as reflecting arrays, RIS is able to assist MIMO transmissions without the need of radio frequency chains resulting in considerable reduction in power consumption. In this paper, we investigate the joint design of transmit beamforming matrix at the base station and the phase shift matrix at the RIS, by leveraging recent advances in deep reinforcement learning (DRL). We first develop a DRL based algorithm, in which the joint design is obtained through trial-and-error interactions with the environment by observing predefined rewards, in the context of continuous state and action. Unlike the most reported works utilizing the alternating optimization techniques to alternatively obtain the transmit beamforming and phase shifts, the proposed DRL based algorithm obtains the joint design simultaneously as the output of the DRL neural network. Simulation results show that the proposed algorithm is not only able to learn from the environment and gradually improve its behavior, but also obtains the comparable performance compared with two state-of-the-art benchmarks. It is also observed that, appropriate neural network parameter settings will improve significantly the performance and convergence rate of the proposed algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Massive MIMO for next generation wireless systems
Larsson, E. G., Edfors, O., Tufvesson, F., & Marzetta, T. L. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6736761 · Cited by 6,779
Scaling Up MIMO: Opportunities and Challenges with Very Large Arrays
Rusek, F., Persson, D., Lau, B. K., Larsson, E. G., Marzetta, T. L., & Tufvesson, F. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.2178495 · Cited by 4,654
Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming
Wu, Q., & Zhang, R. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2936025 · Cited by 4,566
Scaling up MIMO: Opportunities and challenges with very large arrays
Rusek, F., Persson, D., Lau, B. K., Larsson, E. G., Marzetta, T. L., Edfors, O., Tufvesson, F., Print, P., Rusek, F., Persson, D., et al. (2013) · Cited by 4,089
Coding Metamaterials, Digital Metamaterials and Programmable Metamaterials
Cui, T. J., Qi, M. Q., Wan, X., Zhao, J., & Cheng, Q. (2014) · Light: Science & Applications · doi:10.1038/lsa.2014.99 · Cited by 3,801
Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication
Huang, C., Zappone, A., Alexandropoulos, G. C., Debbah, M., & Yuen, C. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2922609 · Cited by 3,761
Self-citationThe Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
Shi, Q., Razaviyayn, M., Luo, Z.-Q., & He, C. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2147784 · Cited by 2,129
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
A New Wireless Communication Paradigm through Software-Controlled Metasurfaces
Liaskos, C., Nie, S., Tsioliaridou, A., Pitsillides, A., Ioannidis, S., & Akyildiz, I. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700659 · Cited by 1,258
Machine Learning Paradigms for Next-Generation Wireless Networks
Jiang, C., Zhang, H., Ren, Y., Han, Z., Chen, K.-C., & Hanzo, L. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1500356wc · Cited by 1,095
Secure Wireless Communication via Intelligent Reflecting Surface
Cui, M., Zhang, G., & Zhang, R. (2019) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2919685 · Cited by 984
Beyond Massive MIMO: The Potential of Data Transmission With Large Intelligent Surfaces
Hu, S., Rusek, F., & Edfors, O. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2816577 · Cited by 892
Large Intelligent Surface-Assisted Wireless Communication Exploiting Statistical CSI
Han, Y., Tang, W., Jin, S., Wen, C.-K., & Ma, X. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2923997 · Cited by 880
Learning to Optimize: Training Deep Neural Networks for Interference Management
Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866382 · Cited by 874
Fifty Years of MIMO Detection: The Road to Large-Scale MIMOs
Yang, S., & Hanzo, L. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2475242 · Cited by 814
Secrecy Rate Maximization for Intelligent Reflecting Surface Assisted Multi-Antenna Communications
Shen, H., Xu, W., Gong, S., He, Z., & Zhao, C. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2924214 · Cited by 556
Deep-Learning-Based Millimeter-Wave Massive MIMO for Hybrid Precoding
Huang, H., Song, Y., Yang, J., Gui, G., & Adachi, F. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2893928 · Cited by 450
Transmission Through Large Intelligent Surfaces: A New Frontier in Wireless Communications
Basar, E. (2019) · 2019 European Conference on Networks and Communications (EuCNC) · doi:10.1109/eucnc.2019.8801961 · Cited by 364
Beyond Massive MIMO: The Potential of Positioning With Large Intelligent Surfaces
Hu, S., Rusek, F., & Edfors, O. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2795547 · Cited by 347
Beamforming Optimization for Intelligent Reflecting Surface with Discrete Phase Shifts
Wu, Q., & Zhang, R. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683145 · Cited by 323
Achievable Rate Maximization by Passive Intelligent Mirrors
Huang, C., Zappone, A., Debbah, M., & Yuen, C. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461496 · Cited by 303
Self-citationIndoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces
Huang, C., Alexandropoulos, G. C., Yuen, C., & Debbah, M. (2019) · 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815412 · Cited by 293
Self-citationMismar, F. B., Evans, B. L., & Alkhateeb, A. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2961332 · Cited by 285
Unsupervised Learning-Based Fast Beamforming Design for Downlink MIMO
Huang, H., Xia, W., Xiong, J., Yang, J., Zheng, G., & Zhu, X. (2019) · IEEE Access · doi:10.1109/access.2018.2887308 · Cited by 222
Beamforming Design for Large-Scale Antenna Arrays Using Deep Learning
Lin, T., & Zhu, Y. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2943466 · Cited by 212
Deep Learning for UL/DL Channel Calibration in Generic Massive MIMO Systems
Huang, C., Alexandropoulos, G. C., Zappone, A., Yuen, C., & Debbah, M. A. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761962 · Cited by 74
Self-citationZhou, F., Lu, G., Wen, M., Liang, Y., Chu, Z., & Wang, Y. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800439 · Cited by 45
Subcarrier Assignment Schemes Based on Q-Learning in Wideband Cognitive Radio Networks
Zhou, Y., Zhou, F., Wu, Y., Hu, R. Q., & Wang, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2953809 · Cited by 35
Research works printed but not linked: 12
- 10.1109/IEEECONF44664.2019.9048966 · doi:10.1109/ieeeconf44664.2019.9048966
- shafin, 2019, Self-tuning sectorization: Deep reinforcement learning meets broadcast beam optimization, arXiv 1906 06021
- basar, 2019, Reconfigurable intelligent surface-based index modulation: A new beyond MIMO paradigm for 6G, arXiv 1904 06704
- gao, 2020, Reconfigurable intelligent surface for miso systems with proportional rate constraints, Proc ICC, 1
- taha, 2019, Enabling large intelligent surfaces with compressive sensing and deep learning, arXiv 1904 10136
- goodfellow, 2016, Deep Learning
- huang, 2019, Holographic MIMO surfaces for 6G wireless networks: Opportunities, challenges, and trends, arXiv 1911 12296
- zhao, 2019, A survey of intelligent reflecting surfaces (IRSs): Towards 6G wireless communication networks, arXiv 1907 04789
- fu, 2019, Reconfigurable intelligent surface empowered downlink non-orthogonal multiple access, arXiv 1910 07361
- guo, 2019, Weighted sum-rate optimization for intelligent reflecting surface enhanced wireless networks, arXiv 1905 07920
- pan, 2019, Multicell MIMO communications relying on intelligent reflecting surface, arXiv 1907 10864
- nadeem, 2019, Asymptotic max-min SINR analysis of reconfigurable intelligent surface assisted MISO systems, arXiv 1903 08127
Cited by
Active RIS vs. Passive RIS: Which Will Prevail in 6G?
Zhang, Z., Dai, L., Chen, X., Liu, C., Yang, F., Schober, R., & Poor, H. V. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3231893 · Cited by 1,150
Simultaneously Transmitting and Reflecting (STAR) RIS Aided Wireless Communications
Mu, X., Liu, Y., Guo, L., Lin, J., & Schober, R. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3118225 · Cited by 896
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“By considering CSI variations [275], [55], [276] and stochastic task arrivals [85], [84], the dynamic”
BackgroundArtificial-Noise-Aided Secure MIMO Wireless Communications via Intelligent Reflecting Surface
Hong, S., Pan, C., Ren, H., Wang, K., & Nallanathan, A. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3024621 · Cited by 361
Machine Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Wireless Networks
Liu, X., Liu, Y., & Chen, Y. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041401 · Cited by 298
Metadata
- Authors
- Huang, C., Mo, R., & Yuen, C.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2020-08
- Volume
- 38
- Issue
- 8
- Pages
- 1839-1850
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3008014991
- Cited by
- 938
- References
- 32
- FWCI
- 48.27
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- A*STAR under its RIE2020 Advanced Manufacturing and Engineering (AME) Industry Alignment Fund–Pre Positioning (A19D6a0053)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.