The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming Design
Open accessAbstract
Wireless communication in the TeraHertz band (0.1--10 THz) is envisioned as one of the key enabling technologies for the future sixth generation (6G) wireless communication systems scaled up beyond massive multiple input multiple output (Massive-MIMO) technology. However, very high propagation attenuations and molecular absorptions of THz frequencies often limit the signal transmission distance and coverage range. Benefited from the recent breakthrough on the reconfigurable intelligent surfaces (RIS) for realizing smart radio propagation environment, we propose a novel hybrid beamforming scheme for the multi-hop RIS-assisted communication networks to improve the coverage range at THz-band frequencies. Particularly, multiple passive and controllable RISs are deployed to assist the transmissions between the base station (BS) and multiple single-antenna users. We investigate the joint design of digital beamforming matrix at the BS and analog beamforming matrices at the RISs, by leveraging the recent advances in deep reinforcement learning (DRL) to combat the propagation loss. To improve the convergence of the proposed DRL-based algorithm, two algorithms are then designed to initialize the digital beamforming and the analog beamforming matrices utilizing the alternating optimization technique. Simulation results show that our proposed scheme is able to improve 50\% more coverage range of THz communications compared with the benchmarks. Furthermore, it is also shown that our proposed DRL-based method is a state-of-the-art method to solve the NP-hard beamforming problem, especially when the signals at RIS-assisted THz communication networks experience multiple hops.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985
Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network
Wu, Q., & Zhang, R. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900107 · Cited by 4,308
Coding Metamaterials, Digital Metamaterials and Programmable Metamaterials
Cui, T. J., Qi, M. Q., Wan, X., Zhao, J., & Cheng, Q. (2014) · Light: Science & Applications · doi:10.1038/lsa.2014.99 · Cited by 3,801 · cited 1×
“RISs have aroused widely public concern and interesting recently, but most of the reported works mainly focus on the optimal RIS phase shifts and beamforming design to improve the performance of wireless communication [24], [25], [29], [32], [33], [39].”
BackgroundReconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication
Huang, C., Zappone, A., Alexandropoulos, G. C., Debbah, M., & Yuen, C. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2922609 · Cited by 3,761
Self-citationWireless Communications Through Reconfigurable Intelligent Surfaces
Basar, E., Di Renzo, M., De Rosny, J., Debbah, M., Alouini, M.-S., & Zhang, R. (2019) · IEEE Access · doi:10.1109/access.2019.2935192 · Cited by 3,394
Self-citationRappaport, T. S., Xing, Y., Kanhere, O., Ju, S., Madanayake, A., Mandal, S., Alkhateeb, A., & Trichopoulos, G. C. (2019) · IEEE Access · doi:10.1109/access.2019.2921522 · Cited by 2,617 · cited 6×
“As mentioned before, communications over the THz band are very different with the low frequency band communications, the transmitted signal suffers from the severe path attenuations [2], [5], [14].”
BackgroundInfluentialA review of metasurfaces: physics and applications
Chen, H.-T., Taylor, A. J., & Yu, N. (2016) · Reports on Progress in Physics · doi:10.1088/0034-4885/79/7/076401 · Cited by 2,551
The Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
Self-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Self-citationHolographic MIMO Surfaces for 6G Wireless Networks: Opportunities, Challenges, and Trends
Huang, C., Hu, S., Alexandropoulos, G. C., Zappone, A., Yuen, C., Zhang, R., Renzo, M. D., & Debbah, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900534 · Cited by 1,342
Self-citationA New Wireless Communication Paradigm through Software-Controlled Metasurfaces
Liaskos, C., Nie, S., Tsioliaridou, A., Pitsillides, A., Ioannidis, S., & Akyildiz, I. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700659 · Cited by 1,258
Machine Learning Paradigms for Next-Generation Wireless Networks
Jiang, C., Zhang, H., Ren, Y., Han, Z., Chen, K.-C., & Hanzo, L. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1500356wc · Cited by 1,095
Tariq, F., Khandaker, M., Wong, K.-K., Imran, M., Bennis, M., & Debbah, M. (2019) · arXiv · doi:10.48550/arxiv.1902.06700 · Cited by 1,014
Self-citationTariq, F., Khandaker, M. R. A., Wong, K.-K., Imran, M. A., Bennis, M., & Debbah, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900488 · Cited by 1,014
Self-citationSecure Wireless Communication via Intelligent Reflecting Surface
Cui, M., Zhang, G., & Zhang, R. (2019) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2919685 · Cited by 984
Huang, C., Mo, R., & Yuen, C. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3000835 · Cited by 938
Self-citationIntelligent Reflecting Surface: Practical Phase Shift Model and Beamforming Optimization
Abeywickrama, S., Zhang, R., & Yuen, C. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148961 · Cited by 901
Self-citationBeyond Massive MIMO: The Potential of Data Transmission With Large Intelligent Surfaces
Hu, S., Rusek, F., & Edfors, O. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2816577 · Cited by 892
Large Intelligent Surface-Assisted Wireless Communication Exploiting Statistical CSI
Han, Y., Tang, W., Jin, S., Wen, C.-K., & Ma, X. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2923997 · Cited by 880
Dai, L., Wang, B., Wang, M., Yang, X., Tan, J., Bi, S., Xu, S., Yang, F., Chen, Z., Renzo, M. D., et al. (2020) · IEEE Access · doi:10.1109/access.2020.2977772 · Cited by 878
Reconfigurable Intelligent Surface-Based Index Modulation: A New Beyond MIMO Paradigm for 6G
Basar, E. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2971486 · Cited by 839
Wu, Q., & Zhang, R. (2018) · 2018 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2018.8647620 · Cited by 812
Cascaded Channel Estimation for Large Intelligent Metasurface Assisted Massive MIMO
He, Z.-Q., & Yuan, X. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2948632 · Cited by 782
Enabling Large Intelligent Surfaces With Compressive Sensing and Deep Learning
Taha, A., Alrabeiah, M., & Alkhateeb, A. (2021) · IEEE Access · doi:10.1109/access.2021.3064073 · Cited by 754
Channel Estimation for RIS-Empowered Multi-User MISO Wireless Communications
Wei, L., Huang, C., Alexandropoulos, G. C., Yuen, C., Zhang, Z., & Debbah, M. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3063236 · Cited by 704
Self-citationA programmable metasurface with dynamic polarization, scattering and focusing control
Yang, H., Cao, X., Yang, F., Gao, J., Xu, S., Li, M., Chen, X., Zhao, Y., Zheng, Y., & Li, S. (2016) · Scientific Reports · doi:10.1038/srep35692 · Cited by 693
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680
Bjornson, E., Bengtsson, M., & Ottersten, B. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2312183 · Cited by 606
Secrecy Rate Maximization for Intelligent Reflecting Surface Assisted Multi-Antenna Communications
Shen, H., Xu, W., Gong, S., He, Z., & Zhao, C. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2924214 · Cited by 556
Han, C., Bicen, A. O., & Akyildiz, I. F. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2014.2386335 · Cited by 489
Combating the Distance Problem in the Millimeter Wave and Terahertz Frequency Bands
Akyildiz, I. F., Han, C., & Nie, S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700928 · Cited by 465
An Overview of Signal Processing Techniques for Terahertz Communications
Sarieddeen, H., Alouini, M.-S., & Al-Naffouri, T. Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3100811 · Cited by 458
Deep-Learning-Based Millimeter-Wave Massive MIMO for Hybrid Precoding
Huang, H., Song, Y., Yang, J., Gui, G., & Adachi, F. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2893928 · Cited by 450
Next Generation Terahertz Communications: A Rendezvous of Sensing, Imaging, and Localization
Sarieddeen, H., Saeed, N., Al-Naffouri, T. Y., & Alouini, M.-S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900698 · Cited by 432
Transmission Through Large Intelligent Surfaces: A New Frontier in Wireless Communications
Basar, E. (2019) · 2019 European Conference on Networks and Communications (EuCNC) · doi:10.1109/eucnc.2019.8801961 · Cited by 364
Artificial-Noise-Aided Secure MIMO Wireless Communications via Intelligent Reflecting Surface
Hong, S., Pan, C., Ren, H., Wang, K., & Nallanathan, A. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3024621 · Cited by 361
Indoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces
Huang, C., Alexandropoulos, G. C., Yuen, C., & Debbah, M. (2019) · 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815412 · Cited by 293
Self-citationNing, B., Chen, Z., Chen, W., Du, Y., & Fang, J. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3052074 · Cited by 292
Mismar, F. B., Evans, B. L., & Alkhateeb, A. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2961332 · Cited by 285
Propagation Modeling for Wireless Communications in the Terahertz Band
Han, C., & Chen, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700898 · Cited by 255
Deep Deterministic Policy Gradient for Urban Traffic Light ControlPreprint
Casas, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09035 · Cited by 240
Unsupervised Learning-Based Fast Beamforming Design for Downlink MIMO
Huang, H., Xia, W., Xiong, J., Yang, J., Zheng, G., & Zhu, X. (2019) · IEEE Access · doi:10.1109/access.2018.2887308 · Cited by 222
Beamforming Design for Large-Scale Antenna Arrays Using Deep Learning
Lin, T., & Zhu, Y. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2943466 · Cited by 212
Unsupervised Learning for Passive Beamforming
Gao, J., Zhong, C., Chen, X., Lin, H., & Zhang, Z. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2020.2965532 · Cited by 211
Self-citationSecure Transmission for Intelligent Reflecting Surface-Assisted mmWave and Terahertz Systems
Qiao, J., & Alouini, M.-S. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2020.3003400 · Cited by 175
Q-PrOP: Sample-efficient policy gradient with an off-policy critic
Gu, S., Lillicrap, T., Ghahramani, Z., Turner, R. E., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.17863/cam.21294 · Cited by 174
Terahertz Communications (TeraCom): Challenges and Impact on 6G Wireless SystemsPreprint
Han, C. Z., Wu, Y., Chen, Z., & Wang, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.06040 · Cited by 163
MISO Wireless Communication Systems via Intelligent Reflecting Surfaces
Yu, X., Xu, D., & Schober, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12199 · Cited by 160
Ma, X., Chen, Z., Chen, W., Li, Z., Chi, Y., Han, C. Z., & Li, S. (2020) · IEEE Access · doi:10.1109/access.2020.2994100 · Cited by 141
Distance-Aware Bandwidth-Adaptive Resource Allocation for Wireless Systems in the Terahertz Band
Han, C. Z., & Akyildiz, I. F. (2016) · IEEE Transactions on Terahertz Science and Technology · doi:10.1109/tthz.2016.2569460 · Cited by 137
Alexandropoulos, G. C., Lerosey, G., Debbah, M. A., & Fink, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11136 · Cited by 118
Self-citationBeamforming Design for Multiuser Transmission Through Reconfigurable Intelligent Surface
Yang, Z., Xu, W., Huang, C., Shi, J., & Shikh‐Bahaei, M. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3028309 · Cited by 118
Self-citationParallel Factor Decomposition Channel Estimation in RIS-Assisted Multi-User MISO Communication
Wei, L., Huang, C., Alexandropoulos, G. C., & Yuen, C. (2020) · IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) · doi:10.1109/sam48682.2020.9104305 · Cited by 111
Self-citationPrecoderNet: Hybrid Beamforming for Millimeter Wave Systems With Deep Reinforcement Learning
Wang, Q., Feng, K., Li, X., et al. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2020.3001121 · Cited by 91
Channel Estimation and Transmission for Intelligent Reflecting Surface Assisted THz Communications
Ning, B., Chen, Z., Chen, W., & Du, Y. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9149153 · Cited by 80
Nie, S., Jornet, J. M., & Akyildiz, I. F. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683394 · Cited by 69
An Interpretable Neural Network for Configuring Programmable Wireless Environments
Liaskos, C., Tsioliaridou, A., Nie, S., Pitsillides, A., Ioannidis, S., & Akyildiz, I. F. (2019) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815428 · Cited by 65
Self-Tuning Sectorization: Deep Reinforcement Learning Meets Broadcast Beam Optimization
Shafin, R., Chen, H., Nam, Y., Hur, S., Park, J.-H., Zhang, J., Reed, J. H., & Liu, L. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2979446 · Cited by 55
A scalable massive MIMO array architecture based on common modules
Puglielli, A., Narevsky, N., Lu, P., Courtade, T. A., Wright, G., Nikolić, B., & Alon, E. (2015) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2015.7247359 · Cited by 37
Coverage and achievable rate analysis for indoor terahertz wireless networks
Moldovan, A., Karunakaran, P., Akyildiz, I. F., & Gerstacker, W. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996402 · Cited by 35
Deep Kernel Learning-Based Channel Estimation in Ultra-Massive MIMO Communications at 0.06-10 THz
Nie, S., & Akyildiz, I. F. (2019) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps45667.2019.9024624 · Cited by 23
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2018) · arXiv · doi:10.48550/arxiv.1810.07862 · Cited by 17
Cited by
Terahertz Band Communication: An Old Problem Revisited and Research Directions for the Next Decade
Akyildiz, I. F., Han, C., Hu, Z., Nie, S., & Jornet, J. M. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3171800 · Cited by 678
Xu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Self-citationAn Overview of Signal Processing Techniques for Terahertz Communications
Sarieddeen, H., Alouini, M.-S., & Al-Naffouri, T. Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3100811 · Cited by 458
Energy-Efficient Wireless Communications With Distributed Reconfigurable Intelligent Surfaces
Yang, Z., Chen, M., Saad, W., Xu, W., Shikh-Bahaei, M., Poor, H. V., & Cui, S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3098632 · Cited by 350
Self-citationGong, T., Gavriilidis, P., Ji, R., Huang, C., Alexandropoulos, G. C., Wei, L., Zhang, Z., Debbah, M., Poor, H. V., & Yuen, C. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3309529 · Cited by 328
Self-citation
Metadata
- Authors
- Huang, C., Yang, Z., Alexandropoulos, G. C., Xiong, K., Wei, L., Yuen, C., Zhang, Z., & Debbah, M.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-06
- Volume
- 39
- Issue
- 6
- Pages
- 1663-1677
- ISSN
- 2331-8422 (ISSN-L)
- 0733-8716
- 1558-0008
- OpenAlex
- W3158743991
- Cited by
- 430
- References
- 69
- Type
- posted content
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.