The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
Toward Massive Machine Type Communications in Ultra-Dense Cellular IoT Networks: Current Issues and Machine Learning-Assisted Solutions
Open accessAbstract
The ever-increasing number of resource-constrained machine-type communication (MTC) devices is leading to the critical challenge of fulfilling diverse communication requirements in dynamic and ultra-dense wireless environments. Among different application scenarios that the upcoming 5G and beyond cellular networks are expected to support, such as enhanced mobile broadband (eMBB), massive machine type communications (mMTCs), and ultra-reliable and low latency communications (URLLCs), the mMTC brings the unique technical challenge of supporting a huge number of MTC devices in cellular networks, which is the main focus of this paper. The related challenges include quality of service (QoS) provisioning, handling highly dynamic and sporadic MTC traffic, huge signalling overhead, and radio access network (RAN) congestion. In this regard, this paper aims to identify and analyze the involved technical issues, to review recent advances, to highlight potential solutions and to propose new research directions. First, starting with an overview of mMTC features and QoS provisioning issues, we present the key enablers for mMTC in cellular networks. Along with the highlights on the inefficiency of the legacy random access (RA) procedure in the mMTC scenario, we then present the key features and channel access mechanisms in the emerging cellular IoT standards, namely, LTE-M and narrowband IoT (NB-IoT). Subsequently, we present a framework for the performance analysis of transmission scheduling with the QoS support along with the issues involved in short data packet transmission. Next, we provide a detailed overview of the existing and emerging solutions toward addressing RAN congestion problem, and then identify potential advantages, challenges, and use cases for the applications of emerging machine learning (ML) techniques in ultra-dense cellular networks. Out of several ML techniques, we focus on the application of low-complexity Q-learning approach in the mMTC scenario along with the recent advances toward enhancing its learning performance and convergence. Finally, we discuss some open research challenges and promising future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2444095 · Cited by 8,630
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332 · cited 1×
“In addition, Neural Networks (NNs) can be utilized to detect network intrusion and in this context, authors in [31] have provided a comprehensive review of ML and data mining techniques for intrusion detection in cyber analytic applications.”
BackgroundDeep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing
Li, H., Ota, K., & Dong, M. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700202 · Cited by 1,566
Effective capacity: A wireless link model for support of quality of service
Wu, D., & Negi, R. (2003) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2003.814353 · Cited by 1,472
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Single carrier FDMA for uplink wireless transmission
Myung, H., Lim, J., & Goodman, D. (2006) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2006.307304 · Cited by 1,236
Toward Massive, Ultrareliable, and Low-Latency Wireless Communication With Short Packets
Durisi, G., Koch, T., & Popovski, P. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2537298 · Cited by 1,154
Big IoT data analytics: Architecture, opportunities, and open research challenges
(2017) · IEEE Access · doi:10.1109/access.2017.2689040 · Cited by 980
Machine learning in wireless sensor networks: Algorithms, strategies, and applications
Alsheikh, M. A., Lin, S., Niyato, D., & Tan, H.-P. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2320099 · Cited by 965
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Ultra-Dense Networks: A Survey
Kamel, M., Hamouda, W., & Youssef, A. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2571730 · Cited by 919
Fadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810
A Primer on 3GPP Narrowband Internet of Things
Wang, Y.-P. E., Lin, X., Adhikary, A., Grovlen, A., Sui, Y., Blankenship, Y., Bergman, J., & Razaghi, H. S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600510cm · Cited by 795
Massive machine-type communications in 5g: physical and MAC-layer solutions
Bockelmann, C., Pratas, N., Nikopour, H., Au, K., Svensson, T., Stefanovic, C., Popovski, P., & Dekorsy, A. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7565189 · Cited by 748
IoT Security Techniques Based on Machine Learning: How Do IoT Devices Use AI to Enhance Security?
Xiao, L., Wan, X., Lu, X., Zhang, Y., & Wu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2825478 · Cited by 681
Security and Privacy for Cloud-Based IoT: Challenges
Zhou, J., Cao, Z., Dong, X., & Vasilakos, A. V. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600363cm · Cited by 652
Machine Learning Methods for Attack Detection in the Smart Grid
Ozay, M., Esnaola, I., Yarman Vural, F. T., Kulkarni, S. R., & Poor, H. V. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2404803 · Cited by 641
Toward ubiquitous massive accesses in 3GPP machine-to-machine communications
Lien, S.-Y., Chen, K.-C., & Lin, Y. (2011) · IEEE Communications Magazine · doi:10.1109/mcom.2011.5741148 · Cited by 606
Saleem, Y., Crespi, N., Rehmani, M. H., & Copeland, R. (2019) · IEEE Access · doi:10.1109/access.2019.2913984 · Cited by 604
Intelligent 5G: When Cellular Networks Meet Artificial Intelligence
Li, R., Zhao, Z., Zhou, X., Ding, G., Chen, Y., Wang, Z., & Zhang, H. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1600304wc · Cited by 601 · cited 5×
“Furthermore, authors in [16] recently introduced the fundamental concepts of AI and its relation with 5G candidate technologies.”
BackgroundMethodInfluentialLaya, A., Alonso, L., & Alonso-Zarate, J. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.111313.00244 · Cited by 574
Random access for machine-to-machine communication in LTE-advanced networks: issues and approaches
Hasan, M., Hossain, E., & Niyato, D. (2013) · IEEE Communications Magazine · doi:10.1109/mcom.2013.6525600 · Cited by 563
Liu, L., Larsson, E. G., Yu, W., Popovski, P., Stefanovic, C., & de Carvalho, E. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2844952 · Cited by 510
Advances in optimizing recurrent networks
Bengio, Y., Boulanger-Lewandowski, N., & Pascanu, R. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639349 · Cited by 469
Context-Aware Computing, Learning, and Big Data in Internet of Things: A Survey
Sezer, O. B., Dogdu, E., & Ozbayoglu, A. M. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2773600 · Cited by 453
Toward Massive Machine Type Cellular Communications
Dawy, Z., Saad, W., Ghosh, A., Andrews, J. G., & Yaacoub, E. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1500284wc · Cited by 452
Challenges in 5G: how to empower SON with big data for enabling 5G
Imran, A., & Zoha, A. (2014) · IEEE Network · doi:10.1109/mnet.2014.6963801 · Cited by 441
Green Industrial Internet of Things Architecture: An Energy-Efficient Perspective
Wang, K., Wang, Y., Sun, Y., Guo, S., & Wu, J. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.1600399cm · Cited by 433
Verma, S., Kawamoto, Y., Fadlullah, Z. M., Nishiyama, H., & Kato, N. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2694469 · Cited by 422
Artificial intelligence: foundations of computational agents
(2010) · Choice Reviews Online · doi:10.5860/choice.48-2130 · Cited by 415
Evaluation of machine learning classifiers for mobile malware detection
Narudin, F. A., Feizollah, A., Anuar, N. B., & Gani, A. (2016) · Soft Computing · doi:10.1007/s00500-014-1511-6 · Cited by 401
5G wireless access: requirements and realization
Dahlman, E., Mildh, G., Parkvall, S., Peisa, J., Sachs, J., Selén, Y., & Sköld, J. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6979985 · Cited by 401
Kato, N., Fadlullah, Z. M., Mao, B., Tang, F., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1600317wc · Cited by 400
Enabling technologies for green Internet of Things
Shaikh, F. K., Zeadally, S., & Exposito, E. (2017) · IEEE Systems Journal · doi:10.1109/jsyst.2015.2415194 · Cited by 382
Enabling Cognitive Smart Cities Using Big Data and Machine Learning: Approaches and Challenges
Mohammadi, M., & Al-Fuqaha, A. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700298 · Cited by 377
A Survey on Energy Internet: Architecture, Approach, and Emerging Technologies
Wang, K., Yu, J., Yu, Y., Qian, Y., Zeng, D., Guo, S., Xiang, Y., & Wu, J. (2018) · IEEE Systems Journal · doi:10.1109/jsyst.2016.2639820 · Cited by 374
Ghavimi, F., & Chen, H.-H. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2361626 · Cited by 348
Radio resource allocation in LTE-advanced cellular networks with M2M communications
Zheng, K., Hu, F., Wang, W., Xiang, W., & Döhler, M. (2012) · IEEE Communications Magazine · doi:10.1109/mcom.2012.6231296 · Cited by 331
M2M Service Platforms: Survey, Issues, and Enabling Technologies
Kim, J., Lee, J., Kim, J., & Yun, J. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.100713.00203 · Cited by 321
Waveform Contenders for 5G - Suitability for Short Packet and Low Latency Transmissions
Schaich, F., Wild, T., & Chen, Y. (2014) · 2014 IEEE 79th Vehicular Technology Conference (VTC Spring) · doi:10.1109/vtcspring.2014.7023145 · Cited by 307
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · ACM SIGPLAN Notices · doi:10.1145/2644865.2541967 · Cited by 281
Ultra-dense networks in millimeter-wave frequencies
Baldemair, R., Irnich, T., Balachandran, K., et al. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7010535 · Cited by 262
The challenges of M2M massive access in wireless cellular networks
Biral, A., Centenaro, M., Zanella, A., Vangelista, L., & Zorzi, M. (2015) · Digital Communications and Networks · doi:10.1016/j.dcan.2015.02.001 · Cited by 262
Chen, X., Wu, J., Cai, Y., Zhang, H., & Chen, T. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2393496 · Cited by 250
Sharma, S. K., Bogale, T. E., Le, L. B., Chatzinotas, S., Wang, X., & Ottersten, B. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2773628 · Cited by 248
Self-citationBig Data Meet Cyber-Physical Systems: A Panoramic Survey
Atat, R., Liu, L., Wu, J., Li, G., Ye, C., & Yang, Y. (2018) · IEEE Access · doi:10.1109/access.2018.2878681 · Cited by 247
Live Data Analytics With Collaborative Edge and Cloud Processing in Wireless IoT Networks
Sharma, S. K., & Wang, X. (2017) · IEEE Access · doi:10.1109/access.2017.2682640 · Cited by 241 · cited 9×
“In this regard, collaborative processing between these two platforms will be a promising approach to address various issues including latency minimization [78], dynamic spectrum sharing [79], peak traffic management and data offloading in ultra-dense IoT networks [19].”
BackgroundMethodInfluentialSelf-citationAchieving Sustainable Ultra-Dense Heterogeneous Networks for 5G
An, J., Yang, K., Wu, J., Ye, N., Guo, S., & Liao, Z. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1700410 · Cited by 238
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., & Kawsar, F. (2015) · Proceedings of the 2015 International Workshop on Internet of Things towards Applications · doi:10.1145/2820975.2820980 · Cited by 228
Short-Packet Communications Over Multiple-Antenna Rayleigh-Fading Channels
Durisi, G., Koch, T., Ostman, J., Polyanskiy, Y., & Yang, W. (2016) · IEEE Transactions on Communications · doi:10.1109/tcomm.2015.2511087 · Cited by 206
Overview of 3GPP Release 14 Enhanced NB-IoT
Hoglund, A., Lin, X., Liberg, O., Behravan, A., Yavuz, E. A., Van Der Zee, M., Sui, Y., Tirronen, T., Ratilainen, A., & Eriksson, D. (2017) · IEEE Network · doi:10.1109/mnet.2017.1700082 · Cited by 206
A Survey of Enabling Technologies of Low Power and Long Range Machine-to-Machine Communications
Wang, H., & Fapojuwo, A. O. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2721379 · Cited by 197
Data-Driven Computing and Caching in 5G Networks: Architecture and Delay Analysis
Chen, M., Qian, Y., Hao, Y., Li, Y., & Song, J. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700216 · Cited by 195
Narrowband Wireless Access for Low-Power Massive Internet of Things: A Bandwidth Perspective
Yang, W., Wang, M., Zhang, J., Zou, J., Hua, M., Xia, T., & You, X. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1600298 · Cited by 190
Leveraging LSTM Networks for Attack Detection in Fog-to-Things Communications
Diro, A., & Chilamkurti, N. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701270 · Cited by 190
Radio access for ultra-reliable and low-latency 5G communications
Johansson, N. A., Wang, Y.-P. E., Eriksson, E., & Hessler, M. (2015) · 2015 IEEE International Conference on Communication Workshop (ICCW) · doi:10.1109/iccw.2015.7247338 · Cited by 188
Wang, X., Li, X., & Leung, V. C. M. (2015) · IEEE Access · doi:10.1109/access.2015.2467174 · Cited by 187
Self-citationAn overview of 3GPP enhancements on machine to machine communications
Rico-Alvarino, A., Vajapeyam, M., Xu, H., Wang, X., Blankenship, Y., Bergman, J., Tirronen, T., & Yavuz, E. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7497761 · Cited by 185
Self-citationKar, S., Moura, J. M. F., & Poor, H. V. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2241057 · Cited by 175
Uplink Scheduling and Link Adaptation for Narrowband Internet of Things Systems
Yu, C., Yu, L., Wu, Y., He, Y., & Lu, Q. (2017) · IEEE Access · doi:10.1109/access.2017.2664418 · Cited by 175
Glorennec, P. Y., & Jouffe, L. (2002) · Proceedings of 6th International Fuzzy Systems Conference · doi:10.1109/fuzzy.1997.622790 · Cited by 169
Han, F., Zhao, S., Zhang, L., & Wu, J. (2016) · IEEE Access · doi:10.1109/access.2016.2598813 · Cited by 167
LTE/LTE-A Random Access for Massive Machine-Type Communications in Smart Cities
Ali, M. S., Hossain, E., & Kim, D. I. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600215cm · Cited by 167
Enabling Deep Learning on IoT Devices
Tang, J., Sun, D., Liu, S., & Gaudiot, J.-L. (2017) · Computer · doi:10.1109/mc.2017.3641648 · Cited by 164
Artificial Intelligence: Foundations of Computational Agents
Poole, D. L., & Mackworth, A. K. (2017) · Cambridge University Press eBooks · doi:10.1017/9781108164085 · Cited by 158
Chu, M., Li, H., Liao, X., & Cui, S. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872440 · Cited by 153
Wu, C., Ohzahata, S., & Kato, T. (2013) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2013.2273945 · Cited by 152
A Survey of Traffic Issues in Machine-to-Machine Communications Over LTE
Soltanmohammadi, E., Ghavami, K., & Naraghi‐Pour, M. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2533541 · Cited by 145
Machine-to-Machine Communications in Ultra-Dense Networks—A Survey
Chen, S., Ma, R., Chen, H., Zhang, H., Meng, W., & Liu, J. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2678518 · Cited by 134
LSTM-Based Analysis of Industrial IoT Equipment
Zhang, W., Guo, W., Liu, X., Liu, Y., Zhou, J., Li, B., Lu, Q., & Yang, S. (2018) · IEEE Access · doi:10.1109/access.2018.2825538 · Cited by 134
In-Situ AI: Towards Autonomous and Incremental Deep Learning for IoT Systems
Song, M., Zhong, K., Zhang, J., Hu, Y., Liu, D., Zhang, W., Wang, J., & Li, T. (2018) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00018 · Cited by 131
Narrowband IoT Data Transmission Procedures for Massive Machine-Type Communications
Andrés-Maldonado, P., Ameigeiras, P., Prados-Garzon, J., Navarro‐Ortiz, J., & Lopez-Soler, J. M. (2017) · IEEE Network · doi:10.1109/mnet.2017.1700081 · Cited by 130
Comparing exploration strategies for Q-learning in random stochastic mazes
Tijsma, A. D., Drugan, M. M., & Wiering, M. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849366 · Cited by 128
Reservoir Computing Meets Smart Grids: Attack Detection Using Delayed Feedback Networks
Hamedani, K., Liu, L., Atat, R., Wu, J., & Yi, Y. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2769106 · Cited by 122
Learning How to Communicate in the Internet of Things: Finite Resources and Heterogeneity
Park, T., Abuzainab, N., & Saad, W. (2016) · IEEE Access · doi:10.1109/access.2016.2615643 · Cited by 121
A Mobile Offloading Game Against Smart Attacks
Xiao, L., Xie, C., Chen, T., Dai, H., & Poor, H. V. (2016) · IEEE Access · doi:10.1109/access.2016.2565198 · Cited by 116
Cheng, R., Chen, J., Chen, D.-W., & Wei, C. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2015.2398858 · Cited by 109
(2000) · Applied Physics Letters · doi:10.1162/jmlr.2003.4.6.1039 · Cited by 108
Elsaadany, M., Ali, A., & Hamouda, W. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2728013 · Cited by 107
Energy-efficient ConvNets through approximate computing
Moons, B., Brabandere, B. D., Gool, L. V., & Verhelst, M. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477614 · Cited by 103
Rahimiyan, M., & Mashhadi, H. R. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2044174 · Cited by 96
Code-expanded random access for machine-type communications
Pratas, N. K., Thomsen, H., Stefanović, Č., et al. (2012) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2012.6477838 · Cited by 96
A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
Wang, W., Kwasinski, A., Niyato, D. T., & Han, Z. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2539923 · Cited by 91
Collaborative Distributed Q-Learning for RACH Congestion Minimization in Cellular IoT Networks
Sharma, S. K., & Wang, X. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2896929 · Cited by 88
Self-citationOn the Road to 5G: Comparative Study of Physical Layer in MTC Context
Medjahdi, Y., Traverso, S., Gerzaguet, R., Shaïek, H., Zayani, R., Demmer, D., Zakaria, R., Doré, J., Mabrouk, M. B., Ruyet, D. L., et al. (2017) · IEEE Access · doi:10.1109/access.2017.2774002 · Cited by 80
Self-Learning Cloud Controllers: Fuzzy Q-Learning for Knowledge Evolution
Jamshidi, P., Sharifloo, A. M., Pahl, C., Metzger, A., & Estrada, G. G. (2015) · International Conference on Cloud and Autonomic Computing (ICCAC) · doi:10.1109/iccac.2015.35 · Cited by 77
Classification of LTE Uplink Scheduling Techniques: An M2M Perspective
Mehaseb, M. A., Gadallah, Y., Elhamy, A., & El‐Hennawy, H. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2504182 · Cited by 76
Application of reinforcement learning to medium access control for wireless sensor networks
Chu, Y., Koşunalp, S., Mitchell, P., Grace, D., & Clarke, T. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.08.004 · Cited by 72
Optimizing M2M Communications and Quality of Services in the IoT for Sustainable Smart Cities
Huang, J., Xing, C.-C., Shin, S. Y., et al. (2017) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2017.2702589 · Cited by 70
Efficient small data access for machine-type communications in LTE
Andreev, S. D., Larmo, A., Gerasimenko, M., et al. (2013) · International Conference on Communications · doi:10.1109/icc.2013.6655105 · Cited by 67
A Multiagent Q-Learning-Based Optimal Allocation Approach for Urban Water Resource Management System
Ni, J., Liu, M., Ren, L., & Yang, S. X. (2013) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2229978 · Cited by 63
Shah, K., & Kumar, M. (2007) · doi:10.1109/mobhoc.2007.4428658 · Cited by 59
Context-aware networking and communications: Part 1 [Guest Editorial]
Wu, J., Bisio, I., Gniady, C., Hossain, E., Valla, M., & Li, H. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6829939 · Cited by 55
LTE-M Evolution Towards 5G Massive MTC
Ratasuk, R., Mangalvedhe, N. R., Bhatoolaul, D., & Ghosh, A. (2017) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2017.8269112 · Cited by 54
Dynamic fuzzy Q-learning for handover parameters optimization in 5G multi-tier networks
Wu, J. H., Liu, J., Huang, Z., & Zheng, S. (2015) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp.2015.7341220 · Cited by 51
Mai, L., Dao, N., & Park, M. (2018) · Sensors · doi:10.3390/s18092830 · Cited by 47
Compressive coded random access for massive MTC traffic in 5G systems
Wunder, G., Stefanović, Č., Popovski, P., & Thiele, L. (2015) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2015.7421050 · Cited by 45
Qolomany, B., Al‐Fuqaha, A., Benhaddou, D., & Gupta, A. K. (2017) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-smartcity-dss.2017.7 · Cited by 44
Comparison of Collision-Free and Contention-Based Radio Access Protocols for the Internet of Things
Centenaro, M., Vangelista, L., Saur, S., Weber, A. C., & Braun, V. (2017) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2707074 · Cited by 41
Latency Minimization in Wireless IoT Using Prioritized Channel Access and Data Aggregation
Bhandari, S., Sharma, S. K., & Wang, X. (2017) · Globecom · doi:10.1109/glocom.2017.8255038 · Cited by 40
Self-citationA Deep Learning Approach for Privacy Preservation in Assisted Living
Psychoula, I., Merdivan, E., Singh, D., Chen, L., Chen, F., Hanke, S., Kropf, J., Holzinger, A., & Geist, M. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480247 · Cited by 39
Uplink Transmission Design with Massive Machine Type Devices in Tactile Internet
She, C., Yang, C., & Quek, T. Q. S. (2016) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2016.7849072 · Cited by 39
Application of Q-Learning for RACH Access to Support M2M Traffic over a Cellular Network
Bello, L. M., Mitchell, P., & Grace, D. (2014) · European Wireless Conference · Cited by 37
Combining Model-Based $Q$ -Learning With Structural Knowledge Transfer for Robot Skill Learning
Deng, Z., Guan, H., Huang, R., Liang, H., Zhang, L., & Zhang, J. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2718938 · Cited by 37
Efficient embedded learning for IoT devices
Venkataramani, S., Roy, K., & Raghunathan, A. (2016) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428029 · Cited by 36
Device Grouping for Fast and Efficient Channel Access in IEEE 802.11ah Based IoT Networks
Bhandari, S., Sharma, S. K., & Wang, X. (2018) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2018.8403521 · Cited by 25
Self-citationDistributed Caching Enabled Peak Traffic Reduction in Ultra-Dense IoT Networks
Sharma, S. K., & Wang, X. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2810211 · Cited by 24
Self-citationLeveraging Edge Computing through Collaborative Machine Learning
Portelli, K., & Anagnostopoulos, C. B. (2017) · International Conference on Future Internet of Things and Cloud Workshops (FiCloudW) · doi:10.1109/ficloudw.2017.72 · Cited by 22
Impact of M2M traffic on human-type communication users on the LTE uplink channel
de Andrade, T. P. C., Astudillo, C. A., & da Fonseca, N. L. S. (2015) · IEEE Latin-American Conference on Communications · doi:10.1109/latincom.2015.7430142 · Cited by 21
Physical layer aspects of wireless IoT
Sharma, S. K., Bogale, T. E., Chatzinotas, S., Wang, X., & Le, L. B. (2016) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2016.7600919 · Cited by 19
Self-citationAccess control of MTC devices using reinforcement learning approach
Moon, J., & Lim, Y. (2017) · International Conference on Information Networking · doi:10.1109/icoin.2017.7899576 · Cited by 19
Novel RAT selection mechanism based on Hopfield neural networks
Rakovic, V., & Gavrilovska, L. M. (2010) · International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT) · doi:10.1109/icumt.2010.5676635 · Cited by 14
Model based path planning using Q-Learning
Sharma, A., Gupta, K., Kumar, A., Sharma, A., & Kumar, R. (2017) · IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2017.7915468 · Cited by 14
Fuzzy Q-learning-based user-centric backhaul-aware user cell association scheme
Pervez, F., Jaber, M., Qadir, J., Younis, M. S., & Imran, M. A. (2017) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc.2017.7986564 · Cited by 13
Reinforcement learning techniques for Outer Loop Link Adaptation in 4G/5G systemsPreprint
Pulliyakode, S. K., & Kalyani, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.00994 · Cited by 10
A New Link Adaptation Method to Mitigate SINR Mismatch in Ultra-Dense Small Cell LTE Networks
Park, Y., Heo, J., Chung, W., Weon, S., Choi, S., & Hong, D. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2775635 · Cited by 8
A Scheme to Smooth Aggregated Traffic from Sensors with Periodic Reports
Oh, S., & Jang, J. W. (2017) · Sensors · doi:10.3390/s17030503 · Cited by 7
Cooperative sensing delay minimization in cloud-assisted DSA networks
Sharma, S. K., & Wang, X. (2017) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2017.8292538 · Cited by 3
Self-citation
Cited by
On the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
Satellite Communications in the New Space Era: A Survey and Future Challenges
Kodheli, O., Lagunas, E., Maturo, N., Sharma, S. K., Shankar, B., Montoya, J. F. M., Duncan, J. C. M., Spano, D., Chatzinotas, S., Kisseleff, S., et al. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3028247 · Cited by 1,524
Self-citationEnabling Massive IoT Toward 6G: A Comprehensive Survey
Guo, F., Yu, F. R., Zhang, H., Li, X., Ji, H., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063686 · Cited by 701
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
Self-citation6G Wireless Communications Networks: A Comprehensive Survey
Alsabah, M., Naser, M. A., Mahmmod, B. M., Abdulhussain, S. H., Eissa, M. R., Al-Baidhani, A., Noordin, N. K., Sait, S. M., Al-Utaibi, K. A., & Hashim, F. (2021) · IEEE Access · doi:10.1109/access.2021.3124812 · Cited by 575
Metadata
- Authors
- Sharma, S. K., & Wang, X.
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2020
- Volume
- 22
- Issue
- 1
- Pages
- 426-471
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W2887019724
- Cited by
- 427
- References
- 130
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.