The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things
Abstract
Cognitive networks (CNs) are one of the key enablers for the Internet of Things (IoT), where CNs will play an important role in the future Internet in several application scenarios, such as healthcare, agriculture, environment monitoring, and smart metering. However, the current low packet transmission efficiency of IoT faces a problem of the crowded spectrum for the rapidly increasing popularities of various wireless applications. Hence, the IoT that uses the advantages of cognitive technology, namely the cognitive radio-based IoT (CIoT), is a promising solution for IoT applications. A major challenge in CIoT is the packet transmission efficiency using CNs. Therefore, a new Q-learning-based transmission scheduling mechanism using deep learning for the CIoT is proposed to solve the problem of how to achieve the appropriate strategy to transmit packets of different buffers through multiple channels to maximize the system throughput. A Markov decision process-based model is formulated to describe the state transformation of the system. A relay is used to transmit packets to the sink for the other nodes. To maximize the system utility in different system states, the reinforcement learning method, i.e., the Q learning algorithm, is introduced to help the relay to find the optimal strategy. In addition, the stacked auto-encoders deep learning model is used to establish the mapping between the state and the action to accelerate the solution of the problem. Finally, the experimental results demonstrate that the new action selection method can converge after a certain number of iterations. Compared with other algorithms, the proposed method can better transmit packets with less power consumption and packet loss.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970 · cited 1×
“where Cp is a constant greater than 0 [53].”
BackgroundFinite-state Markov channel-a useful model for radio communication channels
Wang, H. S., & Moayeri, N. (1995) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.350282 · Cited by 1,647
Disease Prediction by Machine Learning Over Big Data From Healthcare Communities
Chen, M., Hao, Y., Hwang, K., Wang, L., & Wang, L. (2017) · IEEE Access · doi:10.1109/access.2017.2694446 · Cited by 1,311 · cited 1×
“E-commerce, medical device [9], [10], virtual reality and aug-”
BackgroundDeep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning
Huang, W., Song, G., Hong, H., & Xie, K. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2311123 · Cited by 1,139
Cognitive internet of things: A new paradigm beyond connection
Wu, Q., Ding, G., Xu, Y., Feng, S., Du, Z., Wang, J., & Long, K. (2014) · IEEE Internet of Things Journal · doi:10.1109/jiot.2014.2311513 · Cited by 550
Evolution of wireless sensor networks towards the Internet of Things: A survey
Mainetti, L., Patrono, L., & Vilei, A. (2011) · AIRUS · Cited by 483
A Deep Learning Network Approach to ab initio Protein Secondary Structure Prediction
Spencer, M., Eickholt, J., & Cheng, J. (2015) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2014.2343960 · Cited by 297
Wei, Q., Liu, D., & Shi, G. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2361485 · Cited by 230
Image recognition based on deep learning
Wu, M., & Chen, L. (2015) · Chinese Automation Congress · doi:10.1109/cac.2015.7382560 · Cited by 180
Multimedia cloud transmission and storage system based on internet of things
Yang, J., He, S., Lin, Y., & Lv, Z. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2967-9 · Cited by 158
A 5G Cognitive System for Healthcare
Chen, M., Yang, J., Hao, Y., Mao, S., & Hwang, K. (2017) · Big Data and Cognitive Computing · doi:10.3390/bdcc1010002 · Cited by 158
Wireless sensors networks for Internet of Things
Khalil, N., Abid, M. R., Benhaddou, D., & Gerndt, M. (2014) · International Conference on Intelligent Sensors, Sensor Networks and Information Processing · doi:10.1109/issnip.2014.6827681 · Cited by 157
When Cognitive Radio meets the Internet of Things?
Khan, A. A., Rehmani, M. H., & Rachedi, A. (2016) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc.2016.7577103 · Cited by 123
Distributed Auctions for Task Assignment and Scheduling in Mobile Crowdsensing Systems
Duan, Z., Li, W., & Cai, Z. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.121 · Cited by 122
A Low-Power and Portable Biomedical Device for Respiratory Monitoring with a Stable Power Source
Yang, J., Chen, B., Zhou, J., & Lv, Z. (2015) · Sensors · doi:10.3390/s150819618 · Cited by 120
A Study on Application-Aware Scheduling in Wireless Networks
Zheng, X., Cai, Z., Li, J., & Gao, H. (2016) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2016.2613529 · Cited by 103
Maghsudi, S., & Stańczak, S. (2015) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2015.2423691 · Cited by 100
Zhu, J., Song, Y., Jiang, D., & Song, H. (2016) · IEEE Access · doi:10.1109/access.2016.2600633 · Cited by 82
Self-citationExploiting Social Internet of Things Features in Cognitive Radio
Nitti, M., Murroni, M., Fadda, M., & Atzori, L. (2016) · IEEE Access · doi:10.1109/access.2016.2645979 · Cited by 70
A Multiagent Q-Learning-Based Optimal Allocation Approach for Urban Water Resource Management System
Ni, J., Liu, M., Ren, L., & Yang, S. X. (2013) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2229978 · Cited by 63
Cognitive radio networks for Internet of Things: Applications, challenges and future
Shah, M. A., Zhang, S., & Maple, C. R. (2013) · International Conference on Automation and Computing (ICAC) · Cited by 61
An optimization-based robust routing algorithm to energy-efficient networks for cloud computing
Jiang, D., Xu, Z., Liu, J., & Zhao, W. (2015) · Telecommunication Systems · doi:10.1007/s11235-015-9975-y · Cited by 51
Self-citationSupporting smart-city mobility with cognitive Internet of Things
Somov, A., Dupont, C., & Giaffreda, R. (2013) · Cited by 48
BTG-AC: Break-the-Glass Access Control Model for Medical Data in Wireless Sensor Networks
Maw, H. A., Xiao, H., Christianson, B., & Malcolm, J. A. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2510403 · Cited by 44
Cognitive Internet-of-Things solutions enabled by wireless sensor and actuator networks
Tervonen, J. K., Mikhaylov, K., Pieskä, S., Jämsä, J., & Heikkilä, M. (2014) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2014.7020426 · Cited by 34
Joint Cross-Layer Design for Wireless QoS Content Delivery
Chen, J., Lv, T., & Zheng, H. (2005) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/asp.2005.167 · Cited by 16
Cited by
On the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Security of the Internet of Things: Vulnerabilities, Attacks, and Countermeasures
Butun, I., Osterberg, P., & Song, H. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2953364 · Cited by 707
Self-citationEnabling Massive IoT Toward 6G: A Comprehensive Survey
Guo, F., Yu, F. R., Zhang, H., Li, X., Ji, H., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063686 · Cited by 701
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654
“[169] implemented stacked auto-encoders (SAEs) to realize Q-learning for transmission scheduling in cognitive IoT relays.”
Background
Metadata
- Authors
- Zhu, J., Song, Y., Jiang, D., & Song, H.
- Venue
- IEEE Internet of Things Journal
- Published
- 2018-08
- Volume
- 5
- Issue
- 4
- Pages
- 2375-2385
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2761694337
- Cited by
- 296
- References
- 28
- FWCI
- 23.85
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.