The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Open accessAbstract
Internet of Things (IoT) devices can apply mobile edge computing (MEC) and energy harvesting (EH) to provide high-level experiences for computational intensive applications and concurrently to prolong the lifetime of the battery. In this paper, we propose a reinforcement learning (RL) based offloading scheme for an IoT device with EH to select the edge device and the offloading rate according to the current battery level, the previous radio transmission rate to each edge device, and the predicted amount of the harvested energy. This scheme enables the IoT device to optimize the offloading policy without knowledge of the MEC model, the energy consumption model, and the computation latency model. Further, we present a deep RL-based offloading scheme to further accelerate the learning speed. Their performance bounds in terms of the energy consumption, computation latency, and utility are provided for three typical offloading scenarios and verified via simulations for an IoT device that uses wireless power transfer for energy harvesting. Simulation results show that the proposed RL-based offloading scheme reduces the energy consumption, computation latency, and task drop rate, and thus increases the utility of the IoT device in the dynamic MEC in comparison with the benchmark offloading schemes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607
Efficient multi-user computation offloading for mobile-edge cloud computing
Chen, X., Jiao, L., Li, W., & Fu, X. (2016) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2015.2487344 · Cited by 2,675
Wireless Networks With RF Energy Harvesting: A Contemporary Survey
Lu, X., Wang, P., Niyato, D., Kim, D. I., & Han, Z. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2368999 · Cited by 2,603
Fog and IoT: An Overview of Research Opportunities
Chiang, M., & Zhang, T. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2584538 · Cited by 2,362
Energy Harvesting Sensor Nodes: Survey and Implications
Sudevalayam, S., & Kulkarni, P. (2011) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.060710.00094 · Cited by 1,981
Dynamic computation offloading for mobile-edge computing with energy harvesting devices
Mao, Y., Zhang, J., & Letaief, K. B. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2611964 · Cited by 1,705
Convolutional neural networks at constrained time cost
He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558
Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading
You, C., Huang, K., Chae, H., & Kim, B.-H. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2633522 · Cited by 1,503
Connected Vehicles: Solutions and Challenges
Lu, N., Cheng, N., Zhang, N., Shen, X., & Mark, J. W. (2014) · IEEE Internet of Things Journal · doi:10.1109/jiot.2014.2327587 · Cited by 1,252
Wireless powered communication: opportunities and challenges
Bi, S., Ho, C. K., & Zhang, R. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7081084 · Cited by 1,092
Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling
Wang, Y., Sheng, M., Wang, X., Wang, L., & Li, J. (2016) · IEEE Transactions on Communications · doi:10.1109/tcomm.2016.2599530 · Cited by 1,002
Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures
Hou, X., Li, Y., Chen, M., Wu, D., Jin, D., & Chen, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2532863 · Cited by 930
Self-citationJoint Offloading and Computing Optimization in Wireless Powered Mobile-Edge Computing Systems
Wang, F., Xu, J., Wang, X., & Cui, S. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2785305 · Cited by 922
Bi, S., & Zhang, Y. J. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2821664 · Cited by 870
Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling
Thinh, T. Q., Tang, J., La, Q. D., & Quek, T. Q. S. (2017) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2699660 · Cited by 866
Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel
Zhang, W., Wen, Y., Guan, K., Kilper, D., Luo, H., & Wu, D. O. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2013.072513.121842 · Cited by 863
Self-citationDeep reinforcement learning based computation offloading and resource allocation for MEC
Li, J., Gao, H., Lv, T., & Lu, Y. (2018) · 2018 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2018.8377343 · Cited by 548
Energy Efficient Mobile Cloud Computing Powered by Wireless Energy Transfer
You, C., Huang, K., & Chae, H. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2545382 · Cited by 495
A Dynamic Offloading Algorithm for Mobile Computing
Huang, D., Wang, P., & Niyato, D. (2012) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2012.041912.110912 · Cited by 493
Incentivizing Energy Trading for Interconnected Microgrids
Wang, H., & Huang, J. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2614988 · Cited by 477
Munoz, O., Pascual-Iserte, A., & Vidal, J. (2015) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2014.2372852 · Cited by 415
Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Xu, J., Chen, L., & Ren, S. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2725277 · Cited by 368
AVE: Autonomous Vehicular Edge Computing Framework with ACO-Based Scheduling
Feng, J., Liu, Z., Wu, C., & Ji, Y. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2714704 · Cited by 330
DeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning
Lane, N. D., Georgiev, P., & Qendro, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804262 · Cited by 310
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., & Kawsar, F. (2015) · Proceedings of the 2015 International Workshop on Internet of Things towards Applications · doi:10.1145/2820975.2820980 · Cited by 228
Smart RF energy harvesting communications: challenges and opportunities
Mishra, D., De, S., Jana, S., Basagni, S., Chowdhury, K., & Heinzelman, W. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7081078 · Cited by 215
Cloud-Based Malware Detection Game for Mobile Devices with Offloading
Xiao, L., Li, Y., Huang, X., & Du, X. (2017) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2017.2687918 · Cited by 200
Self-citationFuzzy Regression Transfer Learning in Takagi–Sugeno Fuzzy Models
Zuo, H., Zhang, G., Witold Pedrycz, C., Behbood, V., & Lü, J. (2016) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2633376 · Cited by 140
Exploiting fully convolutional neural networks for fast road detection
Mendes, C. C. T., Frémont, V., & Wolf, D. F. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487486 · Cited by 125
A Mobile Offloading Game Against Smart Attacks
Xiao, L., Xie, C., Chen, T., Dai, H., & Poor, H. V. (2016) · IEEE Access · doi:10.1109/access.2016.2565198 · Cited by 116
Self-citationDynamic analysis of multiagent Q -learning with ε-greedy exploration
Gomes, E. R., & Kowalczyk, R. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553422 · Cited by 87
Lin, F., Chen, C., Zhang, N., Guan, X., & Shen, X. (2015) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2490544 · Cited by 59
SEGUE: Quality of Service Aware Edge Cloud Service Migration
Zhang, W., Hu, Y., Zhang, Y., & Raychaudhuri, D. (2016) · IEEE International Conference on Cloud Computing Technology and Science · doi:10.1109/cloudcom.2016.0061 · Cited by 59
Dilemma at RF Energy Harvesting Relay: Downlink Energy Relaying or Uplink Information Transfer?
Mishra, D., De, S. K., & Krishnaswamy, D. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2704084 · Cited by 55
Liu, W., Cao, J., Yang, L., Xu, L., Qiu, X., & Li, J. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2624733 · Cited by 32
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Hence, CNN is used to compress the state space in the learning process [254].”
BackgroundMethodEdge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,147
Huang, L., Bi, S., & Zhang, Y.-J. A. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2928811 · Cited by 1,040
Pham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
Metadata
- Authors
- Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W.
- Affiliations
- Xiamen University (CN)
- State Key Laboratory of Industrial Control Technology (CN)
- Sun Yat-sen University (CN)
- University of Waterloo (CA)
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2019-02
- Volume
- 68
- Issue
- 2
- Pages
- 1930-1941
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2964098968
- Cited by
- 560
- References
- 38
- Citations by year
- 2026: 24 · 2025: 33 · 2024: 68 · 2023: 97 · 2022: 104 · 2021: 84 · 2020: 108 · 2019: 39
- FWCI
- 45.84
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Vehicular Technology (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61671396, 91638204, 61761136012, 61533015, 61572538)
- National Mobile Communications Research Laboratory, Southeast University (2018D08)
- Fundamental Research Funds for the Central Universities (17LGJC23)
- Guangdong Special Support Program (2017TX04X148)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Energy Harvesting in Wireless Networks
- Keywords
- computation offloading, Internet of Things, energy harvesting, mobile edge computing, reinforcement learning, deep reinforcement learning, wireless power transfer, battery life, computation latency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.