Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Mobile edge computing (also known as fog computing) has recently emerged to enablein-situprocessing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is costly and even infeasible (in certain rugged or under-developed areas), thus mandating on-site renewable energy as a major or even sole power supply in increasingly many scenarios. Nonetheless, the high intermittency and unpredictability of renewable energy make it very challenging to deliver a high quality of service to users in energy harvesting mobile edge computing systems. In this paper, we address the challenge of incorporating renewables into mobile edge computing and propose an efficient reinforcement learning-based resource management algorithm, which learns on-the-fly the optimal policy of dynamic workload offloading (to the centralized cloud) and edge server provisioning to minimize the long-term system cost (including both service delay and operational cost). Our online learning algorithm uses a decomposition of the (offline) value iteration and (online) reinforcement learning, thus achieving a significant improvement of learning rate and run-time performance when compared to standard reinforcement learning algorithms such as${Q}$-learning. We prove the convergence of the proposed algorithm and analytically show that the learned policy has a simple monotone structure amenable to practical implementation. Our simulation results validate the efficacy of our algorithm, which significantly improves the edge computing performance compared to fixed or myopic optimization schemes and conventional reinforcement learning algorithms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“At this background, large state and action spaces in the whole offloading problem make the conventional learning algorithms [245] [256] [247] infeasible actually.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [245]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 5×
“The proposed PDS-based learning algorithm is compared with three benchmark schemes: • Q-learning [10]: Q-learning is a famous model-free reinforcement learning technique for solving MDP problems.”
BackgroundMethodInfluentialReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
(1995) · Cited by 10,558
Edge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733 · cited 4×
“backbone networks [1] but also result in (sometimes intolerable) large transmission latencies that degrade the quality of service [2]–[4].”
BackgroundInfluentialMarkov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037 · cited 1×
“battery state b and the power demand action a for any given λ,e,h. This is to prove that ∀b ≤ b′ and a ≤ a′, we have C(b,a ′)− C(b,a) ≥ C(b ,a′)− C(b′,a) (32) If the above is true, then we can apply [27] (Section 4.7) to show that π(s) is non-decreasing in b. Equation (32) is equivalent to V∗(b− a ′)− V ∗(b −a) ≥ V∗(b…”
InfluentialA Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A. (1995) · Technometrics · doi:10.1080/00401706.1995.10484354 · Cited by 2,415
Fog and IoT: An Overview of Research Opportunities
Chiang, M., & Zhang, T. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2584538 · Cited by 2,362 · cited 2×
“Fog computing [5] is a related concept that refers to the same computing paradigm.”
BackgroundStochastic Network Optimization with Application to Communication and Queueing Systems
Neely, M. J. (2010) · Synthesis lectures on communication networks · doi:10.2200/s00271ed1v01y201006cnt007 · Cited by 2,218
Energy Harvesting Sensor Nodes: Survey and Implications
Sudevalayam, S., & Kulkarni, P. (2011) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.060710.00094 · Cited by 1,981 · cited 2×
“and/or solar radiation is embraced as a major or even sole power supply for edge systems in the field, thanks to the recent advancements of energy harvesting techniques [8], [9].”
Background
Research works printed but not linked: 4
- reiss, 2011, Google Cluster-usage Traces Format+ Schema, 1
- patel, 2014, Mobile-Edge Computing—Introductory Technical White Paper
- 2017, Elia Power Generation
- rivera, 2014, Gartner Says the Internet of Things Will Transform the Data Center
Cited by
Items 101–200 of 368
UAV-Aided Low Latency Multi-Access Edge Computing
Yu, Y., Bu, X., Yang, K., Yang, H., Gao, X., & Han, Z. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3072065 · Cited by 59
“In [23], the authors propose a novel algorithm based on online learning methods, which aims to solve both offloading and autoscaling problems in a MEC network with energy harvesting.”
BackgroundRobustness-oriented k Edge Server Placement
Cui, G., He, Q., Xia, X., Chen, F., Jin, H., & Yang, Y. J. (2020) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid49817.2020.00-85 · Cited by 61
“, [2], [5], [9], [13], [14].”
Delay Characterization of Mobile-Edge Computing for 6G Time-Sensitive Services
Cao, J., Feng, W., Ge, N., & Lü, J. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3023933 · Cited by 56
Sensing, computing, and communications for energy harvesting IoTs: A survey
Ma, D., Lan, G., Hassan, M., Hu, W. S., & Das, S. K. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 53
Lu, H., Gu, C., Luo, F., Ding, W., Zheng, S., & Shen, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3036416 · Cited by 56
“The reference [11] chose whether to offload tasks to the edge server which serves for multiple users by deep reinforcement learning algorithm, so as to reduce energy consumption and average computing delay.”
BackgroundArcas, G. I., Cioara, T., Anghel, I. M., Lazea, D., & Hângan, A. (2024) · Smart Cities · doi:10.3390/smartcities7010028 · Cited by 78
Online Geographical Load Balancing for Energy-Harvesting Mobile Edge Computing
Wu, H., Chen, L., Shen, C., Wen, W., & Xu, J. (2018) · 2018 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2018.8422299 · Cited by 49
Self-citationKe, H., Wang, H., Sun, W., & Sun, H. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3118696 · Cited by 52
Huang, B., Li, Y., Li, Z., Pan, L., Wang, S., Xu, Y., & Hu, H. (2019) · Wireless Communications and Mobile Computing · doi:10.1155/2019/3816237 · Cited by 50
“In particular, in [24], an efficient reinforcement learning-based algorithm is proposed to minimize the long-term computation task offloading cost (including both service delay and 2 Wireless Communications and Mobile Computing”
BackgroundMobile Edge Computation Offloading Using Game Theory and Reinforcement LearningPreprint
Ranadheera, S., Maghsudi, S., & Hossain, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09012 · Cited by 48
“Reference [8] investigates joint offloading decision making and dynamic edge server provisioning in an offloading mobile edge network with energy harvesting capability.”
BackgroundLi, S., Li, B., & Zhao, W. (2020) · IEEE Access · doi:10.1109/access.2020.3002895 · Cited by 47
“Although local caching can cause some delay, the delay of local caching is negligible compared to cooperative caching and offloading computation [32].”
BackgroundJoint Optimization for Task Offloading in Edge Computing: An Evolutionary Game Approach
Dong, C., & Wen, W. (2019) · Sensors · doi:10.3390/s19030740 · Cited by 50
“[24] proposed strategies based on Markov Decision Process.”
MethodPérez, S., Arroba, P., & Moya, J. M. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.07.031 · Cited by 51
Chougule, S., Chaudhari, B. S., Ghorpade, S. N., & Zennaro, M. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15020039 · Cited by 58
Joint Computation Offloading and Resource Allocation for Maritime MEC With Energy Harvesting
Wang, Z. J., Lin, B., Ye, Q. J., Fang, Y. M., & Han, X. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3371049 · Cited by 51
A ‘Joint-Me’ Task Deployment Strategy for Load Balancing in Edge Computing
Dong, Y., Xu, G., Ding, Y., Meng, X., & Zhao, J. (2019) · IEEE Access · doi:10.1109/access.2019.2928582 · Cited by 52
“When the number of tasks is in the [0-100], they have the same success rate.”
BackgroundJOTE: Joint Offloading of Tasks and Energy in Fog-Enabled IoT Networks
Cai, P., Yang, F., Wang, J., Wu, X., Yang, Y., & Luo, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2964951 · Cited by 45
“Reinforcement learning-based offloading policies for EH devices were studied in [19] and [20].”
BackgroundOnline Learning and Optimization for Computation Offloading in D2D Edge Computing and Networks
Qiao, G., Leng, S., & Zhang, Y. (2019) · Mobile Networks and Applications · doi:10.1007/s11036-018-1176-y · Cited by 44
Perin, G., Berno, M., Erseghe, T., & Rossi, M. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3112796 · Cited by 50
Proactive autoscaling for edge computing systems with kubernetes
Ju, L., Singh, P., & Salman Zubair, T. O. O. R. (2021) · IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion) · doi:10.1145/3492323.3495588 · Cited by 60
“In real world scenarios, autoscaling of applications for both traditional cloud computing and edge computing is essential[8, 9].”
BackgroundRisk-Aware Edge Computation Offloading Using Bayesian Stackelberg Game
Bai, Y., Chen, L., Song, L., & Xu, J. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.2985080 · Cited by 42
“, stochastic task arrivals [15], energy efficiency [16], [17], edge resource cost [18], and fast decisionmaking [19].”
BackgroundSelf-citationEfficient Edge Nodes Reconfiguration and Selection for the Internet of Things
Rahman, T., Yao, X., Tao, G., Ning, H., & Zhou, Z. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2895119 · Cited by 43
“Data offloading to the cloud has also remain a central subject of numerous earlier works [6], [7].”
BackgroundMonetizing Edge Service in Mobile Internet Ecosystem
Wang, Z., Gao, L. X., Wang, T., & Luo, J. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3025286 · Cited by 43
Liu, Y., Xie, S., Yang, Q., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3033160 · Cited by 43
Computation Offloading in Heterogeneous Mobile Edge Computing With Energy Harvesting
Zhang, T., & Chen, W. (2021) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3050414 · Cited by 42
“In [14], an efficient reinforcement learning-based resource management algorithm is designed for energy harvesting MEC.”
MethodOnline learning offloading framework for heterogeneous mobile edge computing system
Zhang, F., Ge, J., Wong, C., Li, C., Chen, X., Zhang, S., Luo, B., Zhang, H., & Chang, V. I. C. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.02.003 · Cited by 41
“The inherent complexities have not been addressed, which either optimize the heterogeneous MEC resource [7-8] and dynamicity of MEC environment separately [9] rather than taken these two aspects together.”
BackgroundXu, S., Liu, Q., Gong, B., Qi, F., Guo, S., Qiu, X., & Yang, C. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002427 · Cited by 46
“3) Energy-Optimal (E-Optimal) Algorithm [11]: It just considers the energy cost while ignores delay cost in the computation offloading process.”
BackgroundDeep reinforcement learning for the computation offloading in MIMO-based Edge Computing
Sadiki, A., Bentahar, J., Dssouli, R., En‐Nouaary, A., & Otrok, H. (2023) · Ad Hoc Networks · doi:10.1016/j.adhoc.2022.103080 · Cited by 44
Online Workload Allocation via Fog-Fog-Cloud Cooperation to Reduce IoT Task Service Delay
Li, L., Guo, M., Ma, L., Mao, H., & Guan, Q. (2019) · Sensors · doi:10.3390/s19183830 · Cited by 41
“[15] proposed an online learning algorithm to determine workload offloading in mobile edge computing to minimize the cost of the edge device.”
BackgroundMachine learning-based computation offloading in edge and fog: a systematic review
Taheri-abed, S., Moghadam, A. M. E., & Rezvani, M. H. (2023) · Cluster Computing · doi:10.1007/s10586-023-04100-z · Cited by 45
“[76] - Does not use load balancing (BS to BS communication) to reach objectives - Taking advantage of green energy”
BackgroundEnergy harvesting computation offloading game towards minimizing delay for mobile edge computing
Guo, M., Li, Q., Peng, Z., Liu, X., & Cui, D. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108678 · Cited by 41
Deep Reinforcement Learning-Based Task Assignment for Cooperative Mobile Edge Computing
Hsieh, L.-T., Liu, H., Guo, Y., & Gazda, R. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3270242 · Cited by 44
Li, B., Fei, Z., Shen, J., Jiang, X. F., & Zhong, X. (2019) · IEEE Access · doi:10.1109/access.2019.2922362 · Cited by 37
“solar radiation, wind energy and human motion energy) to power mobile devices [23]–[26] or edge servers in outdoor scenarios [27], [28].”
BackgroundUAV‐enabled computation migration for complex missions: A reinforcement learning approach
Zhu, S., Gui, L., Cheng, N., Zhang, Q., Sun, F., & Lang, X. (2020) · IET Communications · doi:10.1049/iet-com.2019.1188 · Cited by 34
Offloading Decision in Edge Computing for Continuous Applications Under Uncertainty
Chang, W., Xiao, Y., Lou, W., & Shou, G. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3001012 · Cited by 38
“[33] formulate the offloading problem as a Markov decision process and design an efficient reinforcement learning-based algorithm to reduce delay and operational cost.”
BackgroundLi, H., Zheng, P., Wang, T., Wang, J., & Liu, T. (2022) · Cluster Computing · doi:10.1007/s10586-022-03809-7 · Cited by 37
“[37] used deep learning to allocate computing resources and proposed a dynamic offloading strategy based on deep learning.”
BackgroundDistributed Intelligence in Wireless Networks
Liu, X., Yu, J., Liu, Y., Gao, Y., Mahmoodi, T., Lambotharan, S., & Tsang, D. H. K. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3265425 · Cited by 48
“Therefore, in [107], [108], the authors leveraged the RL techniques to extract valuable knowledge from the environment and then to make adaptive decisions, and hence they offered distributed computation offloading policy and optimal resource allocation for the end users without the need for a…”
BackgroundOnline task scheduling for edge computing based on repeated Stackelberg game
Jie, Y., Tang, X., Choo, K. R., Su, S., Li, M., & Guo, C. (2018) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2018.07.019 · Cited by 38
Asheralieva, A. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2892733 · Cited by 33
“, stochastic task arrivals [2], [5], [7], energy efficiency [8]–[12], matching and game theory [6], [13]–[16], etc.”
BackgroundMulti-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems
Munir, M. S., Tran, N. H. K., Saad, W., & Hong, C. S. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3057960 · Cited by 42
Multi-Agent Driven Resource Allocation and Interference Management for Deep Edge Networks
Gong, Y., Yao, H., Wang, J., Jiang, L., & Yu, F. R. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3134467 · Cited by 39
“[26] used an offline value iteration method for minimizing operational cost and service latency.”
MethodUAV-Aided Low Latency Mobile Edge Computing with mmWave Backhaul
Yu, Y., Bu, X., Yang, K., Yang, H., & Han, Z. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761403 · Cited by 34
“In [9], the authors propose an online learning algorithm to solve the offloading and autoscaling in the energy harvesting enabled MEC network, and the convergence and complexity are analyzed and proved.”
BackgroundLi, J., Zhang, X., Zhang, J., Wu, J., Sun, Q., & Xie, Y. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2954396 · Cited by 37
“An MDP based online learning method was proposed in [24] for MEC offloading.”
MethodAbbasi, M., Yaghoobikia, M., Rafiee, M., Jolfaei, A., & Khosravi, M. R. (2020) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2019.0783 · Cited by 36
“As a result, in 2017 Xu et al. [14] modified and improved their previous learning algorithm by changing its learning model.”
BackgroundMethodInfluentialHan, P., Liu, Y., & Guo, L. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3048832 · Cited by 34
“Each node that holds multiple services can also be characterized by the M/G/1 queuing system [31], [32], where “M” indicates that the packet arrival process follows the Poisson process and “G” means that the amount of bandwidth required to process the packets can follow any distribution.”
BackgroundEfficient Blockchain-Enabled Large Scale Parked Vehicular Computing With Green Energy Supply
Teng, Y., Cao, Y., Liu, M., Yu, F. R., & Leung, V. C. M. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3099306 · Cited by 36
“2) Battery Depreciation Cost: As green energy is utilized to accomplish the computing load, instead of focusing on absolute energy consumption as conventional practices, we attach more importance to the battery depreciation cost [28].”
MethodZhao, H., Wang, Y., & Sun, R. (2018) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc.2018.8450448 · Cited by 31
“Moreover, since the transmission power of the BS is much larger than that of MD, and the size of D i is much smaller than D i , therefore, the transmission delay over the wireless downlink can be neglected [10].”
BackgroundKansal, P., Kumar, M., & Verma, O. P. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-022-04338-1 · Cited by 38
Energy-Efficient Cooperation in Mobile Edge Computing-Enabled Cognitive Radio Networks
Liu, B., Wang, J., Ma, S., Zhou, F., Ma, Y., & Lu, G. (2019) · IEEE Access · doi:10.1109/access.2019.2909319 · Cited by 32
“In order to alleviate this issue, the authors in [11] proposed an efficient reinforcement learning-based resource management algorithm to minimize the long-term system cost.”
BackgroundDynamic Neural Network-Based Resource Management for Mobile Edge Computing in 6G Networks
Ma, L., Cheng, N., Zhou, C., Wang, X., Lu, N., Zhang, N., Aldubaikhy, K., & Alqasir, A. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3346824 · Cited by 35
Energy efficient task scheduling for heterogeneous multicore processors in edge computing
Liu, Y., Qu, H., Chen, S., & Feng, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-92604-6 · Cited by 49
Intelligent dynamic service pricing strategy for multi-user vehicle-aided MEC networks
Liao, Y., Qiao, X., Yu, Q. G., & Liu, Q. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.07.051 · Cited by 32
Rafiq, A., Wang, P., Wei, M., & Muthanna, M. S. A. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3058976 · Cited by 34
“A post-decision state-based algorithm was proposed for fog offloading and autoscaling policy [48].”
MethodResultHemalatha, M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118227 · Cited by 32
“Edge computing (Xu, Chen, & Ren, 2017) mainly increases the processing capabilities of edge devices via on-site processing before transferring the data to the cloud.”
Optimizing Online Task Allocation for Multi-Attribute Social Sensing
Zhang, Y., Zhang, D., Vance, N., & Wang, D. (2018) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn.2018.8487401 · Cited by 28
“proposed an efficient online reinforcement learning-based resource management algorithm, which learns the optimal policy of dynamic workload offloading (to the centralized cloud) to minimize the system delay and operation cost [32].”
BackgroundJin, J., & Xu, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111414 · Cited by 28
Wang, F., Cai, S., & Lau, V. K. N. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3221850 · Cited by 34
“In the literature, some works exist on task offloading designs for MEC systems with renewable sources [24], [25], [26], [27], [28], [29].”
BackgroundInfluentialLi, C., Tang, J., Zhang, Y., Yan, X., & Luo, Y. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.106890 · Cited by 29
Intelligent architecture and platforms for private edge cloud systems: A review
Xu, X., Zang, S., Bilal, M., Xu, X., & Dou, W. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.024 · Cited by 38
Liang, S., Wan, H., Qin, T., Li, J., & Chen, W. (2020) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct50939.2020.9295872 · Cited by 31
“[8] proposed a new deep reinforcement learning (DRL) algorithm based on the post-decision state, which can learn the optimal strategy of dynamic computation offloading and edge server configuration.”
BackgroundMethodGreen Parallel Online Offloading for DSCI-Type Tasks in IoT-Edge Systems
Chen, J., Wu, H., Li, R., & Jiao, P. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3167668 · Cited by 27
“As a result, not only has today’s already congested network become worse [6], [7], but the entire IoT system has also become unstable.”
BackgroundDynamic multi-user computation offloading for wireless powered mobile edge computing
Li, C., Tang, J., & Luo, Y. (2019) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.01.020 · Cited by 31
Optimal Resource Allocation for Wireless Powered Mobile Edge Computing with Dynamic Task Arrivals
Wang, F., Xing, H., & Xu, J. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761143 · Cited by 26
“Notice that in the literature, some prior works [11]–[13] investigated joint communication and computation management in MEC systems with dynamic task arrivals over time, while other works (see, e.”
ResultSelf-citationReal-Time QoS Optimization for Vehicular Edge Computing With Off-Grid Roadside Units
Ku, Y.-J., Chiang, P.-H., & Dey, S. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3007640 · Cited by 26
“[18], [19] characterize multiple aspects of RE-powered MEC system by Markov Decision Process (MDP) states and propose an online learning-based algorithm to minimize system delay, battery depreciation, and backup power supply cost.”
BackgroundIntelligent energy-efficient scheduling with ant colony techniques for heterogeneous edge computing
Liu, J., Yang, P., & Chen, C. (2022) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2022.10.003 · Cited by 26
An energy harvesting solution for computation offloading in Fog Computing networks
Bozorgchenani, A., Disabato, S., Tarchi, D., & Roveri, M. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.06.032 · Cited by 27
Towards an energy balancing solution for wireless sensor network with mobile sink node
Thomson, C. J., Wadhaj, I., Tan, Z., & Al‐Dubai, A. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.01.011 · Cited by 26
UCAA: User-Centric User Association and Resource Allocation in Fog Computing Networks
Tong, S., Liu, Y., Cheriet, M., Kadoch, M., & Shen, B. (2020) · IEEE Access · doi:10.1109/access.2020.2965218 · Cited by 24
Jin, W., Xu, R., Lim, S., Park, D.-H., Park, C., & Kim, D. (2021) · Sensors · doi:10.3390/s21020630 · Cited by 32
“[45] proposed intelligent edge computing based on offloading the learning approach to the cloud for renewable power supply.”
BackgroundAn intelligent resource management method in SDN based fog computing using reinforcement learning
Anoushee, M., Fartash, M., & Torkestani, J. A. (2023) · Computing · doi:10.1007/s00607-022-01141-x · Cited by 30
Zhou, H., Wang, X., Umehira, M., Chen, X., Wu, C., & Ji, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3067662 · Cited by 24
“As stated in [17]–[21], reinforcement learning based approaches could adapt to dynamic network environment, however, the convergence of the learning results become extremely slow when the environmental state space is large.”
BackgroundEnhancing Sustainable Edge Computing Offloading via Renewable Prediction for Energy Harvesting
Alhartomi, M. A., Salh, A., Audah, L., Alzahrani, S., & Alzahmi, A. (2024) · IEEE Access · doi:10.1109/access.2024.3404222 · Cited by 29
“While ignoring the temporal link between system states and decisions, the authors of [29] stress the significance of maximizing the time-average cost.”
BackgroundMethodInfluentialOptimal Distribution of Workloads in Cloud-Fog Architecture in Intelligent Vehicular Networks
Abbasi, M., Yaghoobikia, M., Rafiee, M., Khosravi, M. R., & Menon, V. G. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3071328 · Cited by 23
Video Offloading in Mobile Edge Computing: Dealing With Uncertainty
Ma, W., & Mashayekhy, L. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3369685 · Cited by 23
A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
Zhang, Y., Liu, T., Zhu, Y., & Yang, Y. (2020) · International Workshop on Quality of Service · doi:10.1109/iwqos49365.2020.9212868 · Cited by 23
“There are some works [9]–[11] propose reinforcement learning based algorithms to solve online computation offloading problem without knowing accurate information in future.”
BackgroundMethodLi, X., Bi, S., Quan, Z., & Wang, H. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3151509 · Cited by 26
“In this case, the optimal task offloading solution is directly affected by the dynamic spectrum access method, where the conventional optimization methods (such as in [9]–[14]) are no longer applicable.”
BackgroundMethodFair Resource Allocation in Virtualized O-RAN Platforms
Aslan, F., Iosifidis, G., Ayala‐Romero, J. A., García‐Saavedra, A., & Costa‐Pérez, X. (2024) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3639043 · Cited by 22
Collaborative Service Caching for Edge Computing in Dense Small Cell NetworksPreprint
Chen, L., & Xu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.08662 · Cited by 24
“stochastic task arrivals [8], [9], energy efficiency [10], [3], collaborative offloading [11], [12] etc.”
BackgroundSelf-citationOliver, M. E., Chapman, O., Grijalva, S., Matisoff, D. C., Ramadhani, M., & West, A. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.116334 · Cited by 26
Enabling Service Cache in Edge Clouds
Huang, C.-K., & Shen, S.-H. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3456564 · Cited by 21
“Specific topics in MEC have been investigated, such as the selection of edge clouds [10, 12, 47], energy efficiency [7, 36, 43], major/edge cloud collaboration [11, 18, 45], and stochastic task arrivals [16, 21].”
BackgroundYan, L., Chen, H., Tu, Y., & Zhou, X. (2022) · IEEE Access · doi:10.1109/access.2022.3150406 · Cited by 22
“[8] offload tasks to multiple edge servers by deep reinforcement learning algorithms to reduce energy consumption and average computational latency.”
BackgroundStochastic Computation Offloading and Scheduling Based on Mobile Edge Computing
Zheng, X., Li, M., Tahir, M., Chen, Y., & Alam, M. (2019) · IEEE Access · doi:10.1109/access.2019.2919651 · Cited by 22
“However, [15] only considered the computation offloading of a set of MDs in a BS, failed to consider user movements, and did not guarantee random offloading.”
BackgroundTeng, Y., Mei, Y., Liu, D., Han, Z., & Song, M. N. (2019) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2959583 · Cited by 20
“Assume that there is no depreciation cost in recharging the battery, only the discharging cost is considered [13].”
BackgroundContext-aware distribution of fog applications using deep reinforcement learning
Wang, N., & Varghese, B. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103354 · Cited by 27
Chen, N., Zhang, S., Qian, Z., Wu, J., & Lu, S. (2019) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads47876.2019.00066 · Cited by 22
“, energy efficient [8]–[11], resource allocation [12] [13], and some specific mobile applications such as AR/VR [5], [14]–[16].”
BackgroundEfficient offloading schemes using Markovian models: a literature review
Masdari, M., & Khezri, H. (2020) · Computing · doi:10.1007/s00607-020-00812-x · Cited by 24
Efficient Resource Allocation for NOMA-MEC System in Ultra-Dense Network: A Mean Field Game Approach
Cheng, Q., Li, L., Sun, Y., Wang, D., Liang, W. J., Li, X., & Han, Z. (2020) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops49005.2020.9145070 · Cited by 21
“With the rapid development of reinforcement learning (RL), it has been become a powerful tool to be applied in the MEC system to solve various problems such as resource allocation, power control, and so on [5], [6].”
MethodHorizontal Auto-Scaling for Multi-Access Edge Computing Using Safe Reinforcement Learning
Ray, K., & Banerjee, A. (2021) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3475991 · Cited by 19
Energy-Efficient Online Data Sensing and Processing in Wireless Powered Edge Computing Systems
Li, X., Bi, S., Zheng, Y., & Wang, H. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3186718 · Cited by 20
Near-optimal and learning-driven task offloading in a 5G multi-cell mobile edge cloud
Xia, Q., Lou, Z., Xu, W., & Xu, Z. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107276 · Cited by 21
An advanced decision model enabling two-way initiative offloading in edge computing
Yin, Z., Chen, H., & Hu, F. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.07.031 · Cited by 19
Fuzzy-Based Microservice Resource Management Platform for Edge Computing in the Internet of Things
Li, D. C., Huang, C.-T., Tseng, C.-W., & Chou, L. (2021) · Sensors · doi:10.3390/s21113800 · Cited by 26
Jin, W., Lim, S., Woo, S., Park, C., & Kim, D. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-022-00659-z · Cited by 22
Adaptive Network Configuration for Efficient and Accurate Neural Video Inference
Yang, P., Cheng, Y., Zhang, N., Cheng, Q., & Yu, L. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3320879 · Cited by 18
Collaborative Computation Offloading in Wireless Powered Mobile-Edge Computing Systems
He, B., Bi, S., Xing, H., & Lin, X. (2019) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps45667.2019.9024424 · Cited by 18
“Several other works have also considered the designs of wireless powered MEC system under random task arrivals [11], using machines learning based structure [12], and for UAV-enabled scenarios [13], [14].”
BackgroundSustainable Virtual Network Function Placement and Traffic Routing for Green Mobile Edge Networks
Liang, J., Huang, S., Yu, Q., Liu, L., Aziz, F., & Chen, M. (2024) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2024.3392813 · Cited by 17
A Survey: Resource Allocation Technology Based on Edge Computing in IIoT
Lin, Z., Liu, J., Xiao, J., & Zi, S. (2020) · International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI) · doi:10.1109/ccci49893.2020.9256663 · Cited by 24
“These factors are interrelated and are used to find the most suitable computing strategy[23].”
BackgroundOrchestrating Energy-Efficient vRANs: Bayesian Learning and Experimental Results
Ayala‐Romero, J. A., García‐Saavedra, A., Costa‐Pérez, X., & Iosifidis, G. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3123794 · Cited by 17
“In [33], the authors address the problem of offloading and autoscaling in mobile edge computing considering renewable energy.”
Optimized task offloading strategy in IoT edge computing network
Birhanie, H. M., & Adem, M. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.101942 · Cited by 25
“Big data streaming has also led to 70 percent of mobile data traffic and is expected to grow 500 times within ten years since 2017 (Xu et al., 2017).”
On-demand deployment for IoT applications
Zhang, J., Ma, M., He, W., & Wang, P. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101794 · Cited by 19
Metadata
- Authors
- Xu, J., Chen, L., & Ren, S.
- Affiliations
- University of Miami (US)
- University of California, Riverside (US)
- Venue
- IEEE Transactions on Cognitive Communications and Networking
- Published
- 2017-09
- Volume
- 3
- Issue
- 3
- Pages
- 361-373
- ISSN
- 2332-7731 (ISSN-L)
- OpenAlex
- W2599106590
- Cited by
- 368
- References
- 33
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 32 · 2023: 24 · 2022: 41 · 2021: 55 · 2020: 87 · 2019: 59 · 2018: 34 · 2017: 7
- FWCI
- 34.02
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Cognitive Communications and Networking (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- U.S. NSF (CNS-1551661, CNS-1565474, ECCS-1610471)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- mobile edge computing, fog computing, energy harvesting, renewable energy, workload offloading, auto-scaling, reinforcement learning, online learning, service delay, operating costs, convergence analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.