A Distributed Deep Reinforcement Learning Technique for Application Placement in Edge and Fog Computing Environments
Open accessAbstract
Fog/Edge computing is a novel computing paradigm supporting resource-constrained Internet of Things (IoT) devices by placement of their tasks on edge and/or cloud servers. Recently, several Deep Reinforcement Learning (DRL)-based placement techniques have been proposed in fog/edge computing environments, which are only suitable for centralized setups. The training of well-performed DRL agents requires manifold training data while obtaining training data is costly. Hence, these centralized DRL-based techniques lack generalizability and quick adaptability, thus failing to efficiently tackle application placement problems. Moreover, many IoT applications are modeled as Directed Acyclic Graphs (DAGs) with diverse topologies. Satisfying dependencies of DAG-based IoT applications incur additional constraints and increase the complexity of placement problem. To overcome these challenges, we propose an actor-critic-based distributed application placement technique, working based on the IMPortance weighted Actor-Learner Architectures (IMPALA). IMPALA is known for efficient distributed experience trajectory generation that significantly reduces exploration costs of agents. Besides, it uses an adaptive off-policy correction method for faster convergence to optimal solutions. Our technique uses recurrent layers to capture temporal behaviors of input data and a replay buffer to improve the sample efficiency. The performance results, obtained from simulation and testbed experiments, demonstrate that our technique significantly improves execution cost of IoT applications up to 30% compared to its counterparts.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Huang, L. P., Bi, S., & Zhang, Y. A. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2928811 · Cited by 1,108 · see citing works
Fog Computing: A Taxonomy, Survey and Future Directions
Mahmud, R., Ramamohanarao, K., & Buyya, R. (2017) · Internet of things · doi:10.1007/978-981-10-5861-5_5 · Cited by 935 · see citing works
Self-citationSurvey on fog computing: architecture, key technologies, applications and open issues
Hu, P., Dhelim, S., Ning, H., & Qiu, T. (2017) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.09.002 · Cited by 880 · see citing works
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner ArchitecturesPreprint
Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V., Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning, I., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01561 · Cited by 851 · see citing works
Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey
Mao, Q., Hu, F., & Hao, Q. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2846401 · Cited by 789 · see citing works
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680 · see citing works
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678 · see citing works
List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table
Arabnejad, H., & Barbosa, J. G. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.57 · Cited by 660 · see citing works
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560 · see citing works
QoS-Aware Deployment of IoT Applications Through the Fog
Brogi, A., & Forti, S. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2701408 · Cited by 481 · see citing works
Delay-Aware Microservice Coordination in Mobile Edge Computing: A Reinforcement Learning Approach
Wang, S., Guo, Y., Zhang, N., Yang, P., Zhou, A., & Shen, X. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2957804 · Cited by 466 · see citing works
Fog Computing in Healthcare Internet of Things: A Case Study on ECG Feature Extraction
Gia, T. N., Jiang, M., Rahmani, A.-M., Westerlund, T., Liljeberg, P., & Tenhunen, H. (2015) · doi:10.1109/cit/iucc/dasc/picom.2015.51 · Cited by 448 · see citing works
Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement Learning
Wang, J., Hu, J. W., Min, G., Zomaya, A. Y., & Georgalas, N. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3014896 · Cited by 420 · see citing works
Mobility-Aware Application Scheduling in Fog Computing
Bittencourt, L. F., Diaz‐Montes, J., Buyya, R., RANA, O. F., & Parashar, M. (2017) · IEEE Cloud Computing · doi:10.1109/mcc.2017.27 · Cited by 408 · see citing works
Self-citationRa, M.-R., Sheth, A. N., Mummert, L., Pillai, P. S., Wetherall, D. J., & Govindan, R. (2011) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/1999995.2000000 · Cited by 360 · see citing works
Goudarzi, M., Wu, H., Palaniswami, M. S., & Buyya, R. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2967041 · Cited by 357 · see citing works
Self-citationEnergy-Efficient Resource Allocation for Mobile Edge Computing-Based Augmented Reality Applications
Al-Shuwaili, A., & Simeone, O. (2017) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2696539 · Cited by 347 · see citing works
A computation offloading method over big data for IoT-enabled cloud-edge computing
Xu, X., Liu, Q., Luo, Y., Peng, K., Zhang, X., Meng, S., & Qi, L. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2018.12.055 · Cited by 336 · see citing works
Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
Xiong, X., Zheng, K., Lei, L., & Hou, L. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.2986615 · Cited by 301 · see citing works
Qi, Q., Wang, J., Ma, Z., Sun, H., Cao, Y., Zhang, L., & Liao, J. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2894437 · Cited by 268 · see citing works
Tuli, S., Ilager, S., Ramamohanarao, K., & Buyya, R. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3017079 · Cited by 262 · see citing works
Self-citationHuang, L. P., Xu, F., Zhang, C., Qian, L., & Wu, Y. (2018) · Digital Communications and Networks · doi:10.1016/j.dcan.2018.10.003 · Cited by 261 · see citing works
Optimal Joint Scheduling and Cloud Offloading for Mobile Applications
Mahmoodi, S. E., Uma, R. N., & Subbalakshmi, K. P. (2016) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2016.2560808 · Cited by 236 · see citing works
iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks
Chen, J., Chen, S., Wang, Q., Cao, B., Feng, G., & Hu, J. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2913162 · Cited by 225 · see citing works
Lu, H., Gu, C., Luo, F., Ding, W., & Liu, X. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.07.019 · Cited by 211 · see citing works
Optimal Application Deployment in Resource Constrained Distributed Edges
Deng, S., Xiang, Z., Taheri, J., Khoshkholghi, M. A., Yin, J., Zomaya, A. Y., & Dustdar, S. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2970698 · Cited by 199 · see citing works
Distributed Deep Learning-based Offloading for Mobile Edge Computing Networks
Huang, L. P., Xu, F., Feng, A., Huang, Y., & Qian, L. (2018) · Mobile Networks and Applications · doi:10.1007/s11036-018-1177-x · Cited by 182 · see citing works
Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
Lu, H., He, X., Du, M., Ruan, X., Sun, Y., & Wang, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2981557 · Cited by 175 · see citing works
Gazori, P., Rahbari, D., & Nickray, M. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.060 · Cited by 130 · see citing works
An Efficient Application Partitioning Algorithm in Mobile Environments
Wu, H., Knottenbelt, W. J., & Wolter, K. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2891695 · Cited by 125 · see citing works
Qiu, X., Zhang, W., Chen, W., & Zheng, Z. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3042599 · Cited by 114 · see citing works
Delay-Sensitive Multi-Period Computation Offloading with Reliability Guarantees in Fog Networks
Wang, J., Liu, K., Li, B., Liu, T., Li, R., & Han, Z. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2918773 · Cited by 91 · see citing works
A fast hybrid multi-site computation offloading for mobile cloud computing
Goudarzi, M., Zamani, M., & Haghighat, A. T. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.12.031 · Cited by 69 · see citing works
Self-citationLearning Everywhere: Pervasive Machine Learning for Effective High-Performance Computation
Fox, G., Adiga, A., Chen, J., Beckstein, O., Jha, S., Glazier, J. A., Kadupitiya, J., Jadhao, V., Kim, M., Qiu, J., et al. (2019) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2019.00081 · Cited by 56 · see citing works
Deng, Q., Goudarzi, M., & Buyya, R. (2021) · International Workshop on Big Data in Emergent Distributed Environments (BiDEDE) · doi:10.1145/3460866.3461768 · Cited by 51 · see citing works
Self-citationGoudarzi, M., Palaniswami, M. S., & Buyya, R. (2021) · Annals of Computer Science and Information Systems · doi:10.15439/2021f005 · Cited by 27 · see citing works
Self-citationA fog-driven dynamic resource allocation technique in ultra dense femtocell networks
Goudarzi, M., Palaniswami, M. S., & Buyya, R. (2019) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102407 · Cited by 25 · see citing works
Self-citationMobile Cloud Computing: A multisite computation offloading
Goudarzi, M., Movahedi, Z., & Nazari, M. (2016) · International Symposium on Telecommunications · doi:10.1109/istel.2016.7881904 · Cited by 15 · see citing works
Self-citation
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A review on TinyML: State-of-the-art and prospects
Ray, P. P. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.019 · Cited by 460 · see citing works
Walia, G. K., Kumar, M., & Gill, S. S. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3338015 · Cited by 299 · see citing works
Wang, Z., Goudarzi, M., Gong, M., & Buyya, R. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.10.012 · Cited by 197 · see citing works
Self-citationDuan, Q., Huang, J., Hu, S., Deng, R., Lu, Z., & Yu, S. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3316615 · Cited by 175 · see citing works
Jayanetti, A., Halgamuge, S. K., & Buyya, R. (2024) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2024.3360448 · Cited by 140 · see citing works
Self-citationAdvancements in TinyML: Applications, Limitations, and Impact on IoT Devices
Elhanashi, A., Dini, P., Saponara, S., & Zheng, Q. (2024) · Electronics · doi:10.3390/electronics13173562 · Cited by 139 · see citing works
Xing, X., Zhou, Z., Li, Y., Xiao, B., & Xun, Y. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3389555 · Cited by 134 · see citing works
Chen, Z., Xiong, B., Chen, X., Min, G., & Li, J. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3396511 · Cited by 133 · see citing works
TinyML: Tools, applications, challenges, and future research directions
Kallimani, R., Pai, K., Raghuwanshi, P., Iyer, S., & López, O. L. A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16740-9 · Cited by 128 · see citing works
Scheduling IoT Applications in Edge and Fog Computing Environments: A Taxonomy and Future Directions
Goudarzi, M., Palaniswami, M. S., & Buyya, R. (2022) · ACM Computing Surveys · doi:10.1145/3544836 · Cited by 122 · see citing works
Self-citationVNF and CNF Placement in 5G: Recent Advances and Future Trends
Attaoui, W., Sabir, E., Elbiaze, H., & Guizani, M. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3264005 · Cited by 111 · see citing works
Advanced Deep Learning Models for 6G: Overview, Opportunities, and Challenges
Jiao, L., Shao, Y., Sun, L., Liu, F., Yang, S., Ma, W., Li, L., Liu, X., Hou, B., Zhang, X., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3418900 · Cited by 111 · see citing works
A decade of research in fog computing: Relevance, challenges, and future directions
Srirama, S. N. (2023) · Software Practice and Experience · doi:10.1002/spe.3243 · Cited by 110 · see citing works
Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
Liu, J., Du, Y., Yang, K., Wu, J., Wang, Y., Hu, X., Wang, Z., Liu, Y., Sun, P., Boukerche, A., et al. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3669216 · Cited by 92 · see citing works
Alsadie, D. (2024) · IEEE Access · doi:10.1109/access.2024.3447097 · Cited by 81 · see citing works
Liu, Z., Huang, L., Gao, Z., Luo, M., Hosseinalipour, S., & Dai, H. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3387707 · Cited by 63 · see citing works
A genetic-based approach for service placement in fog computing
Sarrafzade, N., Entezari‐Maleki, R., & Sousa, L. A. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-021-04254-w · Cited by 49 · see citing works
Ye, F., Ge, J., Zhang, S., Wu, J., & Luo, B. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3266226 · Cited by 44 · see citing works
Machine learning-based solutions for resource management in fog computing
Fahimullah, M., Ahvar, S., Agarwal, M., & Trocan, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16399-2 · Cited by 41 · see citing works
An Efficient Algorithm for Microservice Placement in Cloud-Edge Collaborative Computing Environment
He, X., Xu, H., Xu, X., Chen, Y., & Wang, Z. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3399650 · Cited by 41 · see citing works
Container Orchestration in Edge and Fog Computing Environments for Real-Time IoT Applications
Wang, Z., Goudarzi, M., Aryal, J., & Buyya, R. (2022) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-19-3391-2_1 · Cited by 37 · see citing works
Self-citationPallewatta, S., Kostakos, V., & Buyya, R. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3394486 · Cited by 35 · see citing works
Self-citationNahar, A., Mondal, K. K., Das, D., & Buyya, R. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3419016 · Cited by 34 · see citing works
Self-citationSattibabu, G., Ganesan, N., & Kumaran, R. S. (2025) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-024-01887-5 · Cited by 33 · see citing works
Bansal, M., Chana, I., & Clarke, S. (2022) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2022.3218044 · Cited by 33 · see citing works
An Efficient Processing Scheme for Concurrent Applications in the IoT Edge
Shi, T., Cai, Z., Li, J., Gao, H., Qiu, T., & Qu, W. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3219983 · Cited by 29 · see citing works
Luo, C., Zhang, J., Cheng, X., Hong, Y., Chen, Z., & Xing, X. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3321938 · Cited by 28 · see citing works
Goudarzi, M., Rodriguez, M. A., Sarvi, M., & Buyya, R. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3332308 · Cited by 27 · see citing works
Self-citationEnergy-Efficient Task Offloading for Distributed Edge Computing in Vehicular Networks
Lin, Z., Yang, J., Wu, C., & Chen, P. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3395893 · Cited by 27 · see citing works
Xu, S., Liu, Q., Gong, C., & Wen, X. (2025) · Sensors · doi:10.3390/s25113403 · Cited by 26 · see citing works
Aqib, M., Kumar, D., & Tripathi, S. (2022) · Wireless Personal Communications · doi:10.1007/s11277-022-10160-y · Cited by 26 · see citing works
FLight: A lightweight federated learning framework in edge and fog computing
Zhu, W., Goudarzi, M., & Buyya, R. (2023) · Software Practice and Experience · doi:10.1002/spe.3300 · Cited by 23 · see citing works
Self-citationDRL-Based Distributed Task Offloading Framework in Edge-Cloud Environment
Nashaat, H., Hashem, W., Rizk, R. Y., & Attia, R. M. (2024) · IEEE Access · doi:10.1109/access.2024.3371993 · Cited by 23 · see citing works
Zhang, D., Hu, Y., Zhang, S., & Zhang, Y. (2026) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2026.112249 · Cited by 23 · see citing works
TPTO: A Transformer-PPO based Task Offloading Solution for Edge Computing Environments
Gholipour, N., de Assunção, M. D., Agarwal, P., Gascon‐Samson, J., & Buyya, R. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00164 · Cited by 23 · see citing works
Self-citationDRLQ: A Deep Reinforcement Learning-based Task Placement for Quantum Cloud Computing
Nguyen, H. T., Usman, M., & Buyya, R. (2024) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud62652.2024.00060 · Cited by 22 · see citing works
Self-citationLera, I., & Guerrero, C. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06439-5 · Cited by 19 · see citing works
A Reinforcement Learning-Driven Task Scheduling Algorithm for Multi-Tenant Distributed Systems
Zhang, X., Wang, X., & Wang, X. (2025) · International Conference on Intelligent Communications and Computing (ICICC) · doi:10.1109/icicc66840.2025.11199662 · Cited by 19 · see citing works
Ghafari, R., & Mansouri, N. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127214 · Cited by 18 · see citing works
Optimization of resource-aware parallel and distributed computing: a review
Czarnul, P., Antal, M., Baniata, H., Griebler, D., Kertész, A., Keßler, C. W., Kouloumpris, A., Kovačić, S., Márkus, A., Michael, M. K., et al. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07295-7 · Cited by 18 · see citing works
A Triple-Tap Hybrid Load Balancing System (TTHLB) for Health Monitoring System
Ponnapalli, S., Dornala, R. R., & Vallabaneni, S. P. (2023) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac58438.2023.10290416 · Cited by 17 · see citing works
Naresh, M., Das, V., Saxena, P., & Gupta, M. (2022) · Computing · doi:10.1007/s00607-021-01046-1 · Cited by 16 · see citing works
Baskar, R., Mohanraj, E., Saradha, M., & Monika, R.-M. (2025) · Scientific Reports · doi:10.1038/s41598-025-85142-8 · Cited by 15 · see citing works
Su, C., Wei, J., Lin, D., Kong, L., & Guan, Y. L. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3314496 · Cited by 14 · see citing works
An Analysis of Methods and Metrics for Task Scheduling in Fog Computing
Misirli, J., & Casalicchio, E. (2023) · Future Internet · doi:10.3390/fi16010016 · Cited by 14 · see citing works
Maia, A. M., & Ghamri-Doudane, Y. M. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437143 · Cited by 14 · see citing works
Offloading Coalition Formation for Scheduling Scientific Workflow Ensembles in Fog Environments
Siar, H., & Izadi, M. (2021) · Journal of Grid Computing · doi:10.1007/s10723-021-09574-y · Cited by 14 · see citing works
Distributed Computation Offloading in Mobile Fog Computing: A Deep Neural Network Approach
Yang, Z., & Bai, W. (2021) · IEEE Communications Letters · doi:10.1109/lcomm.2021.3138800 · Cited by 13 · see citing works
Bushehrian, O., & Moazeni, A. (2024) · Computing · doi:10.1007/s00607-024-01353-3 · Cited by 13 · see citing works
Edge Server Selection with Round-Robin-Based Task Processing in Multiserver Mobile Edge Computing
Hasan, K. F., & Yazıcı, M. A. (2025) · Sensors · doi:10.3390/s25113443 · Cited by 13 · see citing works
Adaptive Deep Learning Architectures for Real-Time Data Streams in Edge Computing Environments
Sıcakyüz, Ç., Almufti, S. M., & Rustamova, N. R. (2024) · Qubahan Techno Journal · doi:10.48161/qtj.v3n2a25 · Cited by 13 · see citing works
Distributed Machine Learning and Native AI Enablers for End-to-End Resources Management in 6G
Karachalios, O. A., Zafeiropoulos, A., Kontovasilis, K. P., & Papavassiliou, S. (2023) · Electronics · doi:10.3390/electronics12183761 · Cited by 12 · see citing works
Wang, J., Zhu, K., Dai, P., & Han, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3322748 · Cited by 12 · see citing works
Liu, L., & Zhang, Y. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.107588 · Cited by 11 · see citing works
Reinforcement Learning-Driven Service Placement in 6G Networks across the Compute Continuum
Ocampo, A. F., & Santos, J. (2024) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm62983.2024.10814365 · Cited by 11 · see citing works
QoS-Ensured Model Optimization for AIoT: A Multi-Scale Reinforcement Learning Approach
Wu, G., Zhou, F., Qu, Y., Luo, P., & Li, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3294512 · Cited by 10 · see citing works
SPACE4AI-D: A Design-time Tool for AI applications Resource Selection in Computing Continua
Sedghani, H., Filippini, F., & Ardagna, D. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3479935 · Cited by 9 · see citing works
Egwuche, O. S., Greeff, J., & Ezugwu, A. E.-S. (2025) · IEEE Access · doi:10.1109/access.2025.3535870 · Cited by 9 · see citing works
Yamsani, N., & Reddy, P. C. (2025) · Array · doi:10.1016/j.array.2025.100645 · Cited by 9 · see citing works
Efficient Resource Allocation in Blockchain-Assisted Health Care Systems
Alfakeeh, A. S., & Javed, M. A. (2023) · Applied Sciences · doi:10.3390/app13179625 · Cited by 8 · see citing works
LESP:A fault-aware internet of things service placement in fog computing
Apat, H. K., & Sahoo, B. (2025) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2025.101097 · Cited by 8 · see citing works
Graph Reinforcement and Asynchronous Federated Learning based task offloading in fog computing
Verma, N. K., & Naik, K. J. (2025) · Physical Communication · doi:10.1016/j.phycom.2025.102776 · Cited by 7 · see citing works
Shang, C., Fu, L., Xiao, H., Bao, X., & Xu, X. (2024) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2024.3372945 · Cited by 7 · see citing works
Resource Allocation and Placement in Multi-access Edge Computing
Xu, Y., He, Z., & Li, K. (2024) · Studies in big data · doi:10.1007/978-981-97-2644-8_3 · Cited by 7 · see citing works
Pakpahan, M. S. M., Nugroho, L. E., & Widyawan, W. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.104299 · Cited by 7 · see citing works
Song, X., Feng, J., Liu, L., Pei, Q., Yu, F. R., & Zhang, N. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3619100 · Cited by 6 · see citing works
SecDS: A security-aware DAG task scheduling strategy for edge computing
Long, L., Liu, Z., Shen, J., & Jiang, Y. F. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.107627 · Cited by 6 · see citing works
Ali, B., Golec, M., Gill, S. S., Cuadrado, F., & Uhlig, S. (2025) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2025.3602521 · Cited by 6 · see citing works
HierRL: Hierarchical Reinforcement Learning for Task Scheduling in Distributed Systems
Guan, Y., Liu, Y., Li, Y., & Xu, X. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892507 · Cited by 6 · see citing works
Distributed deep reinforcement learning architecture for task offloading in autonomous IoT systems
Boni, A. K. C. S., Hablatou, Y., Hassan, H., & Drira, K. (2022) · International Conference on the Internet of Things (IoT) · doi:10.1145/3567445.3567454 · Cited by 6 · see citing works
Liu, H., Zheng, G., Liu, Z., Tian, S., & Li, Y. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3639051 · Cited by 5 · see citing works
Manik, K. H., Nath, A., Rimi, M. A. P., Ahmed, R., Rhine, A., Hasan, M. J., Mim, J. J., & Hossain, N. (2026) · Next Materials · doi:10.1016/j.nxmate.2026.102175 · Cited by 5 · see citing works
Distributed Reinforcement Learning for IoT Security in Heterogeneous and Distributed Networks
Jagatheesaperumal, S. K., Rahouti, M., Aledhari, M., Hafid, A., Oliveira, D., Drid, H., & Amin, R. (2024) · Computing&AI Connect · doi:10.69709/caic.2024.100109 · Cited by 5 · see citing works
Shang, X., Liu, Z., Gao, D., Yang, D., Zhang, W., Foh, C. H., & Zhang, H. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3574618 · Cited by 5 · see citing works
Duan, Q., Huang, J. G., Hu, S., Deng, R., Lu, Z., & Yu, S. (2022) · doi:10.36227/techrxiv.21788450 · Cited by 5 · see citing works
EFTR-HGNet: An Efficient Rescheduling Method of Edge Service Tasks in Fault Scene
Yao, L., Wang, Y., & Li, K. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3595407 · Cited by 4 · see citing works
Tiwari, N. (2025) · International Conference on Artificial Intelligence and Machine Vision (AIMV) · doi:10.1109/aimv66517.2025.11203535 · Cited by 4 · see citing works
Trabelsi, M., Bendaoud, N. M. M., & Ahmed, S. B. (2023) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc58397.2023.10217950 · Cited by 4 · see citing works
Heterogeneous Resources in Infrastructures of the Edge Network Paradigm: A Comprehensive Review
Alsaffar, Q. S., & Ayed, L. J. B. (2024) · Karbala International Journal of Modern Science · doi:10.33640/2405-609x.3360 · Cited by 4 · see citing works
Lyu, Z., Li, P., Wei, Z., Fan, Y., Xu, J., & Shi, L. (2024) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-024-01766-z · Cited by 4 · see citing works
Tamura, Y., & Yamada, S. (2023) · International Journal of Reliability Quality and Safety Engineering · doi:10.1142/s0218539323500109 · Cited by 4 · see citing works
Xiao, J., Wang, Q., & Zhou, Y. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111260 · Cited by 3 · see citing works
Data Orchestration Service Placement and Resource Allocation Scheme for Cloud-Edge System
Liu, Y., He, Z., Xie, X., Liu, A., Li, Z., & Deng, Q. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3660225 · Cited by 3 · see citing works
Nguyen, H. T., Usman, M., & Buyya, R. (2026) · ACM Transactions on Quantum Computing · doi:10.1145/3799898 · Cited by 3 · see citing works
Self-citationIntelligent Management at the Edge
Mosahebfard, M., Torres-Pérez, C., Carmona-Cejudo, E., Cordova, A. C., Martínez, A. P., Camargo, B. J. S., Coronado, E., & Siddiqui, M. S. (2023) · River Publishers eBooks · doi:10.1201/9781032632407-9 · Cited by 3 · see citing works
An efficient computational offloading method using deep reinforcement learning in edge-end-cloud
Liu, X., Feng, L., Zhang, P., Yu, Y., & Wang, J. (2025) · Ad Hoc Networks · doi:10.1016/j.adhoc.2025.103941 · Cited by 3 · see citing works
Sun, Y., Zhang, C., & Huang, T. (2024) · Journal of Grid Computing · doi:10.1007/s10723-024-09770-6 · Cited by 3 · see citing works
Blockchain Assisted Trust Management for Data-Parallel Distributed Learning
Song, Y., He, D., Dai, M., Chan, S., Choo, K. R., & Guizani, M. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3521443 · Cited by 3 · see citing works
Duan, Q., Huang, J. G., Hu, S., Deng, R., Lu, Z., & Yu, S. (2022) · doi:10.36227/techrxiv.21788450.v1 · Cited by 3 · see citing works
Wang, Y., He, Y., Liu, G., & Li, K. (2025) · ACM Transactions on Internet Technology · doi:10.1145/3762993 · Cited by 2 · see citing works
Application Placement with Constraint Relaxation
Azzolini, D., DUCA, M., GALLO, F., Ielo, A., & Forti, S. (2025) · Theory and Practice of Logic Programming · doi:10.1017/s1471068425100148 · Cited by 2 · see citing works
Service placement in the continuum: A systematic literature review
Sajjad, W., Farreras, M., García, J., & Masip‐Bruin, X. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108370 · Cited by 2 · see citing works
Lakshmi, M. S., Kiran, P., Suneetha, S., Sri, B. S., Madala, S. R., Bhagavatham, N. K., & Bhavsingh, M. (2025) · Journal of Robotics and Control (JRC) · doi:10.18196/jrc.v6i4.25026 · Cited by 2 · see citing works
Deep Reinforcement Learning Based Beamforming in RIS-Assisted MIMO System Under Hardware Loss
Sun, Y., Bai, Z., Zhao, J., Ma, D., Xian, Z., & Kwak, K. (2024) · International Conference on Advanced Communications Technology (ICACT) · doi:10.23919/icact60172.2024.10472006 · Cited by 2 · see citing works
Intelligent Service Provisioning in Fog Computing
Pittalà, G. F., & Cerroni, W. (2023) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft57336.2023.10175416 · Cited by 2 · see citing works
On the Partial Offloading to Multiple Helpers-Based Task Offloading for IoT Networks
Malik, U. M., Javed, M. A., AlMohimeed, A., Alkhathami, M., & Almujalli, A. (2024) · IEEE Access · doi:10.1109/access.2024.3452588 · Cited by 1 · see citing works
Mobile Application Placement in Multi-access Edge Computing Environments
Schuster, D., Hesenius, M., & Gruhn, V. (2024) · International Conference on Fog and Mobile Edge Computing (FMEC) · doi:10.1109/fmec62297.2024.10710198 · Cited by 1 · see citing works
Li, Y., Liu, Y., Liu, X., Xie, Y., & Wu, P. (2025) · International Conference on Electrical Automation and Artificial Intelligence (ICEAAI) · doi:10.1109/iceaai64185.2025.10957692 · Cited by 1 · see citing works
Computing-Aware Routing for LEO Satellite Networks Based on Multi-Step DQN
Li, Y., Wang, H., Zhang, Z., Lv, H., Lin, J., & Feng, G. (2024) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn63567.2024.00051 · Cited by 1 · see citing works
Stability-Oriented Heterogeneous Application Re-Deployment in Mobile Edge Computing
Zhang, G., Jia, S., Xu, L., Xu, B., Wu, W., & Zheng, L. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3592382 · Cited by 1 · see citing works
- Authors
- Goudarzi, M., Palaniswami, M., & Buyya, R.
- Affiliations
- The University of Melbourne (AU)
- Venue
- IEEE Transactions on Mobile Computing
- Published
- 2023-05-01
- Volume
- 22
- Issue
- 5
- Pages
- 2491-2505
- ISSN
- 1536-1233 (ISSN-L)
- 1558-0660
- 2161-9875
- OpenAlex
- W3208229128
- Cited by
- 155
- References
- 40
- Citations by year
- 2026: 31 · 2025: 41 · 2024: 40 · 2023: 27 · 2022: 13 · 2021: 3
- FWCI
- 9.31
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Mobile Computing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Keywords
- application placement, edge computing, fog computing, deep reinforcement learning, distributed training, impala, actor-critic, directed acyclic graphs, Internet of Things, task placement, execution cost, recurrent neural networks, replay buffer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review