Exploring Deep-Reinforcement-Learning-Assisted Federated Learning for Online Resource Allocation in Privacy-Preserving EdgeIoT
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Federated learning (FL) has been increasingly considered to preserve data training privacy from eavesdropping attacks in mobile-edge computing-based Internet of Things (EdgeIoT). On the one hand, the learning accuracy of FL can be improved by selecting the IoT devices with large data sets for training, which gives rise to a higher energy consumption. On the other hand, the energy consumption can be reduced by selecting the IoT devices with small data sets for FL, resulting in a falling learning accuracy. In this article, we formulate a new resource allocation problem for privacy-preserving EdgeIoT to balance the learning accuracy of FL and the energy consumption of the IoT device. We propose a new FL-enabled twin-delayed deep deterministic policy gradient (FL-DLT3) framework to achieve the optimal accuracy and energy balance in a continuous domain. Furthermore, long short-term memory (LSTM) is leveraged in FL-DLT3 to predict the time-varying network state while FL-DLT3 is trained to select the IoT devices and allocate the transmit power. Numerical results demonstrate that the proposed FL-DLT3 achieves fast convergence (less than 100 iterations) while the FL accuracy-to-energy consumption ratio is improved by 51.8% compared to the existing state-of-the-art benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650 · cited 2×
“FL-DLT3 leverages the actor–critic neural network structure to develop the TD3-based DRL [44].”
BackgroundMobile Edge Computing: A Survey on Architecture and Computation Offloading
Mach, P., & Becvar, Z. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2682318 · Cited by 3,258 · cited 1×
“computation-intensive tasks to computationally powerful edge servers [4], [5].”
BackgroundUnderstanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875 · cited 7×
“In [18], different IoT devices own different computing capabilities and wireless channel conditions, resulting in different local model training time and upload time.”
BackgroundInfluentialClient Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Dynamic computation offloading for mobile-edge computing with energy harvesting devices
Mao, Y., Zhang, J., & Letaief, K. B. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2611964 · Cited by 1,705 · cited 1×
“According to [34] and [35], the energy consumption on ckDt,k CPU cycles at IoT device k is E t,k1 = ζkckDt,kf 2 k (4)”
BackgroundSim-to-Real Transfer of Robotic Control with Dynamics Randomization
Peng, X. B., Andrychowicz, M., Zaremba, W., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460528 · Cited by 1,309
Energy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153 · cited 1×
“According to [34] and [35], the energy consumption on ckDt,k CPU cycles at IoT device k is E t,k1 = ζkckDt,kf 2 k (4)”
BackgroundAbdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796 · cited 1×
“By iteratively training the local model at the IoT device and updating the global model at the edge server, the learning accuracy of FL on the data classification and event prediction can be progressively improved [16].”
MethodSelf-citationIoT Security Techniques Based on Machine Learning: How Do IoT Devices Use AI to Enhance Security?
Xiao, L., Wan, X., Lu, X., Zhang, Y., & Wu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2825478 · Cited by 681
A Learning-Based Incentive Mechanism for Federated Learning
Zhan, Y., Li, P., Qu, Z., Zeng, D., & Guo, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2967772 · Cited by 602
Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism
Khan, L. U., Pandey, S. R., Tran, N. H., Saad, W., Han, Z., Nguyen, M. N. H., & Hong, C. S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900649 · Cited by 506 · cited 1×
“According to [36]–[38], the accuracy of FL, denoted by (βt,k), can be simplified as”
BackgroundFederated learning over wireless networks Convergence analysis and resource allocation
Dinh, C. T., Tran, N. H., Nguyen, M. N. H., Hong, C. S., Bao, W., Zomaya, A. Y., & Gramoli, V. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2020.3035770 · Cited by 483 · cited 1×
“According to [33], the computation time of training the local model at device k in the each tth round [33], we have”
MethodInternet of Things Intrusion Detection: Centralized, On-Device, or Federated Learning?
Rahman, S. A., Tout, H., Talhi, C., & Mourad, A. (2020) · IEEE Network · doi:10.1109/mnet.011.2000286 · Cited by 414 · cited 1×
“In EdgeIoT, offloading the source data of the IoT devices to the edge server is vulnerable to eavesdropping attacks [6], [7].”
Collaborative Federated Learning for Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge
Qayyum, A., Ahmad, K., Ahsan, M. A., Al-Fuqaha, A., & Qadir, J. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3206407 · Cited by 345 · cited 1×
“, labels of the image) of the FL model [31], respectively.”
BackgroundSecurity in Mobile Edge Caching with Reinforcement Learning
Xiao, L., Wan, X., Dai, C., Du, X., Chen, X., & Guizani, M. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700291 · Cited by 228
Self-citation
Cited by
When Internet of Things Meets Metaverse: Convergence of Physical and Cyber Worlds
Li, K., Cui, Y., Li, W., Lv, T., Yuan, X., Li, S., Ni, W., Simsek, M., & Dressler, F. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3232845 · Cited by 266
Self-citationWan, Y., Qu, Y., Ni, W., Xiang, Y., Gao, L., & Hossain, E. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3361451 · Cited by 152
Self-citationAdam, M., & Baroudi, U. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3506214 · Cited by 46
Data-Agnostic Model Poisoning Against Federated Learning: A Graph Autoencoder Approach
Li, K., Zheng, J., Yuan, X., Ni, W., Akan, O. B., & Poor, H. V. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3362147 · Cited by 41
Self-citationExploring Adversarial Graph Autoencoders to Manipulate Federated Learning in The Internet of Things
Li, K., Yuan, X., Zheng, J., Ni, W., & Guizani, M. (2023) · 2023 International Wireless Communications and Mobile Computing (IWCMC) · doi:10.1109/iwcmc58020.2023.10183217 · Cited by 8
Self-citation
Metadata
- Authors
- Zheng, J., Li, K., Mhaisen, N., Ni, W., Tovar, E., & Guizani, M.
- Venue
- IEEE Internet of Things Journal
- Published
- 2022-11-01
- Volume
- 9
- Issue
- 21
- Pages
- 21099-21110
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W4293195534
- Cited by
- 87
- References
- 19
- FWCI
- 8.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.