The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Optimizing Federated Learning in Distributed Industrial IoT: A Multi-Agent Approach
Abstract
In this paper, we aim to make the best joint decision of device selection and computing and spectrum resource allocation for optimizing federated learning (FL) performance in distributed industrial Internet of Things (IIoT) networks. To implement efficient FL over geographically dispersed data, we introduce a three-layer collaborative FL architecture to support deep neural network (DNN) training. Specifically, using the data dispersed in IIoT devices, the industrial gateways locally train the DNN model and the local models can be aggregated by their associated edge servers every FL epoch or by a cloud server every a few FL epochs for obtaining the global model. To optimally select participating devices and allocate computing and spectrum resources for training and transmitting the model parameters, we formulate a stochastic optimization problem with the objective of minimizing FL evaluating loss while satisfying delay and long-term energy consumption requirements. Since the objective function of the FL evaluating loss is implicit and the energy consumption is temporally correlated, it is difficult to solve the problem via traditional optimization methods. Thus, we propose a “Reinforcement on Federated” (RoF) scheme, based on deep multi-agent reinforcement learning, to solve the problem. Specifically, the RoF scheme is executed decentralizedly at edge servers, which can cooperatively make the optimal device selection and resource allocation decisions. Moreover, a device refinement subroutine is embedded into the RoF scheme to accelerate convergence while effectively saving the on-device energy. Simulation results demonstrate that the RoF scheme can facilitate efficient FL and achieve better performance compared with state-of-the-art benchmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · cited 14×
“In summary, there are 5 × M FCNNs should be considered in the MASAC, thus the total computational complexity of the algorithm is 5 × M × K .”
BackgroundInfluentialA Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985 · cited 1×
“Utilized tremendous data, deep learning approaches, especially deep neural networks (DNNs) can facilitate industrial intelligence [4].”
BackgroundFederated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Industrial Internet of Things: Challenges, Opportunities, and Directions
Sisinni, E., Saifullah, A., Han, S., Jennehag, U., & Gidlund, M. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2852491 · Cited by 2,380
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 1×
“[20] aimed at maximizing the number of participating devices in each FL epoch via exploiting superposition property of wireless multiple-access channels.”
BackgroundClient-Edge-Cloud Hierarchical Federated Learning
Liu, L., Zhang, J., Song, S. H., & Letaief, K. B. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148862 · Cited by 1,033
Optimizing Federated Learning on Non-IID Data with Reinforcement Learning
Wang, H., Kaplan, Z., Niu, D., & Li, B. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications · doi:10.1109/infocom41043.2020.9155494 · Cited by 981
Reliable Federated Learning for Mobile Networks
Kang, J., Xiong, Z., Niyato, D., Zou, Y., Zhang, Y., & Guizani, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900119 · Cited by 617
Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
Cui, J., Liu, Y., & Nallanathan, A. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2935201 · Cited by 593
Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933962 · Cited by 559
Peng, H., & Shen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036962 · Cited by 521
Self-citationAI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Self-citationA Crowdsourcing Framework for On-Device Federated Learning
Pandey, S. R., Tran, N. H., Bennis, M., Tun, Y. K., Manzoor, A., & Hong, C. S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2971981 · Cited by 318
Energy-Efficient Radio Resource Allocation for Federated Edge Learning
Zeng, Q., Du, Y., Huang, K., & Leung, K. K. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145118 · Cited by 286
On the Computational Efficiency of Training Neural Networks
Livni, R., Shalev‐Shwartz, S., & Shamir, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.1141 · Cited by 245
Peng, H., & Shen, X. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.2978856 · Cited by 222
Self-citationGunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning
Wu, W., Chen, N., Zhou, C., Li, M., Shen, X., Zhuang, W., & Li, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041405 · Cited by 186
Self-citationDeng, S., Xiang, Z., Zhao, P., Taheri, J., Gao, H., Yin, J., & Zomaya, A. Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2974875 · Cited by 167
Fast mmwave Beam Alignment via Correlated Bandit Learning
Wu, W. R., Cheng, N., Zhang, N., Yang, P., Zhuang, W., & Shen, X. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2940454 · Cited by 154
Self-citationMulti-Tenant Cross-Slice Resource Orchestration: A Deep Reinforcement Learning Approach
Chen, X., Zhao, Z., Wu, C., Bennis, M., Liu, H., Ji, Y., & Zhang, H. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933893 · Cited by 137
Self-citationOn-Board Deep Q-Network for UAV-Assisted Online Power Transfer and Data Collection
Li, K., Ni, W., Tovar, E., & Jamalipour, A. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2945037 · Cited by 108
Zhang, W., Yang, D., Xu, Y., Huang, X., Zhang, J., & Gidlund, M. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3029551 · Cited by 87
Self-citationConvergence Time Minimization of Federated Learning over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. R. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148815 · Cited by 76
Data Management for Future Wireless Networks: Architecture, Privacy Preservation, and Regulation
Shen, X., Huang, C., Liu, D., Xue, L., Zhuang, W., Sun, R., & Ying, B. (2021) · IEEE Network · doi:10.1109/mnet.011.2000666 · Cited by 64
Self-citationDeep-Reinforcement-Learning-Based Latency Minimization in Edge Intelligence Over Vehicular Networks
Zhao, N., Wu, H., Yu, F. R., Wang, L., Zhang, W., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078480 · Cited by 29
Self-citationChen, L., & Xu, J. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036953 · Cited by 16
Spectrum and Computing Resource Management for Federated Learning in Distributed Industrial IoT
Zhang, W., Yang, D., Wu, W. R., Peng, H., Zhang, H., & Shen, X. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473515 · Cited by 15
Self-citationCommunication, Computing, and Learning on the Edge
Huang, K., Zhu, G., You, C., et al. (2018) · IEEE International Conference on Communication Systems (ICCS) · doi:10.1109/iccs.2018.8689229 · Cited by 8
Federated Learning and Control at the Wireless Network Edge
Bennis, M. (2021) · GetMobile Mobile Computing and Communications · doi:10.1145/3447853.3447857 · Cited by 5
Cited by
Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges
Yang, W., Du, H., Liew, Z. Q., Lim, W. Y. B., Xiong, Z., Niyato, D., Chi, X., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3223224 · Cited by 670
Self-citationA Tutorial on Extremely Large-Scale MIMO for 6G: Fundamentals, Signal Processing, and Applications
Wang, Z., Zhang, J., Du, H., Niyato, D., Cui, S., Ai, B., Debbah, M., Letaief, K. B., & Poor, H. V. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3349276 · Cited by 449
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Self-citationHolistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Self-citationDecentralized Federated Learning: A Survey and Perspective
Yuan, L., Wang, Z., Sun, L., Yu, P. S., & Brinton, C. G. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3407584 · Cited by 290
Metadata
- Authors
- Zhang, W., Yang, D., Wu, W., Peng, H., Zhang, N., Zhang, H., & Shen, X.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-12
- Volume
- 39
- Issue
- 12
- Pages
- 3688-3703
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3205260830
- Cited by
- 300
- References
- 37
- FWCI
- 22.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.