The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning
Open accessAbstract
To enable the large scale and efficient deployment of Artificial Intelligence (AI), the confluence of AI and Edge Computing has given rise to Edge Intelligence, which leverages on the computation and communication capabilities of end devices and edge servers to process data closer to where it is produced. One of the enabling technologies of Edge Intelligence is the privacy preserving machine learning paradigm known as Federated Learning (FL), which enables data owners to conduct model training without having to transmit their raw data to third-party servers. However, the FL network is envisioned to involve thousands of heterogeneous distributed devices. As a result, communication inefficiency remains a key bottleneck. To reduce node failures and device dropouts, the Hierarchical Federated Learning (HFL) framework has been proposed whereby cluster heads are designated to support the data owners through intermediate model aggregation. This decentralized learning approach reduces the reliance on a central controller, e.g., the model owner. However, the issues of resource allocation and incentive design are not well-studied in the HFL framework. In this article, we consider a two-level resource allocation and incentive mechanism design problem. In the lower level, the cluster heads offer rewards in exchange for the data owners' participation, and the data owners are free to choose which cluster to join. Specifically, we apply the evolutionary game theory to model the dynamics of the cluster selection process. In the upper level, each cluster head can choose to serve a model owner, whereas the model owners have to compete amongst each other for the services of the cluster heads. As such, we propose a deep learning based auction mechanism to derive the valuation of each cluster head's services. The performance evaluation shows the uniqueness and stability of our proposed evolutionary game, as well as the revenue maximizing properties of the deep learning based auction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Edge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733
Myerson, R. B. (1981) · Mathematics of Operations Research · doi:10.1287/moor.6.1.58 · Cited by 5,920
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Self-citationTowards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875 · cited 1×
“Several works have proposed a variety of solutions, e.g., model compression techniques such as quantization and subsampling [17], client selection protocols to reduce the occurrences of stragglers [13], as well as Broadband Analog Aggregation (BAA) with over-the-air computation [18].”
BackgroundClient Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
Hofbauer, J., & Sigmund, K. (2003) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-03-00988-1 · Cited by 1,354
Energy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148 · cited 1×
“This has enabled several practical applications, e.g., in the development of next-word-prediction models for text messaging [6], healthcare [7], Unmanned Aerial Vehicles (UAV) sensing [8], and mobile edge computing [9].”
Low energy adaptive clustering hierarchy with deterministic cluster-head selection
Handy, M. J., Haase, M., & Timmermann, D. (2003) · 4th International Workshop on Mobile and Wireless Communications Network · doi:10.1109/mwcn.2002.1045790 · Cited by 1,110
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 2×
“Several works have proposed a variety of solutions, e.g., model compression techniques such as quantization and subsampling [17], client selection protocols to reduce the occurrences of stragglers [13], as well as Broadband Analog Aggregation (BAA) with over-the-air computation [18].”
BackgroundIn-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 1×
“This has enabled several practical applications, e.g., in the development of next-word-prediction models for text messaging [6], healthcare [7], Unmanned Aerial Vehicles (UAV) sensing [8], and mobile edge computing [9].”
Federated learning of predictive models from federated Electronic Health Records
Brisimi, T. S., Chen, R., Mela, T., Olshevsky, A., Paschalidis, I. C., & Shi, W. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.01.007 · Cited by 997 · cited 2×
“This has enabled several practical applications, e.g., in the development of next-word-prediction models for text messaging [6], healthcare [7], Unmanned Aerial Vehicles (UAV) sensing [8], and mobile edge computing [9].”
MethodA Learning-Based Incentive Mechanism for Federated Learning
Zhan, Y., Li, P., Qu, Z., Zeng, D., & Guo, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2967772 · Cited by 602
Ortmann, A., & Weibull, J. W. (1997) · Southern Economic Journal · doi:10.2307/1061129 · Cited by 588
Dynamics of Network Selection in Heterogeneous Wireless Networks: An Evolutionary Game Approach
Niyato, D., & Hossain, E. (2009) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2008.2004588 · Cited by 470
Self-citationHierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
Learning Graph-based POI Embedding for Location-based Recommendation
Xie, M., Yin, H., Wang, H., Xu, F., Chen, W., & Wang, S. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983711 · Cited by 391
Lim, W. Y. B., Huang, J., Xiong, Z., Kang, J., Niyato, D., Hua, X.-S., Leung, C., & Miao, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3056341 · Cited by 318
Self-citationKe, R., Li, Z., Tang, J., Pan, Z., & Wang, Y. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2797697 · Cited by 292
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90123-6 · Cited by 281
Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks
Lim, W. Y. B., Xiong, Z., Miao, C., Niyato, D., Yang, Q., Leung, C., & Poor, H. V. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2985694 · Cited by 233
Self-citationLuong, N. C., Xiong, Z., Wang, P., & Niyato, D. (2018) · 2018 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2018.8422743 · Cited by 229
Self-citationMonitoring road traffic with a UAV-based system
Elloumi, M., Dhaou, R., Escrig, B., Idoudi, H., & Saidane, L. A. (2018) · 2018 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2018.8377077 · Cited by 182
Towards Efficient Data Valuation Based on the Shapley Value
Jia, R., Dao, D., Wang, B., Hubis, F. A., Hynes, N., Gürel, N. M., Li, B., Zhang, C., Song, D. X., & Spanos, C. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10275 · Cited by 168
Sastry, S. (1999) · Interdisciplinary applied mathematics · doi:10.1007/978-1-4757-3108-8_5 · Cited by 132
6G White Paper on Edge Intelligence
Peltonen, E., Bennis, M., Capobianco, M., Debbah, M., Ding, A., Gil-Castiñeira, F., Jurmu, M., Karvonen, T., Kelanti, M., Kliks, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.14850 · Cited by 118 · cited 2×
“14, 15, and 16, we observe that the revenue of the cluster heads determined by the deep-learning based auction is consistently higher than that of the conventional SPA scheme.”
MethodResultGong, X., Duan, L., Chen, X., & Zhang, J. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2659059 · Cited by 105
Optimal Auctions through Deep Learning
Dütting, P., Feng, Z., Narasimhan, H., Parkes, D. C., & Ravindranath, S. S. (2019) · International Conference on Machine Learning · Cited by 91
Optimal auctions through deep learning
Dütting, P., Feng, Z., Narasimhan, H., Parkes, D. C., & Ravindranath, S. S. (2021) · Communications of the ACM · doi:10.1145/3470442 · Cited by 90
Self Organizing Federated Learning Over Wireless Networks: A Socially Aware Clustering Approach
Khan, L. U., Alsenwi, M., Han, Z., & Hong, C. S. (2020) · International Conference on Information Networking · doi:10.1109/icoin48656.2020.9016505 · Cited by 64
Socially aware cluster formation and radio resource allocation in D2D networks
Zhang, G., Yang, K., & Chen, H. (2016) · IEEE Wireless Communications · doi:10.1109/mwc.2016.7553028 · Cited by 60
Mobile Device Training Strategies in Federated Learning: An Evolutionary Game Approach
Zou, Y., Feng, S., Niyato, D. T., Jiao, Y., Gong, S., & Cheng, W. (2019) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings/greencom/cpscom/smartdata.2019.00157 · Cited by 41
Self-citationIncentive Mechanism Design for Resource Sharing in Collaborative Edge LearningPreprint
Lim, W. Y. B., Ng, J. S., Xiong, Z., Niyato, D. T., Leung, C., Miao, C., & Yang, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.00511 · Cited by 40
Self-citationOptimal auctions through deep learning
Dütting, P., Feng, Z., Narasimhan, H., Parkes, D. C., & Ravindranath, S. S. (2019) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 35
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., & Hui, P. (2020) · Cited by 29
Wireless Communications for Collaborative Federated Learning in the Internet of Things.Preprint
Chen, M., Poor, H. V., Saad, W., et al. (2020) · arXiv (Cornell University) · Cited by 16
Cited by
Heterogeneous Federated Learning: State-of-the-art and Research Challenges
Ye, M., Fang, X., Du, B., Yuen, P. C., & Tao, D. (2024) · ACM Computing Surveys · doi:10.1145/3625558 · Cited by 608
Xu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
Self-citationModel aggregation techniques in federated learning: A comprehensive survey
Qi, P., Chiaro, D., Guzzo, A., Ianni, M., Fortino, G., & Piccialli, F. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2023.09.008 · Cited by 452
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Self-citationAkter, M., Moustafa, N., Lynar, T., & Razzak, I. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3192648 · Cited by 128
“Edge Intelligence provides well-organised Artificial Intelligence placement at edge servers by leveraging large-scale computation and connectivity capabilities to process data close to the end devices generated [9].”
Metadata
- Authors
- Lim, W. Y. B., Ng, J. S., Xiong, Z., Jin, J., Zhang, Y., Niyato, D., Leung, C., & Miao, C.
- Venue
- IEEE Transactions on Parallel and Distributed Systems
- Published
- 2022-03-01
- Volume
- 33
- Issue
- 3
- Pages
- 536-550
- ISSN
- 1045-9219 (ISSN-L)
- 1558-2183
- 2161-9883
- OpenAlex
- W3178661111
- Cited by
- 312
- References
- 39
- FWCI
- 18.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.