The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Split Learning Over Wireless Networks: Parallel Design and Resource Management
Open accessAbstract
Split learning (SL) is a collaborative learning framework, which can train an artificial intelligence (AI) model between a device and an edge server by splitting the AI model into a device-side model and a server-side model at a cut layer. The existing SL approach conducts the training process sequentially across devices, which incurs significant training latency especially when the number of devices is large. In this paper, we design a novel SL scheme to reduce the training latency, namedCluster-basedParallelSL(CPSL) which conducts model training in a “first-parallel-then-sequential” manner. Specifically, the CPSL is to partition devices into several clusters, parallelly train device-side models in each cluster and aggregate them, and then sequentially train the whole AI model across clusters, thereby parallelizing the training process and reducing training latency. Furthermore, we propose a resource management algorithm to minimize the training latency of CPSL considering device heterogeneity and network dynamics in wireless networks. This is achieved by stochastically optimizing the cut layer selection, device clustering, and radio spectrum allocation. The proposed two-timescale algorithm can jointly make the cut layer selection decision in a large timescale and device clustering and radio spectrum allocation decisions in a small timescale. Extensive simulation results on non-independent and identically distributed data demonstrate that the proposed solution can greatly reduce the training latency as compared with the existing SL benchmarks, while adapting to network dynamics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“12-layer chain-topology LeNet model [48], [51], which consists of six convolution (CONV) layers, three max-pooling (POOL) layers, and three fully-connected (FC) layers.”
BackgroundLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Reducibility among Combinatorial Problems
Karp, R. M. (1972) · Complexity of Computer Computations · doi:10.1007/978-1-4684-2001-2_9 · Cited by 11,511
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (1999) · Springer Texts in Statistics · doi:10.1007/978-1-4757-3071-5 · Cited by 2,278
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Energy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 1×
“Extensive works are devoted to optimizing FL performance from different research directions, such as multi-tier FL framework design to accommodate a large number of devices [6], [7], and model aggregation and compression techniques to reduce communication overhead [8], [9].”
BackgroundClient-Edge-Cloud Hierarchical Federated Learning
Liu, L., Zhang, J., Song, S. H., & Letaief, K. B. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148862 · Cited by 1,033
General Data Protection Regulation (GDPR)
Deaves, M. (2017) · Cited by 816
Distributed learning of deep neural network over multiple agents
Gupta, O., & Raskar, R. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.05.003 · Cited by 726
SplitFed: When Federated Learning Meets Split Learning
Thapa, C., Mahawaga Arachchige, P. C., Camtepe, S., & Sun, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20825 · Cited by 720
Reliable Federated Learning for Mobile Networks
Kang, J., Xiong, Z., Niyato, D., Zou, Y., Zhang, Y., & Guizani, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900119 · Cited by 617
Joint Service Caching and Task Offloading for Mobile Edge Computing in Dense Networks
Xu, J., Chen, L., & Zhou, P. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485977 · Cited by 585
Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933962 · Cited by 559
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Split learning for health: Distributed deep learning without sharing raw patient data
Vepakomma, P., Gupta, O., Swedish, T., & Raskar, R. (2018) · arXiv · doi:10.48550/arxiv.1812.00564 · Cited by 513
Holistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Self-citationAI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Self-citationOptimizing Federated Learning in Distributed Industrial IoT: A Multi-Agent Approach
Zhang, W., Yang, D., Wu, W., Peng, H., Zhang, N., Zhang, H., & Shen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118352 · Cited by 300
Self-citationEnd-to-End Evaluation of Federated Learning and Split Learning for Internet of Things
Gao, Y., Kim, M., Abuadbba, S., Kim, Y., Thapa, C., Kim, K., Camtep, S. A., Kim, H., & Nepal, S. (2020) · 2020 International Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00017 · Cited by 240
Split Learning for collaborative deep learning in healthcarePreprint
Poirot, M. G., Vepakomma, P., Chang, K., Kalpathy–Cramer, J., Gupta, R., & Raskar, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12115 · Cited by 225
Gunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
Zeng, Q., Du, Y., Huang, K., & Leung, K. K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3088910 · Cited by 214
Tang, J., Shim, B., & Quek, T. Q. S. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2898745 · Cited by 186
Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning
Wu, W., Chen, N., Zhou, C., Li, M., Shen, X., Zhuang, W., & Li, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041405 · Cited by 186
Self-citationAdaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach
Han, P., Wang, S., & Leung, K. K. (2020) · 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00026 · Cited by 181
Energy-Efficient Federated Edge Learning with Joint Communication and Computation Design
Mo, X., & Xu, J. (2021) · Journal of Communications and Information Networks · doi:10.23919/jcin.2021.9475121 · Cited by 164
Unleashing the Tiger: Inference Attacks on Split Learning
Pasquini, D., Ateniese, G., & Bernaschi, M. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3485259 · Cited by 163
Detailed comparison of communication efficiency of split learning and federated learning
Singh, A., Vepakomma, P., Gupta, O., & Raskar, R. (2019) · arXiv · doi:10.48550/arxiv.1909.09145 · Cited by 148
Thapa, C., Chamikara, M. A. P., & Camtepe, S. A. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-70604-3_4 · Cited by 141
The General Data Protection Regulation (GDPR)
Murphy, J. (2018) · PubMed · Cited by 126
HiveMind: Towards Cellular Native Machine Learning Model Splitting
Wang, S., Zhang, X., Uchiyama, H., & Matsuda, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118403 · Cited by 100
Privacy-Sensitive Parallel Split Learning
Jeon, J., & Kim, J. (2020) · International Conference on Information Networking · doi:10.1109/icoin48656.2020.9016486 · Cited by 93
Data Management for Future Wireless Networks: Architecture, Privacy Preservation, and Regulation
Shen, X., Huang, C., Liu, D., Xue, L., Zhuang, W., Sun, R., & Ying, B. (2021) · IEEE Network · doi:10.1109/mnet.011.2000666 · Cited by 64
Self-citationCommunication-Efficient Multimodal Split Learning for mmWave Received Power Prediction
Koda, Y., Park, J., Bennis, M., Yamamoto, K., Nishio, T., Morikura, M., & Nakashima, K. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2020.2978824 · Cited by 63
Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approach
Zhang, J., Li, N., & Dedeoğlu, M. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488818 · Cited by 53
Systematic Resource Allocation in Cloud RAN With Caching as a Service Under Two Timescales
Tang, J., Quek, T. Q. S., Chang, T., & Shim, B. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2934854 · Cited by 47
QoE-Driven Transmission-Aware Cache Placement and Cooperative Beamforming Design in Cloud-RANs
Sun, R., Wang, Y., Cheng, N., Lyu, L., Zhang, S., Zhou, H., & Shen, X. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2952726 · Cited by 47
Self-citationWu, H., Chen, J., Zhou, C., Li, J., & Shen, X. (2021) · Journal of Communications and Information Networks · doi:10.23919/jcin.2021.9549118 · Cited by 45
Self-citationCombining split and federated architectures for efficiency and privacy in deep learning
Turina, V., Zhang, Z., Esposito, F., & Matta, I. (2020) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3386367.3431678 · Cited by 43
5G and Satellite Network Convergence: Survey for Opportunities, Challenges and Enabler Technologies
Gaber, A., ElBahaay, M. A., Mohamed, A. M., Zaki, M. M., Abdo, A. S., & Abdelbaki, N. (2020) · Novel Intelligent and Leading Emerging Sciences Conference (NILES) · doi:10.1109/niles50944.2020.9257914 · Cited by 37
Learning the Optimal Partition for Collaborative DNN Training With Privacy Requirements
Zhang, L., & Xu, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3127715 · Cited by 20
Chen, L., & Xu, J. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036953 · Cited by 16
Cited by
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Self-citation
Metadata
- Authors
- Wu, W., Li, M., Qu, K., Zhou, C., Shen, X., Zhuang, W., Li, X., & Shi, W.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2023-04
- Volume
- 41
- Issue
- 4
- Pages
- 1051-1066
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W4319778953
- Cited by
- 278
- References
- 50
- FWCI
- 30.99
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.