The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Clustered Federated Learning With Adaptive Local Differential Privacy on Heterogeneous IoT Data
Abstract
The Internet of Things (IoT) is penetrating many aspects of our daily life with the proliferation of artificial intelligence applications. Federated learning (FL) has emerged as a promising paradigm enabling many intelligent IoT applications; however, the transmitted model gradients or weights still encode private information, which can be exploited to launch inference attacks. One popular way is to apply local differential privacy (LDP) into FL. However, existing work does not provide a practical solution due to two issues. First, the fine-grained range difference of weights in different layers of an FL model has not been explicitly considered. Second, the accumulated privacy budget may cause a budget explosion. In this article, we propose a local differentially private scheme to train clustered FL models on heterogeneous IoT data by using adaptive clipping, weight compression, and parameter shuffling (namely, ACS-FL), aimed at mitigating the curse of dimensionality, the amount of LDP noise, and the communication overhead of IoT devices. Empirical evaluations on MNIST, fashion-MNIST, and Federated Extended MNIST demonstrate that ACS-FL achieves a superior performance in balancing the tradeoff between privacy and utility.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Through adding noise to updates, differential privacy confirms that personal data cannot be derived from the final aggregated model, an important feature for handling sensitive health data in FL applications [87].”
From Federated Learning in Smart Healthcare: A Comprehensive Review on Privacy, Security, and Predictive Analytics with IoT Integration (2024) · cites this paper as [87]
In the citing paper
“Distinctive privacy is broadly adopted in FL to protect private contributions to model updates.”
From Federated Learning in Smart Healthcare: A Comprehensive Review on Privacy, Security, and Predictive Analytics with IoT Integration (2024) · cites this paper as [87]
Citations
Cites
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
Lin, J., Yu, W., Zhang, N., Yang, X., Zhang, H., & Zhao, W. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2683200 · Cited by 2,793
Federated Learning with Non-IID Data
Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., & Chandra, V. (2018) · arXiv · doi:10.48550/arxiv.1806.00582 · Cited by 2,077
SecureML: A System for Scalable Privacy-Preserving Machine Learning
Mohassel, P., & Zhang, Y. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.12 · Cited by 1,936
Zhu, L., & Han, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_2 · Cited by 1,906
Towards Personalized Federated Learning
Tan, A. Z., Yu, H., Cui, L., & Yang, Q. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3160699 · Cited by 1,474
Sattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355
Federated Multi-Task LearningPreprint
Smith, V., Chiang, C.-K., Sanjabi, M., & Talwalkar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10467 · Cited by 1,282
An Efficient Framework for Clustered Federated Learning
Ghosh, A., Chung, J., Yin, D., & Ramchandran, K. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3192506 · Cited by 956
LEAF: A Benchmark for Federated Settings
Caldas, S., Duddu, S. M. K., Wu, P., Li, T., Konečný, J., McMahan, H. B., Smith, V., & Talwalkar, A. (2018) · arXiv · doi:10.48550/arxiv.1812.01097 · Cited by 894
Personalized Federated Learning: A Meta-Learning ApproachPreprint
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv.org · doi:10.48550/arxiv.2002.07948 · Cited by 751
Agnostic Federated LearningPreprint
Mohri, M., Sivek, G., & Suresh, A. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00146 · Cited by 652
Yin, X., Zhu, Y., & Hu, J. (2022) · ACM Computing Surveys · doi:10.1145/3460427 · Cited by 638
Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning Approach
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · neural information processing systems · Cited by 596
Ditto: Fair and Robust Federated Learning Through PersonalizationPreprint
Li, T., Hu, S., Beirami, A., & Smith, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04221 · Cited by 536
Cai, Z., He, Z., Guan, X., & Li, Y. (2016) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2016.2613521 · Cited by 530
BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning
Zhang, C., Li, S., XIA, J., Wang, W., Yan, F., & Liu, Y. (2020) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 522
Self-Balancing Federated Learning With Global Imbalanced Data in Mobile Systems
Duan, M., Liu, D., Chen, X., Liu, R., Tan, Y., & Liang, L. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3009406 · Cited by 442
Minimax Optimal Procedures for Locally Private Estimation
Duchi, J. C., Jordan, M. I., & Wainwright, M. J. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1389735 · Cited by 439
LDP-Fed: federated learning with local differential privacy
Truex, S., Liu, L., Chow, K.-H., Gursoy, M. E., & Wei, W. (2020) · Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking · doi:10.1145/3378679.3394533 · Cited by 435
Collecting and Analyzing Multidimensional Data with Local Differential Privacy
Wang, N., Xiao, X., Yang, Y., Zhao, J., Hui, S. C., Shin, H., Shin, J., & Yu, G. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00063 · Cited by 420
Survey of Personalization Techniques for Federated Learning
Kulkarni, V., Kulkarni, M., & Pant, A. (2020) · World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4) · doi:10.1109/worlds450073.2020.9210355 · Cited by 381
Enabling Cognitive Smart Cities Using Big Data and Machine Learning: Approaches and Challenges
Mohammadi, M., & Al-Fuqaha, A. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700298 · Cited by 377
Broadening the Scope of Differential Privacy Using Metrics
Konstantinos Chatzikokolakis, A., Andrés, M. E., Bordenabe, N. E., & Catuscia Palamidessi, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39077-7_5 · Cited by 369
Security and Privacy in Metaverse: A Comprehensive Survey
Huang, Y., Li, Y. J., & Cai, Z. (2023) · Big Data Mining and Analytics · doi:10.26599/bdma.2022.9020047 · Cited by 313
LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy
Sun, L., Qian, J., & Chen, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/217 · Cited by 267
A Differential-Private Framework for Urban Traffic Flows Estimation via Taxi Companies
Cai, Z., Zheng, X., & Yu, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2911697 · Cited by 223
Realizing the Heterogeneity: A Self-Organized Federated Learning Framework for IoT
Pang, J., Huang, Y., Xie, Z., Han, Q., & Cai, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3007662 · Cited by 187
FedSel: Federated SGD Under Local Differential Privacy with Top-k Dimension Selection
Liu, R., Cao, Y., Yoshikawa, M., & Chen, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59410-7_33 · Cited by 141
An Ensemble Learning Based Intrusion Detection Model for Industrial IoT Security
Mohy-eddine, M., Guezzaz, A., Benkirane, S., Azrour, M., & Farhaoui, Y. (2023) · Big Data Mining and Analytics · doi:10.26599/bdma.2022.9020032 · Cited by 139
Privacy-Preserving Federated Depression Detection From Multisource Mobile Health Data
Xu, X., Peng, H. M., Bhuiyan, M. Z. A., Hao, Z., Liu, L., Sun, L., & He, L. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3113708 · Cited by 110
Secure and Utility-Aware Data Collection with Condensed Local Differential Privacy
Gürsoy, M. E., Tamersoy, A., Truex, S., Wei, W., & Liu, L. (2019) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2019.2949041 · Cited by 87
Differentially Private Releasing via Deep Generative ModelPreprint
Zhang, X., Ji, S., & Wang, T. (2018) · arXiv (Cornell University) · Cited by 53
Federated Generative Model on Multi-Source Heterogeneous Data in IoT
Xiong, Z., Li, W., & Cai, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26252 · Cited by 53
Federated Multi-view Learning for Private Medical Data Integration and Analysis
Che, S., Kong, Z., Peng, H. M., Sun, L., Leow, A., Chen, Y., & He, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3501816 · Cited by 45
Compressed Federated Learning Based on Adaptive Local Differential Privacy
Miao, Y., Xie, R., Li, X., Liu, X., Ma, Z., & Deng, R. H. (2022) · Annual Computer Security Applications Conference · doi:10.1145/3564625.3567973 · Cited by 44
Compression Boosts Differentially Private Federated Learning
Kerkouche, R., Ács, G., Castelluccia, C., & Genevès, P. (2021) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp51992.2021.00029 · Cited by 36
SignDS-FL: Local Differentially Private Federated Learning with Sign-based Dimension Selection
Jiang, X., Zhou, X., & Großklags, J. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3517820 · Cited by 22
Group Privacy for Personalized Federated Learning
Galli, F., Biswas, S., Jung, K., Cucinotta, T., & Catuscia Palamidessi, A. (2023) · International Conference on Information Systems Security and Privacy (ICISSP) · doi:10.5220/0011885000003405 · Cited by 21
Inference Attacks and Controls on Genotypes and Phenotypes for Individual Genomic Data
He, Z., Yu, J., Li, J., Han, Q., Luo, G., & Li, Y. (2018) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2810180 · Cited by 16
A Differential Privacy Protection Protocol Based on Location Entropy
Guo, P., Ye, B., Chen, Y., Li, T., Yang, Y., Qian, X., & Yu, X. (2022) · Tsinghua Science & Technology · doi:10.26599/tst.2022.9010003 · Cited by 15
ASCFL: Accurate and Speedy Semi-Supervised Clustering Federated Learning
He, J., Gong, B., Yang, J., Wang, H., Xu, P., & Xing, T. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2022.9010057 · Cited by 14
Personalization in Federated Learning
Agarwal, M., Yurochkin, M., & Sun, Y. (2022) · Springer eBooks · doi:10.1007/978-3-030-96896-0_4 · Cited by 7
Research works printed but not linked: 2
- Xu, 2021, FedMood: Federated learning on mobile health data for mood detection, arXiv:2102.09342 · arXiv
- LeCun, 2010, MNIST Handwritten Digit Database
Cited by
Sorted by citations
Abbas, S. R., Abbas, Z., Zahir, A., & Lee, S. W. (2024) · Healthcare · doi:10.3390/healthcare12242587 · Cited by 228
Privacy-Preserving Federated Learning for Intrusion Detection in IoT Environments: A Survey
Vyas, A., Lin, P., Hwang, R., & Tripathi, M. (2024) · IEEE Access · doi:10.1109/access.2024.3454211 · Cited by 115
“The empirical evaluations in [179] demonstrate that the proposed ACS-FL (adaptive clipping, weight compression, and parameter shuffling) scheme achieves superior performance in striking an equilibrium between privacy preservation and utility maximization.”
BackgroundInfluentialMohammadi, S., Balador, A., Sinaei, S., & Flammini, F. (2024) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2024.104918 · Cited by 93
IOFL: Intelligent-Optimization-Based Federated Learning for Non-IID Data
Li, X., Zhao, H., & Deng, W. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3354942 · Cited by 60
“Regarding privacy protection issues in FL, some existing researches typically combine FL with cryptographic techniques of differential privacy, multiparty secure computing, and homomorphic encryption, or replace client server communication content [30], [31], [32].”
BackgroundDigital Twin-Assisted Federated Learning Service Provisioning Over Mobile Edge Networks
Zhang, R., Xie, Z., Yu, D., Liang, W., & Cheng, X. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3337317 · Cited by 36
“There are many investigations on implementing FL in MEC networks [24], [25], [26], [27].”
Background
Metadata
- Authors
- He, Z., Wang, L., & Cai, Z.
- Affiliations
- Jinan University (CN)
- Georgia State University (US)
- Venue
- IEEE Internet of Things Journal
- Published
- 2024-01-01
- Volume
- 11
- Issue
- 1
- Pages
- 137-146
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W4385627109
- Cited by
- 143
- References
- 48
- Citations by year
- 2026: 35 · 2025: 55 · 2024: 48
- FWCI
- 12.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Funders
- Guangzhou Basic and Applied Basic Research Project (SL2022A04J01519)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Internet Traffic Analysis and Secure E-voting
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Keywords
- federated learning, local differential privacy, Internet of Things, data heterogeneity, clustering, adaptive clipping, weight compression, privacy-utility trade-off, inference attacks, communication overhead
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review