Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks
Open accessThe DOI matches its Crossref record; 45 of the 48 references it cites were found in a registry or an index.
Abstract
Federated learning (FL) is emerging as a new paradigm to train machine learning (ML) models in distributed systems. Rather than sharing and disclosing the training data set with the server, the model parameters (e.g., neural networks' weights and biases) are optimized collectively by large populations of interconnected devices, acting as local learners. FL can be applied to power-constrained Internet of Things (IoT) devices with slow and sporadic connections. In addition, it does not need data to be exported to third parties, preserving privacy. Despite these benefits, a main limit of existing approaches is the centralized optimization which relies on a server for aggregation and fusion of local parameters; this has the drawback of a single point of failure and scaling issues for increasing network size. This article proposes a fully distributed (or serverless) learning approach: the proposed FL algorithms leverage the cooperation of devices that perform data operations inside the network by iterating local computations and mutual interactions via consensus-based methods. The approach lays the groundwork for integration of FL within 5G and beyond networks characterized by decentralized connectivity and computing, with intelligence distributed over the end devices. The proposed methodology is verified by the experimental data sets collected inside an Industrial IoT (IIoT) environment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deploying cross-devices FL in IoT networks raises practical challenges, i.e., the IoT devices have sporadic access to the wireless network [181].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [181]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“image database [40] of handwritten digits.”
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Consensus and Cooperation in Networked Multi-Agent Systems
Olfati-Saber, R., Fax, J. A., & Murray, R. M. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.887293 · Cited by 10,522 · cited 1×
“= maxk(i∈Nk̄ αk,i), namely, the maximum degree of the graph G [28] that models the interaction topology of the network.”
BackgroundLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
(2013) · Cited by 3,740
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
Internet of Things in the 5G Era: Enablers, Architecture, and Business Models
Palattella, M. R., Dohler, M., Grieco, A., Rizzo, G., Torsner, J., Engel, T., & Ladid, L. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2525418 · Cited by 1,459
Device-to-device communication in 5G cellular networks: challenges, solutions, and future directions
Tehrani, M. N., Uysal, M., & Yanikomeroglu, H. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6815897 · Cited by 1,040
C2PS: A Digital Twin Architecture Reference Model for the Cloud-Based Cyber-Physical Systems
Alam, K. M., & El Saddik, A. (2017) · IEEE Access · doi:10.1109/access.2017.2657006 · Cited by 741
Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals
Schizas, I. D., Ribeiro, A., & Giannakis, G. B. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.906734 · Cited by 685
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654 · cited 1×
“services [2] in several domains, such as Industry 4.”
BackgroundMachine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548
Sayed, A. H., Tu, S.-Y., Chen, J., Zhao, X., & Towfic, Z. J. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2231991 · Cited by 494
Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1811.11479 · Cited by 465
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC Computer Science & Data Analysis · doi:10.1201/b11429-4 · Cited by 460
Quantized incremental algorithms for distributed optimization
Rabbat, M. G., & Nowak, R. D. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2005.843546 · Cited by 408
Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor
Zhang, Z., Tian, Z., & Zhou, M. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2808688 · Cited by 333
Indoor Person Identification Using a Low-Power FMCW Radar
Vandersmissen, B., Knudde, N., Jalalvand, A., Couckuyt, I., Bourdoux, A., De Neve, W., & Dhaene, T. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2816812 · Cited by 262
DiSCO: Distributed Optimization for Self-Concordant Empirical Loss
Zhang, Y., & Xiao, L. (2015) · International Conference on Machine Learning · Cited by 243
Squeezing Deep Learning into Mobile and Embedded Devices
Lane, N. D., Bhattacharya, S., Mathur, A., Georgiev, P., Forlivesi, C., & Kawsar, F. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.2940968 · Cited by 224
BrainTorrent: A Peer-to-Peer Environment for Decentralized Federated Learning
Roy, A. G., Siddiqui, S., Pölsterl, S., Navab, N., & Wachinger, C. (2019) · arXiv · doi:10.48550/arxiv.1905.06731 · Cited by 212
Distributed optimization with arbitrary local solvers
Ma, C., Konečný, J., Jaggi, M., Smith, V., Jordan, M. I., Richtárik, P., & Takáč, M. (2017) · Optimization Methods and Software · doi:10.1080/10556788.2016.1278445 · Cited by 191
Decentralized Federated Learning: A Segmented Gossip ApproachPreprint
Hu, C., Jiang, J., & Wang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07782 · Cited by 184
Peer-to-peer Federated Learning on Graphs
Lalitha, A., Kilinc, O. C., Javidi, T., & Koushanfar, F. (2019) · arXiv · doi:10.48550/arxiv.1901.11173 · Cited by 146
A Survey of Traffic Issues in Machine-to-Machine Communications Over LTE
Soltanmohammadi, E., Ghavami, K., & Naraghi‐Pour, M. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2533541 · Cited by 145
Analysis of Spatial and Incremental LMS Processing for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2100386 · Cited by 130
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Amiri, M. M., & Gündüz, D. (2019) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849334 · Cited by 114
Brambilla, M., Nicoli, M., Soatti, G., & Deflorio, F. P. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2941435 · Cited by 90
Self-citationGossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent
Daily, J., Vishnu, A., Siegel, C., Warfel, T., & Amatya, V. (2018) · arXiv · doi:10.48550/arxiv.1803.05880 · Cited by 80
Gossip training for deep learning
Blot, M., Picard, D., Cord, M., & Thome, N. (2016) · arXiv · doi:10.48550/arxiv.1611.09726 · Cited by 77
Wireless Cloud Networks for the Factory of Things: Connectivity Modeling and Layout Design
Savazzi, S., Rampa, V., & Spagnolini, U. (2014) · IEEE Internet of Things Journal · doi:10.1109/jiot.2014.2313459 · Cited by 72
Self-citationAscorti, L., Savazzi, S., Soatti, G., Nicoli, M., Sisinni, E., & Galimberti, S. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2016.2640579 · Cited by 55
Self-citationDevice-Free Human Sensing and Localization in Collaborative Human–Robot Workspaces: A Case Study
Savazzi, S., Rampa, V., Vicentini, F., & Giussani, M. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2015.2500121 · Cited by 54
Self-citationConsensus-Based Algorithms for Distributed Network-State Estimation and Localization
Soatti, G., Nicoli, M., Savazzi, S., & Spagnolini, U. (2016) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2016.2626141 · Cited by 51
Self-citationSavazzi, S., Sigg, S., Vicentini, F., Kianoush, S., & Findling, R. D. (2019) · Computer · doi:10.1109/mc.2019.2913626 · Cited by 38
Self-citationA Cloud-IoT Platform for Passive Radio Sensing: Challenges and Application Case Studies
Kianoush, S., Raja, M., Savazzi, S., & Sigg, S. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2834530 · Cited by 35
Self-citationReducing communication overhead in distributed learning by an order of magnitude (almost)
Øland, A., & Raj, B. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178365 · Cited by 18
Aloi, G., Briante, O., Felice, M. D., Ruggeri, G., & Savazzi, S. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2017.10.004 · Cited by 11
Self-citationReply to "Comments on "Consensus and Cooperation in Networked Multi-Agent Systems""
Olfati-Saber, R., Fax, J., & Murray, R. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2049912 · Cited by 10
Passive Detection and Discrimination of Body Movements in the sub-THz Band: A Case Study
Kianoush, S., Savazzi, S., & Rampa, V. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682165 · Cited by 5
Self-citation
Research works printed but not linked: 6
- abadi, 2015, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- 10.1109/JPROC.2018.2867029 · DOI
- 10.1109/GLOCOM.2018.8647927 · DOI · Paper page
- 2019, Federated Learning Example Dataset (FMCW 122GHz Radars)
- 2018, 120-GHz Highly Integrated IQ Transceiver With Antennas on Chip in Silicon Germanium Technology
- lalitha, 2018, Fully decentralized federated learning, Proc 3rd Workshop Bayesian Deep NIPS Workshop, 1
Cited by
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“munication to achieve a consensus on the global update [36].”
BackgroundFederated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. (2021) · Deakin Research Online (Deakin University) · Cited by 889
Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“In this scenario, the local model updates need to be fast and reliably aggregated within neighbors via vehicle-to-vehicle communications [181], or to the roadside units via vehicle-to-infrastructure communication.”
Background
Metadata
- Authors
- Savazzi, S., Nicoli, M., & Rampa, V.
- Affiliations
- Institute of Electronics, Computer and Telecommunication Engineering (IT)
- Politecnico di Milano (IT)
- Venue
- IEEE Internet of Things Journal
- Published
- 2020-05
- Volume
- 7
- Issue
- 5
- Pages
- 4641-4654
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2996845627
- Cited by
- 431
- References
- 48
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 68 · 2023: 93 · 2022: 70 · 2021: 83 · 2020: 21
- FWCI
- 26.22
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- arXiv (Cornell University) (publishedVersion)
- Virtual Community of Pathological Anatomy (University of Castilla La Mancha) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- ERA-NET CO-FUND H2020 CHISTERA III Project RadioSense
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- federated learning, consensus algorithms, Internet of Things, Industrial Internet of Things, 5G, decentralized computing, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.