A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data
Open accessPublished version of a preprint
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Training on multiple diverse data sources is critical to ensure unbiased and generalizable AI. In healthcare, data privacy laws prohibit data from being moved outside the country of origin, preventing global medical datasets being centralized for AI training. Data-centric, cross-silo federated learning represents a pathway forward for training on distributed medical datasets. Existing approaches typically require updates to a training model to be transferred to a central server, potentially breaching data privacy laws unless the updates are sufficiently disguised or abstracted to prevent reconstruction of the dataset. Here we present a completely decentralized federated learning approach, using knowledge distillation, ensuring data privacy and protection. Each node operates independently without needing to access external data. AI accuracy using this approach is found to be comparable to centralized training, and when nodes comprise poor-quality data, which is common in healthcare, AI accuracy can exceed the performance of traditional centralized training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 2×
“Three different DAG topologies, namely (1) 5-node in 1-cluster, (2) 15-node in 1-cluster and (3) 15-node in 3-cluster (5 nodes each) as being described in more details in Supplementary Information section S1, were deployed.”
MethodFederated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
Sheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69250-1 · Cited by 1,646
Big data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Federated learning of predictive models from federated Electronic Health Records
Brisimi, T. S., Chen, R., Mela, T., Olshevsky, A., Paschalidis, I. C., & Shi, W. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.01.007 · Cited by 997
Research works printed but not linked: 19
- Fitzgerald, R. C. Big data is crucial to the early detection of cancer. Nat. Med. 26, 19–20 (2020). · DOI
- McCoy, L. G., Banja, J. D., Ghassemi, M. & Celi, L. A. Ensuring machine learning for healthcare works for all. BMJ Health Care Inform., 27(3) (2020). · DOI
- McGraw, D. & Mandl, K. D. Privacy protections to encourage use of health-relevant digital data in a learning health system. NPJ Digit. Med. 4, 2 (2021). · DOI · Paper page
- Bradford, L., Aboy, M. & Liddell, K., International transfers of health data between the EU and USA: a sector-specific approach for the USA to ensure an ‘adequate’ level of protection. J. Law Biosci. 7(1) (2020). · DOI
- McMahan, H. B., Moore, E., Ramage, D., Hampson, S. & Aguera y Arcas, B. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 1273–1282 (2017).
- Bonawitz, K., et al. Towards federated learning at scale: System design. In Proceedings of the 2nd SysML Conference (2019).
- Hallock, H., Marshall, S. E., 't Hoen, P. A. C., Nygård, J. F., Hoorne, B., Fox, C., Alagaratnam, S. Federated networks for distributed analysis of health data. Front. Public Health. 9, 712569 (2021). · DOI
- Roth, H. R., et al., Federated learning for breast density classification: A real-world implementation, in Domain Adaptation and Representation Transfer, and Distributed and Collaborative Learning, Springer, 181–191 (2020).
- Tedeschini, B. C. et al. Decentralized federated learning for healthcare networks: A case study on tumor segmentation. IEEE Access 10, 8693–8708 (2022). · DOI · Paper page
- McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B.A. Y, Communication-efficient learning of deep networks from decentralized data. In Int. Conf. Artif. Intell. Stat. AISTATS (2017).
- Huang, Y. et al. Personalized cross-silo federated learning on non-IID data. Proc. AAAI Conf. Artif. Intell. 35(9), 7865–7873 (2021).
- Madi, A., et al., A Secure Federated Learning framework using Homomorphic Encryption and Verifiable Computing. In 2021 Reconciling Data Analytics, Automation, Privacy, and Security: A Big Data Challenge (RDAAPS), 2021, pp. 1–8. · DOI
- Stripelis, D., et al., Secure neuroimaging analysis using federated learning with homomorphic encryption. In Proc. SPIE 12088, 17th International Symposium on Medical Information Processing and Analysis, 1208814 (2021). · DOI
- Rabenseifner, R. Optimization of Collective Reduction Operations. International Conference on Computational Science (ICCS) (2004). · DOI · Paper page
- Gou, J., Yu, B., Maybank, S. J. & Tao, D. Knowledge distillation: A survey. Int. J. Comput. Vis. 129, 1789–1819 (2021). · DOI · Paper page
- Kullback, S. & Leibler, R. A. On information and sufficiency. Ann. Math. Stat. 22(1), 79–86 (1951). · DOI · Paper page
- Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 4700–4708 (2017). · DOI · Paper page
- Xue, C., Yu, L., Chen, P., Dou. Q. & Heng, P. -A. Robust medical image classification from noisy labeled data with global and local representation guided co-training. IEEE Trans. Med. Imaging (2021). · DOI
- Dakka, M. A. et al. Automated detection of poor-quality data: case studies in healthcare. Sci. Rep. 11(1), 18005 (2021). · DOI
Cited by
Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
Martínez Beltrán, E. T., Pérez, M. Q., Sánchez, P. M. S., Bernal, S. L., Bovet, G., Pérez, M. G., Pérez, G. M., & Celdrán, A. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315746 · Cited by 625
“In contrast, Nguyen et al. [16] discussed the use of federated distillation to decrease model complexity, using a private dataset called The Noisy Blind consisting of 1198 original images collected from four clinics.”
BackgroundMethodInfluentialRauniyar, A., Hagos, D. H., Jha, D., Håkegård, J. E., Bagci, U., Rawat, D. B., & Vlassov, V. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3329061 · Cited by 315
“However, the data disparity among these institutions may require a higher number of FL iterations to achieve the desired model accuracy on a global server [186], [187].”
BackgroundDecentralized Federated Learning: A Survey and Perspective
Yuan, L., Wang, Z., Sun, L., Yu, P. S., & Brinton, C. G. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3407584 · Cited by 290
Teo, Z. L., Jin, L., Liu, N., Li, S., Miao, D., Zhang, X., Ng, W. Y., Tan, T. F., Lee, D. M., Chua, K. J., et al. (2024) · Cell Reports Medicine · doi:10.1016/j.xcrm.2024.101419 · Cited by 255
“28 Research to explore solutions such as data normalization before training or adapting the FL model to heterogeneous data is ongoing.”
BackgroundA Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems
Gu, X., Sabrina, F., Fan, Z., & Sohail, S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156539 · Cited by 139
“[59] proposed a knowledge distillationbased decentralized FL model to ensure data privacy and protection.”
Background
Metadata
- Authors
- Nguyen, T. V., Dakka, M. A., Diakiw, S. M., VerMilyea, M. D., Perugini, M., Hall, J. M. M., & Perugini, D.
- Venue
- Scientific Reports
- Published
- 2022-05-25
- Volume
- 12
- Issue
- 1
- Pages
- 8888-8888
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W4281485033
- Cited by
- 77
- References
- 19
- FWCI
- 5.01
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Presagen Pty Ltd
- South Australian Government: Research, Commercialisation, and Startup Fund
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data. https://app.cochat.ai/papers/10.1038/s41598-022-12833-x
- The paper
- Nguyen, T. V., Dakka, M. A., Diakiw, S. M., VerMilyea, M. D., Perugini, M., Hall, J. M. M., & Perugini, D. (2022). A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data. Scientific Reports. https://doi.org/10.1038/s41598-022-12833-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.