CoChat

A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data

Open access
Nguyen, T. V., Dakka, M. A., Diakiw, S. M., VerMilyea, M. D., Perugini, M., Hall, J. M. M., Perugini, D. · 2022 · Scientific Reports

Published version of a preprint

Cited by 77

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Abstract

Training on multiple diverse data sources is critical to ensure unbiased and generalizable AI. In healthcare, data privacy laws prohibit data from being moved outside the country of origin, preventing global medical datasets being centralized for AI training. Data-centric, cross-silo federated learning represents a pathway forward for training on distributed medical datasets. Existing approaches typically require updates to a training model to be transferred to a central server, potentially breaching data privacy laws unless the updates are sufficiently disguised or abstracted to prevent reconstruction of the dataset. Here we present a completely decentralized federated learning approach, using knowledge distillation, ensuring data privacy and protection. Each node operates independently without needing to access external data. AI accuracy using this approach is found to be comparable to centralized training, and when nodes comprise poor-quality data, which is common in healthcare, AI accuracy can exceed the performance of traditional centralized training.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-022-12833-x

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 19 references

Research works printed but not linked: 19

  1. Fitzgerald, R. C. Big data is crucial to the early detection of cancer. Nat. Med. 26, 19–20 (2020). · DOI
  2. McCoy, L. G., Banja, J. D., Ghassemi, M. & Celi, L. A. Ensuring machine learning for healthcare works for all. BMJ Health Care Inform., 27(3) (2020). · DOI
  3. McGraw, D. & Mandl, K. D. Privacy protections to encourage use of health-relevant digital data in a learning health system. NPJ Digit. Med. 4, 2 (2021). · DOI · Paper page
  4. Bradford, L., Aboy, M. & Liddell, K., International transfers of health data between the EU and USA: a sector-specific approach for the USA to ensure an ‘adequate’ level of protection. J. Law Biosci. 7(1) (2020). · DOI
  5. McMahan, H. B., Moore, E., Ramage, D., Hampson, S. & Aguera y Arcas, B. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 1273–1282 (2017).
  6. Bonawitz, K., et al. Towards federated learning at scale: System design. In Proceedings of the 2nd SysML Conference (2019).
  7. Hallock, H., Marshall, S. E., 't Hoen, P. A. C., Nygård, J. F., Hoorne, B., Fox, C., Alagaratnam, S. Federated networks for distributed analysis of health data. Front. Public Health. 9, 712569 (2021). · DOI
  8. Roth, H. R., et al., Federated learning for breast density classification: A real-world implementation, in Domain Adaptation and Representation Transfer, and Distributed and Collaborative Learning, Springer, 181–191 (2020).
  9. Tedeschini, B. C. et al. Decentralized federated learning for healthcare networks: A case study on tumor segmentation. IEEE Access 10, 8693–8708 (2022). · DOI · Paper page
  10. McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B.A. Y, Communication-efficient learning of deep networks from decentralized data. In Int. Conf. Artif. Intell. Stat. AISTATS (2017).
  11. Huang, Y. et al. Personalized cross-silo federated learning on non-IID data. Proc. AAAI Conf. Artif. Intell. 35(9), 7865–7873 (2021).
  12. Madi, A., et al., A Secure Federated Learning framework using Homomorphic Encryption and Verifiable Computing. In 2021 Reconciling Data Analytics, Automation, Privacy, and Security: A Big Data Challenge (RDAAPS), 2021, pp. 1–8. · DOI
  13. Stripelis, D., et al., Secure neuroimaging analysis using federated learning with homomorphic encryption. In Proc. SPIE 12088, 17th International Symposium on Medical Information Processing and Analysis, 1208814 (2021). · DOI
  14. Rabenseifner, R. Optimization of Collective Reduction Operations. International Conference on Computational Science (ICCS) (2004). · DOI · Paper page
  15. Gou, J., Yu, B., Maybank, S. J. & Tao, D. Knowledge distillation: A survey. Int. J. Comput. Vis. 129, 1789–1819 (2021). · DOI · Paper page
  16. Kullback, S. & Leibler, R. A. On information and sufficiency. Ann. Math. Stat. 22(1), 79–86 (1951). · DOI · Paper page
  17. Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 4700–4708 (2017). · DOI · Paper page
  18. Xue, C., Yu, L., Chen, P., Dou. Q. & Heng, P. -A. Robust medical image classification from noisy labeled data with global and local representation guided co-training. IEEE Trans. Med. Imaging (2021). · DOI
  19. Dakka, M. A. et al. Automated detection of poor-quality data: case studies in healthcare. Sci. Rep. 11(1), 18005 (2021). · DOI

Cited by

See all 77

Metadata

Authors
Nguyen, T. V., Dakka, M. A., Diakiw, S. M., VerMilyea, M. D., Perugini, M., Hall, J. M. M., & Perugini, D.
Venue
Scientific Reports
Published
2022-05-25
Volume
12
Issue
1
Pages
8888-8888
ISSN
2045-2322 (ISSN-L)
OpenAlex
W4281485033
Cited by
77
References
19
FWCI
5.01
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • Presagen Pty Ltd
  • South Australian Government: Research, Commercialisation, and Startup Fund

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data. https://app.cochat.ai/papers/10.1038/s41598-022-12833-x
The paper
Nguyen, T. V., Dakka, M. A., Diakiw, S. M., VerMilyea, M. D., Perugini, M., Hall, J. M. M., & Perugini, D. (2022). A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data. Scientific Reports. https://doi.org/10.1038/s41598-022-12833-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.