Facing small and biased data dilemma in drug discovery with enhanced federated learning approaches
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) models usually require large amounts of high-quality training data, which is in striking contrast to the situation of small and biased data faced by current drug discovery pipelines. The concept of federated learning has been proposed to utilize distributed data from different sources without leaking sensitive information of the data. This emerging decentralized machine learning paradigm is expected to dramatically improve the success rate of AI-powered drug discovery. Here, we simulated the federated learning process with different property and activity datasets from different sources, among which overlapping molecules with high or low biases exist in the recorded values. Beyond the benefit of gaining more data, we also demonstrated that federated training has a regularization effect superior to centralized training on the pooled datasets with high biases. Moreover, different network architectures for clients and aggregation algorithms for coordinators have been compared on the performance of federated learning, where personalized federated learning shows promising results. Our work demonstrates the applicability of federated learning in predicting drug-related properties and highlights its promising role in addressing the small and biased data dilemma in drug discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Advances and Open Problems in Federated Learning
Kairouz, P., McMahan, H. B., Avent, B., Bellet, A., Bennis, M., Bhagoji, A. N., Bonawitz, K., Charles, Z., Cormode, G., Cummings, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.04977 · Cited by 7,857
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 11×
“For the AKT1 kinase inhibitory activity data-sets, the RFCN consists of two fully connected layers and a DenseNet of two 2-layer dense blocks (Figure S1C in Supporting Information).”
BackgroundInfluentialPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · cited 1×
“Both the Federated Averaging and Secure Aggregation protocol are proposed by Google’s team in separate works (McMahan et al., 2017; Bonawitz et al., 2017).”
MethodComprehensive analysis of kinase inhibitor selectivity
Davis, M. I., Hunt, J. P., Herrgard, S., Ciceri, P., Wodicka, L. M., Pallares, G., Hocker, M., Treiber, D. K., & Zarrinkar, P. P. (2011) · Nature Biotechnology · doi:10.1038/nbt.1990 · Cited by 2,409
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
Comprehensive assay of kinase catalytic activity reveals features of kinase inhibitor selectivity
Anastassiadis, T., Deacon, S. W., Devarajan, K., Ma, H., & Peterson, J. R. (2011) · Nature Biotechnology · doi:10.1038/nbt.2017 · Cited by 919
Rethinking drug design in the artificial intelligence era
Schneider, P., Walters, W. P., Plowright, A. T., Sieroka, N., Listgarten, J., Goodnow, R. A., Fisher, J., Jansen, J. M., Duca, J. S., Rush, T. S., et al. (2020) · Nature Reviews Drug Discovery · doi:10.1038/s41573-019-0050-3 · Cited by 894 · cited 1×
“Data acquisition difficulties and data biases in the measurement of scientific tests have significantly limited the effect of AI in drug discovery (Smalley, 2017; Schneider et al., 2020; Chen et al., 2020).”
Applied Federated Learning: Improving Google Keyboard Query Suggestions
Yang, T., Andrew, G., Eichner, H., Sun, H., Li, W., Kong, N., Ramage, D., & Beaufays, F. (2018) · arXiv · doi:10.48550/arxiv.1812.02903 · Cited by 684 · cited 5×
“Federated learning represents a scenario where multiple clients can train a model collectively without sharing raw data (McMahan et al., 2017; Yang et al., 2018; Bonawitz et al., 2019; Kairouz et al., 2019).”
BackgroundMethodInfluentialGiger (2018) · doi:10.1016/j.jacr.2017.12.028 · Cited by 634
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · arXiv · doi:10.48550/arxiv.1902.04885 · Cited by 600
Privacy-Preserving Federated Brain Tumour Segmentation
Li, W., Milletarì, F., Xu, D., Rieke, N., Hancox, J., Zhu, W., Baust, M., Cheng, Y., Ourselin, S., Cardoso, M. J., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32692-0_16 · Cited by 578
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381
Comprehensive characterization of the Published Kinase Inhibitor Set
Elkins, J. M., Fedele, V., Szklarz, M., Abdul Azeez, K. R., Salah, E., Mikolajczyk, J., Romanov, S., Sepetov, N., Huang, X.-P., Roth, B. L., et al. (2016) · Nature Biotechnology · doi:10.1038/nbt.3374 · Cited by 323
Smirnov, E. A., Timoshenko, D. M., & Andrianov, S. N. (2014) · AASRI Procedia · doi:10.1016/j.aasri.2014.05.013 · Cited by 237
Federated Evaluation of On-device Personalization
Wang, K., Mathews, R., Kiddon, C., Eichner, H., Beaufays, F., & Ramage, D. (2019) · arXiv · doi:10.48550/arxiv.1910.10252 · Cited by 184 · cited 2×
“personalized model in federated learning (Jiang et al., 2019; Wang et al., 2019).”
BackgroundHarnessing big ‘omics’ data and AI for drug discovery in hepatocellular carcinoma
Chen, B., Garmire, L., Calvisi, D. F., Chua, M.-S., Kelley, R. K., & Chen, X. (2020) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/s41575-019-0240-9 · Cited by 154
Three pitfalls to avoid in machine learning.
Riley, P. (2019) · Nature · doi:10.1038/d41586-019-02307-y · Cited by 142 · cited 1×
“Apart from diffi-culty-causing confidentiality problems for data acquisition, data biases in the measurement of scientific tests also perplex AI for drug discovery (Riley, 2019).”
Background
Cited by
Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications
Aledhari, M., Razzak, R., Parizi, R. M., & Saeed, F. (2020) · IEEE Access · doi:10.1109/access.2020.3013541 · Cited by 733
The transformational role of GPU computing and deep learning in drug discovery
Pandey, M., Fernandez, M., Gentile, F., Isayev, O., Tropsha, A., Stern, A. C., & Cherkasov, A. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00463-x · Cited by 255
Review on Federated Learning for digital transformation in healthcare through big data analytics
Babar, M., Qureshi, B., & Koubaa, A. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.05.046 · Cited by 55
Metadata
- Authors
- Xiong, Z., Cheng, Z., Lin, X., Xu, C., Liu, X., Wang, D., Luo, X., Zhang, Y., Jiang, H., Qiao, N., & Zheng, M.
- Venue
- Science China Life Sciences
- Published
- 2021-07-26
- Volume
- 65
- Issue
- 3
- Pages
- 529-539
- ISSN
- 1674-7305 (ISSN-L)
- 1869-1889
- OpenAlex
- W3186401068
- Cited by
- 69
- References
- 19
- FWCI
- 5.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.