The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
DeepSynergy: predicting anti-cancer drug synergy with Deep Learning
Open accessAbstract
Motivation: While drug combination therapies are a well-established concept in cancer treatment, identifying novel synergistic combinations is challenging due to the size of combinatorial space. However, computational approaches have emerged as a time- and cost-efficient way to prioritize combinations to test, based on recently available large-scale combination screening data. Recently, Deep Learning has had an impact in many research areas by achieving new state-of-the-art model performance. However, Deep Learning has not yet been applied to drug synergy prediction, which is the approach we present here, termed DeepSynergy. DeepSynergy uses chemical and genomic information as input information, a normalization strategy to account for input data heterogeneity, and conical layers to model drug synergies. Results: DeepSynergy was compared to other machine learning methods such as Gradient Boosting Machines, Random Forests, Support Vector Machines and Elastic Nets on the largest publicly available synergy dataset with respect to mean squared error. DeepSynergy significantly outperformed the other methods with an improvement of 7.2% over the second best method at the prediction of novel drug combinations within the space of explored drugs and cell lines. At this task, the mean Pearson correlation coefficient between the measured and the predicted values of DeepSynergy was 0.73. Applying DeepSynergy for classification of these novel drug combinations resulted in a high predictive performance of an AUC of 0.90. Furthermore, we found that all compared methods exhibit low predictive performance when extrapolating to unexplored drugs or cell lines, which we suggest is due to limitations in the size and diversity of the dataset. We envision that DeepSynergy could be a valuable tool for selecting novel synergistic drug combinations. Availability and implementation: DeepSynergy is available via www.bioinf.jku.at/software/DeepSynergy. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Open Babel: An open chemical toolbox
O'Boyle, N. M., Banck, M., James, C. A., Morley, C., Vandermeersch, T., & Hutchison, G. R. (2011) · Journal of Cheminformatics · doi:10.1186/1758-2946-3-33 · Cited by 10,939
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Extended-Connectivity Fingerprints
Rogers, D., & Hahn, M. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100050t · Cited by 7,524
Chou, T.-C. (2006) · Pharmacological Reviews · doi:10.1124/pr.58.3.10 · Cited by 5,163
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
THE TOXICITY OF POISONS APPLIED JOINTLY1
BLISS, C. I. (1939) · Annals of Applied Biology · doi:10.1111/j.1744-7348.1939.tb06990.x · Cited by 2,419
A Landscape of Pharmacogenomic Interactions in Cancer
Iorio, F., Knijnenburg, T. A., Vis, D. J., Bignell, G. R., Menden, M. P., Schubert, M., Aben, N., Gonçalves, E., Barthorpe, S., Lightfoot, H., et al. (2016) · Cell · doi:10.1016/j.cell.2016.06.017 · Cited by 2,090
Chemotherapy, Bevacizumab, and Cetuximab in Metastatic Colorectal Cancer
Tol, J., Koopman, M., Cats, A., Rodenburg, C. J., Creemers, G. J. M., Schrama, J. G., Erdkamp, F. L. G., Vos, A. H., van Groeningen, C. J., Sinnige, H. A. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0808268 · Cited by 1,341
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159
DeepTox: toxicity prediction using deep learning
Mayr, A., Klambauer, G., Unterthiner, T., & Hochreiter, S. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2015.00080 · Cited by 1,081
Self-citationCombinatorial drug therapy for cancer in the post-genomic era
Al-Lazikani, B., Banerji, U., & Workman, P. (2012) · Nature Biotechnology · doi:10.1038/nbt.2284 · Cited by 1,070
Hit and lead generation: beyond high-throughput screening
Bleicher, K. H., Böhm, H.-J., Müller, K., & Alanine, A. I. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1086 · Cited by 1,056
Mechanisms of drug combinations: interaction and network perspectives
Jia, J., Zhu, F., Ma, X., Cao, Z. W., Li, Y. X., & Chen, Y. Z. (2009) · Nature Reviews Drug Discovery · doi:10.1038/nrd2683 · Cited by 969
(1953) · PubMed · Cited by 942
Integration of virtual and high-throughput screening
Bajorath, J. (2002) · Nature Reviews Drug Discovery · doi:10.1038/nrd941 · Cited by 930
Structure and dynamics of molecular networks: A novel paradigm of drug discovery
Csermely, P., Korcsmáros, T., Kiss, H. J. M., London, G., & Nussinov, R. (2013) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2013.01.016 · Cited by 892
Hecht, J. R., Mitchell, E., Chidiac, T., Scroggin, C., Hagenstad, C., Spigel, D., Marshall, J., Cohn, A., McCollum, D., Stella, P., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.19.8135 · Cited by 850
Searching for Drug Synergy in Complex Dose–Response Landscapes Using an Interaction Potency Model
Yadav, B., Wennerberg, K., Aittokallio, T., & Tang, J. (2015) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2015.09.001 · Cited by 845
Combination Therapy for Treatment of Infections with Gram-Negative Bacteria
Tamma, P. D., Cosgrove, S. E., & Maragakis, L. L. (2012) · Clinical Microbiology Reviews · doi:10.1128/cmr.05041-11 · Cited by 836
Combenefit: an interactive platform for the analysis and visualization of drug combinations
Di Veroli, G. Y., Fornari, C., Wang, D., Mollard, S., Bramhall, J. L., Richards, F. M., & Jodrell, D. I. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw230 · Cited by 736
Combination approaches to combat multidrug-resistant bacteria
Worthington, R. J., & Melander, C. (2013) · Trends in Biotechnology · doi:10.1016/j.tibtech.2012.12.006 · Cited by 625
Toward more realistic drug-target interaction predictions
Pahikkala, T., Airola, A., Pietila, S., Shakyawar, S., Szwajda, A., Tang, J., & Aittokallio, T. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbu010 · Cited by 559
Kruijtzer, C. M. F., Beijnen, J. H., Rosing, H., ten Bokkel Huinink, W. W., Schot, M., Jewell, R. C., Paul, E. M., & Schellens, J. H. M. (2002) · Journal of Clinical Oncology · doi:10.1200/jco.2002.12.116 · Cited by 464
The design of drugs for HIV and HCV
Clercq, E. D. (2007) · Nature Reviews Drug Discovery · doi:10.1038/nrd2424 · Cited by 430
An unbiased oncology compound screen to identify novel combination strategies
O'Neil, J., Benita, Y., Feldman, I., Chenard, M., Roberts, B., Liu, Y., Li, J., Kral, A., Lejnine, S., Loboda, A., et al. (2016) · Molecular Cancer Therapeutics · doi:10.1158/1535-7163.mct-15-0843 · Cited by 407
Mathews Griner, L. A., Guha, R., Shinn, P., Young, R. M., Keller, J. M., Liu, D., Goldlust, I. S., Yasgar, A., McKnight, C., Boxer, M. B., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1311846111 · Cited by 377
A community computational challenge to predict the activity of pairs of compounds
Community, N.-D., Bansal, M., Yang, J., Karan, C., Menden, M. P., Costello, J. C., Tang, H., Xiao, G., Li, Y., Allen, J., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.3052 · Cited by 321
High-Throughput Screening in Drug Metabolism and Pharmacokinetic Support of Drug Discovery
White, R. E. (2000) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev.pharmtox.40.1.133 · Cited by 304
NLLSS: Predicting Synergistic Drug Combinations Based on Semi-supervised Learning
Chen, X., Ren, B., Chen, M., Wang, Q., Zhang, L., & Yan, G. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004975 · Cited by 279
A new summarization method for affymetrix probe level data
Hochreiter, S., Clevert, D.-A., & Obermayer, K. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl033 · Cited by 248
Self-citationChemoPy: freely available python package for computational biology and chemoinformatics
Cao, D.-S., Xu, Q.-S., Hu, Q.-N., & Liang, Y.-Z. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt105 · Cited by 239
Repurposing High-Throughput Image Assays Enables Biological Activity Prediction for Drug Discovery
Simm, J., Klambauer, G., Arany, A., Steijaert, M., Wegner, J. K., Gustin, E., Chupakhin, V., Chong, Y. T., Vialard, J., Buijnsters, P., et al. (2018) · Cell Chemical Biology · doi:10.1016/j.chembiol.2018.01.015 · Cited by 232
Self-citationMethods for High-throughput Drug Combination Screening and Synergy Scoring
He, L., Kulesskiy, E., Saarela, J., Turunen, L., Wennerberg, K., Aittokallio, T., & Tang, J. (2018) · Methods in Molecular Biology · doi:10.1007/978-1-4939-7493-1_17 · Cited by 232
Bulusu, K. C., Guha, R., Mason, D. J., Lewis, R. P. I., Muratov, E., Kalantar Motamedi, Y., Cokol, M., & Bender, A. (2016) · Drug Discovery Today · doi:10.1016/j.drudis.2015.09.003 · Cited by 202
Self-citationLarge-scale exploration and analysis of drug combinations
Li, P., Huang, C., Fu, Y., Wang, J., Wu, Z., Ru, J., Zheng, C., Guo, Z., Chen, X., Zhou, W., et al. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv080 · Cited by 195
Baumann, D., & Baumann, K. (2014) · Journal of Cheminformatics · doi:10.1186/s13321-014-0047-1 · Cited by 167
Systematic identification of synergistic drug pairs targeting HIV
Tan, X., Hu, L., Luquette, L. J., Gao, G., Liu, Y., Qu, H., Xi, R., Lu, Z. J., Park, P. J., & Elledge, S. J. (2012) · Nature Biotechnology · doi:10.1038/nbt.2391 · Cited by 138
Prediction of Synergism from Chemical-Genetic Interactions by Machine Learning
Wildenhain, J., Spitzer, M., Dolma, S., Jarvik, N., White, R., Roy, M. M., Griffiths, E., Bellows, D. S., Wright, G. D., & Tyers, M. (2015) · Cell Systems · doi:10.1016/j.cels.2015.12.003 · Cited by 127
DCDB 2.0: a major update of the drug combination database
Liu, Y., Wei, Q., Yu, G., Gai, W., Li, Y., & Chen, X. (2014) · Database · doi:10.1093/database/bau124 · Cited by 123
Systems approaches and algorithms for discovery of combinatorial therapies
Feala, J. D., Cortes, J., Duxbury, P. M., Piermarocchi, C., McCulloch, A. D., & Paternostro, G. (2009) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.51 · Cited by 118
Talloen, W., Clevert, D.-A., Hochreiter, S., Amaratunga, D., Bijnens, L., Kass, S. U., & Göhlmann, H. W. H. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm478 · Cited by 117
Self-citationDCDB: Drug combination database
Liu, Y., Hu, B. X., Cheng‐Xin, F. U., & Chen, X. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp697 · Cited by 97
Approaches to modernize the combination drug development paradigm
Day, D., & Siu, L. L. (2016) · Genome Medicine · doi:10.1186/s13073-016-0369-x · Cited by 97
jCompoundMapper: An open source Java library and command-line tool for chemical fingerprints
Hinselmann, G., Rosenbaum, L., Jahn, A., Fechner, N., & Zell, A. (2011) · Journal of Cheminformatics · doi:10.1186/1758-2946-3-3 · Cited by 95
Guichard, S. M., Cussac, D., Hennebelle, I., Bugat, R., & Canal, P. (1997) · International Journal of Cancer · Cited by 93
ASDCD: Antifungal Synergistic Drug Combination Database
Chen, X., Ren, B., Chen, M., Liu, M.-X., Ren, W., Wang, Q., Zhang, L., & Yan, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086499 · Cited by 89
Combinatorial therapy discovery using mixed integer linear programming
Pang, K., Wan, Y., Choi, W. T.-S., Donehower, L. A., Sun, J., Pant, D. K., & Liu, Z. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu046 · Cited by 86
Kano, Y., Akutsu, M., Tsunoda, S., Ando, J., Matsui, J., Suzuki, K., Ikeda, T., Inoue, Y., & Adachi, K. (1996) · British Journal of Cancer · doi:10.1038/bjc.1996.425 · Cited by 74
Tooker, P., Yen, W.-C., Ng, S., et al. (2007) · Cancer Research · doi:10.1158/0008-5472.can-06-4495 · Cited by 71
Singh, P. K., Negi, A., Gupta, P. K., Chauhan, M., & Kumar, R. (2015) · Archives of Toxicology · doi:10.1007/s00204-015-1587-5 · Cited by 62
Modeling of signaling crosstalk-mediated drug resistance and its implications on drug combination
Sun, X., Bao, J., You, Z., Chen, X., & Cui, J. (2016) · Oncotarget · doi:10.18632/oncotarget.11745 · Cited by 61
Recent Advances in Antifungal Prevention and Treatment
Groll, A. H., & Tragiannidis, A. (2009) · Seminars in Hematology · doi:10.1053/j.seminhematol.2009.03.003 · Cited by 48
Goswami, C. P., Cheng, L., Alexander, P., Singal, A. G., & Li, L. (2015) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.9 · Cited by 40
Guichard, S. M., Arnould, S., Hennebelle, I., Bugat, R., & Canal, P. (2001) · Anti-Cancer Drugs · doi:10.1097/00001813-200110000-00006 · Cited by 40
DIGRE: Drug‐Induced Genomic Residual Effect Model for Successful Prediction of Multidrug Effects
Yang, J., Tang, J. P., Li, Y., Zhong, R., Wang, T.-M., Wong, S. T. C., Xiao, G., & Xie, Y. (2015) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.1 · Cited by 37
López‐Camarillo, C., & Aréchaga-Ocampo, E. (2013) · InTech eBooks · doi:10.5772/1745 · Cited by 36
Morris, M. K., Clarke, D. C., Osimiri, L., & Lauffenburger, D. A. (2016) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12104 · Cited by 36
Huang, Y., Jiang, D., Sui, M., Wang, X., & Fan, W. (2016) · Oncology Reports · doi:10.3892/or.2016.5315 · Cited by 31
Akutsu, M., Kano, Y., Tsunoda, S., Suzuki, K., Yazawa, Y., & Miura, Y. (1995) · European Journal of Cancer · doi:10.1016/0959-8049(95)00448-3 · Cited by 22
Kano, Y., Akutsu, M., Tsunoda, S., Furuta, M., Yazawa, Y., & Ando, J. (1998) · PubMed · Cited by 16
Cited by
Artificial intelligence to deep learning: machine intelligence approach for drug discovery
Gupta, R., Srivastava, D., Sahu, M., Tiwari, S., Ambasta, R. K., & Kumar, P. (2021) · Molecular Diversity · doi:10.1007/s11030-021-10217-3 · Cited by 1,473
“…characteristics features of drug compounds such as SMILES2Vec (predicts chemical properties) [339], Chemception (DNN-based prediction of chemical properties) [245], DeepSynergy (prediction of anti-cancer drug synergy with DL) [340], and deepAOT (prediction of compound acute oral toxicity) [341].”
BackgroundDeep learning in cancer diagnosis, prognosis and treatment selection
Tran, K. A., Kondrashova, O., Bradley, A., Williams, E. D., Pearson, J. V., & Waddell, N. (2021) · Genome Medicine · doi:10.1186/s13073-021-00968-x · Cited by 932
Zheng, S., Wang, W., Aldahdooh, J., Malyutina, A., Shadbahr, T., Tanoli, Z., Pessia, A., & Tang, J. (2022) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.01.004 · Cited by 733
Large-scale comparison of machine learning methods for drug target prediction on ChEMBL
Mayr, A., Klambauer, G., Unterthiner, T., Steijaert, M., Wegner, J. K., Ceulemans, H., Clevert, D.-A., & Hochreiter, S. (2018) · Chemical Science · doi:10.1039/c8sc00148k · Cited by 584
Self-citationMater, A. C., & Coote, M. L. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00266 · Cited by 565
Metadata
- Authors
- Preuer, K., Lewis, R. P. I., Hochreiter, S., Bender, A., Bulusu, K. C., & Klambauer, G.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-12-15
- Volume
- 34
- Issue
- 9
- Pages
- 1538-1546
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2775061087
- Cited by
- 653
- References
- 67
- FWCI
- 20.34
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.