Relevant Applications of Generative Adversarial Networks in Drug Design and Discovery: Molecular De Novo Design, Dimensionality Reduction, and De Novo Peptide and Protein Design
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
A growing body of evidence now suggests that artificial intelligence and machine learning techniques can serve as an indispensable foundation for the process of drug design and discovery. In light of latest advancements in computing technologies, deep learning algorithms are being created during the development of clinically useful drugs for treatment of a number of diseases. In this review, we focus on the latest developments for three particular arenas in drug design and discovery research using deep learning approaches, such as generative adversarial network (GAN) frameworks. Firstly, we review drug design and discovery studies that leverage various GAN techniques to assess one main application such as molecular de novo design in drug design and discovery. In addition, we describe various GAN models to fulfill the dimension reduction task of single-cell data in the preclinical stage of the drug development pipeline. Furthermore, we depict several studies in de novo peptide and protein design using GAN frameworks. Moreover, we outline the limitations in regard to the previous drug design and discovery studies using GAN models. Finally, we present a discussion of directions and challenges for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Weininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436 · cited 1×
“While many molecular representation schemes exist, the most popular molecular representation scheme is a string-based representation called simplified molecular-input line-entry system (SMILES) strings for representing a set of molecular compounds [48].”
BackgroundUMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 5×
“In terms of architecture, the concept of the conditioned GAN structure stems from the conditional GAN structure [33] and the Wasserstein GAN structure with gradient penalty [32,73].”
BackgroundMethodInfluentialModeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
PubChem Substance and Compound databases
Kim, S., Thiessen, P. A., Bolton, E. E., Chen, J., Fu, G., Gindulyte, A., Han, L., He, J., He, S., Shoemaker, B. A., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv951 · Cited by 5,436 · cited 1×
“) [ GDB-17 : gdb.unibe.ch downloads) [55], QM9 (http: quantummachine.org datasets nih. gov) [57], and ChemDiv (http://www.chemdiv.com/) [56], PubChem : // pubchem.ncbi.nlm.nih.gov) [57] databases. and To generate new molecules with desired molecular features, Kadurin et al. [28,29] investigated the…”
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“In addition, these three deep learning approaches could be applied to other research categories in drug design and discovery, including compound property and activity prediction, reaction analysis, synthesis prediction, and biological image analysis [1,121,122].”
BackgroundMachine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968 · cited 1×
“Nowadays researchers have been making compelling progress in the interdisciplinary fields of artificial intelligence, machine learning, and drug design and discovery [1–4].”
BackgroundA Next Generation Connectivity Map: L1000 Platform and the First 1,000,000 Profiles
Subramanian, A., Narayan, R., Corsello, S. M., Peck, D. D., Natoli, T. E., Lu, X., Gould, J., Davis, J. F., Tubelli, A. A., Asiedu, J. K., et al. (2017) · Cell · doi:10.1016/j.cell.2017.10.049 · Cited by 3,515
Applications of machine learning in drug discovery and development
Vamathevan, J., Clark, D., Czodrowski, P., Dunham, I., Ferran, E., Lee, G., Li, B., Madabhushi, A., Shah, P., Spitzer, M., et al. (2019) · Nature Reviews Drug Discovery · doi:10.1038/s41573-019-0024-5 · Cited by 3,228
ZINC 15 – Ligand Discovery for Everyone
Sterling, T., & Irwin, J. J. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00559 · Cited by 3,224
Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq
Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., et al. (2015) · Science · doi:10.1126/science.aaa1934 · Cited by 3,124
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
Deep generative modeling for single-cell transcriptomics
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018) · Nature Methods · doi:10.1038/s41592-018-0229-2 · Cited by 2,530 · cited 2×
“From the experiments, it was indicated that the DR-A model had better performance than other widely used dimensionality reduction methods, including the PCA [80], Zero-Inflated Factor Analysis (ZIFA) [83], Single-cell Variational Inference (scVI) [82], Sparse Autoencoder for Unsupervised Clustering, Imputation, and Em…”
MethodDirectory of useful decoys, enhanced (DUD-E): better ligands and decoys for better benchmarking.
Mysinger, M. M., Carchia, M., Irwin, J. J., & Shoichet, B. K. (2012) · Journal of Medicinal Chemistry · doi:10.1021/jm300687e · Cited by 2,412 · cited 1×
“Yet, it is an open challenge that large-scale benchmark datasets [106,107] might not be accessible to facilitate subsequent analysis in deep learning research.”
BackgroundArjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Quantum chemistry structures and properties of 134 kilo molecules
Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. (2014) · Scientific Data · doi:10.1038/sdata.2014.22 · Cited by 1,966 · cited 2×
“Other public databases for commercially available compounds combinatorially generated [54], GDB-17 (http://gdb.unibe.ch/downloads) libraries include ZINC (http: zinc15.docking [55], QM9 (http://quantummachine.org/datasets/) [56], PubChem (https://pubchem.ncbi.nlm.”
BackgroundMethodPlanning chemical syntheses with deep neural networks and symbolic AI
Segler, M. H. S., Preuss, M., & Waller, M. P. (2018) · Nature · doi:10.1038/nature25978 · Cited by 1,847 · cited 1×
“…the goal of artificial intelligence and machine learning approaches is to provide data-driven algorithms that can in general help facilitate various stages of the drug development pipeline, such as drug target prediction, drug screening and discovery, preclinical trials, and clinical trials [2,5,6].”
BackgroundThe rise of deep learning in drug discovery
Chen, H., Engkvist, O., Wang, Y., Olivecrona, M., & Blaschke, T. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.01.039 · Cited by 1,770
Deep Reinforcement Learning That Matters
Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685
Performance evaluation of classification algorithms by k-fold and leave-one-out cross validation
Wong, T.-T. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.03.009 · Cited by 1,562
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17
Ruddigkeit, L., van Deursen, R., Blum, L. C., & Reymond, J.-L. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300415d · Cited by 1,505 · cited 4×
“Drug-like compound databases such as the ZINC [54] and GDB-17 [55] databases were utilized.”
BackgroundMethodInfluentialThe coming of age of de novo protein design
Huang, P.-S., Boyken, S. E., & Baker, D. (2016) · Nature · doi:10.1038/nature19946 · Cited by 1,478
Deep learning for computational biology
Angermueller, C., Pärnamaa, T., Parts, L., & Stegle, O. (2016) · Molecular Systems Biology · doi:10.15252/msb.20156651 · Cited by 1,473 · cited 1×
“Thus, the general public and governments should deal with these challenges and issues with high priorities in the up-coming decade [128,129].”
BackgroundHybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412 · cited 1×
“While the ORGANIC structure used a long short-term memory unit [64] in the recurrent neural network model [46], the RANC structure employed a di ff erentiable neural computer architecture which has been shown to outperform the long short-term memory unit [65].”
MethodDeep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159 · cited 2×
“For instance, Ma et al. [123] employed fully connected deep neural network algorithms for property prediction by using the Kaggle benchmark datasets (www.kaggle.com / datasets).”
MethodDeep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069
Machine learning in chemoinformatics and drug discovery
Lo, Y.-C., Rensi, S. E., Torng, W., & Altman, R. B. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.05.010 · Cited by 960
GuacaMol: Benchmarking Models for de Novo Molecular Design
Brown, N., Fiscato, M., Segler, M. H. S., & Vaucher, A. C. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00839 · Cited by 895
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Polykovskiy, D., Zhebrak, A., Sanchez-Lengeling, B., Golovanov, S., Tatanov, O., Belyaev, S., Kurbanov, R., Artamonov, A., Aladinskiy, V., Veselov, M., et al. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.565644 · Cited by 849 · cited 2×
“Recently, two benchmarking tools for molecular de novo design were developed, including GuacaMol [101] and MOSES (Molecular Sets) [102].”
MethodDeep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723 · cited 1×
“Furthermore, it should be emphasized that we should employ the traditional linear models as the fundamental basis when applying deep learning approaches such as the GAN architecture [108].”
Validation of noise models for single-cell transcriptomics
Grün, D., Kester, L., & van Oudenaarden, A. (2014) · Nature Methods · doi:10.1038/nmeth.2930 · Cited by 721
A general and flexible method for signal extraction from single-cell RNA-seq data
Risso, D., Perraudeau, F., Gribkova, S., Dudoit, S., & Vert, J.-P. (2018) · Nature Communications · doi:10.1038/s41467-017-02554-5 · Cited by 718
Applications of Deep Learning in Biomedicine
Mamoshina, P., Vieira, A., Lane, E., & Zhavoronkov, A. (2016) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.5b00982 · Cited by 701
Deep learning for molecular design—a review of the state of the art
Elton, D. C., Boukouvalas, Z., Fuge, M. D., & Chung, P. W. (2019) · Molecular Systems Design & Engineering · doi:10.1039/c9me00039a · Cited by 683 · cited 1×
“It should be also pointed out that future research is needed to investigate and compare multiple molecular representations, such as SMILES strings and graph grammar-based approaches, in order to properly represent the chemical structures and further improve chemical accuracy [117].”
BackgroundKadurin, A., Nikolenko, S., Khrabrov, K., Aliper, A., & Zhavoronkov, A. (2017) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.7b00346 · Cited by 587
Large-scale comparison of machine learning methods for drug target prediction on ChEMBL
Mayr, A., Klambauer, G., Unterthiner, T., Steijaert, M., Wegner, J. K., Ceulemans, H., Clevert, D.-A., & Hochreiter, S. (2018) · Chemical Science · doi:10.1039/c8sc00148k · Cited by 584
ZIFA: Dimensionality reduction for zero-inflated single-cell gene expression analysis
Pierson, E., & Yau, C. (2015) · Genome Biology · doi:10.1186/s13059-015-0805-z · Cited by 577 · cited 3×
“On the other hand, PCA, ZIFA, t-SNE, and UMAP utilize traditional machine learning approaches without deep learning techniques, where deep learning techniques usually refer to artificial neural networks with multiple layers, that is, fully connected deep neural network algorithms.”
MethodMolGAN: An implicit generative model for small molecular graphs
De Cao, N., & Kipf, T. (2018) · arXiv · doi:10.48550/arxiv.1805.11973 · Cited by 442
Application of Generative Autoencoder in De Novo Molecular Design
Blaschke, T., Olivecrona, M., Engkvist, O., Bajorath, J., & Chen, H. (2018) · Molecular Informatics · doi:10.1002/minf.201700123 · Cited by 411
Interpretable dimensionality reduction of single cell transcriptome data with deep generative models
Ding, J., Condon, A., & Shah, S. P. (2018) · Nature Communications · doi:10.1038/s41467-018-04368-5 · Cited by 337 · cited 1×
“…the preclinical stage of the drug development pipeline, deep learning approaches such as deep variational autoencoder [14] have been used to conduct the dimension reduction task of single-cell data for cell-specific biomarker discovery with single-cell RNA sequencing (scRNA-seq) techniques [15,16].”
MethodCang, Z., & Wei, G.-W. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005690 · Cited by 330 · cited 2×
“It has been demonstrated that under the condition of relatively small training datasets, TopologyNet (Pearson correlation coe ffi cient of 0.826) was able to achieve better performance than single-task models such as random forests (Pearson correlation coe ffi cient of 0.803) [124].”
MethodInfluentialEntangled Conditional Adversarial Autoencoder for de Novo Drug Discovery
Polykovskiy, D., Zhebrak, A., Vetrov, D., Ivanenkov, Y., Aladinskiy, V., Mamoshina, P., Bozdaganyan, M., Aliper, A., Zhavoronkov, A., & Kadurin, A. (2018) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.8b00839 · Cited by 278 · cited 3×
“[40] ECAAE AAE latent vector autoencoder ZINC ECAAE generated novel molecular compounds which can be considered as target drugs in rheumatoid arthritis, psoriasis, and vitiligo.”
BackgroundInfluentialMol-CycleGAN: a generative model for molecular optimization
Maziarka, Ł., Pocha, A., Kaczmarczyk, J., Rataj, K., Danel, T., & Warchoł, M. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-019-0404-1 · Cited by 275
Generative Adversarial Networks and Its Applications in Biomedical Informatics
Lan, L., You, L., Zhang, Z., Fan, Z., Zhao, W., Zeng, N., Chen, Y., & Zhou, X. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00164 · Cited by 237 · cited 10×
“Molecules 2020 , 25 , x FOR PEER REVIEW 3 of 25 Because there is a flood of publications on numerous variants of the GAN architecture in di ff erent branches of science and engineering, it is really challenging to follow the emerging trend [30,31].”
BackgroundMethodInfluentialA renaissance of neural networks in drug discovery
Baskin, I. I., Winkler, D., & Tetko, I. V. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1201262 · Cited by 235
Will Artificial Intelligence for Drug Discovery Impact Clinical Pharmacology?
Zhavoronkov, A., Vanhaelen, Q., & Oprea, T. I. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1795 · Cited by 159
Cited by
Visan, A. I., & Negut, I. (2024) · Life · doi:10.3390/life14020233 · Cited by 279
The transformational role of GPU computing and deep learning in drug discovery
Pandey, M., Fernandez, M., Gentile, F., Isayev, O., Tropsha, A., Stern, A. C., & Cherkasov, A. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00463-x · Cited by 255
“These methods were promptly utilized by researchers in drug discovery to artificially synthesize data across subproblems 66 .”
MethodA critical overview of computational approaches employed for COVID-19 drug discovery
Muratov, E. N., Amaro, R., Andrade, C. H., Brown, N., Ekins, S., Fourches, D., Isayev, O., Kozakov, D., Medina-Franco, J. L., Merz, K. M., et al. (2021) · Chemical Society Reviews · doi:10.1039/d0cs01065k · Cited by 206
Generative machine learning for de novo drug discovery: A systematic review
Martinelli, D. D. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105403 · Cited by 177
Computer especially AI-assisted drug virtual screening and design in traditional Chinese medicine
Lin, Y., Zhang, Y., Wang, D., Yang, B., & Shen, Y.-Q. (2022) · Phytomedicine · doi:10.1016/j.phymed.2022.154481 · Cited by 107
Metadata
- Authors
- Lin, E., Lin, C.-H., & Lane, H.-Y.
- Venue
- Molecules
- Publisher
- MDPI AG
- Published
- 2020-07-16
- Volume
- 25
- Issue
- 14
- Pages
- 3250
- ISSN
- 1420-3049 (ISSN-L)
- OpenAlex
- W3042995081
- Cited by
- 109
- References
- 54
- FWCI
- 5.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.