AI in drug development: a multidisciplinary perspective
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
The introduction of a new drug to the commercial market follows a complex and long process that typically spans over several years and entails large monetary costs due to a high attrition rate. Because of this, there is an urgent need to improve this process using innovative technologies such as artificial intelligence (AI). Different AI tools are being applied to support all four steps of the drug development process (basic research for drug discovery; pre-clinical phase; clinical phase; and postmarketing). Some of the main tasks where AI has proven useful include identifying molecular targets, searching for hit and lead compounds, synthesising drug-like compounds and predicting ADME-Tox. This review, on the one hand, brings in a mathematical vision of some of the key AI methods used in drug development closer to medicinal chemists and, on the other hand, brings the drug development process and the use of different models closer to mathematicians. Emphasis is placed on two aspects not mentioned in similar surveys, namely, Bayesian approaches and their applications to molecular modelling and the eventual final use of the methods to actually support decisions. Graphic abstract: Promoting a perfect synergy
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 4×
“Since transformer-based models are more amenable to paralleli-sation, they have been trained over massive datasets in the NLP domain, leading to architectures such as Bidirectional Encoder Representations for Transformers (BERT) [48] or Fig.”
MethodInfluentialAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“One possibility is to use interpretable models, easily comprehensible for humans, as cogently argued by [162] who claims that in many contexts we may perform with such models almost as well as with deep ones.”
BackgroundUMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754 · cited 1×
“In particular their solution would facilitate the development of probabilistic programming languages [166, 167].”
BackgroundWeininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436 · cited 6×
“In chemical design tasks, the most popular case is to treat the SMILES representation of the molecule as the input sequence to a RNN to provide novel molecular descriptions.”
BackgroundInfluentialUMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Graph Neural Networks: A Review of Methods and Applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2018) · arXiv · doi:10.48550/arxiv.1812.08434 · Cited by 6,880
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 1×
“Fortunately, these computational demands are mitigated through the use of classical SGD methods [61] to perform the estimation [62].”
MethodBackpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“Backpropagating through long sequences may lead to problems of either vanishing or exploding gradients [44].”
BackgroundLarge Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Innovation in the pharmaceutical industry: New estimates of R&D costs
DiMasi, J. A., Grabowski, H. G., & Hansen, R. W. (2016) · Journal of Health Economics · doi:10.1016/j.jhealeco.2016.01.012 · Cited by 3,359
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107 · cited 1×
“Regarding molecular representations, ChemBERTa has been recently introduced leading to encouraging results on MoleculeNet tasks [50, 51].”
ResultAutomatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106 · cited 2×
“One of the pioneers in proposing novel VAE based methods to generate chemical structures was [83].”
BackgroundMethodNonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037
A Deep Learning Approach to Antibiotic Discovery
Stokes, J. M., Yang, K., Swanson, K., Jin, W., Cubillos-Ruiz, A., Donghia, N. M., MacNair, C. R., French, S., Carfrae, L. A., Bloom-Ackermann, Z., et al. (2020) · Cell · doi:10.1016/j.cell.2020.01.021 · Cited by 2,463
Artificial intelligence in medicine
Hamet, P., & Tremblay, J. (2017) · Metabolism · doi:10.1016/j.metabol.2017.01.011 · Cited by 2,334
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312 · cited 1×
“ML has also been successfully used to analyse longtime scale simulation data in large systems [148], for predicting ground state energies [149], molecular atomisation energies [150] or even predict the solvent-solute interaction map [151] demonstrating the versatility and applicability of ML in improving MD techniques.”
MethodAnalyzing Learned Molecular Representations for Property Prediction
Yang, K., Swanson, K., Jin, W., Coley, C., Eiden, P., Gao, H., Guzman-Perez, A., Hopper, T., Kelley, B., Mathea, M., et al. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00237 · Cited by 1,923
Generating Focused Molecule Libraries for Drug Discovery with Recurrent Neural Networks
Segler, M. H. S., Kogej, T., Tyrchan, C., & Waller, M. P. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00512 · Cited by 1,537
Software for molecular docking: a review
Pagadala, N. S., Syed, K., & Tuszynski, J. (2017) · Biophysical Reviews · doi:10.1007/s12551-016-0247-1 · Cited by 1,522 · cited 1×
“Molecular docking techniques are used to study the ligand–target interaction applying molecular mechanics to solve molecular interactions, being a key method in drug discovery and drug development [121, 122].”
MethodArtificial intelligence to deep learning: machine intelligence approach for drug discovery
Gupta, R., Srivastava, D., Sahu, M., Tiwari, S., Ambasta, R. K., & Kumar, P. (2021) · Molecular Diversity · doi:10.1007/s11030-021-10217-3 · Cited by 1,473 · cited 1×
“Recent theoretical models learn task-related features from raw data and then refine the molecular representation to a standard [169].”
BackgroundGoing Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159 · cited 1×
“One of the first models based on feed-forward NNs was [108].”
BackgroundDeepTox: toxicity prediction using deep learning
Mayr, A., Klambauer, G., Unterthiner, T., & Hochreiter, S. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2015.00080 · Cited by 1,081 · cited 1×
“Several platforms like DeepTox [159] and PrOCTOR [160] are available.”
MethodHANSCH, C., MALONEY, P. P., FUJITA, T., & MUIR, R. M. (1962) · Nature · doi:10.1038/194178b0 · Cited by 1,056 · cited 1×
“A QSAR model is able to predict changes in bioactivity as a function of structural modifications [105].”
MethodArtificial intelligence in drug development: Present status and future prospects
Mak, K.-K., & Pichika, M. R. (2019) · Drug Discovery Today · doi:10.1016/j.drudis.2018.11.014 · Cited by 1,018 · cited 2×
“Moreover, approximately only 38% of new chemical entities in Phase IIb and Phase III clinical trials reached the market, being the major sources of attrition failures in safety and efficacy followed by those in relation to formulation, pharmacokinetic and bioavailability [6].”
BackgroundRethinking drug design in the artificial intelligence era
Schneider, P., Walters, W. P., Plowright, A. T., Sieroka, N., Listgarten, J., Goodnow, R. A., Fisher, J., Jansen, J. M., Duca, J. S., Rush, T. S., et al. (2020) · Nature Reviews Drug Discovery · doi:10.1038/s41573-019-0050-3 · Cited by 894 · cited 1×
“recently showcased the benefits of using AI tools in drug development due to the potential of predictive models for navigating large chemical databases [10].”
BackgroundLow Data Drug Discovery with One-Shot Learning
Altae-Tran, H., Ramsundar, B., Pappu, A. S., & Pande, V. (2017) · ACS Central Science · doi:10.1021/acscentsci.6b00367 · Cited by 799 · cited 1×
“As an example, Altae-Tran et al have developed an algorithm based on one-shot learning that can be used to significantly lower the amount of data required [168].”
MethodOn Outliers and Activity CliffsWhy QSAR Often Disappoints
Maggiora, G. M. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci060117s · Cited by 728
A Review on Applications of Computational Methods in Drug Screening and Design
Lin, X., Li, X., & Lin, X. (2020) · Molecules · doi:10.3390/molecules25061375 · Cited by 718 · cited 1×
“Over the last decades several computational methods have been introduced to reduce drug discovery times and costs, as well as improve the development process quality and its success rate [8].”
BackgroundArtificial intelligence for clinical trial design
Harrer, S., Shah, P., Antony, B., & Hu, J. (2019) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2019.05.005 · Cited by 672
Jinnouchi, R., Lahnsteiner, J., Karsai, F., Kresse, G., & Bokdam, M. (2019) · Physical Review Letters · doi:10.1103/physrevlett.122.225701 · Cited by 635 · cited 1×
“This technique has been applied in several recent works, demonstrating that it can improve the results obtained with conventional approaches [144–146].”
MethodKadurin, A., Nikolenko, S., Khrabrov, K., Aliper, A., & Zhavoronkov, A. (2017) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.7b00346 · Cited by 587 · cited 1×
“Subsequently, [85] proposed an improved architecture called druGAN, which uses the VAE as a molecular descriptor generator combined with a GAN capable of generating novel chemical structures.”
MethodBayesian Active Learning for Classification and Preference Learning
Houlsby, N., Huszár, F., Ghahramani, Z., & Lengyel, M. (2011) · arXiv · doi:10.48550/arxiv.1112.5745 · Cited by 507
Application of Generative Autoencoder in De Novo Molecular Design
Blaschke, T., Olivecrona, M., Engkvist, O., Bajorath, J., & Chen, H. (2018) · Molecular Informatics · doi:10.1002/minf.201700123 · Cited by 411
Bender, A., & Cortés-Ciriano, I. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2020.12.009 · Cited by 405
Ulissi, Z. W., Tang, M. T., Xiao, J., Liu, X., Torelli, D. A., Karamad, M., Cummins, K., Hahn, C., Lewis, N. S., Jaramillo, T. F., et al. (2017) · ACS Catalysis · doi:10.1021/acscatal.7b01648 · Cited by 387
Graph Convolutional Neural Networks for Predicting Drug-Target Interactions
Torng, W., & Altman, R. B. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00628 · Cited by 371
Ain, Q. U., Aleksandrova, A., Roessler, F. D., & Ballester, P. J. (2015) · WIREs Computational Molecular Science · doi:10.1002/wcms.1225 · Cited by 357
Transformer protein language models are unsupervised structure learners
Rao, R., Meier, J., Sercu, T., Ovchinnikov, S., & Rives, A. (2020) · doi:10.1101/2020.12.15.422761 · Cited by 341
A Data-Driven Approach to Predicting Successes and Failures of Clinical Trials
Gayvert, K. M., Madhukar, N. S., & Elemento, O. (2016) · Cell chemical biology · doi:10.1016/j.chembiol.2016.07.023 · Cited by 310 · cited 1×
“Several platforms like DeepTox [159] and PrOCTOR [160] are available.”
MethodMachine learning approaches for analyzing and enhancing molecular dynamics simulations
Wang, Y., Lamim Ribeiro, J. M., & Tiwary, P. (2020) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2019.12.016 · Cited by 303 · cited 1×
“ML has also been successfully used to analyse longtime scale simulation data in large systems [148], for predicting ground state energies [149], molecular atomisation energies [150] or even predict the solvent-solute interaction map [151] demonstrating the versatility and applicability of ML in improving MD techniques.”
Method
Cited by
Serrano, D. R., Luciano, F. C., Anaya, B. J., Ongoren, B., Kara, A., Molina, G., Ramirez, B. I., Sánchez-Guirales, S. A., Simon, J. A., Tomietto, G., et al. (2024) · Pharmaceutics · doi:10.3390/pharmaceutics16101328 · Cited by 488
The Integration of Artificial Intelligence into Clinical Practice
Karalis, V. D. (2024) · Applied Biosciences · doi:10.3390/applbiosci3010002 · Cited by 255
“The primary objective of reinforcement learning is to train autonomous agents to effectively make a series of decisions within a given environment, aiming to optimize the total cumulative reward obtained [29].”
BackgroundGanjavi, C., Eppler, M. B., Pekcan, A., Biedermann, B., Abreu, A., Collins, G. S., Gill, I. S., & Cacciamani, G. E. (2024) · BMJ · doi:10.1136/bmj-2023-077192 · Cited by 266
Generative machine learning for de novo drug discovery: A systematic review
Martinelli, D. D. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105403 · Cited by 177
Schleinitz, J., Langevin, M., Smail, Y., Wehnert, B., Grimaud, L., & Vuilleumier, R. (2022) · Journal of the American Chemical Society · doi:10.1021/jacs.2c05302 · Cited by 88
Metadata
- Authors
- Gallego, V., Naveiro, R., Roca, C., Ríos Insua, D., & Campillo, N. E.
- Venue
- Molecular Diversity
- Published
- 2021-07-12
- Volume
- 25
- Issue
- 3
- Pages
- 1461-1479
- ISSN
- 1381-1991 (ISSN-L)
- 1573-501X
- OpenAlex
- W3183046872
- Cited by
- 73
- References
- 53
- FWCI
- 5.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.