The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Best Practices for QSAR Model Development, Validation, and Exploitation
Abstract
After nearly five decades “in the making”, QSAR modeling has established itself as one of the major computational molecular modeling methodologies. As any mature research discipline, QSAR modeling can be characterized by a collection of well defined protocols and procedures that enable the expert application of the method for exploring and exploiting ever growing collections of biologically active chemical compounds. This review examines most critical QSAR modeling routines that we regard as best practices in the field. We discuss these procedures in the context of integrative predictive QSAR modeling workflow that is focused on achieving models of the highest statistical rigor and external predictive power. Specific elements of the workflow consist of data preparation including chemical structure (and when possible, associated biological data) curation, outlier detection, dataset balancing, and model validation. We especially emphasize procedures used to validate models, both internally and externally, as well as the need to define model applicability domains that should be used when models are employed for the prediction of external compounds or compound libraries. Finally, we present several examples of successful applications of QSAR models for virtual screening to identify experimentally confirmed hits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of Molecular Descriptors
Todeschini, R., & Consonni, V. (2000) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527613106 · Cited by 4,107 · cited 1×
“…description of major tenets of QSAR modeling is beyond the scope of this paper; the overview of many popular QSAR modeling techniques including statistical and datamining techniques as well as approaches to descriptor calculations could be found in many reviews and monographs, e.g., [4,5] ).”
MethodZINC − A Free Database of Commercially Available Compounds for Virtual Screening
Irwin, J. J., & Shoichet, B. K. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049714+ · Cited by 4,058
Golbraikh, A., & Tropsha, A. (2002) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(01)00123-1 · Cited by 3,735
Self-citationPrinciples of QSAR models validation: internal and external
Gramatica, P. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200610151 · Cited by 2,208
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Self-citationEriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Fourches, D., Muratov, E., & Tropsha, A. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100176x · Cited by 832
Self-citationOn Outliers and Activity CliffsWhy QSAR Often Disappoints
Maggiora, G. M. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci060117s · Cited by 728
Rational selection of training and test sets for the development of validated QSAR models
Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1025386326946 · Cited by 712
Self-citationGolbraikh, A., & Tropsha, A. (2002) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1020869118689 · Cited by 500
Self-citation
Cited by
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968
QSAR Modeling: Where have you been? Where are you going to?
Cherkasov, A., Muratov, E. N., Fourches, D., Varnek, A., Baskin, I. I., Cronin, M., Dearden, J., Gramatica, P., Martin, Y. C., Todeschini, R., et al. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm4004285 · Cited by 2,164
Self-citationDeep reinforcement learning for de novo drug design
Popova, M., Isayev, O., & Tropsha, A. (2018) · Science Advances · doi:10.1126/sciadv.aap7885 · Cited by 1,182
Self-citationConcepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Machine learning in chemoinformatics and drug discovery
Lo, Y.-C., Rensi, S. E., Torng, W., & Altman, R. B. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.05.010 · Cited by 960
Muratov, E. N., Bajorath, J., Sheridan, R. P., Tetko, I. V., Filimonov, D., Poroikov, V., Oprea, T. I., Baskin, I. I., Varnek, A., Roitberg, A., et al. (2020) · Chemical Society Reviews · doi:10.1039/d0cs00098a · Cited by 913
Self-citationCombining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
Keith, J. A., Vassilev-Galindo, V., Cheng, B., Chmiela, S., Gastegger, M., Müller, K.-R., & Tkatchenko, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00107 · Cited by 849
Deep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809
QSARINS: A new software for the development, analysis, and validation of QSAR MLR models
Gramatica, P., Chirico, N., Papa, E., Cassani, S., & Kovarich, S. (2013) · Journal of Computational Chemistry · doi:10.1002/jcc.23361 · Cited by 780
Chirico, N., & Gramatica, P. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200211n · Cited by 779
Beware of R2: Simple, Unambiguous Assessment of the Prediction Accuracy of QSAR and QSPR Models
Alexander, D. L. J., Tropsha, A., & Winkler, D. A. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00206 · Cited by 745
Self-citationDeep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723
A Review on Applications of Computational Methods in Drug Screening and Design
Lin, X., Li, X., & Lin, X. (2020) · Molecules · doi:10.3390/molecules25061375 · Cited by 718
Be aware of error measures. Further studies on validation of predictive QSAR models
Roy, K., Das, R. N., Ambure, P., & Aher, R. B. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.01.008 · Cited by 713
Chemical Basis of Interactions Between Engineered Nanoparticles and Biological Systems
Mu, Q., Jiang, G., Chen, L., Zhou, H., Fourches, D., Tropsha, A., & Yan, B. (2014) · Chemical Reviews · doi:10.1021/cr400295a · Cited by 679
Self-citationMachine Learning for Catalysis Informatics: Recent Applications and Prospects
Toyao, T., Maeno, Z., Takakusagi, S., Kamachi, T., Takigawa, I., & Shimizu, K.-I. (2020) · ACS Catalysis · doi:10.1021/acscatal.9b04186 · Cited by 617
OPERA models for predicting physicochemical properties and environmental fate endpoints
Mansouri, K., Grulke, C. M., Judson, R. S., & Williams, A. J. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0263-1 · Cited by 624
Further exploring r metrics for validation of QSPR models
Ojha, P. K., Mitra, I., Das, R. N., & Roy, K. (2011) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2011.03.011 · Cited by 554
Chirico, N., & Gramatica, P. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300084j · Cited by 536
Best practices in machine learning for chemistry
Artrith, N., Butler, K. T., Coudert, F.-X., Han, S., Isayev, O., Jain, A., & Walsh, A. (2021) · Nature Chemistry · doi:10.1038/s41557-021-00716-z · Cited by 505
QSAR-Based Virtual Screening: Advances and Applications in Drug Discovery
Neves, B. J., Braga, R. C., Melo-Filho, C. C., Moreira-Filho, J. T., Muratov, E. N., & Andrade, C. H. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.01275 · Cited by 494
Rings in Clinical Trials and Drugs: Present and Future
Shearer, J., Castro, J. L., Lawson, A. D. G., MacCoss, M., & Taylor, R. D. (2022) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.2c00473 · Cited by 479
Convolutional embedding of attributed molecular graphs for physical property prediction
Coley, C. W., Barzilay, R., Green, W. H., Jaakkola, T. S., & Jensen, K. F. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00601 · Cited by 470
Roy, K., Chakraborty, P., Mitra, I., Ojha, P. K., Kar, S., & Das, R. N. (2013) · Journal of Computational Chemistry · doi:10.1002/jcc.23231 · Cited by 466
Big data and artificial intelligence modeling for drug discovery
Zhu, H. (2020) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010919-023324 · Cited by 455
Gramatica, P., & Sangion, A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00088 · Cited by 420
Chalcone Derivatives: Promising Starting Points for Drug Design
Gomes, M., Muratov, E., Pereira, M., Peixoto, J., Rosseto, L., Cravo, P., Andrade, C., & Neves, B. (2017) · Molecules · doi:10.3390/molecules22081210 · Cited by 418
Graph convolutional networks for computational drug development and discovery
Sun, M., Zhao, S., Gilvary, C., Elemento, O., Zhou, J., & Wang, F. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbz042 · Cited by 413
Integrating QSAR modelling and deep learning in drug discovery: the emergence of deep QSAR
Tropsha, A., Isayev, O., Varnek, A., Schneider, G., & Cherkasov, A. (2024) · Nature Reviews Drug Discovery · doi:10.1038/s41573-023-00832-0 · Cited by 397
Self-citationToxicity testing in the 21st century: progress in the past decade and future perspectives
Krewski, D., Andersen, M. E., Tyshenko, M. G., Krishnan, K., Hartung, T., Boekelheide, K., Wambaugh, J. F., Jones, D., Whelan, M., Thomas, R., et al. (2020) · Archives of Toxicology · doi:10.1007/s00204-019-02613-4 · Cited by 383
Jing, Y., Bian, Y., Hu, Z., Wang, L., & Xie, X.-Q. S. (2018) · The AAPS Journal · doi:10.1208/s12248-018-0210-0 · Cited by 351
A Bayesian Approach to in Silico Blood-Brain Barrier Penetration Modeling
Martins, I. F., Teixeira, A. L., Pinheiro, L., & Falcao, A. O. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300124c · Cited by 331
Trends in Upstream and Downstream Process Development for Antibody Manufacturing
Gronemeyer, P., Ditz, R., & Strube, J. (2014) · Bioengineering · doi:10.3390/bioengineering1040188 · Cited by 329
Xiao, R., Ye, T., Wei, Z., Luo, S., Yang, Z., & Spinney, R. (2015) · Environmental Science & Technology · doi:10.1021/acs.est.5b03078 · Cited by 321
alvaDesc: A Tool to Calculate and Analyze Molecular Descriptors and Fingerprints
Mauri, A. (2020) · Methods in Pharmacology and Toxicology · doi:10.1007/978-1-0716-0150-1_32 · Cited by 305
Kadaoluwa Pathirannahalage, S. P., Meftahi, N., Elbourne, A., Weiss, A. C. G., McConville, C. F., Padua, A., Winkler, D. A., Costa Gomes, M., Greaves, T. L., Le, T. C., et al. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00794 · Cited by 302
Isayev, O., Fourches, D., Muratov, E. N., Oses, C., Rasch, K., Tropsha, A., & Curtarolo, S. (2015) · Chemistry of Materials · doi:10.1021/cm503507h · Cited by 300
Self-citationTrust, but Verify II: A Practical Guide to Chemogenomics Data Curation
Fourches, D., Muratov, E., & Tropsha, A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00129 · Cited by 294
Self-citationOn the Development and Validation of QSAR Models
Gramatica, P. (2013) · Methods in Molecular Biology · doi:10.1007/978-1-62703-059-5_21 · Cited by 274
Zhang, J., Mucs, D., Norinder, U., & Svensson, F. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00633 · Cited by 273
Dereplication: racing to speed up the natural products discovery process
Gaudêncio, S. P., & Pereira, F. (2015) · Natural Product Reports · doi:10.1039/c4np00134f · Cited by 264
Principles of QSAR Modeling: Comments and Suggestions From Personal Experience
Gramatica, P. (2020) · International Journal of Quantitative Structure-Property Relationships · doi:10.4018/ijqspr.20200701.oa1 · Cited by 258
Gramatica, P., Cassani, S., Roy, P. P., Kovarich, S., Yap, C. W., & Papa, E. (2012) · Molecular Informatics · doi:10.1002/minf.201200075 · Cited by 258
Phytotoxicity of veterinary antibiotics to seed germination and root elongation of crops
Pan, M., & Chu, L. M. (2016) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2015.12.027 · Cited by 256
Use of machine learning approaches for novel drug discovery
Lima, A. N., Philot, E. A., Trossini, G. H. G., Scott, L. P. B., Maltarollo, V. G., & Honorio, K. M. (2016) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2016.1146250 · Cited by 254
Perkins, D. O., Jeffries, C. D., Addington, J., Bearden, C. E., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Mathalon, D. H., McGlashan, T. H., Seidman, L. J., et al. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu099 · Cited by 238
Interpretation of Quantitative Structure-Activity Relationship Models: Past, Present, and Future
Polishchuk, P. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00274 · Cited by 236
Artificial Intelligence for Drug Discovery: Are We There Yet?
Hasselgren, C., & Oprea, T. I. (2024) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-040323-040828 · Cited by 236
“Instead, our focus is on the practical issues related to the applicability domain (168) and external predictivity validation (169).”
BackgroundTowards reproducible computational drug discovery
Schaduangrat, N., Lampa, S., Simeon, S., Gleeson, M. P., Spjuth, O., & Nantasenamat, C. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-0408-x · Cited by 208
A critical overview of computational approaches employed for COVID-19 drug discovery
Muratov, E. N., Amaro, R., Andrade, C. H., Brown, N., Ekins, S., Fourches, D., Isayev, O., Kozakov, D., Medina-Franco, J. L., Merz, K. M., et al. (2021) · Chemical Society Reviews · doi:10.1039/d0cs01065k · Cited by 206
Self-citationGolbraikh, A., Muratov, E., Fourches, D., & Tropsha, A. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci400572x · Cited by 152
Self-citationThafar, M. A., Olayan, R. S., Ashoor, H., Albaradei, S., Bajic, V. B., Gao, X., Gojobori, T., & Essack, M. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-00447-2 · Cited by 143
Sedykh, A., Zhu, H., Tang, H., Zhang, L., Richard, A., Rusyn, I., & Tropsha, A. (2011) · Environmental Health Perspectives · doi:10.1289/ehp.1002476 · Cited by 119
Self-citationUniversal Approach for Structural Interpretation of QSAR/QSPR Models
Polishchuk, P. G., Kuz'min, V. E., Artemenko, A. G., & Muratov, E. N. (2013) · Molecular Informatics · doi:10.1002/minf.201300029 · Cited by 76
Gajewicz, A. (2017) · Nanoscale · doi:10.1039/c7nr02211e · Cited by 71
Cheminformatics-driven discovery of polymeric micelle formulations for poorly soluble drugs
Alves, V. M., Hwang, D., Muratov, E., Sokolsky-Papkov, M., Varlamova, E., Vinod, N., Lim, C., Andrade, C. H., Tropsha, A., & Kabanov, A. (2019) · Science Advances · doi:10.1126/sciadv.aav9784 · Cited by 56
Self-citationLuo, M., Wang, X. S., Roth, B. L., Golbraikh, A., & Tropsha, A. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci400460q · Cited by 37
Self-citationComputer-Aided Discovery and Characterization of Novel Ebola Virus Inhibitors
Capuzzi, S. J., Sun, W., Muratov, E. N., Martínez-Romero, C., He, S., Zhu, W., Li, H., Tawa, G., Fisher, E. G., Xu, M., et al. (2018) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.8b00035 · Cited by 35
Self-citationBenchmarking compound activity prediction for real-world drug discovery applications
(2024) · doi:10.1038/s42004-024-01204-4 · Cited by 34
Adding Stochastic Negative Examples into Machine Learning Improves Molecular Bioactivity Prediction
Cáceres, E. L., Mew, N. C., & Keiser, M. J. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00565 · Cited by 33
Wu, W., Zhang, R., Peng, S., Li, X., & Zhang, L. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.06.011 · Cited by 13
Molecular Structure-Based Large-Scale Prediction of Chemical-Induced Gene Expression Changes
Liu, R., AbdulHameed, M. D. M., & Wallqvist, A. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00281 · Cited by 7
Metadata
- Authors
- Tropsha, A.
- Venue
- Molecular Informatics
- Publisher
- Wiley
- Published
- 2010-07-12
- Volume
- 29
- Issue
- 6-7
- Pages
- 476-488
- ISSN
- 1868-1743 (ISSN-L)
- 1868-1751
- OpenAlex
- W2128245586
- Cited by
- 2,024
- References
- 51
- FWCI
- 53.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.