The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Rational selection of training and test sets for the development of validated QSAR models
Abstract
Quantitative Structure-Activity Relationship (QSAR) models are used increasingly to screen chemical databases and/or virtual chemical libraries for potentially bioactive molecules. These developments emphasize the importance of rigorous model validation to ensure that the models have acceptable predictive power. Using k nearest neighbors (kNN) variable selection QSAR method for the analysis of several datasets, we have demonstrated recently that the widely accepted leave-one-out (LOO) cross-validated R2 (q2) is an inadequate characteristic to assess the predictive ability of the models [Golbraikh, A., Tropsha, A. Beware of q2! J. Mol. Graphics Mod. 20, 269-276, (2002)]. Herein, we provide additional evidence that there exists no correlation between the values of q2 for the training set and accuracy of prediction (R2) for the test set and argue that this observation is a general property of any QSAR model developed with LOO cross-validation. We suggest that external validation using rationally selected training and test sets provides a means to establish a reliable QSAR model. We propose several approaches to the division of experimental datasets into training and test sets and apply them in QSAR studies of 48 functionalized amino acid anticonvulsants and a series of 157 epipodophyllotoxin derivatives with antitumor activity. We formulate a set of general criteria for the evaluation of predictive power of QSAR models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Golbraikh et al. 43 proposed a protocol to determine if a QSAR model has a predictive power.”
From Quantitative Toxicity Prediction Using Topology Based Multitask Deep Neural Networks (2018) · cites this paper as [43]
Citations
Cites
Golbraikh, A., & Tropsha, A. (2002) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(01)00123-1 · Cited by 3,735
Self-citationSachs, L. (1984) · Springer series in statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 1,016
Chemometric Methods in Molecular Design
Waterbeemd, H. V. D. (1995) · Methods and principles in medicinal chemistry · doi:10.1002/9783527615452 · Cited by 757
Chemometric methods in molecular design
Waterbeemd, H. V. D. (1995) · Medical Entomology and Zoology · Cited by 561
Golbraikh, A., & Tropsha, A. (2002) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1020869118689 · Cited by 504
Self-citationZheng, W., & Tropsha, A. (1999) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci980033m · Cited by 448
Self-citationKubinyi, H., Hamprecht, F. A., & Mietzner, T. (1998) · Journal of Medicinal Chemistry · doi:10.1021/jm970732a · Cited by 240
Comparison of algorithms for dissimilarity-based compound selection
Snarey, M., Terrett, N. K., Willett, P., & Wilton, D. J. (1997) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(98)00008-4 · Cited by 212
Fan, Y., Shi, L. M., Kohn, K. W., Pommier, Y. G., & Weinstein, J. N. (2001) · Journal of Medicinal Chemistry · doi:10.1021/jm0005151 · Cited by 162
Recanatini, M., Cavalli, A., Belluti, F., Piazzi, L., Rampa, A., Bisi, A., Gobbi, S., Valenti, P., Andrisano, V., Bartolini, M., et al. (2000) · Journal of Medicinal Chemistry · doi:10.1021/jm990971t · Cited by 154
Research works printed but not linked: 5
- Belkina, N.V., Skvortsov, V.S., Ivanov, A.S., Archakov, A.I., Vopr. Med. Khim. 44 (1998) 464.
- Wold, S., Eriksson, L. In: Chemometrics Methods in Molecular Design, van de Waterbeemd, H. (Ed.), VCH, 1995, pp. 309-318.
- Tropsha, A., Gramatica, P., Gombar, V., Quant. Struct. Act. Relat. (2002) (in press).
- Xiao, Z. Design and Synthesis of Etoposide-Related Topo II Inhibitors by Conventional and Computational Approaches. Ph.D. Dissertation. The University of North Carolina at Chapel Hill, 2003.
- Zhang, Y., Lee, K.H., Chin. Pharm. J. 46 (1994) 319.
Cited by
Sorted by citations
Principles of QSAR models validation: internal and external
Gramatica, P. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200610151 · Cited by 2,249
Best Practices for QSAR Model Development, Validation, and Exploitation
Tropsha, A. (2010) · Molecular Informatics · doi:10.1002/minf.201000061 · Cited by 2,107
Self-citationOn Some Aspects of Variable Selection for Partial Least Squares Regression Models
Roy, P. P., & Roy, K. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200710043 · Cited by 795
Chirico, N., & Gramatica, P. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200211n · Cited by 788
Comments on the Definition of the Q 2 Parameter for QSAR Validation
Consonni, V., Ballabio, D., & Todeschini, R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900115y · Cited by 587
Metadata
- Authors
- Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Tropsha, Alexander
- Venue
- Journal of Computer-Aided Molecular Design
- Published
- 2003-02
- Volume
- 17
- Issue
- 2-4
- Pages
- 241-253
- ISSN
- 0920-654X (ISSN-L)
- 1573-4951
- OpenAlex
- W1571439140
- Cited by
- 712
- References
- 30
- Citations by year
- 2026: 24 · 2025: 36 · 2024: 26 · 2023: 41 · 2022: 35 · 2021: 44 · 2020: 47 · 2019: 38 · 2018: 36 · 2017: 31 · 2016: 35 · 2015: 36 · 2014: 28 · 2013: 31 · 2012: 30
- FWCI
- 13.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Journal of Computer-Aided Molecular Design (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (5r03mh060328-02)
- National Institute of Mental Health (MH60328)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Keywords
- QSAR model validation, leave-one-out cross-validation, external validation, epipodophyllotoxin derivatives, anticancer activity, virtual screening
- MeSH terms
- Algorithms, Anticonvulsants, Models, Chemical, Software Validation, Molecular Structure, Databases, Factual, Quantitative Structure-Activity Relationship
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
