The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Principles of QSAR models validation: internal and external
Open accessAbstract
The recent REACH Policy of the European Union has led to scientists and regulators to focus their attention on establishing general validation principles for QSAR models in the context of chemical regulation (previously known as the Setubal, nowadays, the OECD principles). This paper gives a brief analysis of some principles: unambiguous algorithm, Applicability Domain (AD), and statistical validation. Some concerns related to QSAR algorithm reproducibility and an example of a fast check of the applicability domain for MLR models are presented. Common myths and misconceptions related to popular techniques for verifying internal predictivity, particularly for MLR models (for instance cross‐validation, bootstrap), are commented on and compared with commonly used statistical techniques for external validation. The differences in the two validating approaches are highlighted, and evidence is presented that only models that have been validated externally, after their internal validation, can be considered reliable and applicable for both external prediction and regulatory purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golbraikh, A., & Tropsha, A. (2002) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(01)00123-1 · Cited by 3,735
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Self-citationLinear Model Selection by Cross-validation
Shao, J. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476299 · Cited by 1,790
Eriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Self-citationGenetic algorithms as a strategy for feature selection
Leardi, R., Boggia, R., & Terrile, M. (1992) · Journal of Chemometrics · doi:10.1002/cem.1180060506 · Cited by 828
Plots, Transformations, and Regression
Weisberg, S. (1987) · Technometrics · doi:10.1080/00401706.1987.10488260 · Cited by 800
Assessing Model Fit by Cross-Validation
Hawkins, D. M., Basak, S. C., & Mills, D. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci025626i · Cited by 757
Rational selection of training and test sets for the development of validated QSAR models
Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1025386326946 · Cited by 712
Chemometric methods in molecular design
Waterbeemd, H. V. D. (1995) · Medical Entomology and Zoology · Cited by 561
Gasteiger, J., & Zupan, J. (1993) · Angewandte Chemie International Edition in English · doi:10.1002/anie.199305031 · Cited by 503
Golbraikh, A., & Tropsha, A. (2002) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1020869118689 · Cited by 500
Wehrens, R., Putter, H., & Buydens, L. M. C. (2000) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(00)00102-7 · Cited by 490
Chemometric methods in molecular design
Martin, Y. C. (1996) · Trends in Pharmacological Sciences · doi:10.1016/s0165-6147(96)90278-3 · Cited by 367
Statistical Validation of QSAR Results
Wold, S., Eriksson, L., & Clementi, S. (1995) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527615452.ch5 · Cited by 334
Quantitative structure-activity relationship methods: Perspectives on drug discovery and toxicology
Perkins, R., Fang, H., Tong, W., & Welsh, W. J. (2003) · Environmental Toxicology and Chemistry · doi:10.1897/01-171 · Cited by 286
Statistical external validation and consensus modeling: A QSPR case study for Koc prediction
Gramatica, P., Giani, E., & Papa, E. (2007) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2006.06.005 · Cited by 258
Self-citationPredicting Chemical Toxicity and Fate
(2004) · CRC Press eBooks · doi:10.1201/9780203642627 · Cited by 248
Cross-validation as the objective function for variable-selection techniques
Baumann, K. (2003) · TrAC Trends in Analytical Chemistry · doi:10.1016/s0165-9936(03)00607-1 · Cited by 248
Gramatica, P., Pilutti, P., & Papa, E. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049923u · Cited by 209
Self-citationJaworska, J. S., Comber, M., Auer, C., & Van Leeuwen, C. J. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5757 · Cited by 192
Papa, E., Villa, F., & Gramatica, P. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci050212l · Cited by 165
Self-citationAssessing the reliability of a QSAR model's predictions
He, L., & Jurs, P. C. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.03.003 · Cited by 120
A new algorithm for optimal, distance-based experimental design
Marengo, E. A., & Todeschini, R. (1992) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(92)80076-g · Cited by 109
QSAR Modeling of Bioconcentration Factor by theoretical molecular descriptors
Gramatica, P., & Papa, E. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390027 · Cited by 106
Self-citationPractical Considerations on the Use of Predictive Models for Regulatory Purposes
Tunkel, J., Mayo, K., Austin, C., Hickerson, A., & Howard, P. H. (2005) · Environmental Science & Technology · doi:10.1021/es049220t · Cited by 102
From Narcosis to Hyperspace: The History of QSAR
Kubinyi, H. (2002) · Quantitative Structure-Activity Relationships · doi:10.1002/1521-3838(200210)21:4<348::aid-qsar348>3.0.co;2-d · Cited by 94
Öberg, T. (2005) · Atmospheric Environment · doi:10.1016/j.atmosenv.2005.01.007 · Cited by 82
A QSAR for Baseline Toxicity: Validation, Domain of Application, and Prediction
Öberg, T. (2004) · Chemical Research in Toxicology · doi:10.1021/tx0498253 · Cited by 75
Validation tools for variable subset regression
Baumann, K., & Stiefl, N. (2004) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-004-4071-5 · Cited by 74
(Q)SAR S : gatekeepers against risk on chemicals?
Hulzebos, E., & Posthumus, R. (2003) · SAR and QSAR in environmental research · doi:10.1080/1062936032000101510 · Cited by 62
Generation of QSAR sets with a self-organizing map
Guha, R., Serra, J. R., & Jurs, P. C. (2004) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2004.03.003 · Cited by 58
Gramatica, P., Pilutti, P., & Papa, E. (2004) · Atmospheric Environment · doi:10.1016/j.atmosenv.2004.07.026 · Cited by 56
Self-citationQSAR Prediction of Ozone Tropospheric Degradation
Gramatica, P., Pilutti, P., & Papa, E. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390026 · Cited by 48
Self-citationAsikainen, A. H., Ruuskanen, J., & Tuppurainen, K. A. (2004) · SAR and QSAR in environmental research · doi:10.1080/1062936032000169642 · Cited by 45
Gramatica, P., Pilutti, P., & Papa, E. (2003) · Atmospheric Environment · doi:10.1016/s1352-2310(03)00293-0 · Cited by 42
Self-citation
Cited by
Best Practices for QSAR Model Development, Validation, and Exploitation
Tropsha, A. (2010) · Molecular Informatics · doi:10.1002/minf.201000061 · Cited by 2,024
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Daina, A., Michielin, O., & Zoete, V. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci500467k · Cited by 974
3D-QSAR in Drug Design - A Review
Verma, J., Khedkar, V., & Coutinho, E. (2010) · Current Topics in Medicinal Chemistry · doi:10.2174/156802610790232260 · Cited by 830
Deep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809
Metadata
- Authors
- Gramatica, P.
- Venue
- QSAR & Combinatorial Science
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 26
- Issue
- 5
- Pages
- 694-701
- ISSN
- 1611-020X (ISSN-L)
- 1611-0218
- OpenAlex
- W2054716083
- Cited by
- 2,208
- References
- 36
- FWCI
- 63.18
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.