The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
On Two Novel Parameters for Validation of Predictive QSAR Models
Open accessAbstract
Validation is a crucial aspect of quantitative structure–activity relationship (QSAR) modeling. The present paper shows that traditionally used validation parameters (leave-one-out Q2 for internal validation and predictive R2 for external validation) may be supplemented with two novel parameters rm2 and Rp2 for a stricter test of validation. The parameter rm2(overall) penalizes a model for large differences between observed and predicted values of the compounds of the whole set (considering both training and test sets) while the parameter Rp2 penalizes model R2 for large differences between determination coefficient of nonrandom model and square of mean correlation coefficient of random models in case of a randomization test. Two other variants of rm2 parameter, rm2(LOO) and rm2(test), penalize a model more strictly than Q2 and R2pred respectively. Three different data sets of moderate to large size have been used to develop multiple models in order to indicate the suitability of the novel parameters in QSAR studies. The results show that in many cases the developed models could satisfy the requirements of conventional parameters (Q2 and R2pred) but fail to achieve the required values for the novel parameters rm2 and Rp2. Moreover, these parameters also help in identifying the best models from among a set of comparable models. Thus, a test for these two parameters is suggested to be a more stringent requirement than the traditional validation parameters to decide acceptability of a predictive QSAR model, especially when a regulatory decision is involved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golbraikh, A., & Tropsha, A. (2002) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(01)00123-1 · Cited by 3,735 · cited 1×
“Only recently, validation of QSAR models has received considerable attention [7-19].”
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Principles of QSAR models validation: internal and external
Gramatica, P. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200610151 · Cited by 2,208
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Eriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Rogers, D., & Hopfinger, A. J. (1994) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00020a020 · Cited by 982
On Some Aspects of Variable Selection for Partial Least Squares Regression Models
Roy, P. P., & Roy, K. (2008) · QSAR & Combinatorial Science · doi:10.1002/qsar.200710043 · Cited by 793
Self-citationAssessing Model Fit by Cross-Validation
Hawkins, D. M., Basak, S. C., & Mills, D. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci025626i · Cited by 757
Chemometric methods in molecular design
Waterbeemd, H. V. D. (1995) · Medical Entomology and Zoology · Cited by 561
Schüürmann, G., Ebert, R.-U., Chen, J., Wang, B., & Kühne, R. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800253u · Cited by 531
Tetko, I. V., Sushko, I., Pandey, A. K., Zhu, H., Tropsha, A., Papa, E., Öberg, T., Todeschini, R., Fourches, D., & Varnek, A. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800151m · Cited by 416
Chemometric Methods in Molecular Design
(1995) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527615452 · Cited by 330
Exploring the impact of size of training sets for the development of predictive QSAR models
Roy, P. P., Leonard, J. T., & Roy, K. (2008) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2007.07.004 · Cited by 306
Self-citationOn some aspects of validation of predictive quantitative structure–activity relationship models
Roy, K. (2007) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2.12.1567 · Cited by 303
Self-citationQuantitative structure-activity relationship methods: Perspectives on drug discovery and toxicology
Perkins, R., Fang, H., Tong, W., & Welsh, W. J. (2003) · Environmental Toxicology and Chemistry · doi:10.1897/01-171 · Cited by 286
On Selection of Training and Test Sets for the Development of Predictive QSAR models
Leonard, J. T., & Roy, K. (2006) · QSAR & Combinatorial Science · doi:10.1002/qsar.200510161 · Cited by 257
Self-citationKubinyi, H., Hamprecht, F. A., & Mietzner, T. (1998) · Journal of Medicinal Chemistry · doi:10.1021/jm970732a · Cited by 240
Artificial neural networks in classification of NIR spectral data: Design of the training set
Wu, W., Walczak, B., Massart, D. L., et al. (1996) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(95)00077-1 · Cited by 227
Inference from Clustering with Application to Gene-Expression Microarrays
Dougherty, E. R., Barrera, J., Brun, M., Kim, S., Cesar, R. M., Chen, Y., Bittner, M., & Trent, J. M. (2002) · Journal of Computational Biology · doi:10.1089/10665270252833217 · Cited by 158
Aptula, A. O., Jeliazkova, N., Schultz, T. W., & Cronin, M. (2005) · QSAR & Combinatorial Science · doi:10.1002/qsar.200430909 · Cited by 129
Assessing the reliability of a QSAR model's predictions
He, L., & Jurs, P. C. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.03.003 · Cited by 120
Tong, W., Xie, Q., Hong, H., Shi, L. M., Fang, H., & Perkins, R. (2004) · Environmental Health Perspectives · doi:10.1289/txg.7125 · Cited by 118
Yang, G., & Huang, X. (2006) · Current Pharmaceutical Design · doi:10.2174/138161206779010431 · Cited by 104
Benigni, R., & Bossa, C. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci8000088 · Cited by 92
Dorn, C. P., Finke, P. E., Oates, B. D., Budhu, R. J., Mills, S. G., MacCoss, M., Malkowitz, L., Springer, M. S., Daugherty, B. L., Gould, S. L., et al. (2001) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/s0960-894x(00)00637-5 · Cited by 90
Finke, P. E., Oates, B. D., Mills, S. G., MacCoss, M., Malkowitz, L., Springer, M. S., Gould, S. L., DeMartino, J. A., Carella, A. V., Carver, G., et al. (2001) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/s0960-894x(01)00492-9 · Cited by 88
Single and domain mode variable selection in 3D QSAR applications
Norinder, U. (1996) · Journal of Chemometrics · Cited by 77
Robust Cross-Validation of Linear Regression QSAR Models
Konovalov, D. A., Llewellyn, L. E., Heyden, Y. V., & Coomans, D. H. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800209k · Cited by 76
Zvinavashe, E., Murk, A. J., & Rietjens, I. M. C. M. (2008) · Chemical Research in Toxicology · doi:10.1021/tx800252e · Cited by 76
Finke, P. E., Meurer, L. C., Oates, B. D., Mills, S. G., MacCoss, M., Malkowitz, L., Springer, M. S., Daugherty, B. L., Gould, S. L., DeMartino, J. A., et al. (2001) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/s0960-894x(00)00639-9 · Cited by 67
The Impact of variable selection on the modelling of oestrogenicity
Ghafourian, T., & Cronin, M. (2005) · SAR and QSAR in environmental research · doi:10.1080/10629360412331319808 · Cited by 57
Selection of data sets for qsars: Analyses of tetrahymena toxicity from aromatic compounds
Schultz, T. W., Netzeva, T. I., & Cronin, M. (2003) · SAR and QSAR in environmental research · doi:10.1080/1062936021000058782 · Cited by 54
Roy, K., & Paul, S. (2009) · QSAR & Combinatorial Science · doi:10.1002/qsar.200810130 · Cited by 51
Self-citationUse of comparative molecular field analysis and cluster analysis in series design
Novellino, E., Fattorusso, C., & Greco, G. (1995) · Pharmaceutica Acta Helvetiae · doi:10.1016/0031-6865(95)00014-z · Cited by 43
Finke, P. E., Meurer, L. C., Oates, B. D., Shah, S. K., Loebach, J. L., Mills, S. G., MacCoss, M., Castonguay, L., Malkowitz, L., Springer, M. S., et al. (2001) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/s0960-894x(01)00491-7 · Cited by 41
The quality of QSAR models: problems and solutions
Kolossov, E., & Stanforth, R. (2007) · SAR and QSAR in environmental research · doi:10.1080/10629360601053984 · Cited by 37
On some aspects of validation of predictive QSAR models
Roy, K., Roy, P., & Leonard, J. (2008) · Chemistry Central Journal · doi:10.1186/1752-153x-2-s1-p9 · Cited by 27
Self-citation
Cited by
DeepDTA: deep drug–target binding affinity prediction
Öztürk, H., Özgür, A., & Ozkirimli, E. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty593 · Cited by 1,696
Chirico, N., & Gramatica, P. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200211n · Cited by 779
Bouarab-Chibane, L., Forquet, V., Lantéri, P., Clément, Y., Léonard-Akkari, L., Oulahal, N., Degraeve, P., & Bordes, C. (2019) · Frontiers in Microbiology · doi:10.3389/fmicb.2019.00829 · Cited by 744
Further exploring r metrics for validation of QSPR models
Ojha, P. K., Mitra, I., Das, R. N., & Roy, K. (2011) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2011.03.011 · Cited by 554
Self-citationRoy, K., Chakraborty, P., Mitra, I., Ojha, P. K., Kar, S., & Das, R. N. (2013) · Journal of Computational Chemistry · doi:10.1002/jcc.23231 · Cited by 466
Self-citation
Metadata
- Authors
- Pratim Roy, P., Paul, S., Mitra, I., & Roy, K.
- Venue
- Molecules
- Publisher
- MDPI AG
- Published
- 2009-04-29
- Volume
- 14
- Issue
- 5
- Pages
- 1660-1701
- ISSN
- 1420-3049 (ISSN-L)
- OpenAlex
- W2023782921
- Cited by
- 563
- References
- 37
- FWCI
- 29.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.