The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Beware of q2!
Abstract
Validation is a crucial aspect of any quantitative structure-activity relationship (QSAR) modeling. This paper examines one of the most popular validation criteria, leave-one-out cross-validated R2 (LOO q2). Often, a high value of this statistical characteristic (q2 > 0.5) is considered as a proof of the high predictive ability of the model. In this paper, we show that this assumption is generally incorrect. In the case of 3D QSAR, the lack of the correlation between the high LOO q2 and the high predictive ability of a QSAR model has been established earlier [Pharm. Acta Helv. 70 (1995) 149; J. Chemomet. 10(1996)95; J. Med. Chem. 41 (1998) 2553]. In this paper, we use two-dimensional (2D) molecular descriptors and k nearest neighbors (kNN) QSAR method for the analysis of several datasets. No correlation between the values of q2 for the training set and predictive ability for the test set was found for any of the datasets. Thus, the high value of LOO q2 appears to be the necessary but not the sufficient condition for the model to have a high predictive power. We argue that this is the general property of QSAR models developed using LOO cross-validation. We emphasize that the external validation is the only way to establish a reliable QSAR model. We formulate a set of criteria for evaluation of predictive ability of QSAR models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Importantly, QSAR modeling was one of the first research fields that highlighted the importance of data curation,13 rigorous validation of developed models,14 and data reproducibility,15 that has recently become a significant concern to the scientific community.16”
From QSAR without borders (2020) · cites this paper as [14]
In the citing paper
“Similarly, rigorous model validation prior to prediction14 and the importance of rigor in modeling protocols291 have been articulated in several seminal publications in QSAR field292 and have already been adopted as regulatory requirements.84”
From QSAR without borders (2020) · cites this paper as [14]
Citations
Cites
Harary, F. (1969) · Cited by 10,739
Structural Determination of Paraffin Boiling Points
Wiener, H. (1947) · Journal of the American Chemical Society · doi:10.1021/ja01193a005 · Cited by 4,184
Cramer, R. D., Patterson, D. E., & Bunce, J. D. (1988) · Journal of the American Chemical Society · doi:10.1021/ja00226a005 · Cited by 3,931
Characterization of molecular branching
Randić, M. (1975) · Journal of the American Chemical Society · doi:10.1021/ja00856a001 · Cited by 3,664
Substituent constants for correlation analysis in chemistry and biology
Hansch, C. H., & Leo, A. J. (1979) · Medical Entomology and Zoology · Cited by 2,910
Molecular Connectivity in Chemistry and Drug Research
(1976) · Medicinal chemistry · doi:10.1016/b978-0-12-406560-4.x5001-6 · Cited by 1,628
Sachs, L. (1984) · Springer series in statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 1,016
Graph theory and molecular orbitals. XII. Acyclic polyenes
Gutman, İ., ić, B. R., Trinajstić, N., & WILCOX, C. F. J. (1975) · The Journal of Chemical Physics · doi:10.1063/1.430994 · Cited by 829
Molecular Structure Description: The Electrotopological State
Kier, L. B., & Hall, L. H. (1999) · Medical Entomology and Zoology · Cited by 467
Zheng, W., & Tropsha, A. (1999) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci980033m · Cited by 450
Self-citation
Research works printed but not linked: 6
- S. Clementi, S. Wold, How to choose the proper statistical method, in: H. van de Waterbeemd (Ed.), Chemometrics Methods in Molecular Design, VCH, Weinheim, 1995, pp. 319–338.
- S. Wold, PLS for multivariate linear modeling, in: H. van de Waterbeemd (Ed.), Chemometrics Methods in Molecular Design, VCH, Weinheim, 1995, pp. 195–218.
- L.B. Kier, L.H. Hall, Molecular Connectivity in Structure–Activity Analysis, Wiley, New York, 1986.
- D. Bonchev, Overall connectivity and molecular complexity, in: J. Devillers, A.T. Balaban (Eds.), Topological Indices and Related Descriptors, Gordon and Breach, Reading, UK, 1999, pp. 361–401.
- R.D. Clark, D.G. Sprous, J.M. Leonard, Validating models based on large dataset, in: H.-D. Höltje, W. Sippl (Eds.), Rational Approaches to Drug Design. Proceedings of the 13th European Symposium on Quantitative Structure–Activity Relationships, Prous Sci., 2001, 475–485.
- A. Golbraikh, D. Bonchev, Y.-D. Xiao, A. Tropsha, Novel chiral topological descriptors and their applications to QSAR, in: H.-D. Höltje, W. Sippl (Eds.), Rational Approaches to Drug Design. Proceedings of the 13th European Symposium on Quantitative Structure–Activity relationships, Aug. 27–Sept. 1, 2000, Duesseldorf, Germany, Prous Science, 2001, 219–223.
Cited by
Sorted by citations
Items 701–800 of 1,004
Abdullahi, S. H., Uzairu, A., Ibrahim, M. T., & Umar, A. B. (2021) · Bulletin of the National Research Centre/Bulletin of the National Research Center · doi:10.1186/s42269-021-00631-w · Cited by 43
The effect of noise on the predictive limit of QSAR models
Kolmar, S., & Grulke, C. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-021-00571-7 · Cited by 47
Lin, J., Wen, L., Zhou, Y., Wang, S., Ye, H., Su, J. H., Li, J., Shu, J., Huang, J. H., & Zhou, P. (2022) · Amino Acids · doi:10.1007/s00726-022-03219-4 · Cited by 45
coral Software: QSAR for Anticancer Agents
Benfenati, E., Toropov, A. A., Toropova, A. P., Manganaro, A., & Diaza, R. G. (2011) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2011.01117.x · Cited by 43
Borza, I., Bozó, É., BARTA‐SZALAI, G., Kiss, C., Tárkányi, G., Demeter, Á., Gáti, T., Háda, V., Kolok, S., Gere, A., et al. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm060420k · Cited by 43
Tariq, R., Abatal, M., & Bassam, A. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.133517 · Cited by 42
Khatti, J., & Grover, K. S. (2024) · Rock Mechanics and Rock Engineering · doi:10.1007/s00603-024-03849-y · Cited by 42
“The Golbraikh and Tropsha (2002) theory, which was proposed, is an accurate model in this investigation.”
How to Generate Reliable and Predictive CoMFA Models
Zhang, L., Tsai, K., Du, L., Fang, H., Li, M., & Xu, W. (2011) · Current Medicinal Chemistry · doi:10.2174/092986711794927702 · Cited by 42
Ponnan, P., Gupta, S., Chopra, M., Tandon, R., Baghel, A., Gupta, G., Prasad, A. K., Rastogi, R. C., Bose, M., & Raj, H. G. (2013) · ISRN Structural Biology · doi:10.1155/2013/373516 · Cited by 42
“97 were within the limits [17, 18].”
MethodQSAR model as a random event: A case of rat toxicity
Toropova, A. P., Toropov, A. A., Benfenati, E., Leszczyńska, D., & Leszczyński, J. (2015) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2015.01.055 · Cited by 42
Hsieh, J., Wang, X. S., Teotico, D. G., Golbraikh, A., & Tropsha, A. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-008-9199-2 · Cited by 42
Self-citationContrera, J. F. (2013) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2013.08.008 · Cited by 42
Toropov, A. A., Toropova, A. P., & Benfenati, E. (2010) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2010.05.002 · Cited by 42
Jain, T., & Jayaram, B. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21332 · Cited by 42
Amin, S. A., Adhikari, N., Gayen, S., & Jha, T. (2017) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2017.04.020 · Cited by 42
Floresta, G., Rescifina, A., Marrazzo, A., Dichiara, M., Pistarà, V., Pittalà, V., Prezzavento, O., & Amata, E. (2017) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2017.08.053 · Cited by 42
Simón-Vidal, L., García‐Calvo, O., Oteo, U., Arrasate, S., Lete, E., Sotomayor, N., & González‐Díaz, H. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00286 · Cited by 43
Prediction of the Toxicity of Binary Mixtures by QSAR Approach Using the Hypothetical Descriptors
Wang, T., Tang, L., Luan, F., & Cordeiro, M. N. D. S. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19113423 · Cited by 42
“Some statistical parameters, including R2 (the correlation coefficient between the predicted and observed activities), LOOq2 (leave-one-out correlation coefficient), RMS (root mean square error), F (Fisher’s statistics) [27], etc.”
BackgroundLučić, B., Batista, J., Bojović, V., Lovrić, M., Kržić, A. S., Bešlo, D., Nadramija, D., & Vikić‐Topić, D. (2019) · Croatica Chemica Acta · doi:10.5562/cca3551 · Cited by 42
Li, J., Sun, J., & He, Z. (2006) · Journal of Chromatography A · doi:10.1016/j.chroma.2006.11.091 · Cited by 42
Li, F., Wu, H., Li, L., Li, X., Zhao, J., & Peijnenburg, W. J. G. M. (2012) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2012.03.009 · Cited by 42
“The differences between R2 and QCUM 2 (0.095) did not exceed 0.3, indicating no over-fitting in the model (Golbraikh and Tropsha, 2002).”
BackgroundInfluentialLiu, C., Yu, S., Liu, Y., Dai, X., Wu, Y., Li, R.-J., & Tao, J. (2016) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2016.03.009 · Cited by 42
Unbiased descriptor and parameter selection confirms the potential of proteochemometric modelling
Freyhult, E., Prūsis, P., Lapins, M., Wikberg, J. E. S., Moulton, V., & Gustafsson, M. G. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-50 · Cited by 42
“Interestingly, this problem was recently addressed in the context of conventional QSAR modelling [14], and has also been discussed in earlier work, see [15,16].”
ResultExploring Chemical Reaction Space with Reaction Difference Fingerprints and Parametric t-SNE
Andronov, M. G., Fedorov, M. V., & Sosnin, S. (2021) · ACS Omega · doi:10.1021/acsomega.1c04778 · Cited by 41
“27 We performed experiments with cross-validation to evaluate the stability of the method with respect to training data.”
Halder, A. K., Ambure, P. S., Pérez‐Castillo, Y., & Cordeiro, M. N. D. S. (2022) · Journal of CO2 Utilization · doi:10.1016/j.jcou.2022.101926 · Cited by 41
Indirect estimation of the ultimate bearing capacity of shallow foundations resting on rock masses
Tajeri, S., Sadrossadat, E., & Bazaz, J. B. (2015) · International Journal of Rock Mechanics and Mining Sciences · doi:10.1016/j.ijrmms.2015.09.015 · Cited by 41
Monte Carlo QSAR models for predicting organophosphate inhibition of acetycholinesterase
Veselinović, J. B., Nikolić, G. M., Trutić, N., Živković, J. V., & Veselinović, A. M. (2015) · SAR and QSAR in environmental research · doi:10.1080/1062936x.2015.1049665 · Cited by 41
“The cross-validated q(2) determines the predictive ability of the model where the higher value of q(2) means better model prediction [33].”
BackgroundToropov, A. A., Toropova, A. P., Rasulev, B., Benfenati, E., Gini, G. C., Leszczyńska, D., & Leszczyński, J. (2012) · Journal of Computational Chemistry · doi:10.1002/jcc.23022 · Cited by 41
Predictivity and Reliability of QSAR Models: The Case of Mutagens and Carcinogens
Benigni, R., & Bossa, C. (2008) · Toxicology Mechanisms and Methods · doi:10.1080/15376510701857056 · Cited by 41
“Whereas generally the use of internal cross-validation in the QSAR literature is substantial, a few authors have reported some limitations of internal cross-validation regarding the assessment of the “goodness” of a model (Golbraikh and Tropsha 2002; Kubinyi 2005; Doweyko 2004).”
MethodSupport vector machine applied in QSAR modelling
Hu, M. Y., Zhou, Y., Liang, G., & Li, Z. (2005) · Chinese Science Bulletin · doi:10.1007/bf03183737 · Cited by 41
Leak location of pipelines based on characteristic entropy
Ni, L., Jiang, J., Pan, Y. L., & Wang, Z. (2014) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2014.04.004 · Cited by 41
Singh, K. P., Gupta, S., Basant, N., & Mohan, D. (2014) · Chemical Research in Toxicology · doi:10.1021/tx500100m · Cited by 41
Choubey, S. K., & Jeyakanthan, J. (2016) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2016.09.008 · Cited by 39
Pharmacophore modeling, 3D-QSAR, docking and ADME prediction of quinazoline based EGFR inhibitors
Verma, G., Khan, M. F., Akhtar, W., Alam, M. M., Akhter, M., Alam, O., Hasan, S. S., & Shaquiquzzaman, M. (2016) · Arabian Journal of Chemistry · doi:10.1016/j.arabjc.2016.09.019 · Cited by 41
Floresta, G., Cilibrizzi, A., Abbate, V., Spampinato, A., Zagni, C., & Rescifina, A. (2018) · Bioorganic Chemistry · doi:10.1016/j.bioorg.2018.11.045 · Cited by 40
“69) [41] values for the training and the cross-validated training sets.”
BackgroundChtita, S., Aouidate, A., Belhassan, A., Ousaa, A., Taourati, A. I., Elidrissi, B., Ghamali, M., Bouachrıne, M., & Lakhlifi, T. (2019) · New Journal of Chemistry · doi:10.1039/c9nj04909f · Cited by 41
Predicting aqueous solubility by QSPR modeling
Meftahi, N., Walker, M. L., & Smith, B. J. (2021) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2021.107901 · Cited by 40
Shen, L., Liu, G., & Tang, Y. (2007) · Acta Pharmacologica Sinica · doi:10.1111/j.1745-7254.2007.00664.x · Cited by 41
Caballero, J., Saavedra‐Torres, M., Fernández, M., & González-Nilo, F. D. (2007) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf071031h · Cited by 41
Hsieh, J.-H., Yin, S., Wang, X. S., Liu, S., Dokholyan, N. V., & Tropsha, A. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci2002507 · Cited by 41
Self-citationFernández, M., & Caballero, J. (2007) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2007.06.014 · Cited by 41
Li, F., Li, X., Liu, X., Zhang, L., You, L., Zhao, J., & Wu, H. (2011) · Environmental Toxicology and Pharmacology · doi:10.1016/j.etap.2011.09.001 · Cited by 41
Marrero‐Ponce, Y., Castillo‐Garit, J. A., & Nodarse, D. (2005) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2005.03.010 · Cited by 41
Recent Trends in Quantitative Structure‐Activity Relationships
Tropsha, A. (2003) · Burger's Medicinal Chemistry and Drug Discovery · doi:10.1002/0471266949.bmc002 · Cited by 41
Self-citationNguyen, H. T., Nguyen, K. T. Q., Le, T. C., & Zhang, G. (2021) · Molecules · doi:10.3390/molecules26041022 · Cited by 43
“The use of R2 in conjunction with RMSE or MSE to evaluate the prediction capability of a model is strongly recommended [35,36].”
MethodLi, F., Fan, T., Sun, G., Zhao, L., Zhong, R., & Peng, Y. (2022) · Green Chemistry · doi:10.1039/d2gc00986b · Cited by 40
In silico evaluation of logD7.4 and comparison with other prediction methods
Wang, J., Cao, D., Zhu, M., Yun, Y., Xiao, N., & Liang, Y. (2015) · Journal of Chemometrics · doi:10.1002/cem.2718 · Cited by 40
Manoharan, P., Vijayan, R., & Ghoshal, N. (2010) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-010-9378-9 · Cited by 40
Misra, M., Andrienko, D., Baumeier, B., Faulon, J., & von Lilienfeld, O. A. (2011) · Journal of Chemical Theory and Computation · doi:10.1021/ct200231z · Cited by 40
Evolutionary Computation and QSAR Research
Aguiar‐Pulido, V., Gestal, M., Cruz‐Monteagudo, M., Rabuñal, J. R., Dorado, J., & Munteanu, C. R. (2013) · Current Computer - Aided Drug Design · doi:10.2174/1573409911309020006 · Cited by 41
“Cross-validation (CV), using the original variables (leave-one-out CV, leave-manyout CV) is insufficient for model validation [84].”
MethodAnsari, M. Y., Equbal, A., Dikhit, M. R., Mansuri, R., Rana, S., Ali, V., Sahoo, G. C., & Das, P. K. (2015) · International Journal of Biological Macromolecules · doi:10.1016/j.ijbiomac.2015.11.051 · Cited by 40
Scotti, L., Scotti, L., Ishiki, H. M., de Peron, L. M., de Rezende, L., & do Amaral, A. T. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.03.023 · Cited by 40
QSPR estimation of the auto-ignition temperature for pure hydrocarbons
Borhani, T. N. G., Afzali, A., & Bagheri, M. (2016) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2016.07.004 · Cited by 40
Ecotoxicological modelling of cosmetics for aquatic organisms: A QSTR approach
Khan, K., & Roy, K. (2017) · SAR and QSAR in environmental research · doi:10.1080/1062936x.2017.1352621 · Cited by 40
“model randomization for P. subcapitata toxicity. criteria, including MAE-based criteria [40] and Golbraikh and Tropsha (2002) criteria [46], proving the significance of the model.”
MethodAhmadi, S., Mardinia, F., Azimi, N., Qomi, M., & Balali, E. (2018) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2018.12.089 · Cited by 40
Jain, S., Amin, S. A., Adhikari, N., Jha, T., & Gayen, S. (2019) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2019.1566093 · Cited by 40
“The statistical parameters of these two models are as follows: Split 2: Split 3: The best models from each split were also checked for Golbraikh and Tropsha (2002) validation parameters.”
MethodMendonca, M. L., & Snurr, R. Q. (2019) · Chemistry - A European Journal · doi:10.1002/chem.201900655 · Cited by 40
Kumar, A., & Kumar, P. P. (2020) · Journal of Molecular Liquids · doi:10.1016/j.molliq.2020.114055 · Cited by 40
Halder, A. K., Haghbakhsh, R., Voroshylova, I. V., Duarte, A. R. C., & Cordeiro, M. N. D. S. (2021) · Molecules · doi:10.3390/molecules26195779 · Cited by 41
“Then, two additional external validation paramet rs w re consi ered: the mea absolute error for the test set (MAEtest) and the variance explained in external predicti n (Q(2)F1) [30,31].”
MethodKokalj, A., Xie, C., Milošev, I., & Crespo, D. (2021) · Corrosion Science · doi:10.1016/j.corsci.2021.109900 · Cited by 40
Cammarota, R. C., Liu, W., Bacsa, J., Davies, H. M. L., & Sigman, M. S. (2022) · Journal of the American Chemical Society · doi:10.1021/jacs.1c12198 · Cited by 41
Kumar, P. P., Kumar, A., & Singh, D. (2022) · Environmental Toxicology and Pharmacology · doi:10.1016/j.etap.2022.103893 · Cited by 40
Daouı, O., Elkhattabi, S., & Chtita, S. (2022) · Structural Chemistry · doi:10.1007/s11224-022-02004-z · Cited by 40
Rational design of novel pyridine-based drugs candidates for lymphoma therapy
Daouı, O., Elkhattabi, S., & Chtita, S. (2022) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2022.133964 · Cited by 40
QSAR of phytochemicals for the design of better drugs
Kar, S., & Roy, K. (2012) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2012.716420 · Cited by 43
“The models can be subjected to the test for criteria of external validation as suggested by Golbraikh and Tropsha [44].”
MethodInfluentialRoncaglioni, A., & Benfenati, E. (2007) · Chemical Society Reviews · doi:10.1039/b616276m · Cited by 40
Marrero‐Ponce, Y., Siverio-Mota, D., Gálvez-Llompart, M., Recio, M. C., Giner, R. M., García‐Domenech, R., Torrens, F., Arán, V. J., Cordero-Maldonado, M. L., Esguerra, C. V., et al. (2011) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2011.07.053 · Cited by 41
Gramatica, P., Pilutti, P., & Papa, E. (2003) · Atmospheric Environment · doi:10.1016/s1352-2310(03)00293-0 · Cited by 40
QSAR Modeling of α-Campholenic Derivatives with Sandalwood Odor
Kovatcheva, A., Buchbauer, G., Golbraikh, A., & Wolschann, P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci020296n · Cited by 40
Self-citationTian, F., Tan, R., Guo, T., Zhou, P., & Li, Y. (2013) · Biosystems · doi:10.1016/j.biosystems.2013.04.004 · Cited by 39
“For example, in a highly ited work Golbraikh and Tropsha (2002) argued that the high prole of internal cross-validation appears to be the necessary but not he sufficient condition for the model to have a high predictive ower, and they further emphasized that the external validation s the only way to establish a reliab…”
BackgroundHao, M., Li, Y., Wang, Y., Yan, Y., & Zhang, S. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci2002878 · Cited by 40
Pinheiro, J. R., Bitencourt, M., da Cunha, E. F. F., Ramalho, T. C., & Freitas, M. P. (2007) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2007.11.020 · Cited by 39
Bercu, J. P., Morton, S., Deahl, J. T., Gombar, V. K., Callis, C. M., & LIER, R. B. L. V. (2010) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2010.03.010 · Cited by 39
Ertürk, M. D., Saçan, M. T., Novič, M., & Minovski, N. (2012) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2012.06.002 · Cited by 39
Rojas, C., Duchowicz, P. R., Tripaldi, P., & Diez, R. P. (2015) · Journal of Chromatography A · doi:10.1016/j.chroma.2015.10.028 · Cited by 39
Kumar, A., & Chauhan, S. (2017) · SAR and QSAR in environmental research · doi:10.1080/1062936x.2017.1293729 · Cited by 39
“15 [52]; r(2) m(test) and r m(test) should be >0.”
BackgroundMethodInfluentialSun, G., Fan, T., Sun, X., Hao, Y., Cui, X., Zhao, L., Ren, T., Zhou, Y., Zhong, R., & Peng, Y. (2018) · Molecules · doi:10.3390/molecules23112892 · Cited by 39
“For acceptable QSAR predictive models, the following conditions are satisfied [20,21]: (i) Q2Loo > 0.”
BackgroundMethodŽivković, M., Zlatanović, M., Zlatanović, N., Golubović, M., & Veselinović, A. M. (2020) · Mini-Reviews in Medicinal Chemistry · doi:10.2174/1389557520666200212111428 · Cited by 39
Yan, W., Lin, G., Zhang, R., Liang, Z. Y., Wu, L., & Wu, W. (2020) · Journal of Molecular Liquids · doi:10.1016/j.molliq.2020.112702 · Cited by 39
Mayhew, A. W., Topping, D. O., & Hamilton, J. F. (2020) · ACS Omega · doi:10.1021/acsomega.0c00732 · Cited by 39
Fallahpour, A., Wong, K. Y., Rajoo, S., & Tian, G. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.125287 · Cited by 39
Ouassaf, M., Belaıdı, S., Khamoulı, S., Belaıdı, H., & Chtita, S. (2021) · Acta chimica slovenica · doi:10.17344/acsi.2020.5985 · Cited by 40
Hadni, H., Bakhouch, M., & Elhallaoui, M. (2021) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2021.2004233 · Cited by 37
“According to Tropsha and Golbraikh (Golbraikh & Tropsha, 2002), internal validation is necessary but not sufficient.”
Synthesis, antimicrobial evaluation, ot-QSAR and mt-QSAR studies of 2-amino benzoic acid derivatives
Mahiwal, K., Kumar, P., & Narasimhan, B. (2010) · Medicinal Chemistry Research · doi:10.1007/s00044-010-9537-5 · Cited by 39
“4) is a valid one (Golbraikh and Tropsha, 2002).”
Quantitative structure–activity relationships for organophosphates binding to acetylcholinesterase
Ruark, C. D., Hack, C. E., Robinson, P. J., Anderson, P. E., & Gearhart, J. M. (2012) · Archives of Toxicology · doi:10.1007/s00204-012-0934-z · Cited by 38
“They typically take the form Yi = Fi(X1, X2,…,Xn) where Yi are biological activities of molecules represented by some function Fi of experimental or calculated structural properties or descriptors (X1, X2,…,Xn) (Golbraikh and Tropsha 2002).”
Loader, R. J., Singh, N. K., O’Malley, P. J., & Popelier, P. L. A. (2005) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/j.bmcl.2005.11.079 · Cited by 39
A DFT-based QSARs study of protoporphyrinogen oxidase inhibitors: phenyl triazolinones
Zhang, L., Wan, J., & Yang, G. (2004) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2004.08.046 · Cited by 39
CADASTER QSPR Models for Predictions of Melting and Boiling Points of Perfluorinated Chemicals
Bhhatarai, B., Teetz, W., Liu, T., Öberg, T., Jeliazkova, N., Kochev, N. T., Pukalov, O., Tetko, I. V., Kovarich, S., Papa, E., et al. (2011) · Molecular Informatics · doi:10.1002/minf.201000133 · Cited by 39
QSAR Analysis of 2-Amino or 2-Methyl-1-Substituted Benzimidazoles Against Pseudomonas aeruginosa
Podunavac-Kuzmanović, S. O., Cvetković, D., & Barna, D. J. (2009) · International Journal of Molecular Sciences · doi:10.3390/ijms10041670 · Cited by 40
“According to the reference [40], without the validation of the”
MethodResultArora, P., Narang, R., Bhatia, S., Nayak, S. K., Singh, S. K., & Narasimhan, B. (2015) · Journal of Applied Pharmaceutical Science · doi:10.7324/japs.2015.50206 · Cited by 39
Paricharak, S., Cortés-Ciriano, I., IJzerman, A. P., Malliavin, T. E., & Bender, A. (2015) · Journal of Cheminformatics · doi:10.1186/s13321-015-0063-9 · Cited by 38
“[39,40] and calculated using the Validation function of the R package camb [34].”
MethodQSPR for predicting the hydrophile-lipophile balance (HLB) of non-ionic surfactants
Wu, J., Yan, F., Jia, Q., & Wang, Q. (2020) · Colloids and Surfaces A Physicochemical and Engineering Aspects · doi:10.1016/j.colsurfa.2020.125812 · Cited by 38
Computer-Aided Drug Design towards New Psychotropic and Neurological Drugs
Dorahy, G., Chen, Z., & Balle, T. (2023) · Molecules · doi:10.3390/molecules28031324 · Cited by 44
“The q2 value is obtained by calculating R2 using leave-one-out cross validation [27].”
BackgroundMethodResultInfluentialSoft computing-based prediction models for compressive strength of concrete
Kumar, M., Biswas, R., Kumar, D. R., Samui, P., Kaloop, M. R., & Eldessouki, M. (2023) · Case Studies in Construction Materials · doi:10.1016/j.cscm.2023.e02321 · Cited by 38
Machine learning-driven QSAR models for predicting the cytotoxicity of five common microplastics
Liu, C., Zong, C., Chen, S., Chu, J., Yang, Y., Pan, Y. L., Yuan, B., & Zhang, H. (2024) · Toxicology · doi:10.1016/j.tox.2024.153918 · Cited by 41
Using measured daily meteorological parameters to predict daily solar radiation
Mousavi, S. M., Mostafavi, E. S., Jaafari, A., Jaafari, A., & Hosseinpour, F. (2015) · Measurement · doi:10.1016/j.measurement.2015.08.004 · Cited by 38
Predictivity of Simulated ADME AutoQSAR Models over Time
Rodgers, S. L., Davis, A. M., Tomkinson, N. P., & Waterbeemd, H. V. D. (2011) · Molecular Informatics · doi:10.1002/minf.201000160 · Cited by 39
QSAR studies in the discovery of novel type-II diabetic therapies
Abuhammad, A., & Taha, M. O. (2015) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2016.1118046 · Cited by 38
Chtita, S., Ghamali, M., Hmamouchi, R., Elidrissi, B., Bourass, M., Larif, M., Bouachrıne, M., & Lakhlifi, T. (2016) · Advances in Physical Chemistry · doi:10.1155/2016/5137289 · Cited by 38
“00; if ρ < 1, the network simply memorizes the data, whereas if ρ > 3, the network is not able to generalize [41].”
BackgroundPuzyn, T., Jeliazkova, N., Sarimveis, H., Robinson, R. M., Lobaskin, V., Ralló, R., Richarz, A.-N., Gajewicz, A., Papadopulos, M. G., Hastings, J., et al. (2017) · Food and Chemical Toxicology · doi:10.1016/j.fct.2017.09.037 · Cited by 41
“The resampling techniques discussed in section 2.4.1 are commonly described as internal validation techniques that cannot directly estimate the true predictive ability of a model on unseen data (Chirico and Gramatica, 2011, 2012; Golbraikh and Tropsha, 2002; Gramatica, 2007, 2013).”
BackgroundMethodInfluential
Metadata
- Authors
- Golbraikh, A., & Tropsha, A.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Tropsha, Alexander
- Venue
- Journal of Molecular Graphics and Modelling
- Publisher
- Elsevier BV
- Published
- 2002-01
- Volume
- 20
- Issue
- 4
- Pages
- 269-276
- ISSN
- 1093-3263 (ISSN-L)
- OpenAlex
- W2087661061
- Cited by
- 3,735
- References
- 39
- Citations by year
- 2026: 133 · 2025: 164 · 2024: 179 · 2023: 174 · 2022: 194 · 2021: 197 · 2020: 215 · 2019: 189 · 2018: 200 · 2017: 174 · 2016: 181 · 2015: 175 · 2014: 197 · 2013: 203 · 2012: 202
- FWCI
- 52.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Molecular Graphics and Modelling (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Keywords
- leave-one-out cross-validation, QSAR model validation, predictive power, external validation, 2D molecular descriptors, overfitting, model evaluation metrics
- MeSH terms
- Data Interpretation, Statistical, Ligands, Mathematical Computing, Models, Molecular, Receptors, Histamine H1, Steroids, Transcortin, Databases, Factual, Quantitative Structure-Activity Relationship, Ecdysteroids
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review