The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Beware of q2!
Abstract
Validation is a crucial aspect of any quantitative structure-activity relationship (QSAR) modeling. This paper examines one of the most popular validation criteria, leave-one-out cross-validated R2 (LOO q2). Often, a high value of this statistical characteristic (q2 > 0.5) is considered as a proof of the high predictive ability of the model. In this paper, we show that this assumption is generally incorrect. In the case of 3D QSAR, the lack of the correlation between the high LOO q2 and the high predictive ability of a QSAR model has been established earlier [Pharm. Acta Helv. 70 (1995) 149; J. Chemomet. 10(1996)95; J. Med. Chem. 41 (1998) 2553]. In this paper, we use two-dimensional (2D) molecular descriptors and k nearest neighbors (kNN) QSAR method for the analysis of several datasets. No correlation between the values of q2 for the training set and predictive ability for the test set was found for any of the datasets. Thus, the high value of LOO q2 appears to be the necessary but not the sufficient condition for the model to have a high predictive power. We argue that this is the general property of QSAR models developed using LOO cross-validation. We emphasize that the external validation is the only way to establish a reliable QSAR model. We formulate a set of criteria for evaluation of predictive ability of QSAR models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Importantly, QSAR modeling was one of the first research fields that highlighted the importance of data curation,13 rigorous validation of developed models,14 and data reproducibility,15 that has recently become a significant concern to the scientific community.16”
From QSAR without borders (2020) · cites this paper as [14]
In the citing paper
“Similarly, rigorous model validation prior to prediction14 and the importance of rigor in modeling protocols291 have been articulated in several seminal publications in QSAR field292 and have already been adopted as regulatory requirements.84”
From QSAR without borders (2020) · cites this paper as [14]
Citations
Cites
Harary, F. (1969) · Cited by 10,739
Structural Determination of Paraffin Boiling Points
Wiener, H. (1947) · Journal of the American Chemical Society · doi:10.1021/ja01193a005 · Cited by 4,184
Cramer, R. D., Patterson, D. E., & Bunce, J. D. (1988) · Journal of the American Chemical Society · doi:10.1021/ja00226a005 · Cited by 3,931
Characterization of molecular branching
Randić, M. (1975) · Journal of the American Chemical Society · doi:10.1021/ja00856a001 · Cited by 3,664
Substituent constants for correlation analysis in chemistry and biology
Hansch, C. H., & Leo, A. J. (1979) · Medical Entomology and Zoology · Cited by 2,910
Molecular Connectivity in Chemistry and Drug Research
(1976) · Medicinal chemistry · doi:10.1016/b978-0-12-406560-4.x5001-6 · Cited by 1,628
Sachs, L. (1984) · Springer series in statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 1,016
Graph theory and molecular orbitals. XII. Acyclic polyenes
Gutman, İ., ić, B. R., Trinajstić, N., & WILCOX, C. F. J. (1975) · The Journal of Chemical Physics · doi:10.1063/1.430994 · Cited by 829
Molecular Structure Description: The Electrotopological State
Kier, L. B., & Hall, L. H. (1999) · Medical Entomology and Zoology · Cited by 467
Zheng, W., & Tropsha, A. (1999) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci980033m · Cited by 450
Self-citation
Research works printed but not linked: 6
- S. Clementi, S. Wold, How to choose the proper statistical method, in: H. van de Waterbeemd (Ed.), Chemometrics Methods in Molecular Design, VCH, Weinheim, 1995, pp. 319–338.
- S. Wold, PLS for multivariate linear modeling, in: H. van de Waterbeemd (Ed.), Chemometrics Methods in Molecular Design, VCH, Weinheim, 1995, pp. 195–218.
- L.B. Kier, L.H. Hall, Molecular Connectivity in Structure–Activity Analysis, Wiley, New York, 1986.
- D. Bonchev, Overall connectivity and molecular complexity, in: J. Devillers, A.T. Balaban (Eds.), Topological Indices and Related Descriptors, Gordon and Breach, Reading, UK, 1999, pp. 361–401.
- R.D. Clark, D.G. Sprous, J.M. Leonard, Validating models based on large dataset, in: H.-D. Höltje, W. Sippl (Eds.), Rational Approaches to Drug Design. Proceedings of the 13th European Symposium on Quantitative Structure–Activity Relationships, Prous Sci., 2001, 475–485.
- A. Golbraikh, D. Bonchev, Y.-D. Xiao, A. Tropsha, Novel chiral topological descriptors and their applications to QSAR, in: H.-D. Höltje, W. Sippl (Eds.), Rational Approaches to Drug Design. Proceedings of the 13th European Symposium on Quantitative Structure–Activity relationships, Aug. 27–Sept. 1, 2000, Duesseldorf, Germany, Prous Science, 2001, 219–223.
Cited by
Sorted by citations
Items 201–300 of 1,004
Tuning hERG Out: Antitarget QSAR Models for Drug Development
Braga, R. C., Alves, V. M., da Silva, M. F. B., Muratov, E. N., Fourches, D., Tropsha, A., & Andrade, C. H. (2014) · Current Topics in Medicinal Chemistry · doi:10.2174/1568026614666140506124442 · Cited by 102
“Although these models appear to be well-fitted, a critical analysis reveals that the vast majority of the published QSAR models do not comply with the standard validation procedures and the different statistical criteria described in the best practices of QSAR modeling [80, 81].”
MethodSelf-citationTang, H., Wang, X. S., Huang, X., Roth, B. L., Butler, K. V., Kozikowski, A. P., Jung, M., & Tropsha, A. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci800366f · Cited by 101
Self-citationDahmen, M., & Marquardt, W. (2015) · Energy & Fuels · doi:10.1021/acs.energyfuels.5b01032 · Cited by 106
Pan, Y., Li, T., Cheng, J., Telesca, D., Zink, J. I., & Jiang, J. (2016) · RSC Advances · doi:10.1039/c6ra01298a · Cited by 101
Discovery of Novel Antimalarial Compounds Enabled by QSAR-Based Virtual Screening
Zhang, L., Fourches, D., Sedykh, A., Zhu, H., Golbraikh, A., Ekins, S., Clark, J. A., Connelly, M., Sigal, M. S., Hodges, D., et al. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300421n · Cited by 101
Self-citationComparison of MLR, PLS and GA-MLR in QSAR analysis*
Saxena, S. K., & Prathipati, P. (2003) · SAR and QSAR in environmental research · doi:10.1080/10629360310001624015 · Cited by 104
Faradonbeh, R. S., Taheri, A., Sousa, L. R. E., & Karakus, M. (2020) · International Journal of Rock Mechanics and Mining Sciences · doi:10.1016/j.ijrmms.2020.104279 · Cited by 100
Ashrafian, A., Panahi, E., Salehi, S., Καρόγλου, Μ., & Asteris, P. G. (2023) · Structures · doi:10.1016/j.istruc.2022.12.108 · Cited by 100
Alves, V. M., Muratov, E. N., Fourches, D., Strickland, J. A., Kleinstreuer, N., Andrade, C. H., & Tropsha, A. (2015) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2014.12.014 · Cited by 102
“…not comply with the statistical procedures, statistical criteria, and recommendations for external validation that constitute common best practices (Golbraikh and Tropsha, 2002; Tropsha, 2010) and thus these models are not compliant with the OECD guidance on QSAR model development and validation…”
MethodSelf-citationCombinatorial QSAR of Ambergris Fragrance Compounds
Kovatcheva, A., Golbraikh, A., Oloff, S., Xiao, Y.-D., Zheng, W., Wolschann, P., Buchbauer, G., & Tropsha, A. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034203t · Cited by 100
Self-citationDesai, P. V., Sawada, G. A., Watson, I. A., & Raub, T. J. (2013) · Molecular Pharmaceutics · doi:10.1021/mp300555n · Cited by 98
Golmohammadi, H., Dashtbozorgi, Z., & Acree, W. E. (2012) · European Journal of Pharmaceutical Sciences · doi:10.1016/j.ejps.2012.06.021 · Cited by 98
Shim, J., & MacKerell, A. D. (2011) · MedChemComm · doi:10.1039/c1md00044f · Cited by 106
Zhou, P., Wang, C., Tian, F., Ren, Y., Yang, C., & Huang, J. H. (2013) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-012-9625-3 · Cited by 97
Babanajad, S. K., Gandomi, A. H., & Alavi, A. H. (2017) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2017.03.011 · Cited by 96
The Use of Topological Indices in QSAR and QSPR Modeling
Dearden, J. C. (2017) · Challenges and advances in computational chemistry and physics · doi:10.1007/978-3-319-56850-8_2 · Cited by 96
Marrero‐Ponce, Y., Castillo‐Garit, J. A., Olazábal, E., Serrano, H. S., Morales, A., Castañedo, N., Ibarra‐Velarde, F., Huesca‐Guillén, A., Sánchez, A. M., Torrens, F., et al. (2004) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2004.11.040 · Cited by 96
Li, Q., Jørgensen, F. S., Oprea, T. I., Brunak, S., & Taboureau, O. (2008) · Molecular Pharmaceutics · doi:10.1021/mp700124e · Cited by 96
Alves, V. M., Bobrowski, T., Melo-Filho, C. C., Korn, D., Auerbach, S. S., Schmitt, C., Muratov, E. N., & Tropsha, A. (2020) · Molecular Informatics · doi:10.1002/minf.202000113 · Cited by 99
Self-citationGlobal Bayesian Models for the Prioritization of Antitubercular Agents
Prathipati, P., Ma, N. L., & Keller, T. H. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800143n · Cited by 96
Yap, C. W., Li, Z., & Chen, Y. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.10.004 · Cited by 95
Tian, F., Li, Y., Lv, F., Yang, Q., & Zhou, P. (2008) · Amino Acids · doi:10.1007/s00726-008-0116-8 · Cited by 94
“Golbraikh and Tropsha (2002) claim that cross-validation q2 has no direct relation with modeling predictabilities, and advocate the importance of the external test set.”
BackgroundGan, X., Hu, D., Li, P. S., Wu, J., Chen, X., Xue, W., & Song, B. (2015) · Pest Management Science · doi:10.1002/ps.4018 · Cited by 94
Development of prediction models for shear strength of SFRCB using a machine learning approach
Sarveghadi, M., Gandomi, A. H., Bolandi, H., & Alavi, A. H. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-1997-6 · Cited by 94
“Table 4 shows new criteria recommended by Golbraikh and Tropsha [51] and Roy and Roy [52] for model verification (on testing data).”
MethodLi, C., Wei, G., Chen, J., Zhao, Y. H., Zhang, Y., Su, L., & Qin, W. (2018) · Environmental Science & Technology · doi:10.1021/acs.est.7b05429 · Cited by 92
Pressure drop in pipe flow of cemented paste backfill: Experimental and modeling study
Qi, C., Chen, Q., Fourie, A. B., Zhao, J., & Zhang, Q. (2018) · Powder Technology · doi:10.1016/j.powtec.2018.03.070 · Cited by 94
QSPR/QSAR: State-of-Art, Weirdness, the Future
Toropov, A. A., & Toropova, A. P. (2020) · Molecules · doi:10.3390/molecules25061292 · Cited by 96
“R0 = 1− ∑ (yi−ỹ i ) 2 ∑ (yi−yi)(2) k = yi ỹi ỹ(2)i k′ = yi ỹi y(2)i [77]”
VSMP: A Novel Variable Selection and Modeling Method Based on the Prediction
Liu, S., Liu, H., Yin, C., & Wang, L. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci020377j · Cited by 94
Synthesis, antimicrobial, and QSAR studies of substituted benzamides
Kumar, A., Narasimhan, B., & Kumar, D. (2007) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2007.03.074 · Cited by 94
Zhang, S., Golbraikh, A., & Tropsha, A. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm050260x · Cited by 95
Self-citationPredicting age from cortical structure across the lifespan
Madan, C. R., & Kensinger, E. A. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13835 · Cited by 95
“…was taken to ensure that the age predictions were not biased—for instance, numerous studies have demonstrated that performance with k-fold cross-validation can lead to over-fitting in the model selection (e.g., Golbraikh & Tropsha, 2002; Rao et al., 2008; Saeb et al., 2016; Skocik et al., 2016).”
BackgroundFourches, D., Pu, D., & Tropsha, A. (2011) · Combinatorial Chemistry & High Throughput Screening · doi:10.2174/138620711794728743 · Cited by 92
Self-citationToropova, A. P., Toropov, A. A., Ralló, R., Leszczyńska, D., & Leszczyński, J. (2014) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2014.10.003 · Cited by 92
Yong, W., Zhou, J., Armaghani, D. J., Tahir, M. M., Tarinejad, R., Pham, B. T., & Huynh, V. V. (2020) · Engineering With Computers · doi:10.1007/s00366-019-00932-9 · Cited by 92
A novel QSAR model for predicting induction of apoptosis by 4-aryl-4H-chromenes
Afantitis, A., Melagraki, G., Sarimveis, H., Koutentis, P. A., Markopoulos, J., & Igglessi‐Markopoulou, O. (2006) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2006.05.061 · Cited by 92
Nonlinear modeling of shear strength of SFRC beams using linear genetic programming
Gandomi, A. H., Alavi, A. H., & Yun, G. J. (2011) · STRUCTURAL ENGINEERING AND MECHANICS · doi:10.12989/sem.2011.38.1.001 · Cited by 92
Multivariate statistical analysis methods in QSAR
Pirhadi, S., Shiri, F., & Ghasemi, J. B. (2015) · RSC Advances · doi:10.1039/c5ra10729f · Cited by 93
Comparative Molecular Field Analysis (CoMFA)
Kubinyi, H. (1998) · Encyclopedia of Computational Chemistry · doi:10.1002/0470845015.cca030 · Cited by 92
Scoring functions for protein–protein interactions
Moal, I. H., Moretti, R., Baker, D. A., & Fernández‐Recio, J. (2013) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2013.06.017 · Cited by 91
Zhu, H., Rusyn, I., Richard, A., & Tropsha, A. (2008) · Environmental Health Perspectives · doi:10.1289/ehp.10573 · Cited by 93
Self-citationLQTA-QSAR: A New 4D-QSAR Methodology
Martins, J. P. A., Barbosa, E. G., Pasqualoto, K. F. M., & Ferreira, M. M. C. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900014f · Cited by 91
Polański, J., Bąk, A., Gieleciak, R. M., & Magdziarz, T. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci050314b · Cited by 90
Xiao, Z., Xiao, Y.-D., Feng, J., Golbraikh, A., Tropsha, A., & Lee, K. (2002) · Journal of Medicinal Chemistry · doi:10.1021/jm0105427 · Cited by 90
Self-citationMarrero‐Ponce, Y. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049950k · Cited by 90
Guo, J.-Y., Minko, Y., Santiago, C. B., & Sigman, M. S. (2017) · ACS Catalysis · doi:10.1021/acscatal.7b00739 · Cited by 88
Benigni, R., & Bossa, C. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci8000088 · Cited by 89
Pontiki, E. A., & Hadjipavlou‐Litina, D. (2010) · Medicinal Research Reviews · doi:10.1002/med.20200 · Cited by 89
“5.(121) The standard deviation s is a measure of how well the function derived by the QSAR analysis predicts the observed biological activity.”
BackgroundStructural Variation Governs Substrate Specificity for Organic Anion Transporter (OAT) Homologs
Kaler, G. V., Truong, D. M., Khandelwal, A., Nagle, M. A., Eraly, S. A., Swaan, P. W., & Nigám, S. K. (2007) · Journal of Biological Chemistry · doi:10.1074/jbc.m703467200 · Cited by 89
Zhang, S., Wei, L., Bastow, K., Zheng, W., Brossi, A. R., Lee, K., & Tropsha, A. (2007) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-007-9102-6 · Cited by 90
Self-citationAalizadeh, R., von der Ohe, P. C., & Τhomaidis, Ν. S. (2017) · Environmental Science Processes & Impacts · doi:10.1039/c6em00679e · Cited by 87
Ibrahim, M. K., Eissa, I. H., Alesawy, M. S., Metwaly, A. M., Radwan, M. M., & ElSohly, M. A. (2017) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2017.07.015 · Cited by 91
Piir, G., Kahn, I., García‐Sosa, A. T., Sild, S., Ahte, P., & Maran, U. (2018) · Environmental Health Perspectives · doi:10.1289/ehp3264 · Cited by 93
“…to studies and discussions on the validation of models, their applicability, and the uncertainty of their predictions (Eriksson et al. 2003; Tropsha et al. 2003; Netzeva et al. 2005; Tetko et al. 2006; Gramatica 2007; Chirico and Gramatica 2011; Alexander et al. 2015; Golbraikh and Tropsha 2002).”
On further application of r as a metric for validation of QSAR models
Mitra, I., Roy, P. P., Kar, S., Ojha, P. K., & Roy, K. (2009) · Journal of Chemometrics · doi:10.1002/cem.1268 · Cited by 89
“Different aspects of external validation which have drawn attention of scientists are choice of the method for division of a data set into training and test sets [25–27], setting optimum size of the training set [28], selection of optimum set of variables for a model (whether based on internal or external validation)…”
BackgroundMethodResultInfluentialCassotti, M., Ballabio, D., Todeschini, R., & Consonni, V. (2015) · SAR and QSAR in environmental research · doi:10.1080/1062936x.2015.1018938 · Cited by 87
“lack of an external validation [17,22,27,37–39] or internal validation by means of leave-one-out strategy [17,19,26,37,39], a technique that was reported to give optimistic results on large datasets [70,71].”
Marrero‐Ponce, Y. (2003) · Molecules · doi:10.3390/80900687 · Cited by 87
Marrero‐Ponce, Y., Veitía, M. S., Montero, A., Romero‐Zaldivar, C., Brandt, C. A., Avila, P. E., Kirchgatter, K., & Tugores, Y. M. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci050085t · Cited by 88
Mousavi, S. M., Mostafavi, E. S., & Jiao, P. (2017) · Energy Conversion and Management · doi:10.1016/j.enconman.2017.09.040 · Cited by 87
Mercader, A. G., Duchowicz, P. R., Fernández, F. M., & Castro, E. A. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100103r · Cited by 86
QSAR prediction of additive and non-additive mixture toxicities of antibiotics and pesticide
Qin, L., Chen, Y., Zhang, X., Mo, L., Zeng, H., & Liang, Y. (2018) · Chemosphere · doi:10.1016/j.chemosphere.2018.01.142 · Cited by 86
Ai, H., Wu, X., Zhang, L., Qi, M., Zhao, Y., Zhao, Q., Zhao, J. H., & Liu, H. (2019) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2019.04.035 · Cited by 88
Li, F., Sun, G., Fan, T., Zhang, N., Zhao, L., Zhong, R., & Peng, Y. (2023) · Aquatic Toxicology · doi:10.1016/j.aquatox.2022.106393 · Cited by 86
Krishna, K. M., Inturi, B., Pujar, G. V., Purohit, M. N., & Vijaykumar, G. (2014) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2014.07.051 · Cited by 87
Model-Based Design of Tailor-Made Biofuels
Dahmen, M., & Marquardt, W. (2016) · Energy & Fuels · doi:10.1021/acs.energyfuels.5b02674 · Cited by 87
Kaneko, H., & Funatsu, K. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.01.001 · Cited by 85
Kar, S., Gajewicz, A., Puzyn, T., & Roy, K. (2014) · Toxicology in Vitro · doi:10.1016/j.tiv.2013.12.018 · Cited by 85
“, 2008) and (Golbraikh and Tropsha, 2002) criteria to check the model reliability.”
BackgroundMethod3D-QSAR, docking and ADMET properties of aurone analogues as antimalarial agents
Hadni, H., & Elhallaoui, M. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e03580 · Cited by 86
“According to Golbraikh and Tropsha study [35], The following equation introduces an additional statistic for the external validation:”
BackgroundOjo, O. A., Ojo, A. B., Okolie, C. E., Nwakama, M.-A. C., Iyobhebhe, M. E., Evbuomwan, I. O., Nwonuma, C. O., Maimako, R. F., Adegboyega, A. E., Taiwo, O. A., et al. (2021) · Molecules · doi:10.3390/molecules26071996 · Cited by 88
“Residual plots (scatter) were utilized to identify the existence of outliers from a QSAR model [57,58].”
MethodShah, M. I., Javed, M. F., Alqahtani, A., & Aldrees, A. (2021) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2021.05.026 · Cited by 85
Khan, M. A., Farooq, F., Javed, M. F., Zafar, A., Ostrowski, K. A., Aslam, F., Malazdrewicz, S., & Maślak, M. (2021) · Materials · doi:10.3390/ma15010058 · Cited by 85
“[86] recommended that for a good model the ρ can be less than 0.”
BackgroundClassifiers and their Metrics Quantified
Brown, J. B. (2018) · Molecular Informatics · doi:10.1002/minf.201700127 · Cited by 82
QSAR Studies of CYP2D6 Inhibitor Aryloxypropanolamines Using 2D and 3D Descriptors
Roy, P. P., & Roy, K. (2009) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2009.00791.x · Cited by 84
“A list of values of different parameters for different models as recommended by Golbraikh and Tropsha (59) is given in Table 4.”
BackgroundMethodInfluentialThe “double cross-validation” software tool for MLR QSAR model development
Roy, K., & Ambure, P. S. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.10.009 · Cited by 84
El‐Gamal, K. M., El-morsy, A., Saad, A. M., Eissa, I. H., & Alswah, M. (2018) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2018.04.010 · Cited by 84
Accurate Stabilities of Laccase Mutants Predicted with a Modified FoldX Protocol
Christensen, N. J., & Kepp, K. P. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300398z · Cited by 81
“A LOOCV q 2 value higher than 0.5 is often regarded as a necessary (but insu ffi cient) criterion for predictive power, 58,59 but robustness can only be ascertained by external validation.”
BackgroundInfluentialCastillo‐Garit, J. A., Marrero‐Ponce, Y., Torrens, F., & García‐Domenech, R. (2007) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.21122 · Cited by 84
Isonicotinic acid hydrazide derivatives: synthesis, antimicrobial activity, and QSAR studies
Judge, V., Narasimhan, B., Ahuja, M., Sriram, D., Yogeeswari, P., Clercq, E. D., Pannecouque, C. C., & Balzarini, J. M. (2011) · Medicinal Chemistry Research · doi:10.1007/s00044-011-9662-9 · Cited by 84
“5 is the basic requirement for qualifying a QSAR model to be valid one (Golbraikh and Tropsha, 2002).”
InfluentialMarrero‐Ponce, Y., González‐Díaz, H., Zaldívar, V. R., Torrens, F., & Castro, E. A. (2004) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2004.07.051 · Cited by 84
Shah, M. I., Javed, M. F., Aslam, F., & Alabduljabbar, H. (2021) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2021.125634 · Cited by 83
Assessing How Well a Modeling Protocol Captures a Structure−Activity Landscape
Guha, R., & Drie, J. H. V. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci8001414 · Cited by 85
Tsai, K., Chen, Y., Hsiao, N., Wang, C.-L., Lin, C., Lee, Y., Li, M., & Wang, B. (2010) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2009.12.063 · Cited by 83
Ahmed, L., Rasulev, B., Turabekova, M. A., Leszczyńska, D., & Leszczyński, J. (2013) · Organic & Biomolecular Chemistry · doi:10.1039/c3ob40878g · Cited by 83
Quasi-QSAR for mutagenic potential of multi-walled carbon-nanotubes
Toropov, A. A., & Toropova, A. P. (2014) · Chemosphere · doi:10.1016/j.chemosphere.2014.10.067 · Cited by 82
Huang, T., Sun, G., Zhao, L., Zhang, N., Zhong, R., & Peng, Y. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22168557 · Cited by 82
Assessment of bromide-based ionic liquid toxicity toward aquatic organisms and QSAR analysis
Wang, C., Wei, Z., Wang, L., Sun, P., & Wang, Z. (2015) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2015.02.012 · Cited by 82
Gombar, V. K., & Hall, S. D. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400001u · Cited by 82
Pseudoreceptor models in drug design: bridging ligand- and receptor-based virtual screening
Tanrikulu, Y., & Schneider, G. (2008) · Nature Reviews Drug Discovery · doi:10.1038/nrd2615 · Cited by 82
Jain, T., & Jayaram, B. (2005) · FEBS Letters · doi:10.1016/j.febslet.2005.10.031 · Cited by 82
“Recent studies [47,48] have shown that, in addition to leave-one-out (LOO) cross-validation (q(2)) procedure, validation of the model using an external test set of compounds is”
MethodCamacho-Mendoza, R. L., Gutiérrez, E., Percástegui, E. G., Aquino‐Torres, E., Cruz‐Borbolla, J., Rodríguez, J. A., Alvarado-Rodríguez, J. G., Olvera‐Neria, O., Thangarasu, P., & Medina‐Franco, J. L. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00385 · Cited by 82
Todeschini, R., Consonni, V., & Gramatica, P. (2009) · Elsevier eBooks · doi:10.1016/b978-044452701-1.00007-7 · Cited by 85
Constitutive modelling of cemented paste backfill: A data-mining approach
Qi, C., Chen, Q., Fourie, A. B., Tang, X., Zhang, Q., Dong, X., & Feng, Y. P. (2018) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2018.11.142 · Cited by 81
Lü, X., Zhou, W., Ding, X., Shi, X., Luan, B., & Li, M. (2019) · IEEE Access · doi:10.1109/access.2019.2918177 · Cited by 81
Ahmadi, M., Kheyroddin, A., Dalvand, A., & Kioumarsi, M. (2019) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2019.117293 · Cited by 81
Gandomi, A. H., Alavi, A. H., Kazemi, S., & Gandomi, M. (2014) · Automation in Construction · doi:10.1016/j.autcon.2014.02.007 · Cited by 80
Kooshkaki, A., & Eskandari‐Naddaf, H. (2019) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2019.03.243 · Cited by 83
Multivariate adaptive regression splines model for reinforced soil foundations
Raja, M. N. A., & Shukla, S. K. (2020) · Geosynthetics International · doi:10.1680/jgein.20.00049 · Cited by 81
fadili, M. E., Er-rajy, M., Kara, M., Assouguem, A., Belhassan, A., Alotaibi, A., Mrabti, N. N., Fidan, H., Ullah, R., Erċışlı, S., et al. (2022) · Pharmaceuticals · doi:10.3390/ph15060670 · Cited by 81
“Additionally, the Golbreikh and Tropsha criteria and the Y-randomization test were used to verify the robustness and predictive potential of the established QSAR model [31,46].”
MethodAlyami, M., Nassar, R., Khan, M., Hammad, A. W. A., Alabduljabbar, H., Nawaz, R., Fawad, M., & Gamil, Y. (2024) · Case Studies in Construction Materials · doi:10.1016/j.cscm.2024.e02901 · Cited by 80
“It is stated that the line going through the origin must have a slope (k or k ′ ) equal to 1 [162].”
Narang, R., Narasimhan, B., Sharma, S., Sriram, D., Yogeeswari, P., Clercq, E. D., Pannecouque, C. C., & Balzarini, J. M. (2011) · Medicinal Chemistry Research · doi:10.1007/s00044-011-9664-7 · Cited by 80
“One should not forget the recommendations of Golbraikh and Tropsha (2002) who have recently reported that the only way to estimate the true predictive power of a model is to test their ability to Table 9 Correlation of molecular descriptors with antimicrobial (antibacterial and antifungal)…”
BackgroundInfluentialLi, Y., Li, B., He, J., & Qian, P. (2011) · Journal of Peptide Science · doi:10.1002/psc.1345 · Cited by 80
Zhang, L., Sedykh, A., Tripathi, A., Zhu, H., Afantitis, A., Mouchlis, V. D., Melagraki, G., Rusyn, I., & Tropsha, A. (2013) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2013.04.032 · Cited by 84
“Y-randomization was applied in duplicate to all training/test dataset divisions considered in this study as detailed in (Golbraikh and Tropsha, 2002).”
InfluentialSelf-citation
Metadata
- Authors
- Golbraikh, A., & Tropsha, A.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Tropsha, Alexander
- Venue
- Journal of Molecular Graphics and Modelling
- Publisher
- Elsevier BV
- Published
- 2002-01
- Volume
- 20
- Issue
- 4
- Pages
- 269-276
- ISSN
- 1093-3263 (ISSN-L)
- OpenAlex
- W2087661061
- Cited by
- 3,735
- References
- 39
- Citations by year
- 2026: 133 · 2025: 164 · 2024: 179 · 2023: 174 · 2022: 194 · 2021: 197 · 2020: 215 · 2019: 189 · 2018: 200 · 2017: 174 · 2016: 181 · 2015: 175 · 2014: 197 · 2013: 203 · 2012: 202
- FWCI
- 52.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Molecular Graphics and Modelling (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Keywords
- leave-one-out cross-validation, QSAR model validation, predictive power, external validation, 2D molecular descriptors, overfitting, model evaluation metrics
- MeSH terms
- Data Interpretation, Statistical, Ligands, Mathematical Computing, Models, Molecular, Receptors, Histamine H1, Steroids, Transcortin, Databases, Factual, Quantitative Structure-Activity Relationship, Ecdysteroids
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review