The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Does Rational Selection of Training and Test Sets Improve the Outcome of QSAR Modeling?
Abstract
Prior to using a quantitative structure activity relationship (QSAR) model for external predictions, its predictive power should be established and validated. In the absence of a true external data set, the best way to validate the predictive ability of a model is to perform its statistical external validation. In statistical external validation, the overall data set is divided into training and test sets. Commonly, this splitting is performed using random division. Rational splitting methods can divide data sets into training and test sets in an intelligent fashion. The purpose of this study was to determine whether rational division methods lead to more predictive models compared to random division. A special data splitting procedure was used to facilitate the comparison between random and rational division methods. For each toxicity end point, the overall data set was divided into a modeling set (80% of the overall set) and an external evaluation set (20% of the overall set) using random division. The modeling set was then subdivided into a training set (80% of the modeling set) and a test set (20% of the modeling set) using rational division methods and by using random division. The Kennard-Stone, minimal test set dissimilarity, and sphere exclusion algorithms were used as the rational division methods. The hierarchical clustering, random forest, and k-nearest neighbor (kNN) methods were used to develop QSAR models based on the training sets. For kNN QSAR, multiple training and test sets were generated, and multiple QSAR models were built. The results of this study indicate that models based on rational division methods generate better statistical results for the test sets than models based on random division, but the predictive power of both types of models are comparable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Introduction to Linear Regression Analysis.
Assuncao, R., Sampson, P. D., Montgomery, D. C., & Peck, E. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290746 · Cited by 5,388
Computer Aided Design of Experiments
Kennard, R. W., & Stone, L. A. (1969) · Technometrics · doi:10.1080/00401706.1969.10490666 · Cited by 3,648
Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling
Svetnik, V., Liaw, A., Tong, C., Culberson, J. C., Sheridan, R. P., & Feuston, B. P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034160g · Cited by 3,573
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Fedorov, V. V., Studden, W. J., & Klimko, E. M. (1972) · Cited by 2,092
Cluster analysis for researchers
(1987) · Environmental Software · doi:10.1016/0266-9838(87)90010-4 · Cited by 1,850
Arnot, J. A., & Gobas, F. A. (2006) · Environmental Reviews · doi:10.1139/a06-005 · Cited by 1,418
Introduction to Linear Regression Analysis.
Cass, J. M., Montgomery, D. C., & Peck, E. A. (1983) · Applied Statistics · doi:10.2307/2348054 · Cited by 1,396
Eriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Cluster Analysis for Researchers
Milligan, G. W., & Romesburg, H. C. (1985) · Journal of Marketing Research · doi:10.2307/3151374 · Cited by 1,009
Sachs, L. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 973
Introductory Statistics with R
(2002) · Statistics and Computing · doi:10.1007/b97671 · Cited by 730
Rational selection of training and test sets for the development of validated QSAR models
Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1025386326946 · Cited by 712
Self-citationIntroductory Statistics with R
Dalgaard, P. (2008) · Statistics and Computing · doi:10.1007/978-0-387-79054-1 · Cited by 645
Gasteiger, J., & Zupan, J. (1993) · Angewandte Chemie International Edition in English · doi:10.1002/anie.199305031 · Cited by 503
Golbraikh, A., & Tropsha, A. (2002) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1020869118689 · Cited by 500
Self-citationDesign and Optimization in Organic Synthesis
(1992) · Data Handling in Science and Technology · doi:10.1016/s0922-3487(08)x7011-x · Cited by 403
Chemometric methods in molecular design
Martin, Y. C. (1996) · Trends in Pharmacological Sciences · doi:10.1016/s0165-6147(96)90278-3 · Cited by 367
Quantitative Structure−Activity Relationship Modeling of Rat Acute Toxicity by Oral Exposure
Zhu, H., Martin, T. M., Ye, L., Sedykh, A., Young, D. M., & Tropsha, A. (2009) · Chemical Research in Toxicology · doi:10.1021/tx900189p · Cited by 287
Self-citationCombinatorial QSAR Modeling of Chemical Toxicants Tested against Tetrahymena pyriformis
Zhu, H., Tropsha, A., Fourches, D., Varnek, A., Papa, E., Gramatica, P., Öberg, T., Dao, P., Cherkasov, A., & Tetko, I. V. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci700443v · Cited by 287
Self-citationArtificial neural networks in classification of NIR spectral data: Design of the training set
Wu, W., Walczak, B., Massart, D. L., et al. (1996) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(95)00077-1 · Cited by 227
Applied Statistics: A Handbook of Techniques
Cotton, J. W., Sachs, L., & Reynarowych, Z. (1984) · The American Journal of Psychology · doi:10.2307/1422171 · Cited by 213
Gramatica, P., Pilutti, P., & Papa, E. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049923u · Cited by 209
Comparison of algorithms for dissimilarity-based compound selection
Snarey, M., Terrett, N. K., Willett, P., & Wilton, D. J. (1997) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(98)00008-4 · Cited by 205
Are the Chemical Structures in Your QSAR Correct?
Young, D., Martin, T., Venkatapathy, R., & Harten, P. (2008) · QSAR & Combinatorial Science · doi:10.1002/qsar.200810084 · Cited by 196
Self-citationApplication of Random Forest Approach to QSAR Prediction of Aquatic Toxicity
Polishchuk, P. G., Muratov, E. N., Artemenko, A. G., Kolumbin, O. G., Muratov, N. N., & Kuz’min, V. E. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900203n · Cited by 182
Self-citationMartin, T. M., & Young, D. M. (2001) · Chemical Research in Toxicology · doi:10.1021/tx0155045 · Cited by 174
Self-citationHierarchical QSAR technology based on the Simplex representation of molecular structure
Kuz’min, V. Е., Artemenko, A. G., & Muratov, E. N. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-008-9179-6 · Cited by 158
Self-citationA Hierarchical Clustering Methodology for the Estimation of Toxicity
Martin, T. M., Harten, P. F., Venkatapathy, R., Das, S. G., & Young, D. M. (2008) · Toxicology Mechanisms and Methods · doi:10.1080/15376510701857353 · Cited by 121
Self-citationAssessing the reliability of a QSAR model's predictions
He, L., & Jurs, P. C. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.03.003 · Cited by 120
Base-line model for identifying the bioaccumulation potential of chemicals
Dimitrov, S. D., Dimitrova, N. H., Parkerton, T. F., Comber, M. H. I., Bonnell, M. A., & Mekenyan, O. G. (2005) · SAR and QSAR in environmental research · doi:10.1080/10659360500474623 · Cited by 118
A new hybrid system of QSAR models for predicting bioconcentration factors (BCF)
Zhao, C., Boriani, E., Chana, A., Roncaglioni, A., & Benfenati, E. (2008) · Chemosphere · doi:10.1016/j.chemosphere.2008.09.033 · Cited by 116
A new algorithm for optimal, distance-based experimental design
Marengo, E. A., & Todeschini, R. (1992) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(92)80076-g · Cited by 109
D-optimal onion designs in statistical molecular design
Olsson, I.-M., Gottfries, J., & Wold, S. (2004) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2004.04.001 · Cited by 85
Kuz’min, V. Е., Artemenko, A. G., Muratov, E. N., VOLINECKAYA, I., Makarov, V., Riabova, O., Wutzler, P., & Schmidtke, M. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm0704806 · Cited by 73
Self-citationGasteiger, J., & Zupan, J. (1993) · Angewandte Chemie · doi:10.1002/ange.19931050405 · Cited by 68
Kaiser, K. L. E., & Niculescu, Ş. P. (1999) · Chemosphere · doi:10.1016/s0045-6535(99)00553-6 · Cited by 47
Artemenko, A. G., Muratov, E. N., Kuz’min, V. Е., Kovdienko, N. A., Hromov, A. I., Makarov, V., Riabova, O., Wutzler, P., & Schmidtke, M. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkm172 · Cited by 42
Self-citationGramatica, P., Pilutti, P., & Papa, E. (2003) · Atmospheric Environment · doi:10.1016/s1352-2310(03)00293-0 · Cited by 40
Kuz’min, V. Е., Artemenko, A. G., Lozitsky, V. P., Muratov, E. N., Федчук, А. С., Dyachenko, N. S., Nosach, L. N., Гридина, Т. Л., Шитикова, Л. И., Мудрик, Л. М., et al. (2002) · Acta Biochimica Polonica · doi:10.18388/abp.2002_3832 · Cited by 36
Self-citation
Cited by
QSAR Modeling: Where have you been? Where are you going to?
Cherkasov, A., Muratov, E. N., Fourches, D., Varnek, A., Baskin, I. I., Cronin, M., Dearden, J., Gramatica, P., Martin, Y. C., Todeschini, R., et al. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm4004285 · Cited by 2,164
Self-citationBig-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
Time-Split Cross-Validation as a Method for Estimating the Goodness of Prospective Prediction.
Sheridan, R. P. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400084k · Cited by 376
Pred‐hERG: A Novel web‐Accessible Computational Tool for Predicting Cardiac Toxicity
Braga, R. C., Alves, V. M., Silva, M. F. B., Muratov, E., Fourches, D., Lião, L. M., Tropsha, A., & Andrade, C. H. (2015) · Molecular Informatics · doi:10.1002/minf.201500040 · Cited by 256
Self-citation
Metadata
- Authors
- Martin, T. M., Harten, P., Young, D. M., Muratov, E. N., Golbraikh, A., Zhu, H., & Tropsha, A.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2012-10-03
- Volume
- 52
- Issue
- 10
- Pages
- 2570-2578
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W1996851544
- Cited by
- 321
- References
- 41
- FWCI
- 17.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
