The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Critical Assessment of QSAR Models of Environmental Toxicity against Tetrahymena pyriformis: Focusing on Applicability Domain and Overfitting by Variable Selection
Open accessAbstract
The estimation of the accuracy of predictions is a critical problem in QSAR modeling. The "distance to model" can be defined as a metric that defines the similarity between the training set molecules and the test set compound for the given property in the context of a specific model. It could be expressed in many different ways, e.g., using Tanimoto coefficient, leverage, correlation in space of models, etc. In this paper we have used mixtures of Gaussian distributions as well as statistical tests to evaluate six types of distances to models with respect to their ability to discriminate compounds with small and large prediction errors. The analysis was performed for twelve QSAR models of aqueous toxicity against T. pyriformis obtained with different machine-learning methods and various types of descriptors. The distances to model based on standard deviation of predicted toxicity calculated from the ensemble of models afforded the best results. This distance also successfully discriminated molecules with low and large prediction errors for a mechanism-based model developed using log P and the Maximum Acceptor Superdelocalizability descriptors. Thus, the distance to model metric could also be used to augment mechanistic QSAR models by estimating their prediction errors. Moreover, the accuracy of prediction is mainly determined by the training set data distribution in the chemistry and activity spaces but not by QSAR approaches used to develop the models. We have shown that incorrect validation of a model may result in the wrong estimation of its performance and suggested how this problem could be circumvented. The toxicity of 3182 and 48774 molecules from the EPA High Production Volume (HPV) Challenge Program and EINECS (European chemical Substances Information System), respectively, was predicted, and the accuracy of prediction was estimated. The developed models are available online at http://www.qspr.org site.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Handbook of Molecular Descriptors
Todeschini, R., & Consonni, V. (2000) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527613106 · Cited by 4,107
Self-citationNeural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Principles of QSAR models validation: internal and external
Gramatica, P. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200610151 · Cited by 2,208
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Self-citationVirtual Computational Chemistry Laboratory – Design and Description
Tetko, I. V., Gasteiger, J., Todeschini, R., Mauri, A., Livingstone, D., Ertl, P., Palyulin, V. A., Radchenko, E. V., Zefirov, N. S., Makarenko, A. S., et al. (2005) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-005-8694-y · Cited by 1,500
Self-citationEriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Numerical recipes in C (2nd ed.): the art of scientific computing
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1992) · Cambridge University Press eBooks · Cited by 1,156
Netzeva, T. I., Worth, A. P., Aldenberg, T., Benigni, R., Cronin, M. T. D., Gramatica, P., Jaworska, J. S., Kahn, S., Klopman, G., Marchant, C. A., et al. (2005) · Alternatives to Laboratory Animals · doi:10.1177/026119290503300209 · Cited by 836
Rational selection of training and test sets for the development of validated QSAR models
Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1025386326946 · Cited by 712
Self-citationMannhold, R., Poda, G. I., Ostermann, C., & Tetko, I. V. (2009) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.21494 · Cited by 654
Self-citationComparison of Automatic Three-Dimensional Model Builders Using 639 X-ray Structures
Sadowski, J., Gasteiger, J., & Klebe, G. (1994) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00020a039 · Cited by 646
Neural network studies. 1. Comparison of overfitting and overtraining
Tetko, I. V., Livingstone, D. J., & Luik, A. I. (1995) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00027a006 · Cited by 574
Self-citationNeighborhood Behavior: A Useful Concept for Validation of “Molecular Diversity” Descriptors
Patterson, D. E., Cramer, R. D., Ferguson, A. M., Clark, R. D., & Weinberger, L. E. (1996) · Journal of Medicinal Chemistry · doi:10.1021/jm960290n · Cited by 509
Tetko, I. V., Tanchuk, V. Y., & Villa, A. E. P. (2001) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci010368v · Cited by 381
Self-citationValidation and verification of regression in small data sets
Martens, H. A., & Dardenne, P. (1998) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(98)00167-1 · Cited by 348
Similarity to Molecules in the Training Set Is a Good Discriminator for Prediction Accuracy in QSAR
Sheridan, R. P., Feuston, B. P., Maiorov, V. N., & Kearsley, S. K. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049782w · Cited by 298
Combinatorial QSAR Modeling of Chemical Toxicants Tested against Tetrahymena pyriformis
Zhu, H., Tropsha, A., Fourches, D., Varnek, A., Papa, E., Gramatica, P., Öberg, T., Dao, P., Cherkasov, A., & Tetko, I. V. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci700443v · Cited by 287
Self-citationCan we estimate the accuracy of ADME–Tox predictions?
Tetko, I. V., Bruneau, P., Mewes, H.-W., Rohrer, D. C., & Poda, G. I. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.06.013 · Cited by 243
Self-citationISIDA - Platform for Virtual Screening Based on Fragment and Pharmacophoric Descriptors
Varnek, A., Fourches, D., Horvath, D., Klimchuk, O., Gaudin, C., Vayer, P., Solov'ev, V., Hoonakker, F., Tetko, I., & Marcou, G. (2008) · Current Computer Aided-Drug Design · doi:10.2174/157340908785747465 · Cited by 213
Self-citationVarnek, A., Fourches, D., Hoonakker, F., & Solov’ev, V. P. (2005) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-005-9008-0 · Cited by 208
Self-citationShen, M., Xiao, Y., Golbraikh, A., Gombar, V. K., & Tropsha, A. (2003) · Journal of Medicinal Chemistry · doi:10.1021/jm020491t · Cited by 183
Self-citationBalakin, K., Savchuk, N., & Tetko, I. (2006) · Current Medicinal Chemistry · doi:10.2174/092986706775197917 · Cited by 183
Self-citationNeural Network Studies. 4. Introduction to Associative Neural Networks
Tetko, I. V. (2002) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci010379o · Cited by 151
Self-citationPontolillo, J., & Eganhouse, R. P. (2001) · doi:10.3133/wri014201 · Cited by 117
Cronin, M., & Schultz, T. W. (2001) · Chemical Research in Toxicology · doi:10.1021/tx0155202 · Cited by 99
Wegner, J. K., & Zell, A. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034006u · Cited by 91
QM/NN QSPR Models with Error Estimation: Vapor Pressure and LogP
Beck, B., Breindl, A., & Clark, T. (2000) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci990131n · Cited by 87
Applications of neural networks in structure-activity relationships of a small number of molecules
Tetko, I. V., Luik, A. I., & Poda, G. I. (1993) · Journal of Medicinal Chemistry · doi:10.1021/jm00059a003 · Cited by 86
Self-citationComputational toxicology: risk assessment for pharmaceutical and environmental chemicals
(2008) · Choice Reviews Online · doi:10.5860/choice.45-4386 · Cited by 85
Tetko, I. V. (2002) · Neural Processing Letters · doi:10.1023/a:1019903710291 · Cited by 83
Self-citationAccurate Solubility Prediction with Error Bars for Electrolytes: A Machine Learning Approach
Schwaighofer, A., Schroeter, T. S., Mika, S., Laub, J., ter Laak, A., Sülzle, D., Ganzer, U., Heinrich, N., & Müller, K. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci600205g · Cited by 80
Tetko, I. V., Solov’ev, V. P., Antonov, A. V., Yao, X., Doucet, J. P., Fan, B., Hoonakker, F., Fourches, D., Jost, P., Lachiche, N., et al. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci0504216 · Cited by 71
Self-citationGlobal modeling of narcotic chemicals: ciliate and fish toxicity
Dimitrov, S. D., Mekenyan, O. G., Sinks, G. D., et al. (2003) · Journal of Molecular Structure THEOCHEM · doi:10.1016/s0166-1280(02)00618-8 · Cited by 56
A Quantum Mechanical/Neural Net Model for Boiling Points with Error Estimation
Chalk, A. J., Beck, B., & Clark, T. (2001) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0004614 · Cited by 42
Cited by
QSAR Modeling: Where have you been? Where are you going to?
Cherkasov, A., Muratov, E. N., Fourches, D., Varnek, A., Baskin, I. I., Cronin, M., Dearden, J., Gramatica, P., Martin, Y. C., Todeschini, R., et al. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm4004285 · Cited by 2,164
Self-citationBest Practices for QSAR Model Development, Validation, and Exploitation
Tropsha, A. (2010) · Molecular Informatics · doi:10.1002/minf.201000061 · Cited by 2,024
Self-citationSalmina, E., Haider, N., & Tetko, I. (2015) · Molecules · doi:10.3390/molecules21010001 · Cited by 1,041
Self-citationFourches, D., Muratov, E., & Tropsha, A. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100176x · Cited by 832
Self-citationSushko, I., Novotarskyi, S., Körner, R., Pandey, A. K., Rupp, M., Teetz, W., Brandmaier, S., Abdelaziz, A., Prokopenko, V. V., Tanchuk, V. Y., et al. (2011) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-011-9440-2 · Cited by 686
Self-citation
Metadata
- Authors
- Tetko, I. V., Sushko, I., Pandey, A. K., Zhu, H., Tropsha, A., Papa, E., Öberg, T., Todeschini, R., Fourches, D., & Varnek, A.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2008-08-26
- Volume
- 48
- Issue
- 9
- Pages
- 1733-1746
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2089578131
- Cited by
- 416
- References
- 37
- FWCI
- 28.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
