The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Critical Assessment of QSAR Models of Environmental Toxicity against Tetrahymena pyriformis: Focusing on Applicability Domain and Overfitting by Variable Selection
Open accessAbstract
The estimation of the accuracy of predictions is a critical problem in QSAR modeling. The "distance to model" can be defined as a metric that defines the similarity between the training set molecules and the test set compound for the given property in the context of a specific model. It could be expressed in many different ways, e.g., using Tanimoto coefficient, leverage, correlation in space of models, etc. In this paper we have used mixtures of Gaussian distributions as well as statistical tests to evaluate six types of distances to models with respect to their ability to discriminate compounds with small and large prediction errors. The analysis was performed for twelve QSAR models of aqueous toxicity against T. pyriformis obtained with different machine-learning methods and various types of descriptors. The distances to model based on standard deviation of predicted toxicity calculated from the ensemble of models afforded the best results. This distance also successfully discriminated molecules with low and large prediction errors for a mechanism-based model developed using log P and the Maximum Acceptor Superdelocalizability descriptors. Thus, the distance to model metric could also be used to augment mechanistic QSAR models by estimating their prediction errors. Moreover, the accuracy of prediction is mainly determined by the training set data distribution in the chemistry and activity spaces but not by QSAR approaches used to develop the models. We have shown that incorrect validation of a model may result in the wrong estimation of its performance and suggested how this problem could be circumvented. The toxicity of 3182 and 48774 molecules from the EPA High Production Volume (HPV) Challenge Program and EINECS (European chemical Substances Information System), respectively, was predicted, and the accuracy of prediction was estimated. The developed models are available online at http://www.qspr.org site.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Handbook of Molecular Descriptors
Todeschini, R., & Consonni, V. (2000) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527613106 · Cited by 4,107
Self-citationNeural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Principles of QSAR models validation: internal and external
Gramatica, P. (2007) · QSAR & Combinatorial Science · doi:10.1002/qsar.200610151 · Cited by 2,208
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Self-citationVirtual Computational Chemistry Laboratory – Design and Description
Tetko, I. V., Gasteiger, J., Todeschini, R., Mauri, A., Livingstone, D., Ertl, P., Palyulin, V. A., Radchenko, E. V., Zefirov, N. S., Makarenko, A. S., et al. (2005) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-005-8694-y · Cited by 1,500
Self-citationEriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Numerical recipes in C (2nd ed.): the art of scientific computing
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1992) · Cambridge University Press eBooks · Cited by 1,156
Cited by
QSAR Modeling: Where have you been? Where are you going to?
Cherkasov, A., Muratov, E. N., Fourches, D., Varnek, A., Baskin, I. I., Cronin, M., Dearden, J., Gramatica, P., Martin, Y. C., Todeschini, R., et al. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm4004285 · Cited by 2,164
Self-citationBest Practices for QSAR Model Development, Validation, and Exploitation
Tropsha, A. (2010) · Molecular Informatics · doi:10.1002/minf.201000061 · Cited by 2,024
Self-citationSalmina, E., Haider, N., & Tetko, I. (2015) · Molecules · doi:10.3390/molecules21010001 · Cited by 1,041
Self-citationFourches, D., Muratov, E., & Tropsha, A. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100176x · Cited by 832
Self-citationSushko, I., Novotarskyi, S., Körner, R., Pandey, A. K., Rupp, M., Teetz, W., Brandmaier, S., Abdelaziz, A., Prokopenko, V. V., Tanchuk, V. Y., et al. (2011) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-011-9440-2 · Cited by 686
Self-citationMannhold, R., Poda, G. I., Ostermann, C., & Tetko, I. V. (2009) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.21494 · Cited by 654
Self-citationBig-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
Quantitative Structure–Property Relationship Modeling of Diverse Materials Properties
Le, T., Epa, V. C., Burden, F. R., & Winkler, D. A. (2012) · Chemical Reviews · doi:10.1021/cr200066h · Cited by 565
How not to develop a quantitative structure–activity or structure–property relationship (QSAR/QSPR)
Dearden, J. C., Cronin, M. T. D., & Kaiser, K. L. E. (2009) · SAR and QSAR in Environmental Research · doi:10.1080/10629360902949567 · Cited by 468
Big data and artificial intelligence modeling for drug discovery
Zhu, H. (2020) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010919-023324 · Cited by 455
Self-citationQuantitative Nanostructure−Activity Relationship Modeling
Fourches, D., Pu, D., Tassa, C., Weissleder, R., Shaw, S. Y., Mumper, R. J., & Tropsha, A. (2010) · ACS Nano · doi:10.1021/nn1013484 · Cited by 388
Self-citationTime-Split Cross-Validation as a Method for Estimating the Goodness of Prospective Prediction.
Sheridan, R. P. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400084k · Cited by 376
Exposing the Limitations of Molecular Machine Learning with Activity Cliffs
van Tilborg, D., Alenicheva, A., & Grisoni, F. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.2c01073 · Cited by 337
Chemical predictive modelling to improve compound quality
Cumming, J. G., Davis, A. M., Muresan, S., Haeberlein, M., & Chen, H. (2013) · Nature Reviews Drug Discovery · doi:10.1038/nrd4128 · Cited by 311
Quantitative Structure−Activity Relationship Modeling of Rat Acute Toxicity by Oral Exposure
Zhu, H., Martin, T. M., Ye, L., Sedykh, A., Young, D. M., & Tropsha, A. (2009) · Chemical Research in Toxicology · doi:10.1021/tx900189p · Cited by 287
Self-citationA renaissance of neural networks in drug discovery
Baskin, I. I., Winkler, D., & Tetko, I. V. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1201262 · Cited by 235
Self-citationFourches, D., Barnes, J. C., Day, N. C., Bradley, P., Reed, J. Z., & Tropsha, A. (2010) · Chemical Research in Toxicology · doi:10.1021/tx900326k · Cited by 162
Self-citationOpen Source Bayesian Models. 1. Application to ADME/Tox and Drug Discovery Datasets
Clark, A. M., Dole, K., Coulon-Spektor, A., McNutt, A., Grass, G., Freundlich, J. S., Reynolds, R. C., & Ekins, S. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00143 · Cited by 114
Fourches, D., Pu, D., & Tropsha, A. (2011) · Combinatorial Chemistry & High Throughput Screening · doi:10.2174/138620711794728743 · Cited by 92
Self-citationToxCast EPA in Vitro to in Vivo Challenge: Insight into the Rank-I Model
Novotarskyi, S., Abdelaziz, A., Sushko, Y., Körner, R., Vogt, J., & Tetko, I. V. (2016) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.5b00481 · Cited by 34
Self-citation
Metadata
- Authors
- Tetko, I. V., Sushko, I., Pandey, A. K., Zhu, H., Tropsha, A., Papa, E., Öberg, T., Todeschini, R., Fourches, D., & Varnek, A.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2008-08-26
- Volume
- 48
- Issue
- 9
- Pages
- 1733-1746
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2089578131
- Cited by
- 416
- References
- 37
- FWCI
- 28.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
