The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Applicability Domains for Classification Problems: Benchmarking of Distance to Models for Ames Mutagenicity Set
Open accessAbstract
The estimation of accuracy and applicability of QSAR and QSPR models for biological and physicochemical properties represents a critical problem. The developed parameter of "distance to model" (DM) is defined as a metric of similarity between the training and test set compounds that have been subjected to QSAR/QSPR modeling. In our previous work, we demonstrated the utility and optimal performance of DM metrics that have been based on the standard deviation within an ensemble of QSAR models. The current study applies such analysis to 30 QSAR models for the Ames mutagenicity data set that were previously reported within the 2009 QSAR challenge. We demonstrate that the DMs based on an ensemble (consensus) model provide systematically better performance than other DMs. The presented approach identifies 30-60% of compounds having an accuracy of prediction similar to the interlaboratory accuracy of the Ames test, which is estimated to be 90%. Thus, the in silico predictions can be used to halve the cost of experimental measurements by providing a similar prediction accuracy. The developed model has been made publicly available at http://ochem.eu/models/1 .
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Introduction to Linear Regression Analysis.
Assuncao, R., Sampson, P. D., Montgomery, D. C., & Peck, E. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290746 · Cited by 5,388
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
Partial least squares for discrimination
Barker, M., & Rayens, W. (2003) · Journal of Chemometrics · doi:10.1002/cem.785 · Cited by 2,841
Tropsha, A., Gramatica, P., & Gombar, V. K. (2003) · QSAR & Combinatorial Science · doi:10.1002/qsar.200390007 · Cited by 2,188
Self-citationMolecular Descriptors for Chemoinformatics
Todeschini, R., & Consonni, V. (2009) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527628766 · Cited by 1,746
Self-citationAn Improved Bacterial Test System for the Detection and Classification of Mutagens and Carcinogens
Ames, B. N., Lee, F. D., & Durston, W. E. (1973) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.70.3.782 · Cited by 1,532
Working Set Selection Using Second Order Information for Training Support Vector Machines
Fan, R.-E., Chen, P.-H., & Lin, C. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1194907 · Cited by 1,403
Eriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Self-citationNetzeva, T. I., Worth, A. P., Aldenberg, T., Benigni, R., Cronin, M. T. D., Gramatica, P., Jaworska, J. S., Kahn, S., Klopman, G., Marchant, C. A., et al. (2005) · Alternatives to Laboratory Animals · doi:10.1177/026119290503300209 · Cited by 836
Self-citationMartens, H., & Martens, M. (2000) · Food Quality and Preference · doi:10.1016/s0950-3293(99)00039-7 · Cited by 722
Mannhold, R., Poda, G. I., Ostermann, C., & Tetko, I. V. (2009) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.21494 · Cited by 654
Self-citationDRAGON SOFTWARE: AN EASY APPROACH TO MOLECULAR DESCRIPTOR CALCULATIONS
Mauri, A., Consonni, V., Pavan, M., Todeschini, R., & Chemometrics, M. (2006) · BOA (University of Milano-Bicocca) · Cited by 501
Self-citationNovelty Detection and Neural Network Validation
Bishop, C. M. (1993) · ICANN ’93 · doi:10.1007/978-1-4471-2063-6_225 · Cited by 436
Tetko, I. V., Sushko, I., Pandey, A. K., Zhu, H., Tropsha, A., Papa, E., Öberg, T., Todeschini, R., Fourches, D., & Varnek, A. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800151m · Cited by 416
Self-citationTetko, I. V., Tanchuk, V. Y., & Villa, A. E. P. (2001) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci010368v · Cited by 381
Self-citationBenchmark Data Set for in Silico Prediction of Ames Mutagenicity
Hansen, K., Mika, S., Schroeter, T., Sutter, A., ter Laak, A., Steger-Hartmann, T., Heinrich, N., & Müller, K.-R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900161g · Cited by 370
Self-citationMontgomery, D. C., Peck, E. A., & Vining, G. G. (2007) · Wiley-Interscience eBooks · Cited by 366
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Similarity to Molecules in the Training Set Is a Good Discriminator for Prediction Accuracy in QSAR
Sheridan, R. P., Feuston, B. P., Maiorov, V. N., & Kearsley, S. K. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049782w · Cited by 298
Ertl, P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0255782 · Cited by 292
Roche, O., Schneider, P., Zuegge, J., Guba, W., Kansy, M., Alanine, A., Bleicher, K., Danel, F., Gutknecht, E.-M., Rogers-Evans, M., et al. (2002) · Journal of Medicinal Chemistry · doi:10.1021/jm010934d · Cited by 248
Can we estimate the accuracy of ADME–Tox predictions?
Tetko, I. V., Bruneau, P., Mewes, H.-W., Rohrer, D. C., & Poda, G. I. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.06.013 · Cited by 243
Self-citationISIDA - Platform for Virtual Screening Based on Fragment and Pharmacophoric Descriptors
Varnek, A., Fourches, D., Horvath, D., Klimchuk, O., Gaudin, C., Vayer, P., Solov'ev, V., Hoonakker, F., Tetko, I., & Marcou, G. (2008) · Current Computer Aided-Drug Design · doi:10.2174/157340908785747465 · Cited by 213
Self-citationApplication of Random Forest Approach to QSAR Prediction of Aquatic Toxicity
Polishchuk, P. G., Muratov, E. N., Artemenko, A. G., Kolumbin, O. G., Muratov, N. N., & Kuz’min, V. E. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900203n · Cited by 182
Self-citationPredicting the Predictability: A Unified Approach to the Applicability Domain Problem of QSAR Models
Dragos, H., Gilles, M., & Alexandre, V. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci9000579 · Cited by 179
Hierarchical QSAR technology based on the Simplex representation of molecular structure
Kuz’min, V. Е., Artemenko, A. G., & Muratov, E. N. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-008-9179-6 · Cited by 158
Self-citationNeural Network Studies. 4. Introduction to Associative Neural Networks
Tetko, I. V. (2002) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci010379o · Cited by 151
Self-citationA Hierarchical Clustering Methodology for the Estimation of Toxicity
Martin, T. M., Harten, P. F., Venkatapathy, R., Das, S. G., & Young, D. M. (2008) · Toxicology Mechanisms and Methods · doi:10.1080/15376510701857353 · Cited by 121
Self-citationApplicability domain for in silico models to achieve accuracy of experimental measurements
Sushko, I., Novotarskyi, S., Körner, R., Pandey, A. K., Kovalishyn, V., Prokopenko, V. V., & Tetko, I. V. (2010) · Journal of Chemometrics · doi:10.1002/cem.1296 · Cited by 98
Self-citationFrom outliers to prototypes: Ordering data
Stefan Harmeling, B., Dornhege, G., Tax, D. M. J., Meinecke, F. C., & Müller, K. (2005) · Neurocomputing · doi:10.1016/j.neucom.2005.05.015 · Cited by 96
Self-citationMeasuring Intra-Assay Agreement for the Ames Salmonella Assay
Piegorsch, W. W., & Zeiger, E. (1991) · Lecture notes in medical informatics · doi:10.1007/978-3-642-48736-1_5 · Cited by 94
Contrera, J. F., Matthews, E. J., & Benz, R. D. (2003) · Regulatory Toxicology and Pharmacology · doi:10.1016/s0273-2300(03)00071-0 · Cited by 93
Kuz’min, V. Е., Artemenko, A. G., Muratov, E. N., VOLINECKAYA, I., Makarov, V., Riabova, O., Wutzler, P., & Schmidtke, M. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm0704806 · Cited by 73
Self-citationTetko, I. V. (2008) · Methods in molecular biology · doi:10.1007/978-1-60327-101-1_10 · Cited by 68
Self-citationA Consensus Neural Network-Based Technique for Discriminating Soluble and Poorly Soluble Compounds
Manallack, D. T., Tehan, B. G., Gancia, E., Hudson, B. D., Ford, M. G., Livingstone, D. J., Whitley, D. C., & Pitt, W. R. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0202741 · Cited by 62
Estimation of the applicability domain of kernel-based machine learning models for virtual screening
Fechner, N., Jahn, A., Hinselmann, G., & Zell, A. (2010) · Journal of Cheminformatics · doi:10.1186/1758-2946-2-2 · Cited by 54
Neural Network Uncertainty Assessment Using Bayesian Statistics: A Remote Sensing Application
Aires, F., Prigent, C., & Rossow, W. B. (2004) · Neural Computation · doi:10.1162/0899766041941925 · Cited by 50
Karakoç, E., Şahinalp, S. C., & Cherkasov, A. R. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci0601517 · Cited by 45
Self-citationCherkasov, A. R., Ban, F., Li, Y. Y., Fallahi, M., & Hammond, G. L. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm060961+ · Cited by 43
Self-citationHemmateenejad, B., & Yazdani, M. (2008) · Analytica Chimica Acta · doi:10.1016/j.aca.2008.11.062 · Cited by 42
Tetko, I. V., Poda, G. I., Ostermann, C., & Mannhold, R. (2009) · Chemistry & Biodiversity · doi:10.1002/cbdv.200900075 · Cited by 41
Self-citationA Probabilistic Approach to Classifying Metabolic Stability
Schwaighofer, A., Schroeter, T. S., Mika, S., Hansen, K., ter Laak, A., Lienau, P., Reichel, A., Heinrich, N., & Müller, K. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci700142c · Cited by 39
Self-citationHorvath, D., Bonachéra, F., Solov’ev, V. P., Gaudin, C., & Varnek, A. A. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci600476r · Cited by 37
Self-citationArtemenko, N. V., Baskin, I. I., Palyulin, V. A., & Zefirov, N. S. (2001) · Doklady Chemistry · doi:10.1023/a:1012976623974 · Cited by 35
Self-citationAccurate In Silico log P Predictions: One Can't Embrace the Unembraceable
Tetko, I. V., Poda, G. I., Ostermann, C., et al. (2009) · QSAR & Combinatorial Science · doi:10.1002/qsar.200960003 · Cited by 32
Self-citationComputer‐assisted analysis of interlaboratory Ames test variability
Benigni, R., & Giuliani, A. (1988) · Journal of Toxicology and Environmental Health · doi:10.1080/15287398809531194 · Cited by 31
Can ‘Bacterial-Metabolite-Likeness' Model Improve Odds of ‘in Silico' Antibiotic Discovery?
Cherkasov, A. R. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci050480j · Cited by 23
Self-citation
Cited by
Salmina, E., Haider, N., & Tetko, I. (2015) · Molecules · doi:10.3390/molecules21010001 · Cited by 1,041
Self-citationDeep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723
Time-Split Cross-Validation as a Method for Estimating the Goodness of Prospective Prediction.
Sheridan, R. P. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400084k · Cited by 376
Interpretation of Quantitative Structure-Activity Relationship Models: Past, Present, and Future
Polishchuk, P. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00274 · Cited by 236
Self-citationToxCast EPA in Vitro to in Vivo Challenge: Insight into the Rank-I Model
Novotarskyi, S., Abdelaziz, A., Sushko, Y., Körner, R., Vogt, J., & Tetko, I. V. (2016) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.5b00481 · Cited by 34
Self-citation
Metadata
- Authors
- Sushko, I., Novotarskyi, S., Körner, R., Pandey, A. K., Cherkasov, A., Li, J., Gramatica, P., Hansen, K., Schroeter, T., Müller, K.-R., Xi, L., Liu, H., Yao, X., Öberg, T., Hormozdiari, F., Dao, P., Sahinalp, C., Todeschini, R., Polishchuk, P., Artemenko, A., Kuz’min, V., Martin, T. M., Young, D. M., Fourches, D., Muratov, E., Tropsha, A., Baskin, I., Horvath, D., Marcou, G., Muller, C., Varnek, A., Prokopenko, V. V., & Tetko, I. V.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2010-10-29
- Volume
- 50
- Issue
- 12
- Pages
- 2094-2111
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2042278642
- Cited by
- 258
- References
- 59
- FWCI
- 12.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.