The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Evaluation of model predictive ability by external validation techniques
Abstract
This paper deals with the problem of evaluating the predictive ability of regression models. In some cases, model validation by internal cross‐validation technique is not enough and validation by an external test set has been suggested as an effective way of evaluating the model predictive ability. Different functions for calculating the predictive squared correlation coefficient Q2 from an external set were proposed, which lead to occasionally different estimates of the model predictive ability and therefore to contrasting decisions about model adequacy. In this paper, advantages and drawbacks of these functions in estimating model predictive ability from some simulated datasets are discussed by comparison. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Golbraikh, A., & Tropsha, A. (2002) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(01)00123-1 · Cited by 3,735
Computer Aided Design of Experiments
Kennard, R. W., & Stone, L. A. (1969) · Technometrics · doi:10.1080/00401706.1969.10490666 · Cited by 3,648
Better Bootstrap Confidence Intervals
Efron, B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478410 · Cited by 3,364
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Rational selection of training and test sets for the development of validated QSAR models
Golbraikh, A., Shen, M., Xiao, Z., Xiao, Y.-D., Lee, K.-H., & Tropsha, A. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1025386326946 · Cited by 712
Comments on the Definition of the Q2 Parameter for QSAR Validation
Consonni, V., Ballabio, D., & Todeschini, R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900115y · Cited by 585
Self-citationSchüürmann, G., Ebert, R.-U., Chen, J., Wang, B., & Kühne, R. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800253u · Cited by 531
OECD (2014) · OECD series on testing and assessment · doi:10.1787/9789264085442-en · Cited by 440
Cited by
QSARINS: A new software for the development, analysis, and validation of QSAR MLR models
Gramatica, P., Chirico, N., Papa, E., Cassani, S., & Kovarich, S. (2013) · Journal of Computational Chemistry · doi:10.1002/jcc.23361 · Cited by 780
Chirico, N., & Gramatica, P. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200211n · Cited by 779
Be aware of error measures. Further studies on validation of predictive QSAR models
Roy, K., Das, R. N., Ambure, P., & Aher, R. B. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.01.008 · Cited by 713
Comparison of Different Approaches to Define the Applicability Domain of QSAR Models
Sahigara, F., Mansouri, K., Ballabio, D., Mauri, A., Consonni, V., & Todeschini, R. (2012) · Molecules · doi:10.3390/molecules17054791 · Cited by 633
Self-citationOPERA models for predicting physicochemical properties and environmental fate endpoints
Mansouri, K., Grulke, C. M., Judson, R. S., & Williams, A. J. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0263-1 · Cited by 624
Chirico, N., & Gramatica, P. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300084j · Cited by 536
Roy, K., Chakraborty, P., Mitra, I., Ojha, P. K., Kar, S., & Das, R. N. (2013) · Journal of Computational Chemistry · doi:10.1002/jcc.23231 · Cited by 466
Comparative Studies on Some Metrics for External Validation of QSPR Models
Roy, K., Mitra, I., Kar, S., Ojha, P. K., Das, R. N., & Kabir, H. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci200520g · Cited by 460
Gramatica, P., & Sangion, A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00088 · Cited by 420
Predictive and mechanistic multivariate linear regression models for reaction development
Santiago, C. B., Guo, J.-Y., & Sigman, M. S. (2018) · Chemical Science · doi:10.1039/c7sc04679k · Cited by 404
The use of principal component analysis and discriminant analysis in differential sensing routines
Stewart, S., Ivy, M. A., & Anslyn, E. V. (2014) · Chem. Soc. Rev. · doi:10.1039/c3cs60183h · Cited by 369
Mitra, I., Saha, A., & Roy, K. (2010) · Molecular Simulation · doi:10.1080/08927022.2010.503326 · Cited by 295
On the Development and Validation of QSAR Models
Gramatica, P. (2013) · Methods in Molecular Biology · doi:10.1007/978-1-62703-059-5_21 · Cited by 274
Principles of QSAR Modeling: Comments and Suggestions From Personal Experience
Gramatica, P. (2020) · International Journal of Quantitative Structure-Property Relationships · doi:10.4018/ijqspr.20200701.oa1 · Cited by 258
Paricharak, S., Cortés-Ciriano, I., IJzerman, A. P., Malliavin, T. E., & Bender, A. (2015) · Journal of Cheminformatics · doi:10.1186/s13321-015-0063-9 · Cited by 38
Metadata
- Authors
- Consonni, V., Ballabio, D., & Todeschini, R.
- Venue
- Journal of Chemometrics
- Publisher
- Wiley
- Published
- 2010-02-17
- Volume
- 24
- Issue
- 3-4
- Pages
- 194-201
- ISSN
- 0886-9383 (ISSN-L)
- 1099-128X
- OpenAlex
- W2073511756
- Cited by
- 363
- References
- 15
- FWCI
- 17.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.