The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Assessing the performance of statistical validation tools for megavariate metabolomics data
Open accessAbstract
Statistical model validation tools such as cross-validation, jack-knifing model parameters and permutation tests are meant to obtain an objective assessment of the performance and stability of a statistical model. However, little is known about the performance of these tools for megavariate data sets, having, for instance, a number of variables larger than 10 times the number of subjects. The performance is assessed for megavariate metabolomics data, but the conclusions also carry over to proteomics, transcriptomics and many other research areas. Partial least squares discriminant analyses models were built for several LC-MS lipidomic training data sets of various numbers of lean and obese subjects. The training data sets were compared on their modelling performance and their predictability using a 10-fold cross-validation, a permutation test, and test data sets. A wide range of cross-validation error rates was found (from 7.5% to 16.3% for the largest trainings set and from 0% to 60% for the smallest training set) and the error rate increased when the number of subjects decreased. The test error rates varied from 5% to 50%. The smaller the number of subjects compared to the number of variables, the less the outcome of validation tools such as cross-validation, jack-knifing model parameters and permutation tests can be trusted. The result depends crucially on the specific sample of subjects that is used for modelling. The validation tools cannot be used as warning mechanism for problems due to sample size or to representativity of the sampling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Fat Oxidation before and after a High Fat Load in the Obese Insulin-Resistant State
Blaak, E. E., Hul, G., Verdich, C., Stich, V., Martinez, A., Petersen, M., Feskens, E. F. M., Patel, K., Oppert, J. M., Barbe, P., et al. (2006) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2005-1598 · Cited by 97
Cited by
Assessment of PLSDA Cross Validation
Westerhuis, J. A., Hoefsloot, H. C. J., Smit, S., Vis, D. J., Smilde, A. K., van Velzen, E. J. J., van Duijnhoven, J. P. M., & van Dorsten, F. A. (2008) · Metabolomics · doi:10.1007/s11306-007-0099-6 · Cited by 1,471
Self-citationGromski, P. S., Muhamadali, H., Ellis, D. I., Xu, Y., Correa, E., Turner, M. L., & Goodacre, R. (2015) · Analytica Chimica Acta · doi:10.1016/j.aca.2015.02.012 · Cited by 905
Reflections on univariate and multivariate analysis of metabolomics data
Saccenti, E., Hoefsloot, H. C. J., Smilde, A. K., Westerhuis, J. A., & Hendriks, M. M. W. B. (2014) · Metabolomics · doi:10.1007/s11306-013-0598-6 · Cited by 658
Self-citationScalbert, A., Brennan, L., Fiehn, O., Hankemeier, T., Kristal, B. S., van Ommen, B., Pujos-Guillot, E., Verheij, E., Wishart, D., & Wopereis, S. (2009) · Metabolomics · doi:10.1007/s11306-009-0168-0 · Cited by 565
Self-citationA guide to the identification of metabolites in NMR-based metabonomics/metabolomics experiments
Dona, A. C., Kyriakides, M., Scott, F., Shephard, E. A., Varshavi, D., Veselkov, K., & Everett, J. R. (2016) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2016.02.005 · Cited by 327
Metadata
- Authors
- Rubingh, C. M., Bijlsma, S., Derks, E. P. P. A., Bobeldijk, I., Verheij, E. R., Kochhar, S., & Smilde, A. K.
- Venue
- Metabolomics
- Published
- 2006-06
- Volume
- 2
- Issue
- 2
- Pages
- 53-61
- ISSN
- 1573-3882 (ISSN-L)
- 1573-3890
- OpenAlex
- W2166366638
- Cited by
- 158
- References
- 2
- FWCI
- 1.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the performance of statistical validation tools for megavariate metabolomics data. https://app.cochat.ai/papers/10.1007/s11306-006-0022-6
- The paper
- Rubingh, C. M., Bijlsma, S., Derks, E. P. P. A., Bobeldijk, I., Verheij, E. R., Kochhar, S., & Smilde, A. K. (2006). Assessing the performance of statistical validation tools for megavariate metabolomics data. Metabolomics. https://doi.org/10.1007/s11306-006-0022-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.