The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studies
Open accessAbstract
Partial Least Squares-Discriminant Analysis (PLS-DA) is a PLS regression method with a special binary 'dummy' y-variable and it is commonly used for classification purposes and biomarker selection in metabolomics studies. Several statistical approaches are currently in use to validate outcomes of PLS-DA analyses e.g. double cross validation procedures or permutation testing. However, there is a great inconsistency in the optimization and the assessment of performance of PLS-DA models due to many different diagnostic statistics currently employed in metabolomics data analyses. In this paper, properties of four diagnostic statistics of PLS-DA, namely the number of misclassifications (NMC), the Area Under the Receiver Operating Characteristic (AUROC), Q(2) and Discriminant Q(2) (DQ(2)) are discussed. All four diagnostic statistics are used in the optimization and the performance assessment of PLS-DA models of three different-size metabolomics data sets obtained with two different types of analytical platforms and with different levels of known differences between two groups: control and case groups. Statistical significance of obtained PLS-DA models was evaluated with permutation testing. PLS-DA models obtained with NMC and AUROC are more powerful in detecting very small differences between groups than models obtained with Q(2) and Discriminant Q(2) (DQ(2)). Reproducibility of obtained PLS-DA models outcomes, models complexity and permutation test distributions are also investigated to explain this phenomenon. DQ(2) and Q(2) (in contrary to NMC and AUROC) prefer PLS-DA models with lower complexity and require higher number of permutation tests and submodels to accurately estimate statistical significance of the model performance. NMC and AUROC seem more efficient and more reliable diagnostic statistics and should be recommended in two group discrimination metabolomic studies. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s11306-011-0330-3) contains supplementary material, which is available to authorized users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Empirical threshold values for quantitative trait mapping.
Churchill, G. A., & Doerge, R. W. (1994) · Genetics · doi:10.1093/genetics/138.3.963 · Cited by 4,935
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761 · cited 3×
“Predicted class memberships (ŷ) are also categorical variables and the NMC/AUROC statistics are directly derived from these memberships and are socalled permissible statistics (Stevens 1946).”
BackgroundMethodInfluentialPartial least squares for discrimination
Barker, M., & Rayens, W. (2003) · Journal of Chemometrics · doi:10.1002/cem.785 · Cited by 2,841
Orthogonal projections to latent structures (O‐PLS)
Trygg, J., & Wold, S. (2002) · Journal of Chemometrics · doi:10.1002/cem.695 · Cited by 2,447
MetaboAnalyst: a web server for metabolomic data analysis and interpretation
Xia, J., Psychogios, N., Young, N., & Wishart, D. S. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp356 · Cited by 2,266
Statistics Notes: Diagnostic tests 1: sensitivity and specificity
Altman, D. G., & Bland, J. M. (1994) · BMJ · doi:10.1136/bmj.308.6943.1552 · Cited by 2,061
Breitling, R., Armengaud, P., Amtmann, A., & Herzyk, P. (2004) · FEBS Letters · doi:10.1016/j.febslet.2004.07.055 · Cited by 1,496
What's In A Name? Malay Seals As Onomastic Sources
Library, T. B., & Gallop, A. T. (2018) · Malay Literature · doi:10.37052/ml.31(1)no1 · Cited by 1,483
Cited by
Advanced methods of plant disease detection. A review
Martinelli, F., Scalenghe, R., Davino, S., Panno, S., Scuderi, G., Ruisi, P., Villa, P., Stroppiana, D., Boschetti, M., Goulart, L. R., et al. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-014-0246-1 · Cited by 964
Reflections on univariate and multivariate analysis of metabolomics data
Saccenti, E., Hoefsloot, H. C. J., Smilde, A. K., Westerhuis, J. A., & Hendriks, M. M. W. B. (2014) · Metabolomics · doi:10.1007/s11306-013-0598-6 · Cited by 658
Self-citationBharath, L. P., Agrawal, M., McCambridge, G., Nicholas, D. A., Hasturk, H., Liu, J., Jiang, K., Liu, R., Guo, Z., Deeney, J., et al. (2020) · Cell Metabolism · doi:10.1016/j.cmet.2020.04.015 · Cited by 614
Al-masni, M. A., Al-antari, M. A., Park, J.-M., Gi, G., Kim, T.-Y., Rivera, P., Valarezo, E., Choi, M.-T., Han, S.-M., & Kim, T.-S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.017 · Cited by 482
Metabolic features of chronic fatigue syndrome
Naviaux, R. K., Naviaux, J. C., Li, K., Bright, A. T., Alaynick, W. A., Wang, L., Baxter, A., Nathan, N., Anderson, W., & Gordon, E. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1607571113 · Cited by 391
Metadata
- Authors
- Szymańska, E., Saccenti, E., Smilde, A. K., & Westerhuis, J. A.
- Venue
- Metabolomics
- Published
- 2011-07-08
- Volume
- 8
- Issue
- S1
- Pages
- 3-16
- ISSN
- 1573-3882 (ISSN-L)
- 1573-3890
- OpenAlex
- W1987972238
- Cited by
- 908
- References
- 34
- FWCI
- 7.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studies. https://app.cochat.ai/papers/10.1007/s11306-011-0330-3
- The paper
- Szymańska, E., Saccenti, E., Smilde, A. K., & Westerhuis, J. A. (2012). Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studies. Metabolomics. https://doi.org/10.1007/s11306-011-0330-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.