Multilevel Data Analysis of a Crossover Designed Human Nutritional Intervention Study
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
A new method is introduced for the analysis of 'omics' data derived from crossover designed drug or nutritional intervention studies. The method aims at finding systematic variations in metabolic profiles after a drug or nutritional challenge and takes advantage of the crossover design in the data. The method, which can be considered as a multivariate extension of a paired t test, generates different multivariate submodels for the between- and the within-subject variation in the data. A major advantage of this variation splitting is that each submodel can be analyzed separately without being confounded with the other variation sources. The power of the multilevel approach is demonstrated in a human nutritional intervention study which used NMR-based metabolomics to assess the metabolic impact of grape/wine extract consumption. The variations in the urine metabolic profiles are studied between and within the human subjects using the multilevel analysis. After variation splitting, multilevel PCA is used to investigate the experimental and biological differences between the subjects, whereas a multilevel PLS-DA model is used to reveal the net treatment effect within the subjects. The observed treatment effect is validated with cross model validation and permutations. It is shown that the statistical significance of the multilevel classification model ( p << 0.0002) is a major improvement compared to a ordinary PLS-DA model ( p = 0.058) without variation splitting. Finally, rank products are used to determine which NMR signals are most important in the multilevel classification model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All models were validated using seven-fold cross-validation and permutation testing with 900 models of randomly permuted data [64].”
From Chemical Fingerprints of Emotional Body Odor (2020) · cites this paper as [64]
Citations
Cites
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Polyphenols: Food sources and bioavailability
Manach, C., Scalbert, A., Morand, C., Rémésy, C., & Jiménez, L. (2004) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/79.5.727 · Cited by 8,175
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0347-9_4 · Cited by 6,594
Dietary polyphenols and the prevention of diseases
Scalbert, A., Manach, C., Morand, C., Rémésy, C., & Jiménez, L. (2005) · Critical Reviews in Food Science and Nutrition · doi:10.1080/1040869059096 · Cited by 2,999
van den Berg, R. A., Hoefsloot, H. C., Westerhuis, J. A., Smilde, A. K., & van der Werf, M. J. (2006) · BMC Genomics · doi:10.1186/1471-2164-7-142 · Cited by 2,450
Self-citationMeta-analyses involving cross-over trials: methodological issues
Elbourne, D. R., Altman, D. G., Higgins, J. P., Curtin, F., Worthington, H. V., & Vail, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.140 · Cited by 2,305
Dieterle, F., Ross, A., Schlotterbeck, G., & Senn, H. (2006) · Analytical Chemistry · doi:10.1021/ac051632c · Cited by 1,768
Breitling, R., Armengaud, P., Amtmann, A., & Herzyk, P. (2004) · FEBS Letters · doi:10.1016/j.febslet.2004.07.055 · Cited by 1,496
Assessment of PLSDA Cross Validation
Westerhuis, J. A., Hoefsloot, H. C. J., Smit, S., Vis, D. J., Smilde, A. K., van Velzen, E. J. J., van Duijnhoven, J. P. M., & van Dorsten, F. A. (2008) · Metabolomics · doi:10.1007/s11306-007-0099-6 · Cited by 1,471
Self-citationHuman metabolic phenotype diversity and its association with diet and blood pressure
Holmes, E., Loo, R. L., Stamler, J., Bictash, M., Yap, I. K. S., Chan, Q., Ebbels, T., De Iorio, M., Brown, I. J., Veselkov, K. A., et al. (2008) · Nature · doi:10.1038/nature06882 · Cited by 1,054
Large-Scale Human Metabolomics Studies: A Strategy for Data (Pre-) Processing and Validation
Bijlsma, S., Bobeldijk, I., Verheij, E. R., Ramaker, R., Kochhar, S., Macdonald, I. A., van Ommen, B., & Smilde, A. K. (2006) · Analytical Chemistry · doi:10.1021/ac051495j · Cited by 867
Self-citationStatistical strategies for avoiding false discoveries in metabolomics and related experiments
Broadhurst, D. I., & Kell, D. B. (2007) · Metabolomics · doi:10.1007/s11306-006-0037-z · Cited by 817
Stratil, P., Klejdus, B., & Kubáň, V. (2006) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf052334j · Cited by 722
ANOVA-simultaneous component analysis (ASCA): a new tool for analyzing designed metabolomics data
Smilde, A. K., Jansen, J. J., Hoefsloot, H. C. J., Lamers, R.-J. A. N., van der Greef, J., & Timmerman, M. E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti476 · Cited by 665
Self-citationHigh resolution proton magnetic resonance spectroscopy of biological fluids
Nicholson, J. K., & Wilson, I. D. (1989) · Progress in Nuclear Magnetic Resonance Spectroscopy · doi:10.1016/0079-6565(89)80008-1 · Cited by 625
Scaling and Normalization Effects in NMR Spectroscopic Metabonomic Data Sets
Craig, A., Cloarec, O., Holmes, E., Nicholson, J. K., & Lindon, J. C. (2006) · Analytical Chemistry · doi:10.1021/ac0519312 · Cited by 494
The metabolic fate of dietary polyphenols in humans
Rechner, A. R., Kuhnle, G., Bremner, P., Hubbard, G. P., Moore, K. P., & Rice-Evans, C. A. (2002) · Free Radical Biology and Medicine · doi:10.1016/s0891-5849(02)00877-8 · Cited by 475
A top‐down systems biology view of microbiome‐mammalian metabolic interactions in a mouse model
Martin, F. J., Dumas, M., Wang, Y., Legido‐Quigley, C., Yap, I. K. S., Tang, H., Zirah, S., Murphy, G. M., Cloarec, O., Lindon, J. C., et al. (2007) · Molecular Systems Biology · doi:10.1038/msb4100153 · Cited by 474
Metabolomics in human nutrition: opportunities and challenges
Gibney, M. J., Walsh, M. C., Brennan, L., Roche, H. M., German, B. J., & van Ommen, B. (2005) · American Journal of Clinical Nutrition · doi:10.1093/ajcn.82.3.497 · Cited by 452
Susceptibility of Human Metabolic Phenotypes to Dietary Modulation
Stella, C., Beckwith-Hall, B., Cloarec, O., Holmes, E., Lindon, J. C., Powell, J., van der Ouderaa, F., Bingham, S., Cross, A. J., & Nicholson, J. K. (2006) · Journal of Proteome Research · doi:10.1021/pr060265y · Cited by 376
The challenges of modeling mammalian biocomplexity
Nicholson, J. K., Holmes, E., Lindon, J. C., & Wilson, I. D. (2004) · Nature Biotechnology · doi:10.1038/nbt1015 · Cited by 356
Nutritional Metabonomics: Applications and Perspectives
Rezzi, S., Ramadan, Z., Fay, L. B., & Kochhar, S. (2007) · Journal of Proteome Research · doi:10.1021/pr060522z · Cited by 269
Gonthier, M.-P., Donovan, J. L., Manach, C., Morand, C., Rémésy, C., Scalbert, A., Cheynier, V., Mila, I., & Lapierre, C. (2003) · The Journal of Nutrition · doi:10.1093/jn/133.2.461 · Cited by 253
Lenz, E. M., Bright, J., Wilson, I. D., Hughes, A., Morrisson, J., Lindberg, H., & Lockton, A. (2004) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/j.jpba.2004.08.002 · Cited by 249
Impact of Analytical Bias in Metabonomic Studies of Human Blood Serum and Plasma
Teahan, O., Gamble, S., Holmes, E., Waxman, J., Nicholson, J. K., Bevan, C., & Keun, H. C. (2006) · Analytical Chemistry · doi:10.1021/ac051972y · Cited by 246
ASCA: analysis of multivariate data obtained from an experimental design
Jansen, J. J., Hoefsloot, H. C. J., van der Greef, J., Timmerman, M. E., Westerhuis, J. A., & Smilde, A. K. (2005) · Journal of Chemometrics · doi:10.1002/cem.952 · Cited by 246
Self-citationUsing a combination of reference tests to assess the accuracy of a new diagnostic test
Alonzo, T. A., & Pepe, M. S. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991130)18:22<2987::aid-sim205>3.0.co;2-b · Cited by 240
Faber, N. M., & Rajkó, R. (2007) · Analytica Chimica Acta · doi:10.1016/j.aca.2007.05.030 · Cited by 227
The Art and Practice of Systems Biology in Medicine: Mapping Patterns of Relationships
van der Greef, J., Martin, S., Juhasz, P., Adourian, A., Plasterer, T., Verheij, E. R., & McBurney, R. N. (2007) · Journal of Proteome Research · doi:10.1021/pr0606530 · Cited by 201
Keun, H. C., Ebbels, T. M. D., Antti, H., Bollard, M. E., Beckonert, O., Holmes, E., Lindon, J. C., & Nicholson, J. K. (2003) · Analytica Chimica Acta · doi:10.1016/s0003-2670(03)00094-1 · Cited by 192
Reducing over-optimism in variable selection by cross-model validation
Anderssen, E., Dyrstad, K., Westad, F., & Martens, H. (2006) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2006.04.021 · Cited by 186
Assessing the statistical validity of proteomics based biomarkers
Smit, S., van Breemen, M. J., Hoefsloot, H. C. J., Smilde, A. K., Aerts, J. M. F. G., & de Koster, C. G. (2007) · Analytica Chimica Acta · doi:10.1016/j.aca.2007.04.043 · Cited by 177
Self-citationMetabonomics Approach To Determine Metabolic Differences between Green Tea and Black Tea Consumption
Van Dorsten, F. A., Daykin, C. A., Mulder, T. P. J., & Van Duynhoven, J. P. M. (2006) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf061016x · Cited by 170
Polyphenol levels in human urine after intake of six different polyphenol-rich beverages
Ito, H., Gonthier, M.-P., Manach, C., Morand, C., Mennen, L., Rémésy, C., & Scalbert, A. (2005) · British Journal of Nutrition · doi:10.1079/bjn20051522 · Cited by 165
Statistical validation of megavariate effects in ASCA
Vis, D. J., Westerhuis, J. A., Smilde, A. K., & van der Greef, J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-322 · Cited by 163
Self-citationSolanky, K. S., Bailey, N. J. C., Beckwith-Hall, B. M., Bingham, S. A., Davis, A. L., Holmes, E. C., Nicholson, J. K., & Cassidy, A. (2005) · The Journal of Nutritional Biochemistry · doi:10.1016/j.jnutbio.2004.12.005 · Cited by 148
Symbiosis of chemometrics and metabolomics: past, present, and future
van der Greef, J., & Smilde, A. K. (2005) · Journal of Chemometrics · doi:10.1002/cem.941 · Cited by 136
Self-citationThe Assessment of Plant Metabolite Profiles by NMR-Based Methodologies
Holmes, E. C., Tang, H., Wang, Y., & Seger, C. (2006) · Planta Medica · doi:10.1055/s-2006-946682 · Cited by 131
Optimization of NMR analysis of biological fluids for quantitative accuracy
Saude, E. J., Slupsky, C. M., & Sykes, B. D. (2006) · Metabolomics · doi:10.1007/s11306-006-0023-5 · Cited by 123
Daykin, C. A., Duynhoven, J. P. M. V., Groenewegen, A., Dachtler, M., Amelsvoort, J. M. M. V., & Mulder, T. P. J. (2005) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf048439o · Cited by 114
Maher, A. D., Zirah, S. F. M., Holmes, E., & Nicholson, J. K. (2007) · Analytical Chemistry · doi:10.1021/ac070212f · Cited by 112
Timmerman, M. E. (2006) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711005x67599 · Cited by 103
Multilevel component analysis of time-resolved metabolic fingerprinting data
Jansen, J. J., Hoefsloot, H. C. J., van der Greef, J., Timmerman, M. E., & Smilde, A. K. (2004) · Analytica Chimica Acta · doi:10.1016/j.aca.2004.09.074 · Cited by 102
Self-citationNegative impact of noise on the principal component analysis of NMR data
Halouska, S., & Powers, R. (2005) · Journal of Magnetic Resonance · doi:10.1016/j.jmr.2005.08.016 · Cited by 94
1H NMR-based metabonomics for the diagnosis of inborn errors of metabolism in urine
Constantinou, M. A., Papakonstantinou, E., Spraul, M., Sevastiadou, S., Costalos, C., Koupparis, M. Α., Shulpis, K., Tsantili‐Kakoulidou, A., & Mikros, E. (2005) · Analytica Chimica Acta · doi:10.1016/j.aca.2005.03.059 · Cited by 75
Chemometric Analysis of NMR Spectroscopy Data: A Review
Alam, T. M., & Alam, M. K. (2004) · Annual reports on NMR spectroscopy · doi:10.1016/s0066-4103(04)54002-4 · Cited by 54
A mixed effects model for the analysis of repeated measures cross-over studies
Putt, M. E., & Chinchilli, V. M. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991130)18:22<3037::aid-sim243>3.0.co;2-7 · Cited by 54
Detection of ovarian cancer using chemometric analysis of proteomic profiles
Whelehan, O. P., Earll, M. E., Johansson, E., Toft, M., & Eriksson, L. (2006) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2006.03.008 · Cited by 49
Influence of Wavelength-Shifted Calibration Spectra on Multivariate Calibration Models
Vogt, F., & Booksh, K. S. (2004) · Applied Spectroscopy · doi:10.1366/000370204774103471 · Cited by 15
Cross model validated feature selection based on gene clusters
Gidskehaug, L., Anderssen, E., & Alsberg, B. K. (2006) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2006.05.008 · Cited by 9
Determination of flavonols in body fluids
Hollman, P. C. H. (2001) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/s0076-6879(01)35234-5 · Cited by 7
Research works printed but not linked: 4
- Gibney M. J., 2005, Am. J. Clin. Nutr., 82, 497, 10.1093/ajcn/82.3.497 · doi:10.1093/ajcn/82.3.497 · Paper page
- Jacobs D. M., 2008, NMR Biomed.
- Kochhar S., 2006, Anal. Biochem., 352
- Psihogios N. G., 2008, NMR Biomed.
Cited by
Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studies
Szymańska, E., Saccenti, E., Smilde, A. K., & Westerhuis, J. A. (2012) · Metabolomics · doi:10.1007/s11306-011-0330-3 · Cited by 908
“Statistical significance of obtained PLS-DA models was evaluated with permutation testing.”
MethodSelf-citationGromski, P. S., Muhamadali, H., Ellis, D. I., Xu, Y., Correa, E., Turner, M. L., & Goodacre, R. (2015) · Analytica Chimica Acta · doi:10.1016/j.aca.2015.02.012 · Cited by 905
Reflections on univariate and multivariate analysis of metabolomics data
Saccenti, E., Hoefsloot, H. C. J., Smilde, A. K., Westerhuis, J. A., & Hendriks, M. M. W. B. (2014) · Metabolomics · doi:10.1007/s11306-013-0598-6 · Cited by 658
“Interesting applications include kernel PLS-DA (Rosipal and Trejo 2002), orthogonal PLS-DA (Bylesjö et al. 2006) and Multilevel PLS-DA (van Velzen et al. 2008).”
MethodSelf-citationMetabolic fate of polyphenols in the human superorganism
van Duynhoven, J., Vaughan, E. E., Jacobs, D. M., A. Kemperman, R., van Velzen, E. J. J., Gross, G., Roger, L. C., Possemiers, S., Smilde, A. K., Doré, J., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000098107 · Cited by 540
“The use of cross-over designs where volunteers serve as their own control allows for multilevel analysis schemes that increase power, but still require significant numbers of volunteers to allow for statistical significant multivariate models (36).”
BackgroundSelf-citationThe food metabolome: a window over dietary exposure
Scalbert, A., Brennan, L., Manach, C., Andres-Lacueva, C., Dragsted, L. O., Draper, J., Rappaport, S. M., van der Hooft, J. J., & Wishart, D. S. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.076133 · Cited by 519
“In complex nutritional studies it may be useful to combine ANOVA separations of factors with PLS-DA (133, 134) or use multilevel PLS-DA to reduce the influence of interindividual variation (135).”
Method
Metadata
- Authors
- van Velzen, E. J. J., Westerhuis, J. A., van Duynhoven, J. P. M., van Dorsten, F. A., Hoefsloot, H. C. J., Jacobs, D. M., Smit, S., Draijer, R., Kroner, C. I., & Smilde, A. K.
- Affiliations
- Biosystems Data Analysis, Swammerdam Institute for Life Sciences, Universiteit van Amsterdam, Nieuwe Achtergracht 166, 1018 WV Amsterdam, The Netherlands, Unilever Food and Health Research; Institute, Olivier van Noortlaan 120, 3133 AT Vlaardingen, The Netherlands
- University of Amsterdam (NL)
- Corresponding author
- Westerhuis, Johan A.
- Venue
- Journal of Proteome Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2008-08-28
- Volume
- 7
- Issue
- 10
- Pages
- 4483-4491
- ISSN
- 1535-3893 (ISSN-L)
- 1535-3907
- OpenAlex
- W2130648981
- Cited by
- 161
- References
- 51
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 7 · 2022: 10 · 2021: 8 · 2020: 8 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 10 · 2015: 12 · 2014: 8 · 2013: 17 · 2012: 18
- FWCI
- 2.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Proteome Research (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Physical Sciences › Chemistry › Analytical Chemistry › Spectroscopy and Chemometric Analyses
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multilevel analysis, crossover design, dietary intervention, metabolomics, NMR metabolomics, treatment effect estimation
- MeSH terms
- Double-Blind Method, Humans, Metabolism, Placebos, Plant Extracts, Statistics as Topic, Urine, Reproducibility of Results, Biomarkers, Cross-Over Studies, Nuclear Magnetic Resonance, Biomolecular, Vitis, Nutrition Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.