Multilevel Data Analysis of a Crossover Designed Human Nutritional Intervention Study
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
A new method is introduced for the analysis of 'omics' data derived from crossover designed drug or nutritional intervention studies. The method aims at finding systematic variations in metabolic profiles after a drug or nutritional challenge and takes advantage of the crossover design in the data. The method, which can be considered as a multivariate extension of a paired t test, generates different multivariate submodels for the between- and the within-subject variation in the data. A major advantage of this variation splitting is that each submodel can be analyzed separately without being confounded with the other variation sources. The power of the multilevel approach is demonstrated in a human nutritional intervention study which used NMR-based metabolomics to assess the metabolic impact of grape/wine extract consumption. The variations in the urine metabolic profiles are studied between and within the human subjects using the multilevel analysis. After variation splitting, multilevel PCA is used to investigate the experimental and biological differences between the subjects, whereas a multilevel PLS-DA model is used to reveal the net treatment effect within the subjects. The observed treatment effect is validated with cross model validation and permutations. It is shown that the statistical significance of the multilevel classification model ( p << 0.0002) is a major improvement compared to a ordinary PLS-DA model ( p = 0.058) without variation splitting. Finally, rank products are used to determine which NMR signals are most important in the multilevel classification model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All models were validated using seven-fold cross-validation and permutation testing with 900 models of randomly permuted data [64].”
From Chemical Fingerprints of Emotional Body Odor (2020) · cites this paper as [64]
Citations
Cites
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Polyphenols: Food sources and bioavailability
Manach, C., Scalbert, A., Morand, C., Rémésy, C., & Jiménez, L. (2004) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/79.5.727 · Cited by 8,175
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0347-9_4 · Cited by 6,594
Dietary polyphenols and the prevention of diseases
Scalbert, A., Manach, C., Morand, C., Rémésy, C., & Jiménez, L. (2005) · Critical Reviews in Food Science and Nutrition · doi:10.1080/1040869059096 · Cited by 2,999
van den Berg, R. A., Hoefsloot, H. C., Westerhuis, J. A., Smilde, A. K., & van der Werf, M. J. (2006) · BMC Genomics · doi:10.1186/1471-2164-7-142 · Cited by 2,450
Self-citationMeta-analyses involving cross-over trials: methodological issues
Elbourne, D. R., Altman, D. G., Higgins, J. P., Curtin, F., Worthington, H. V., & Vail, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.140 · Cited by 2,305
Dieterle, F., Ross, A., Schlotterbeck, G., & Senn, H. (2006) · Analytical Chemistry · doi:10.1021/ac051632c · Cited by 1,768
Breitling, R., Armengaud, P., Amtmann, A., & Herzyk, P. (2004) · FEBS Letters · doi:10.1016/j.febslet.2004.07.055 · Cited by 1,496
Assessment of PLSDA Cross Validation
Westerhuis, J. A., Hoefsloot, H. C. J., Smit, S., Vis, D. J., Smilde, A. K., van Velzen, E. J. J., van Duijnhoven, J. P. M., & van Dorsten, F. A. (2008) · Metabolomics · doi:10.1007/s11306-007-0099-6 · Cited by 1,471
Self-citation
Research works printed but not linked: 4
- Gibney M. J., 2005, Am. J. Clin. Nutr., 82, 497, 10.1093/ajcn/82.3.497 · doi:10.1093/ajcn/82.3.497 · Paper page
- Jacobs D. M., 2008, NMR Biomed.
- Kochhar S., 2006, Anal. Biochem., 352
- Psihogios N. G., 2008, NMR Biomed.
Cited by
Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studies
Szymańska, E., Saccenti, E., Smilde, A. K., & Westerhuis, J. A. (2012) · Metabolomics · doi:10.1007/s11306-011-0330-3 · Cited by 908
“Statistical significance of obtained PLS-DA models was evaluated with permutation testing.”
MethodSelf-citationGromski, P. S., Muhamadali, H., Ellis, D. I., Xu, Y., Correa, E., Turner, M. L., & Goodacre, R. (2015) · Analytica Chimica Acta · doi:10.1016/j.aca.2015.02.012 · Cited by 905
Reflections on univariate and multivariate analysis of metabolomics data
Saccenti, E., Hoefsloot, H. C. J., Smilde, A. K., Westerhuis, J. A., & Hendriks, M. M. W. B. (2014) · Metabolomics · doi:10.1007/s11306-013-0598-6 · Cited by 658
“Interesting applications include kernel PLS-DA (Rosipal and Trejo 2002), orthogonal PLS-DA (Bylesjö et al. 2006) and Multilevel PLS-DA (van Velzen et al. 2008).”
MethodSelf-citationMetabolic fate of polyphenols in the human superorganism
van Duynhoven, J., Vaughan, E. E., Jacobs, D. M., A. Kemperman, R., van Velzen, E. J. J., Gross, G., Roger, L. C., Possemiers, S., Smilde, A. K., Doré, J., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000098107 · Cited by 540
“The use of cross-over designs where volunteers serve as their own control allows for multilevel analysis schemes that increase power, but still require significant numbers of volunteers to allow for statistical significant multivariate models (36).”
BackgroundSelf-citationThe food metabolome: a window over dietary exposure
Scalbert, A., Brennan, L., Manach, C., Andres-Lacueva, C., Dragsted, L. O., Draper, J., Rappaport, S. M., van der Hooft, J. J., & Wishart, D. S. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.076133 · Cited by 519
“In complex nutritional studies it may be useful to combine ANOVA separations of factors with PLS-DA (133, 134) or use multilevel PLS-DA to reduce the influence of interindividual variation (135).”
MethodMultivariate paired data analysis: multilevel PLSDA versus OPLSDA
Westerhuis, J. A., van Velzen, E. J. J., Hoefsloot, H. C. J., & Smilde, A. K. (2010) · Metabolomics · doi:10.1007/s11306-009-0185-z · Cited by 417
Self-citationA survey of modulation of gut microbiota by dietary polyphenols
Dueñas, M., Muñoz-González, I., Cueva, C., Jiménez-Girón, A., Sánchez-Patán, F., Santos-Buelga, C., Moreno-Arribas, M. V., & Bartolomé, B. (2015) · BioMed Research International · doi:10.1155/2015/850902 · Cited by 396
Kuehnbaum, N. L., & Britz-McKibbin, P. (2013) · Chemical Reviews · doi:10.1021/cr300484s · Cited by 354
Nutrimetabolomics: An Integrative Action for Metabolomic Analyses in Human Nutritional Studies
Ulaszewska, M. M., Weinert, C. H., Trimigno, A., Portmann, R., Andres Lacueva, C., Badertscher, R., Brennan, L., Brunius, C., Bub, A., Capozzi, F., et al. (2019) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201800384 · Cited by 239
(2020) · Progress in Molecular Biology and Translational Science · doi:10.1016/bs.pmbts.2020.04.003 · Cited by 212
Variable selection and validation in multivariate modelling
Shi, L., Westerhuis, J. A., Rosén, J., Landberg, R., & Brunius, C. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty710 · Cited by 205
“…situations, e.g. in clinical and nutritional cross-over or time-series studies, multilevel data analysis could deal with dependent data structures (Velzen et al., 2008; Westerhuis et al., 2010) and helps to better dissect the treatment effects within subject separately from the biological…”
InfluentialSelf-citationThe metabolic fate of red wine and grape juice polyphenols in humans assessed by metabolomics
van Dorsten, F. A., Grün, C. H., van Velzen, E. J. J., Jacobs, D. M., Draijer, R., & van Duynhoven, J. P. M. (2010) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.200900212 · Cited by 165
Self-citationFonville, J. M., Richards, S. E., Barton, R. H., Boulangé, C. L., Ebbels, T. M. D., Nicholson, J. K., Holmes, E. C., & Dumas, M. (2010) · Journal of Chemometrics · doi:10.1002/cem.1359 · Cited by 180
“human nutritional intervention study [96], where data sets are typically affected by large amount of study-unrelated variation, and therefore profit from a multilevel design and supervised data”
BackgroundPezzatti, J., Boccard, J., Codesido, S., Gagnebin, Y., Joshi, A., Picard, D., González‐Ruiz, V., & Rudaz, S. L. (2020) · Analytica Chimica Acta · doi:10.1016/j.aca.2019.12.062 · Cited by 172
Neal, C. M., Hunter, A. M., Brennan, L., O'Sullivan, A., Hamilton, D. L., DeVito, G., & Galloway, S. D. R. (2013) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00652.2012 · Cited by 136
“Of course, it could be argued that the metabolites of interest may reflect dietary influences (caffeine intake, phytochemical intake, protein intake), as has been reported in previous metabolomics and nutrition studies (54, 56) and highlighted in a review by Gibney et al.”
MethodResultSaccenti, E., & Timmerman, M. E. (2016) · Journal of Proteome Research · doi:10.1021/acs.jproteome.5b01029 · Cited by 126
Lipidomic data analysis: Tutorial, practical guidelines and applications
Checa, A., Bedia, C., & Jaumot, J. (2015) · Analytica Chimica Acta · doi:10.1016/j.aca.2015.02.068 · Cited by 141
Dynamic metabolomic data analysis: a tutorial review
Smilde, A. K., Westerhuis, J. A., Hoefsloot, H. C. J., Bijlsma, S., Rubingh, C. M., Vis, D. J., Jellema, R. H., Pijl, H., Roelfsema, F., & van der Greef, J. (2009) · Metabolomics · doi:10.1007/s11306-009-0191-1 · Cited by 136
“This is especially important in nutritional studies because the effect sizes are usually small (van Velzen et al. 2008).”
BackgroundSelf-citationMultivariate Analysis of Multiple Datasets: a Practical Guide for Chemical Ecology
Hervé, M. R., Nicolè, F., & Cao, K. L. (2018) · Journal of Chemical Ecology · doi:10.1007/s10886-018-0932-6 · Cited by 142
“This approach has been named ‘multilevel analysis’ and can be performed with the methods presented in this article (e.g. Liquet et al. 2012; van Velzen et al. 2008; Westerhuis et al. 2010).”
MethodLiquet, B., Cao, K. L., Hocini, H., & Thiébaut, R. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-325 · Cited by 140
Recent chemometrics advances for foodomics
Bevilacqua, M., Bro, R., Marini, F., Rinnan, Å., Rasmussen, M. A., & Skov, T. (2017) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2017.08.011 · Cited by 129
Prognostic value of metabolic response in breast cancer patients receiving neoadjuvant chemotherapy
Cao, M. D., Giskeødegård, G. F., Bathen, T. F., Sitter, B., Bofin, A. M., Lønning, P. E., Lundgren, S., & Gribbestad, I. S. (2012) · BMC Cancer · doi:10.1186/1471-2407-12-39 · Cited by 106
“Multilevel PLS-DA [24,25] is an extension of ordinary PLS-DA which can be used as a paired analysis for multivariate data.”
MethodImpact of Short-Term Intake of Red Wine and Grape Polyphenol Extract on the Human Metabolome
Jacobs, D. M., Fuhrmann, J. C., van Dorsten, F. A., Rein, D., Peters, S., van Velzen, E. J. J., Hollebrands, B., Draijer, R., van Duynhoven, J., & Garczarek, U. (2012) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf2044247 · Cited by 103
Self-citationDueñas, M., Cueva, C., Muñoz-González, I., Jiménez-Girón, A., Sánchez-Patán, F., Santos-Buelga, C., Moreno-Arribas, M., & Bartolomé, B. (2015) · Antioxidants · doi:10.3390/antiox4010001 · Cited by 102
“The use of crossover designs, where volunteers serve as their own control, permit multilevel analysis schemes that increase power, but as with other human intervention studies, they require a relevant number of volunteers to allow for statistically significant multivariate models [72].”
BackgroundA primer to nutritional metabolomics by NMR spectroscopy and chemometrics
Savorani, F., Rasmussen, M. A., Mikkelsen, M. S., & Engelsen, S. B. (2012) · Food Research International · doi:10.1016/j.foodres.2012.12.025 · Cited by 114
Phenotyping Tea Consumers by Nutrikinetic Analysis of Polyphenolic End-Metabolites
van Velzen, E. J. J., Westerhuis, J. A., van Duynhoven, J. P. M., van Dorsten, F. A., Grün, C. H., Jacobs, D. M., Duchateau, G. S. M. J. E., Vis, D. J., & Smilde, A. K. (2009) · Journal of Proteome Research · doi:10.1021/pr801071p · Cited by 96
Self-citationLaw, K. P., Han, T.-L., Mao, X., & Zhang, H. (2017) · Clinica Chimica Acta · doi:10.1016/j.cca.2017.02.018 · Cited by 91
Nutrimetabolomic Strategies To Develop New Biomarkers of Intake and Health Effects
Llorach, R., Garcia-Aloy, M., Tulipani, S., Vazquez-Fresno, R., & Andres-Lacueva, C. (2012) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf301142b · Cited by 89
Jonsson, P., Wuolikainen, A., Thysell, E., Chorell, E., Stattin, P. E., Wikström, P., & Antti, H. (2015) · Metabolomics · doi:10.1007/s11306-015-0818-3 · Cited by 92
Lee, R., West, D., Phillips, S. M., & Britz-McKibbin, P. (2010) · Analytical Chemistry · doi:10.1021/ac9029746 · Cited by 81
Masoodi, M., Pearl, D. S., Eiden, M., Shute, J. K., Brown, J. F., Calder, P. C., & Trebble, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076532 · Cited by 87
Multivariate analysis of NMR‐based metabolomic data
Debik, J., Sangermani, M., Wang, F., Madssen, T. S., & Giskeødegård, G. F. (2021) · NMR in Biomedicine · doi:10.1002/nbm.4638 · Cited by 84
“In this example, the treatment effect was a small fraction of the total variation and only multilevel PLS was able to find a statistical significant treatment effect.(59)”
BackgroundStatistical data processing in clinical proteomics
Smit, S., Hoefsloot, H. C. J., & Smilde, A. K. (2007) · Journal of Chromatography B · doi:10.1016/j.jchromb.2007.10.042 · Cited by 76
Self-citationShi, L. S., Brunius, C. F., Lehtonen, M., Auriola, S. O. K., Bergdahl, I. A., Rolandsson, O., Hanhineva, K., & Landberg, R. (2018) · Diabetologia · doi:10.1007/s00125-017-4521-y · Cited by 80
“We incorporated standard ML-PLS [23] into a repeated double cross-validation framework with unbiased variable selection, which effectively determines a parsimonious set of discriminative features ranked according to their importance with reduced risk of statistical overfitting [24, 25].”
InfluentialPharmacometabolomics Reveals That Serotonin Is Implicated in Aspirin Response Variability
Ellero‐Simatos, S., Lewis, J. P., Georgiades, A., Yerges-Armstrong, L. M., Beitelshees, A., Horenstein, R. B., Dane, A. D., Harms, A. C., Ramaker, R., Vreeken, R. J., et al. (2014) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2014.22 · Cited by 74
A metabonomic approach applied to predict patients with cerebral infarction
Jiang, Z., Sun, J., Liang, Q., Cai, Y., Li, S., Huang, Y. X., Wang, Y., & Luo, G. (2011) · Talanta · doi:10.1016/j.talanta.2011.01.015 · Cited by 79
Szymańska, E., Bouwman, J., Strassburg, K., Vervoort, J. J. M., Kangas, A. J., Soininen, P., Ala‐Korpela, M., Westerhuis, J. A., van Duynhoven, J., Mela, D. J., et al. (2012) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2012.0062 · Cited by 77
“The analysis was run separately for women and men and with a double-cross validation scheme (7-fold single cross validation and 8-fold double cross validation), including 5-step variable selection (van Velzen et al., 2008).”
Self-citationAn Integrated Metabolomics and Pharmacokinetics Strategy for Multi-Component Drugs Evaluation
Lan, K., & Jia, W. P. (2010) · Current Drug Metabolism · doi:10.2174/138920010791110926 · Cited by 76
“In recent NMR based metabolomics, rank products (RPs) were developed to evaluate the contributions of variables [28, 69, 70].”
BackgroundMethodInfluentialShi, X., Yao, D., & Chen, C. (2012) · Journal of Biological Chemistry · doi:10.1074/jbc.m111.312199 · Cited by 66
“Both unsupervised and supervised multivariate data analyses (MDA), including principal components analysis, projection to latent structures-discriminant analysis (PLS-DA), and orthogonal projection to latent structures (OPLS) analysis, were applied to classify the measured urine samples (45).”
MethodMoazzami, A. A., Zhang, J., Kamal‐Eldin, A., Åman, P., Hallmans, G., Johansson, J., & Andersson, S.-O. (2011) · Journal of Nutrition · doi:10.3945/jn.111.148239 · Cited by 67
“MLPLS-DA can be considered amultivariate extension of a paired t test that generates different multivariate submodels for the between-subject and within-subject variation in the data (23,24).”
BackgroundMethodInfluentialTrends in the application of chemometrics to foodomics studies
Khakimov, B., Gürdeniz, G., & Engelsen, S. B. (2015) · Acta Alimentaria · doi:10.1556/aalim.44.2015.1.1 · Cited by 69
“One of the fi rst applications of ACSA was made to study the effect of grape/wine extracts on the NMR based human urine metabolome by dividing the effects into between and within the human subjects Acta Alimentaria 44, 2015 (VAN VELZEN et al., 2008).”
MethodVázquez‐Fresno, R., Llorach, R., Alcaro, F. D., Rodriguez, M. A., Vinaixa, M., Chiva‐Blanch, G., Estruch, R., Correig, X., & Andrés‐Lacueva, C. (2012) · Electrophoresis · doi:10.1002/elps.201100646 · Cited by 66
Chemical Fingerprints of Emotional Body Odor
Smeets, M. A. M., Rosing, E. A. E., Jacobs, D. M., van Velzen, E., Koek, J. H., Blonk, C., Gortemaker, I., Eidhof, M. B., Markovitch, B., de Groot, J., et al. (2020) · Metabolites · doi:10.3390/metabo10030084 · Cited by 59
“All models were validated using seven‐fold cross‐validation and permutation testing with 900 models of randomly permuted data [64].”
MethodSelf-citationLoo, R. L., Zou, X., Appel, L. J., Nicholson, J. K., & Holmes, E. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqx072 · Cited by 62
“Due to the nature of the cross-over study design, we employed multilevel orthogonal partial least squares discriminant analysis (mOPLSDA) (26, 27), which incorporates the variation between and within participants in the data-set to optimize visualization of dietary response, in conjunction with SHOCSY.”
MethodAn Overview of Metabolomics Data Analysis: Current Tools and Future Perspectives
Lamichhane, S., Sen, P., Dickens, A. M., Hyötyläinen, T., & Orešič, M. (2018) · Comprehensive analytical chemistry · doi:10.1016/bs.coac.2018.07.001 · Cited by 80
Metabolomic and antioxidant properties of different varieties and origins of Dragon fruit
Al‐Mekhlafi, N. A., Mediani, A., Ismail, N. H., Abas, F., Dymerski, T., Lubinska-Szczygeł, M., Vearasilp, S., & Gorinstein, S. (2020) · Microchemical Journal · doi:10.1016/j.microc.2020.105687 · Cited by 60
Miccheli, A., Marini, F., Capuani, G., Miccheli, A. T., Delfini, M., Cocco, M. E. D., Puccetti, C., Paci, M., Rizzo, M., & Spataro, A. (2009) · Journal of the American College of Nutrition · doi:10.1080/07315724.2009.10719787 · Cited by 66
“[17], which takes a multilevel splitting approach to partition the overall variance into the contributions of the different terms involved.”
BackgroundMethodInfluentialHernández‐Alonso, P., Cañueto, D., Giardina, S., Salas‐Salvadó, J., Cañellas, N., Correig, X., & Bulló, M. (2017) · The Journal of Nutritional Biochemistry · doi:10.1016/j.jnutbio.2017.04.002 · Cited by 64
Serum metabolites associated with feed efficiency in black angus steers
Clemmons, B. A., Mihelič, R., Beckford, R. C., Powers, J. B., Melchior, E. A., McFarlane, Z. D., Cope, E. R., Embree, M. M., Mulliniks, J. T., Campagna, S. R., et al. (2017) · Metabolomics · doi:10.1007/s11306-017-1282-z · Cited by 63
Moazzami, A. A., Bondia‐Pons, I., Hanhineva, K., Juntunen, K. S., Antl, N., Poutanen, K. S., & Mykkänen, H. M. (2012) · Nutrition Journal · doi:10.1186/1475-2891-11-88 · Cited by 70
“MLPLS-DA can be considered a multivariate extension of a paired t-test that generates different multivariate sub-models for between-subject and within-subject variation (intervention effect) in the data [24,25].”
BackgroundMethodInfluentialThe bacterial microbiome and metabolome in caries progression and arrest
Rosa, T. D. C., Neves, A. D. A., Azcárate-Peril, M. A., Divaris, K., Wu, D., Cho, H., MOSS, K. L., Paster, B. J., Chen, T., Freitas‐Fernandes, L. B., et al. (2021) · Journal of Oral Microbiology · doi:10.1080/20002297.2021.1886748 · Cited by 56
“0 software was also used to obtain the predictive performance of the models; each model was evaluated for Q2, R2 and accuracy (ACC), for the purpose of cross-validation [39].”
MethodMetabolomics in gestational diabetes
Mao, X., Chen, X., Chen, C., Zhang, H., & Law, K. P. (2017) · Clinica Chimica Acta · doi:10.1016/j.cca.2017.10.019 · Cited by 60
Salivary Metabolite Fingerprint of Type 1 Diabetes in Young Children
de Oliveira, L. R. P., Martins, C., Fidalgo, T. K. D. S., Freitas‐Fernandes, L. B., Torres, R. D. O., Soares, A. L., Almeida, F. C. L., Valente, A. P., & de Souza, I. P. R. (2016) · Journal of Proteome Research · doi:10.1021/acs.jproteome.6b00007 · Cited by 51
Metabolomics as a Potential New Approach for Investigating Human Reproductive Disorders
Courant, F., Antignac, J., Monteau, F., & Bizec, B. L. (2013) · Journal of Proteome Research · doi:10.1021/pr400204q · Cited by 50
Maher, A. D., Coles, C. A., White, J. D., Bateman, J. F., Fuller, E. S., Burkhardt, D., Little, C. B., Cake, M. A., READ, R. W., McDonagh, M. B., et al. (2012) · Journal of Proteome Research · doi:10.1021/pr300368h · Cited by 49
Lan, K., Xie, G., & Jia, W. (2013) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2013/819147 · Cited by 47
Analysis of -omics data: Graphical interpretation- and validation tools in multi-block methods
Hassani, S., Martens, H. A., Qannari, E. M., Hanafi, M. M., Borge, G. I. A., & Köhler, A. (2010) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2010.08.008 · Cited by 47
Eftedal, I., Ljubković, M., Flatberg, A., Jørgensen, A., Brubakk, A. O., & Dujić, Ž. (2013) · Physiological Genomics · doi:10.1152/physiolgenomics.00164.2012 · Cited by 54
Shi, X., Tasdogan, A., Huang, F., Hu, Z., Morrison, S. J., & DeBerardinis, R. J. (2017) · Science Advances · doi:10.1126/sciadv.aao5268 · Cited by 47
A lipidomic analysis approach to evaluate the response to cholesterol-lowering food intake
Szymańska, E., van Dorsten, F. A., Troost, J., Paliukhovich, I., van Velzen, E. J. J., Hendriks, M. M. W. B., Trautwein, E. A., van Duynhoven, J., Vreeken, R. J., & Smilde, A. K. (2011) · Metabolomics · doi:10.1007/s11306-011-0384-2 · Cited by 45
“All six M-PLS-DA analyses included double cross validation and variable selection (Smit et al. 2007; van Velzen et al. 2008).”
MethodSelf-citationFidalgo, T. K. D. S., Freitas‐Fernandes, L. B., Almeida, F. C. L., Valente, A. P., & de Souza, I. P. R. (2014) · Metabolomics · doi:10.1007/s11306-014-0717-z · Cited by 45
“M-PLS-DA has been used to evaluate paired samples, when each subjects serves as own control (Szyman´ska et al. 2012; van Velzen et al. 2008).”
MethodMetabolomics: A High-Throughput Platform for Metabolite Profile Exploration
Cheng, J. Q., Lan, W., Zheng, G., & Gao, X. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-7717-8_16 · Cited by 47
Karaman, İ., Ferreira, D. L. S., Boulangé, C. L., Kaluarachchi, M. R., Herrington, D. M., Dona, A. C., Castagné, R., Moayyeri, A., Lehne, B. C., Loh, M. C. S., et al. (2016) · Journal of Proteome Research · doi:10.1021/acs.jproteome.6b00125 · Cited by 43
Romano, F., Meoni, G., Manavella, V., Baima, G., Mariani, G. M., Cacciatore, S., Tenori, L., & Aimetti, M. (2018) · Archives of Oral Biology · doi:10.1016/j.archoralbio.2018.10.023 · Cited by 47
de Almeida, V., Alexandrino, G. L., Aquino, A., Gomes, A. F., Murgu, M., Dobrowolny, H., Guest, P. C., Steiner, J., & Martins-de-Souza, D. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109945 · Cited by 39
Scaling in ANOVA-simultaneous component analysis
Timmerman, M. E., Hoefsloot, H. C. J., Smilde, A. K., & Ceulemans, E. (2015) · Metabolomics · doi:10.1007/s11306-015-0785-8 · Cited by 39
Self-citationLaw, K. P., Mao, X., Han, T.-L., & Zhang, H. (2016) · Clinica Chimica Acta · doi:10.1016/j.cca.2016.12.010 · Cited by 41
Bernacchioni, C., Ghini, V., Cencetti, F., Japtok, L., Donati, C., Bruni, P., & Turano, P. (2017) · Molecular Oncology · doi:10.1002/1878-0261.12048 · Cited by 39
“…SK1expressing cells can be considered as paired control and treated samples, thus allowing the reduction in the experimental variability between independent cell culture experiments and the metabolic variability introduced by the media composition (van Velzen et al., 2008; Westerhuis et al., 2010).”
BackgroundLaber, S., Forcisi, S., Bentley, L., Petzold, J., Moritz, F., Smirnov, K. S., Sadat, L. A., Williamson, I., Strobel, S., Agnew, T., et al. (2021) · Science Advances · doi:10.1126/sciadv.abg0108 · Cited by 45
SPE–NMR metabolite sub-profiling of urine
Jacobs, D. M., Spiesser, L., Garnier, M., de Roo, N., van Dorsten, F. A., Hollebrands, B., van Velzen, E. J. J., Draijer, R., & van Duynhoven, J. (2012) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-012-6339-2 · Cited by 36
“Other efforts have been made to improve data preprocessing of NMR data [16], statistical analysis [17], metabolite identification [18], and NMR database resources [19].”
Self-citationNutrikinetics: Concept, technologies, applications, perspectives
van Duynhoven, J., van Velzen, E. J. J., Westerhuis, J. A., Foltz, M., Jacobs, D. M., & Smilde, A. K. (2012) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2012.01.004 · Cited by 38
Self-citationDai, D., Gao, Y., Chen, J., Huang, Y., Zhang, Z., & Xu, F. (2016) · Scientific Reports · doi:10.1038/srep34136 · Cited by 33
Stroeve, J. H. M., Saccenti, E., Bouwman, J., Dane, A. D., Strassburg, K., Vervoort, J. J. M., Hankemeier, T., Astrup, A. V., Smilde, A. K., van Ommen, B., et al. (2016) · Obesity · doi:10.1002/oby.21361 · Cited by 36
“A PLS-DA analysis was performed to test whether metabolism in general is changed differently between the groups.”
MethodInfluentialSelf-citationGhini, V., Unger, F. T., Tenori, L., Turano, P., Juhl, H. H., & David, K. A. (2015) · Metabolomics · doi:10.1007/s11306-015-0832-5 · Cited by 35
“Pairwise Wilcoxon test (univariate statistics) and multilevel PLS (van Velzen et al. 2008; Westerhuis et al. 2010) were used to this purpose.”
MethodMontuschi, P., Santini, G., Mores, N., Vignoli, A., Macagno, F., Shoreh, R., Tenori, L., Zini, G., Fuso, L., Mondino, C., et al. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.00258 · Cited by 31
Current status on genome–metabolome-wide associations: an opportunity in nutrition research
Montoliu, I., Genick, U. K., Ledda, M., Collino, S., Martin, F., le Coutre, J., & Rezzi, S. (2012) · Genes & Nutrition · doi:10.1007/s12263-012-0313-7 · Cited by 35
Castro, C., Sar, F., Shaw, W. R., Mishima, M., Miska, E. A., & Griffin, J. L. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-36 · Cited by 36
Lamichhane, S., Westerhuis, J. A., Ouwehand, A. C., Saarinen, M., Forssten, S. D., Jensen, H. M., Young, J. F., Bertram, H. C., & Yde, C. C. (2016) · Metabolomics · doi:10.1007/s11306-015-0936-y · Cited by 28
Self-citationImpact of chlorogenic acids from coffee on urine metabolome in healthy human subjects
Madrid-Gambín, F., Garcia‐Aloy, M., Vázquez‐Fresno, R., Vegas, E., Jubany, M. C. R. D. V., Misawa, K., Hase, T., Shimotoyodome, A., & Andrés‐Lacueva, C. (2016) · Food Research International · doi:10.1016/j.foodres.2016.03.038 · Cited by 35
Shi, L. S., Brunius, C. F., Lindelöf, M., Shameh, S. A., Wu, H., Lee, I., Landberg, R., & Moazzami, A. A. (2016) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201600924 · Cited by 31
“Such multivariate analysis allows separation of the within-subject variation from the inter-subject variation in metabolite profiles [40,41], and has been successfully used to exploit the differences inherent to diet in cross-over design in human nutritional intervention studies [42,43].”
BackgroundMethodMoreira, V., Brasili, E., Fiamoncini, J., Marini, F., Miccheli, A., Daniel, H., Lee, J. J. H., Hassimotto, N. M. A., & Lajolo, F. M. (2018) · Food Research International · doi:10.1016/j.foodres.2018.02.046 · Cited by 33
A Metabolomic Perspective on Coeliac Disease
Calabrò, A., Gralka, E., Luchinat, C., Saccenti, E., & Tenori, L. (2014) · Autoimmune Diseases · doi:10.1155/2014/756138 · Cited by 36
Li, J., Cao, T., Han, J., Qu, H., Jiang, S., Xie, B., Yan, X., Wu, H., Liu, X., Zhang, F., et al. (2019) · Molecular Medicine Reports · doi:10.3892/mmr.2019.9922 · Cited by 33
“We included permutation tests with 100 iterations to validate the supervised model and avoid overfitting (26).”
Bondia‐Pons, I., Cañellas, N., Abete, I., Rodriguez, M. A., Perez‐Cornago, A., Navas‐Carretero, S., Zulet, M. Á., Correig, X., & Martínez, J. A. (2013) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2013.0027 · Cited by 26
“…young subjects by the consumption of two different tomato sauces (HL-and NL-sauce, respectively), ASCA and its special case Multilevel Simultaneous Component Analysis (MSCA), particularly suitable for the analysis of crossover studies, were followed (Smilde et al., 2005; van Velzen et al., 2008).”
Lodge, J. K. (2009) · Proceedings of The Nutrition Society · doi:10.1017/s0029665109991704 · Cited by 30
“A summary of human nutritional metabolomic studies Reference Platform Study Sample Solanky et al.(42,43) NMR Isoflavone (soyabean) intake in healthy females: daily controlled intake either normal or rich in soya, 1 month per treatment (n 5; females) Plasma(42), urine(43) Lenz et al.(30) NMR Population comparisons, die…”
BackgroundMethodInfluentialCastagné, R., Boulangé, C. L., Karaman, İ., Campanella, G., Ferreira, D. L. S., Kaluarachchi, M. R., Lehne, B. C., Moayyeri, A., Lewis, M. R., Spagou, K., et al. (2017) · Journal of Proteome Research · doi:10.1021/acs.jproteome.7b00344 · Cited by 23
Salivary metabolic profile of children and adolescents after hemodialysis
de Almeida, P. A., Fidalgo, T. K. D. S., Freitas‐Fernandes, L. B., Almeida, F. C. L., de Souza, I. P. R., & Valente, A. P. (2017) · Metabolomics · doi:10.1007/s11306-017-1283-y · Cited by 24
The effect of sampling procedures and day-to-day variations in metabolomics studies of biofluids
Giskeødegård, G. F., Andreassen, T., Bertilsson, H., Tessem, M., & Bathen, T. F. (2019) · Analytica Chimica Acta · doi:10.1016/j.aca.2019.07.026 · Cited by 27
Population-based nutrikinetic modeling of polyphenol exposure
van Velzen, E. J. J., Westerhuis, J. A., Grün, C. H., Jacobs, D. M., Eilers, P. H. C., MULDER, T. P. J., Foltz, M., Garczarek, U., Kemperman, R., Vaughan, E. E., et al. (2014) · Metabolomics · doi:10.1007/s11306-014-0645-y · Cited by 23
“For this pre-selection a method able to handle multivariate data obtained from a crossover study can be useful (Van Velzen et al. 2008).”
MethodSelf-citationRebiai, A., Seghir, B. B., Hemmami, H., Zeghoud, S., Amor, I. B., Kouadri, I., Messaoudi, M., Pasdaran, A., Caruso, G., Sharma, S., et al. (2022) · Compounds · doi:10.3390/compounds2020012 · Cited by 24
Changes in urine headspace composition as an effect of strenuous walking
Samudrala, D., Geurts, B., Brown, P. A., Szymańska, E., Mandon, J., Jansen, J. J., Buydens, L. M. C., Harren, F. J. M., & Cristescu, S. M. (2015) · Metabolomics · doi:10.1007/s11306-015-0813-8 · Cited by 23
“In all three groups, M-PLS-DA is able to extract a higher significant exercise effect than classification of a randomly permuted dataset.”
MethodInfluentialThe effects of the intake of plant foods on the human metabolome
Medina, S., Domínguez‐Perles, R., Ferreres, F., Tomás-Barberán, F. A., & Gil‐Izquierdo, Á. (2013) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2013.08.002 · Cited by 22
Metabolite and lipoprotein responses and prediction of weight gain during breast cancer treatment
Madssen, T. S., Thune, I., Flote, V. G., Lundgren, S., Bertheussen, G. F., Frydenberg, H., Wist, E., Schlichting, E., Schäfer, H., Fjøsne, H. E., et al. (2018) · British Journal of Cancer · doi:10.1038/s41416-018-0211-x · Cited by 26
Vignoli, A., Santini, G., Tenori, L., Macis, G., Mores, N., Macagno, F., Pagano, F. C., Higenbottam, T., Luchinat, C., & Montuschi, P. (2019) · Journal of Proteome Research · doi:10.1021/acs.jproteome.9b00345 · Cited by 22
Pinto, K. P., Fidalgo, T. K. D. S., de Lima, C. O., Lopes, R. T., Freitas‐Fernandes, L. B., Valente, A. P., Sassone, L. M., & Silva, E. J. N. L. (2023) · International Endodontic Journal · doi:10.1111/iej.13994 · Cited by 23
Towards the Fecal Metabolome Derived from Moderate Red Wine Intake
Jiménez-Girón, A., Muñoz‐González, I., Martínlvarez, P., Moreno-Arribas, M. V., & Bartolomé, B. (2014) · Metabolites · doi:10.3390/metabo4041101 · Cited by 21
“Taking advantage of the multilevel structure in a crossover designed metabolomics study, other authors have suggested the use of multilevel Partial Least Squares-Discriminant Analysis (PLS-DA) as a possible alternative to detect the significant metabolites after intervention [38].”
MethodZhao, X., Niu, L., Clerici, C., Russo, R., Byrd, M., & Setchell, K. D. R. (2019) · Clinical mass spectrometry · doi:10.1016/j.clinms.2019.05.002 · Cited by 23
Rådjursöga, M., Lindqvist, H. M., Pedersen, A., Karlsson, G., Malmodin, D., Brunius, C. F., Ellegård, L., & Winkvist, A. (2019) · Nutrition Journal · doi:10.1186/s12937-019-0446-2 · Cited by 23
Chemometric variance analysis of 1H NMR metabolomics data on the effects of oral rinse on saliva
Lemańska, A., Grootveld, M. C., Silwood, C. J. L., & Brereton, R. G. (2011) · Metabolomics · doi:10.1007/s11306-011-0358-4 · Cited by 20
Integrating Metabolomics Profiling Measurements Across Multiple Biobanks
Dane, A. D., Hendriks, M. M. W. B., Reijmers, T. H., Harms, A. C., Troost, J., Vreeken, R. J., Boomsma, D. I., van Duijn, C. M., Slagboom, P. E., & Hankemeier, T. (2014) · Analytical Chemistry · doi:10.1021/ac404191a · Cited by 19
Metadata
- Authors
- van Velzen, E. J. J., Westerhuis, J. A., van Duynhoven, J. P. M., van Dorsten, F. A., Hoefsloot, H. C. J., Jacobs, D. M., Smit, S., Draijer, R., Kroner, C. I., & Smilde, A. K.
- Affiliations
- Biosystems Data Analysis, Swammerdam Institute for Life Sciences, Universiteit van Amsterdam, Nieuwe Achtergracht 166, 1018 WV Amsterdam, The Netherlands, Unilever Food and Health Research; Institute, Olivier van Noortlaan 120, 3133 AT Vlaardingen, The Netherlands
- University of Amsterdam (NL)
- Corresponding author
- Westerhuis, Johan A.
- Venue
- Journal of Proteome Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2008-08-28
- Volume
- 7
- Issue
- 10
- Pages
- 4483-4491
- ISSN
- 1535-3893 (ISSN-L)
- 1535-3907
- OpenAlex
- W2130648981
- Cited by
- 161
- References
- 51
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 7 · 2022: 10 · 2021: 8 · 2020: 8 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 10 · 2015: 12 · 2014: 8 · 2013: 17 · 2012: 18
- FWCI
- 2.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Proteome Research (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Physical Sciences › Chemistry › Analytical Chemistry › Spectroscopy and Chemometric Analyses
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multilevel analysis, crossover design, dietary intervention, metabolomics, NMR metabolomics, treatment effect estimation
- MeSH terms
- Double-Blind Method, Humans, Metabolism, Placebos, Plant Extracts, Statistics as Topic, Urine, Reproducibility of Results, Biomarkers, Cross-Over Studies, Nuclear Magnetic Resonance, Biomolecular, Vitis, Nutrition Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.