The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Evaluation and comparison of bioinformatic tools for the enrichment analysis of metabolomics data
Open accessAbstract
BACKGROUND: Bioinformatic tools for the enrichment of 'omics' datasets facilitate interpretation and understanding of data. To date few are suitable for metabolomics datasets. The main objective of this work is to give a critical overview, for the first time, of the performance of these tools. To that aim, datasets from metabolomic repositories were selected and enriched data were created. Both types of data were analysed with these tools and outputs were thoroughly examined. RESULTS: An exploratory multivariate analysis of the most used tools for the enrichment of metabolite sets, based on a non-metric multidimensional scaling (NMDS) of Jaccard's distances, was performed and mirrored their diversity. Codes (identifiers) of the metabolites of the datasets were searched in different metabolite databases (HMDB, KEGG, PubChem, ChEBI, BioCyc/HumanCyc, LipidMAPS, ChemSpider, METLIN and Recon2). The databases that presented more identifiers of the metabolites of the dataset were PubChem, followed by METLIN and ChEBI. However, these databases had duplicated entries and might present false positives. The performance of over-representation analysis (ORA) tools, including BioCyc/HumanCyc, ConsensusPathDB, IMPaLA, MBRole, MetaboAnalyst, Metabox, MetExplore, MPEA, PathVisio and Reactome and the mapping tool KEGGREST, was examined. Results were mostly consistent among tools and between real and enriched data despite the variability of the tools. Nevertheless, a few controversial results such as differences in the total number of metabolites were also found. Disease-based enrichment analyses were also assessed, but they were not found to be accurate probably due to the fact that metabolite disease sets are not up-to-date and the difficulty of predicting diseases from a list of metabolites. CONCLUSIONS: We have extensively reviewed the state-of-the-art of the available range of tools for metabolomic datasets, the completeness of metabolite databases, the performance of ORA methods and disease-based analyses. Despite the variability of the tools, they provided consistent results independent of their analytic approach. However, more work on the completeness of metabolite and pathway databases is required, which strongly affects the accuracy of enrichment analyses. Improvements will be translated into more accurate and global insights of the metabolome.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
KEGG: Kyoto Encyclopedia of Genes and Genomes
Kanehisa, M. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.27 · Cited by 37,077
KEGG: Kyoto Encyclopedia of Genes and Genomes
Ogata, H., Goto, S., Sato, K., Fujibuchi, W., Bono, H., & Kanehisa, M. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.29 · Cited by 31,232
PubChem Substance and Compound databases
Kim, S., Thiessen, P. A., Bolton, E. E., Chen, J., Fu, G., Gindulyte, A., Han, L., He, J., He, S., Shoemaker, B. A., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv951 · Cited by 5,436
Smith, C. A., Want, E. J., O'Maille, G., Abagyan, R., & Siuzdak, G. (2006) · Analytical Chemistry · doi:10.1021/ac051437y · Cited by 5,262
HMDB 3.0—The Human Metabolome Database in 2013
Wishart, D. S., Jewison, T., Guo, A. C., Wilson, M., Knox, C., Liu, Y., Djoumbou, Y., Mandal, R., Aziat, F., Dong, E., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1065 · Cited by 2,845
METLIN—a metabolite mass spectral database
Smith, C. A., Maille, G. O., Want, E. J., Qin, C., Trauger, S. A., Brandon, T. R., Custodio, D. E., Abagyan, R., & Siuzdak, G. (2005) · Therapeutic Drug Monitoring · doi:10.1097/01.ftd.0000179845.53213.39 · Cited by 2,226
Ten Years of Pathway Analysis: Current Approaches and Outstanding Challenges
Khatri, P., Sirota, M., & Butte, A. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002375 · Cited by 1,566
LMSD: LIPID MAPS structure database
Sud, M., Fahy, E., Cotter, D., Brown, A., Dennis, E. A., Glass, C. K., Merrill, A. H., Murphy, R. C., Raetz, C. R. H., Russell, D. W., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl838 · Cited by 1,375
Xia, J., & Wishart, D. S. (2011) · Nature Protocols · doi:10.1038/nprot.2011.319 · Cited by 1,349
Research works printed but not linked: 3
- Hart CD, Vignoli A, Tenori L, Uy GL, Van To T, Adebamowo C, et al. Serum Metabolomic profiles identify ER-positive early breast cancer patients at increased risk of disease recurrence in a multicenter population. Clin Cancer Res. 2017;23:1422–31. · doi:10.1158/1078-0432.ccr-16-1153
- Tenenbaum D. KEGGREST: client-side REST access to KEGG. R Packag. Version. 2013;
- Legendre P, Legendre L. Numerical ecology. Oxford: Elsevier; 2012. p. 1006.
Cited by
MetaboAnalyst 4.0: towards more transparent and integrative metabolomics analysis
Chong, J., Soufan, O., Li, C., Caraus, I., Li, S., Bourque, G., Wishart, D. S., & Xia, J. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky310 · Cited by 3,629
Kurppa, K. J., Liu, Y., To, C., Zhang, T., Fan, M., Vajdi, A., Knelson, E. H., Xie, Y., Lim, K., Cejas, P., et al. (2020) · Cancer Cell · doi:10.1016/j.ccell.2019.12.006 · Cited by 475
Recent advances in the application of metabolomics for food safety control and food quality analyses
Li, S., Tian, Y., Jiang, P., Lin, Y., Liu, X., & Yang, H. (2021) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2020.1761287 · Cited by 394
Spatial Metabolomics and Imaging Mass Spectrometry in the Age of Artificial Intelligence
Alexandrov, T. (2020) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-011420-031537 · Cited by 284
Karp, P. D., Midford, P. E., Caspi, R., & Khodursky, A. (2021) · BMC Genomics · doi:10.1186/s12864-021-07502-8 · Cited by 266
Metadata
- Authors
- Marco-Ramell, A., Palau-Rodriguez, M., Alay, A., Tulipani, S., Urpi-Sarda, M., Sanchez-Pla, A., & Andres-Lacueva, C.
- Venue
- BMC Bioinformatics
- Published
- 2018-01-02
- Volume
- 19
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W2781939187
- Cited by
- 259
- References
- 55
- FWCI
- 8.63
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- ISCII-Subdirección General de Evaluación y Fomento de la Investigación (PI13/01172)
- CIBERfes
- Fondo Europeo de Desarrollo Regional
- Generalitat de Catalunya's Agency AGAUR (2014SGR1566, 2014 SGR 464)
- MINECO (Juan de la Cierva postdoctoral fellowship, Ramon y Cajal postdoctoral fellowship, MTM2015-64465-C2-1-R)
- Universitat de Barcelona (APIF predoctoral fellowship)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation and comparison of bioinformatic tools for the enrichment analysis of metabolomics data. https://app.cochat.ai/papers/10.1186/s12859-017-2006-0
- The paper
- Marco-Ramell, A., Palau-Rodriguez, M., Alay, A., Tulipani, S., Urpi-Sarda, M., Sanchez-Pla, A., & Andres-Lacueva, C. (2018). Evaluation and comparison of bioinformatic tools for the enrichment analysis of metabolomics data. BMC Bioinformatics. https://doi.org/10.1186/s12859-017-2006-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.