Evaluation of an artificial neural network retention index model for chemical structure identification in nontargeted metabolomics
Open accessAbstract
Liquid chromatography coupled with electrospray ionization tandem mass spectrometry (LC-ESI-MS/MS) is a major analytical technique used for nontargeted identification of metabolites in biological fluids. Typically, in LC-ESI-MS/MS based database assisted structure elucidation pipelines, the exact mass of an unknown compound is used to mine a chemical structure database to acquire an initial set of possible candidates. Subsequent matching of the collision induced dissociation (CID) spectrum of the unknown to the CID spectra of candidate structures facilitates identification. However, this approach often fails because of the large numbers of potential candidates (i.e., false positives) for which CID spectra are not available. To overcome this problem, CID fragmentation predication programs have been developed, but these also have limited success if large numbers of isomers with similar CID spectra are present in the candidate set. In this study, we investigated the use of a retention index (RI) predictive model as an orthogonal method to help improve identification rates. The model was used to eliminate candidate structures whose predicted RI values differed significantly from the experimentally determined RI value of the unknown compound. We tested this approach using a set of ninety-one endogenous metabolites and four in silico CID fragmentation algorithms: CFM-ID, CSI:FingerID, Mass Frontier, and MetFrag. Candidate sets obtained from PubChem and the Human Metabolite Database (HMDB) were ranked with and without RI filtering followed by in silico spectral matching. Upon RI filtering, 12 of the ninety-one metabolites were eliminated from their respective candidate sets, i.e., were scored incorrectly as negatives. For the remaining seventy-nine compounds, we show that RI filtering eliminated an average of 58% from PubChem candidate sets. This resulted in an approximately 2-fold improvement in average rankings when using CFM-ID, Mass Frontier, and MetFrag. In addition, RI filtering slightly increased the occurrence of number one rankings for all 4 fragmentation algorithms. However, RI filtering did not significantly improve average rankings when HMDB was used as the candidate database, nor did it significantly improve average rankings when using CSI:FingerID. Overall, we show that the current RI model incorrectly eliminated more true positives (12) than were expected (4-5) on the basis of the filtering method. However, it slightly improved the number of correct first place rankings and improved overall average rankings when using CFM-ID, Mass Frontier, and MetFrag.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Manual verification of metabolites following identification scoring is required for shotgun metabolomics because scoring methods are much less mature than for other omics data types.
“manual verification of metabolites following identification scoring is required for shotgun metabolomics, as scoring methods are much less mature than for other ‘omics data types (Stein and Scott, 1994; Samaraweera et al., 2018).”
From Missing data in multi-omics integration: Recent advances through artificial intelligence (2023) · cites this paper as Samaraweera et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · see citing works
Identifying Small Molecules via High Resolution Mass Spectrometry: Communicating Confidence
Schymanski, E. L., Jeon, J., Gulde, R., Fenner, K., Ruff, M., Singer, H. P., & Hollender, J. (2014) · Environmental Science & Technology · doi:10.1021/es5002105 · Cited by 4,519 · see citing works
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Riedmiller, M., & Braun, H. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298623 · Cited by 3,917 · see citing works
Metabolomics—the link between genotypes and phenotypes
Fiehn, O. (2002) · Plant Molecular Biology · doi:10.1023/a:1013713905833 · Cited by 3,445 · see citing works
Metabolomics — the link between genotypes and phenotypes
Fiehn, O. (2002) · Springer eBooks · doi:10.1007/978-94-010-0448-0_11 · Cited by 3,168 · see citing works
MassBank: a public repository for sharing mass spectral data for life sciences
Horai, H., Arita, M., Kanaya, S., Nihei, Y., Ikeda, T., Suwa, K., Ojima, Y., Tanaka, K., Tanaka, S., Aoshima, K., et al. (2010) · Journal of Mass Spectrometry · doi:10.1002/jms.1777 · Cited by 2,529 · see citing works
METLIN—a metabolite mass spectral database
Smith, C. A., Maille, G. O., Want, E. J., Qin, C., Trauger, S. A., Brandon, T. R., Custodio, D. E., Abagyan, R., & Siuzdak, G. (2005) · Therapeutic Drug Monitoring · doi:10.1097/01.ftd.0000179845.53213.39 · Cited by 2,226 · see citing works
Metabolomics--the link between genotypes and phenotypes.
Fiehn, O. (2002) · PubMed · Cited by 1,517 · see citing works
ChemSpider: An Online Chemical Information Resource
Pence, H. E., & Williams, A. J. (2010) · Journal of Chemical Education · doi:10.1021/ed100697w · Cited by 1,277 · see citing works
PubChem: Integrated Platform of Small Molecules and Biological Activities
Bolton, E., Wang, Y., Thiessen, P. A., & Bryant, S. H. (2008) · Annual reports in computational chemistry · doi:10.1016/s1574-1400(08)00012-1 · Cited by 1,267 · see citing works
Searching molecular structure databases with tandem mass spectra using CSI:FingerID
Dührkop, K., Shen, H., Meusel, M., Rousu, J., & Böcker, S. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1509788112 · Cited by 1,190 · see citing works
MetFrag relaunched: incorporating strategies beyond in silico fragmentation
Ruttkies, C., Schymanski, E., Wolf, S., Hollender, J., & Neumann, S. (2016) · Journal of Cheminformatics · doi:10.1186/s13321-016-0115-9 · Cited by 1,063 · see citing works
In silico fragmentation for computer assisted identification of metabolite mass spectra
Wolf, S., Schmidt, S., Müller-Hannemann, M., & Neumann, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-148 · Cited by 698 · see citing works
Introduction to Machine Learning
Suykens, J. A. K. (2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-396502-8.00013-9 · Cited by 649 · see citing works
Allen, F. R., Pon, A., Wilson, M., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku436 · Cited by 466 · see citing works
Competitive fragmentation modeling of ESI-MS/MS spectra for putative metabolite identification
Allen, F., Greiner, R., & Wishart, D. S. (2014) · Metabolomics · doi:10.1007/s11306-014-0676-4 · Cited by 430 · see citing works
Plumb, R. S., Castro‐Perez, J. M., Granger, J. H., et al. (2004) · Rapid Communications in Mass Spectrometry · doi:10.1002/rcm.1627 · Cited by 343 · see citing works
PubChem3D: a new resource for scientists
Bolton, E., Chen, J., Kim, S., et al. (2011) · Journal of Cheminformatics · doi:10.1186/1758-2946-3-32 · Cited by 192 · see citing works
Metabolite identification and molecular fingerprint prediction through machine learning
Heinonen, M., Shen, H., Zamboni, N., & Rousu, J. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts437 · Cited by 186 · see citing works
Critical Assessment of Small Molecule Identification 2016: automated methods
Schymanski, E., Ruttkies, C., Krauss, M. K. V., Brouard, C., Kind, T., Dührkop, K., Allen, F. R., Vaniya, A., Verdegem, D., Böcker, S., et al. (2017) · Journal of Cheminformatics · doi:10.1186/s13321-017-0207-1 · Cited by 177 · see citing works
Computational mass spectrometry for small molecules
Scheubert, K., Hufsky, F., & Böcker, S. (2013) · Journal of Cheminformatics · doi:10.1186/1758-2946-5-12 · Cited by 174 · see citing works
Johnson, S. R., & Lange, B. M. (2015) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2015.00022 · Cited by 145 · see citing works
Hill, D. W., Kertesz, T. M., Fontaine, D., Friedman, R., & Grant, D. F. (2008) · Analytical Chemistry · doi:10.1021/ac800548g · Cited by 125 · see citing works
Self-citationMIDAS: A Database-Searching Algorithm for Metabolite Identification in Metabolomics
Wang, Y., Kora, G. H., Bowen, B. P., et al. (2014) · Analytical Chemistry · doi:10.1021/ac5014783 · Cited by 121 · see citing works
Metabolite identification through multiple kernel learning on fragmentation trees
Shen, H., Dührkop, K., Böcker, S., & Rousu, J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu275 · Cited by 120 · see citing works
Computational mass spectrometry for small-molecule fragmentation
Hufsky, F., Scheubert, K., & Böcker, S. (2013) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2013.09.008 · Cited by 106 · see citing works
Hufsky, F., & Böcker, S. (2016) · Mass Spectrometry Reviews · doi:10.1002/mas.21489 · Cited by 100 · see citing works
Automatic Compound Annotation from Mass Spectrometry Data Using MAGMa
Ridder, L., van der Hooft, J. J. J., & Verhoeven, S. (2014) · Mass Spectrometry · doi:10.5702/massspectrometry.s0033 · Cited by 95 · see citing works
Metabolomics, Metabonomics and Metabolite Profiling
(2007) · Royal Society of Chemistry eBooks · doi:10.1039/9781847558107 · Cited by 90 · see citing works
MolFind: A Software Package Enabling HPLC/MS-Based Identification of Unknown Chemical Structures
Menikarachchi, L. C., Cawley, S., Hill, D. W., Hall, L. M., Hall, L. H., Lai, S., Wilder, J., & Grant, D. F. (2012) · Analytical Chemistry · doi:10.1021/ac302048x · Cited by 67 · see citing works
Self-citationHall, L. M., Hall, L. H., Kertesz, T. M., et al. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300092s · Cited by 47 · see citing works
Self-citation(2013) · Wiley eBooks · doi:10.1002/9783527655861 · Cited by 45 · see citing works
Zhou, J., Weber, R. J. M., Allwood, J. W., Mistrík, R., Zhu, Z., Ji, Z., Chen, S., Dunn, W. B., He, S., & Viant, M. R. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt711 · Cited by 43 · see citing works
Mass spectral libraries: A statistical review of the visible use
Milman, B. L., & Журкович, И. К. (2016) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2016.04.024 · Cited by 43 · see citing works
Zhang, M., Pace, N., Kerns, E. H., et al. (2005) · Journal of Mass Spectrometry · doi:10.1002/jms.876 · Cited by 37 · see citing works
Winners of CASMI2013: Automated Tools and Challenge Data
Nishioka, T., Kasama, T., Kinumi, T., et al. (2014) · Mass Spectrometry · doi:10.5702/massspectrometry.s0039 · Cited by 27 · see citing works
Hall, L. M., Hill, D. W., Menikarachchi, L. C., et al. (2015) · Bioanalysis · doi:10.4155/bio.15.1 · Cited by 26 · see citing works
Self-citationHall, L. M., Hill, D. W., Bugden, K., et al. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00496 · Cited by 25 · see citing works
Self-citationDubey, R., Hill, D. W., Lai, S., Chen, M., & Grant, D. F. (2014) · Metabolomics · doi:10.1007/s11306-014-0732-0 · Cited by 13 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 5
- [2]Fiehn O Plant Mol. Biol. 2002, 48 (1–2), 155– 171. 11860207
- [6]Milman BL; Zhurkovich IK TrAC, Trends Anal. Chem. 2016, 80, 636– 640.
- [17]Hufsky F; Scheubert K; Böcker S TrAC, Trends Anal. Chem. 2014, 53, 41– 48.
- [23]Allen F; Greiner R; Wishart D Metabolomics 2015, 11 (1), 98– 110.
- [32]Bolton EE; Wang Y; Thiessen PA; Bryant SH Annu. Rep. Comput. Chem. 2008, 4, 217– 241.
Cited by
Sorted by citations
Missing data in multi-omics integration: Recent advances through artificial intelligence
Flores, J. E., Claborne, D. M., Weller, Z. D., Webb-Robertson, B.-J. M., Waters, K. M., & Bramer, L. M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1098308 · Cited by 181 · see citing works
“For small molecule measurements, such as metabolomics, manual verification of metabolites following identification scoring is required for shotgun metabolomics, as scoring methods are much less mature than for other ‘omics data types (Stein and Scott, 1994; Samaraweera et al., 2018).”
Method
- Authors
- Samaraweera, M. A., Hall, L. M., Hill, D. W., & Grant, D. F.
- Affiliations
- University of Connecticut (US)
- Hall Associates Consulting, 2 Davis Street, Quincy, Massachusetts 02170, United States
- Corresponding author
- Grant, David F.
- Venue
- Analytical Chemistry
- Publisher
- American Chemical Society (ACS)
- Published
- 2018-10-15
- Volume
- 90
- Issue
- 21
- Pages
- 12752-12760
- ISSN
- 0003-2700 (ISSN-L)
- 1520-6882
- PMC
- PMC8378237
- OpenAlex
- W2896473185
- Cited by
- 41
- References
- 39
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 6 · 2022: 7 · 2021: 4 · 2020: 12 · 2019: 8
- FWCI
- 2.13
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Analytical Chemistry (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of General Medical Sciences (GM087714)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Physical Sciences › Chemistry › Spectroscopy › Mass Spectrometry Techniques and Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
- Keywords
- retention index prediction, artificial neural networks, untargeted metabolomics, chemical structure identification, LC-ESI-MS/MS, in silico fragmentation, false positives, endogenous metabolites, PubChem, MetFrag
- MeSH terms
- Algorithms, Chromatography, Liquid, Computer Simulation, Models, Chemical, Molecular Structure, Neural Networks, Computer, Spectrometry, Mass, Electrospray Ionization, Metabolomics, Databases, Chemical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review