Protein Identification False Discovery Rates for Very Large Proteomics Data Sets Generated by Tandem Mass Spectrometry
Open accessThe DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Abstract
Comprehensive characterization of a proteome is a fundamental goal in proteomics. To achieve saturation coverage of a proteome or specific subproteome via tandem mass spectrometric identification of tryptic protein sample digests, proteomics data sets are growing dramatically in size and heterogeneity. The trend toward very large integrated data sets poses so far unsolved challenges to control the uncertainty of protein identifications going beyond well established confidence measures for peptide-spectrum matches. We present MAYU, a novel strategy that reliably estimates false discovery rates for protein identifications in large scale data sets. We validated and applied MAYU using various large proteomics data sets. The data show that the size of the data set has an important and previously underestimated impact on the reliability of protein identifications. We particularly found that protein false discovery rates are significantly elevated compared with those of peptide-spectrum matches. The function provided by MAYU is critical to control the quality of proteome data repositories and thereby to enhance any study relying on these data sources. The MAYU software is available as standalone software and also integrated into the Trans-Proteomic Pipeline.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To exclude the possibility of an inflated protein false discovery rate (FDR) due to error propagation from peptide to protein level inference, we used the Mayu software tool that determines the protein FDR in large data sets as a function of the peptide FDR (Reiter et al, 2009).”
From The quantitative proteome of a human cell line (2011) · cites this paper as Reiter et al, 2009
In the citing paper
“Protein FDRs have been estimated by the generalized target-decoy strategy Mayu (Reiter et al, 2009).”
From The quantitative proteome of a human cell line (2011) · cites this paper as Reiter et al, 2009
In the citing paper
“The accumulation of new peak groups steadily increased across the data set, indicating a likely accumulation of false positives and, highlighting the importance of appropriate global FDR control55, 56.”
From Multi-laboratory assessment of reproducibility, qualitative and quantitative performance of SWATH-mass spectrometry (2017) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Mass spectrometry-based proteomics
Aebersold, R., & Mann, M. (2003) · Nature · doi:10.1038/nature01511 · Cited by 6,955 · cited 1×
“An explicit goal of proteomics is the complete description of a proteome and the measurement of its response to perturbations (Aebersold and Mann 2003).”
BackgroundSelf-citationEng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484 · cited 2×
“We searched each data set against a composite target-decoy database using Turbo Sequest (Eng, McCormack et al. 1994) and Sequest on a Sorcerer machine (Sorcerer™-SEQUEST®, 3.10.4 release).”
MethodInfluentialKeller, A., Nesvizhskii, A. I., Kolker, E., & Aebersold, R. (2002) · Analytical Chemistry · doi:10.1021/ac025747h · Cited by 4,830
Self-citationA Statistical Model for Identifying Proteins by Tandem Mass Spectrometry
Nesvizhskii, A. I., Keller, A., Kolker, E., & Aebersold, R. (2003) · Analytical Chemistry · doi:10.1021/ac0341261 · Cited by 4,809 · cited 14×
“Widely used protein inference tools like ProteinProphet (24) have proven to yield reliable error estimates on data sets at the experiment level (typically 10–50 LC-MS/MS runs) but fail to estimate an accurate protein identification FDR for large data sets (Fig.”
MethodInfluentialSelf-citationLarge-scale analysis of the yeast proteome by multidimensional protein identification technology
Washburn, M. P., Wolters, D., & Yates, J. R. (2001) · Nature Biotechnology · doi:10.1038/85686 · Cited by 4,752 · cited 1×
“at the protein identification level (2, 3, 7, 27, 28).”
BackgroundElias, J. E., & Gygi, S. P. (2007) · Nature Methods · doi:10.1038/nmeth1019 · Cited by 3,925 · cited 12×
“We performed all the database searches using a concatenated target-decoy database (Elias and Gygi 2007 Based on the well established assumption that false positive PSMs equally likely map to either target or decoy database, we used the number of PSMs mapping to the decoy database as an estimate for the number of false…”
BackgroundMethodInfluentialA Model for Random Sampling and Estimation of Relative Protein Abundance in Shotgun Proteomics
Liu, H., Sadygov, R. G., & Yates, J. R. (2004) · Analytical Chemistry · doi:10.1021/ac0498563 · Cited by 2,500 · cited 1×
“(41), and targeted proteomics approaches based on the”
BackgroundThe Bioperl Toolkit: Perl Modules for the Life Sciences
Stajich, J. E., Block, D., Boulez, K., Brenner, S. E., Chervitz, S. A., Dagdigian, C., Fuellen, G., Gilbert, J. G. R., Korf, I., Lapp, H., et al. (2002) · Genome Research · doi:10.1101/gr.361602 · Cited by 1,654 · cited 2×
“We used the standard deviatio n pI of isoelectric point deviations pI as a quality measure for a set H of PSMs, ( σ where pI pr (i) is the isoelectric point of a PSM i predicted by Bioperl (Stajich, Block et al. 2002). pI ex (i) corresponds to the experimentally measured isoelectric point of a PSM i, determined as the…”
BackgroundInfluentialPeng, J., Elias, J. E., Thoreen, C. C., Licklider, L. J., & Gygi, S. P. (2003) · Journal of Proteome Research · doi:10.1021/pr025556v · Cited by 1,647 · cited 2×
“Number, frequency and size and heterogeneity of proteomic data sets steadily increase (Washburn, Wolters et al. 2001; Peng, Elias et al. 2003; Omenn, States et al. 2005; Foster, de Hoog et al. 2006; King, Deutsch et al. 2006; Brunner, Ahrens et al. 2007; Baerenfaller, Grossmann et al. 2008; de…”
Background
Cited by
The MaxQuant computational platform for mass spectrometry-based shotgun proteomics
Tyanova, S., Temu, T., & Cox, J. (2016) · Nature Protocols · doi:10.1038/nprot.2016.136 · Cited by 4,797
“This is a very crucial step, because if search results for separate raw files are collected into one larger data set without any further higher-level FDR control, false-positive protein identifications will aggregate 42,43 .”
BackgroundMass-spectrometry-based draft of the human proteome
Wilhelm, M., Schlegl, J., Hahne, H., Gholami, A. M., Lieberenz, M., Savitski, M. M., Ziegler, E., Butzmann, L., Gessulat, S., Marx, H., et al. (2014) · Nature · doi:10.1038/nature13319 · Cited by 1,820
Protein Analysis by Shotgun/Bottom-up Proteomics
Zhang, Y., Fonslow, B. R., Shan, B., Baek, M.-C., & Yates, J. R. (2013) · Chemical Reviews · doi:10.1021/cr3003533 · Cited by 1,491
Bruderer, R., Bernhardt, O. M., Gandhi, T., Miladinović, S. M., Cheng, L.-Y., Messner, S., Ehrenberger, T., Zanotelli, V., Butscheid, Y., Escher, C., et al. (2015) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m114.044305 · Cited by 1,238
“The FDR was controlled at protein level (37).”
BackgroundSelf-citationData‐independent acquisition‐based SWATH ‐ MS for quantitative proteomics: a tutorial
Ludwig, C., Gillet, L., Rosenberger, G., Amon, S., Collins, B. C., & Aebersold, R. (2018) · Molecular Systems Biology · doi:10.15252/msb.20178126 · Cited by 1,002
“If SWATH extraction results are summarized at the inferred protein level, the error rate can be further inflated by such false positives (Reiter et al , 2009; Rosen-berger et al , 2017a).”
Self-citation
Metadata
- Authors
- Reiter, L., Claassen, M., Schrimpf, S. P., Jovanovic, M., Schmidt, A., Buhmann, J. M., Hengartner, M. O., & Aebersold, R.
- Affiliations
- University of Zurich (CH)
- ETH Zurich (CH)
- Corresponding author
- Aebersold, Ruedi
- Venue
- Molecular & Cellular Proteomics
- Publisher
- Elsevier BV
- Published
- 2009-11
- Volume
- 8
- Issue
- 11
- Pages
- 2405-2417
- ISSN
- 1535-9476 (ISSN-L)
- PMC
- PMC2773710
- OpenAlex
- W2129897014
- Cited by
- 312
- References
- 44
- Citations by year
- 2026: 7 · 2025: 3 · 2024: 6 · 2023: 7 · 2022: 14 · 2021: 18 · 2020: 18 · 2019: 20 · 2018: 26 · 2017: 24 · 2016: 25 · 2015: 33 · 2014: 11 · 2013: 25 · 2012: 28
- FWCI
- 10.59
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by/4.0/ (vor, 3972 d)
- Locations
- Molecular & Cellular Proteomics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (10767)
- Universität Zürich
- SystemsX.ch
- National Institutes of Health (n01hv028179-000)
- Functional Genomics Center Zurich
- National Heart, Lung, and Blood Institute (N01 HV028179, N01-HV-28179)
- Topics
- Physical Sciences › Chemistry › Spectroscopy › Advanced Proteomics Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Physical Sciences › Chemistry › Spectroscopy › Mass Spectrometry Techniques and Applications
- Keywords
- protein identification, false discovery rate, tandem mass spectrometry, peptide-spectrum matches, proteome coverage
- MeSH terms
- Algorithms, Animals, False Positive Reactions, Leptospira, Peptides, Schizosaccharomyces, Reproducibility of Results, Models, Statistical, Caenorhabditis elegans, Computational Biology, Proteome, Databases, Protein, Proteomics, Tandem Mass Spectrometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Protein Identification False Discovery Rates for Very Large Proteomics Data Sets Generated by Tandem Mass Spectrometry. https://app.cochat.ai/papers/10.1074/mcp.m900317-mcp200
- The paper
- Reiter, L., Claassen, M., Schrimpf, S. P., Jovanovic, M., Schmidt, A., Buhmann, J. M., Hengartner, M. O., & Aebersold, R. (2009). Protein Identification False Discovery Rates for Very Large Proteomics Data Sets Generated by Tandem Mass Spectrometry. Molecular & Cellular Proteomics. https://doi.org/10.1074/mcp.m900317-mcp200
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.