The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
False discovery rates in spectral identification
Open accessAbstract
Automated database search engines are one of the fundamental engines of high-throughput proteomics enabling daily identifications of hundreds of thousands of peptides and proteins from tandem mass (MS/MS) spectrometry data. Nevertheless, this automation also makes it humanly impossible to manually validate the vast lists of resulting identifications from such high-throughput searches. This challenge is usually addressed by using a Target-Decoy Approach (TDA) to impose an empirical False Discovery Rate (FDR) at a pre-determined threshold x% with the expectation that at most x% of the returned identifications would be false positives. But despite the fundamental importance of FDR estimates in ensuring the utility of large lists of identifications, there is surprisingly little consensus on exactly how TDA should be applied to minimize the chances of biased FDR estimates. In fact, since less rigorous TDA/FDR estimates tend to result in more identifications (at higher 'true' FDR), there is often little incentive to enforce strict TDA/FDR procedures in studies where the major metric of success is the size of the list of identifications and there are no follow up studies imposing hard cost constraints on the number of reported false positives. Here we address the problem of the accuracy of TDA estimates of empirical FDR. Using MS/MS spectra from samples where we were able to define a factual FDR estimator of 'true' FDR we evaluate several popular variants of the TDA procedure in a variety of database search contexts. We show that the fraction of false identifications can sometimes be over 10×higher than reported and may be unavoidably high for certain types of searches. In addition, we further report that the two-pass search strategy seems the most promising database search strategy. While unavoidably constrained by the particulars of any specific evaluation dataset, our observations support a series of recommendations towards maximizing the number of resulting identifications while controlling database searches with robust and reproducible TDA estimation of empirical FDR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484 · cited 3×
“For example, SEQUEST Xcorr tends to assign large scores to long peptides.”
MethodElias, J. E., & Gygi, S. P. (2007) · Nature Methods · doi:10.1038/nmeth1019 · Cited by 3,925
Assigning Significance to Peptides Identified by Tandem Mass Spectrometry Using Decoy Databases
Käll, L., Storey, J. D., MacCoss, M. J., & Noble, W. S. (2008) · Journal of Proteome Research · doi:10.1021/pr700600n · Cited by 607
Precision proteomics: The case for high resolution and high mass accuracy
Mann, M., & Kelleher, N. L. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0800788105 · Cited by 450
Cited by
MS-GF+ makes progress towards a universal database search tool for proteomics
Kim, S., & Pevzner, P. A. (2014) · Nature Communications · doi:10.1038/ncomms6277 · Cited by 1,098
“MS-GF þ estimates FDRs using the target decoy approach 38,39 .”
MethodSelf-citationA Scalable Approach for Protein False Discovery Rate Estimation in Large Proteomic Data Sets
Savitski, M. M., Wilhelm, M., Hahne, H., Kuster, B., & Bantscheff, M. (2015) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m114.046995 · Cited by 445
JUMP: a tag-based database search tool for peptide identification with high sensitivity and accuracy
Wang, X., Li, Y., Wu, Z., Wang, H., Tan, H., & Peng, J. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.o114.039586 · Cited by 194
Applications and challenges of forensic proteomics
Merkley, E. D., Wunschel, D. S., Wahl, K. L., & Jarman, K. H. (2019) · Forensic Science International · doi:10.1016/j.forsciint.2019.01.022 · Cited by 64
Shen, Y., Tolić, N., Piehowski, P. D., Shukla, A. K., Kim, S., Zhao, R., Qu, Y., Robinson, E., Smith, R. D., & Paša-Tolić, L. (2017) · Journal of Chromatography A · doi:10.1016/j.chroma.2017.01.008 · Cited by 63
Self-citation
Metadata
- Authors
- Jeong, K., Kim, S., & Bandeira, N.
- Venue
- BMC Bioinformatics
- Published
- 2012-11
- Volume
- 13
- Issue
- S16
- Pages
- S2-S2
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W2113381588
- Cited by
- 159
- References
- 4
- FWCI
- 5.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: False discovery rates in spectral identification. https://app.cochat.ai/papers/10.1186/1471-2105-13-s16-s2
- The paper
- Jeong, K., Kim, S., & Bandeira, N. (2012). False discovery rates in spectral identification. BMC Bioinformatics. https://doi.org/10.1186/1471-2105-13-s16-s2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.