Target-Decoy Approach and False Discovery Rate: When Things May Go Wrong
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
The target-decoy approach (TDA) has done the field of proteomics a great service by filling in the need to estimate the false discovery rates (FDR) of peptide identifications. While TDA is often viewed as a universal solution to the problem of FDR evaluation, we argue that the time has come to critically re-examine TDA and to acknowledge not only its merits but also its demerits. We demonstrate that some popular MS/MS search tools are not TDA-compliant and that it is easy to develop a non-TDA compliant tool that outperforms all TDA-compliant tools. Since the distinction between TDA-compliant and non-TDA compliant tools remains elusive, we are concerned about a possible proliferation of non-TDA-compliant tools in the future (developed with the best intentions). We are also concerned that estimation of the FDR by TDA awkwardly depends on a virtual coin toss and argue that it is important to take the coin toss factor out of our estimation of the FDR. Since computing FDR via TDA suffers from various restrictions, we argue that TDA is not needed when accurate p-values of individual Peptide-Spectrum Matches are available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692 · cited 2×
“While exactly computing the RHS (right hand side) of equation 2 can be challenging, if the size of the spectra set Σ is rather large we can rely on the common approximation of the mean of ratio as the ratio of means (e.g., Storey and Tibshirani 2003 [ 20 ]):”
MethodRapid and sensitive protein similarity searches
Lipman, D. J., & Pearson, W. R. (1985) · Science · doi:10.1126/science.2983426 · Cited by 4,033
Elias, J. E., & Gygi, S. P. (2007) · Nature Methods · doi:10.1038/nmeth1019 · Cited by 3,925
Semi-supervised learning for peptide identification from shotgun proteomics datasets
Käll, L., Canterbury, J. D., Weston, J., Noble, W. S., & MacCoss, M. J. (2007) · Nature Methods · doi:10.1038/nmeth1113 · Cited by 2,424
Assigning Significance to Peptides Identified by Tandem Mass Spectrometry Using Decoy Databases
Käll, L., Storey, J. D., MacCoss, M. J., & Noble, W. S. (2008) · Journal of Proteome Research · doi:10.1021/pr700600n · Cited by 607 · cited 3×
“See Kall et al., 2008 [15] for a qvalue based correction for both size of the protein database and the size/structure of the spectral dataset.”
BackgroundMethod
Cited by
Mass-spectrometry-based draft of the human proteome
Wilhelm, M., Schlegl, J., Hahne, H., Gholami, A. M., Lieberenz, M., Savitski, M. M., Ziegler, E., Butzmann, L., Gessulat, S., Marx, H., et al. (2014) · Nature · doi:10.1038/nature13319 · Cited by 1,820
Protein Analysis by Shotgun/Bottom-up Proteomics
Zhang, Y., Fonslow, B. R., Shan, B., Baek, M.-C., & Yates, J. R. (2013) · Chemical Reviews · doi:10.1021/cr3003533 · Cited by 1,491
MS-GF+ makes progress towards a universal database search tool for proteomics
Kim, S., & Pevzner, P. A. (2014) · Nature Communications · doi:10.1038/ncomms6277 · Cited by 1,098
“See Gupta et al. 24 for the details of our probabilistic framework.”
Self-citationMass spectral molecular networking of living microbial colonies
Watrous, J., Roach, P., Alexandrov, T., Heath, B. S., Yang, J. Y., Kersten, R. D., van der Voort, M., Pogliano, K., Gross, H., Raaijmakers, J. M., et al. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1203689109 · Cited by 971
Self-citationA Scalable Approach for Protein False Discovery Rate Estimation in Large Proteomic Data Sets
Savitski, M. M., Wilhelm, M., Hahne, H., Kuster, B., & Bantscheff, M. (2015) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m114.046995 · Cited by 445
Metadata
- Authors
- Gupta, N., Bandeira, N., Keich, U., & Pevzner, P. A.
- Venue
- Journal of the American Society for Mass Spectrometry
- Publisher
- American Chemical Society (ACS)
- Published
- 2011-05-05
- Volume
- 22
- Issue
- 7
- Pages
- 1111-1120
- ISSN
- 1044-0305 (ISSN-L)
- OpenAlex
- W2099314206
- Cited by
- 154
- References
- 5
- FWCI
- 5.75
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Target-Decoy Approach and False Discovery Rate: When Things May Go Wrong. https://app.cochat.ai/papers/10.1007/s13361-011-0139-3
- The paper
- Gupta, N., Bandeira, N., Keich, U., & Pevzner, P. A. (2011). Target-Decoy Approach and False Discovery Rate: When Things May Go Wrong. Journal of the American Society for Mass Spectrometry. https://doi.org/10.1007/s13361-011-0139-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.