Assigning Significance to Peptides Identified by Tandem Mass Spectrometry Using Decoy Databases
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Automated methods for assigning peptides to observed tandem mass spectra typically return a list of peptide-spectrum matches, ranked according to an arbitrary score. In this article, we describe methods for converting these arbitrary scores into more useful statistical significance measures. These methods employ a decoy sequence database as a model of the null hypothesis, and use false discovery rate (FDR) analysis to correct for multiple testing. We first describe a simple FDR inference method and then describe how estimating and taking into account the percentage of incorrectly identified spectra in the entire data set can lead to increased statistical power.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The false discovery rate (FDR) was controlled at 1% at the peptide query and protein levels using the q-value approach50–54 in the global context, and at 1% peptide query FDR on a sample-by-sample basis.”
From Multi-laboratory assessment of reproducibility, qualitative and quantitative performance of SWATH-mass spectrometry (2017) · cites this paper as [52]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Self-citationPerkins, D. N., Pappin, D. J. C., Creasy, D. M., & Cottrell, J. S. (1999) · Electrophoresis · doi:10.1002/(sici)1522-2683(19991201)20:18<3551::aid-elps3551>3.0.co;2-2 · Cited by 8,203
Eng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Self-citationA Statistical Model for Identifying Proteins by Tandem Mass Spectrometry
Nesvizhskii, A. I., Keller, A., Kolker, E., & Aebersold, R. (2003) · Analytical Chemistry · doi:10.1021/ac0341261 · Cited by 4,809
Genomic Control for Association Studies
Devlin, B., & Roeder, K. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00997.x · Cited by 3,162
Mathematical Statistics and Data Analysis
Rabinowitz, L. (1989) · Technometrics · doi:10.1080/00401706.1989.10488573 · Cited by 3,116
TANDEM: matching proteins with tandem mass spectra
Craig, R., & Beavis, R. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth092 · Cited by 2,536
Semi-supervised learning for peptide identification from shotgun proteomics datasets
Käll, L., Canterbury, J. D., Weston, J., Noble, W. S., & MacCoss, M. J. (2007) · Nature Methods · doi:10.1038/nmeth1113 · Cited by 2,424
Self-citationCapturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
Self-citationEmpirical Bayes analysis of a microarray experiment
Efron, B., Tibshirani, R., Storey, J. D., & Tusher, V. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382129 · Cited by 1,733
Self-citationTrypsin Cleaves Exclusively C-terminal to Arginine and Lysine Residues
Olsen, J. V., Ong, S.-E., & Mann, M. (2004) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t400003-mcp200 · Cited by 1,254
Bioinformatics the machine learning approach
Baldi, P., & Brunak, S. (2001) · Cited by 942
Mathematical Statistics and Data Analysis
Ziegel, E. R., & Rice, J. (1995) · Technometrics · doi:10.2307/1269179 · Cited by 842
Correlation and Large-Scale Simultaneous Significance Testing
Efron, B. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001211 · Cited by 405
Qscore: An algorithm for evaluating SEQUEST database search results
Moore, R. E., Young, M. K., & Lee, T. D. (2002) · Journal of the American Society for Mass Spectrometry · doi:10.1016/s1044-0305(02)00352-5 · Cited by 390
Estimating the Proportion of True Null Hypotheses, with application to DNA Microarray Data
Langaas, M., Lindqvist, B. H., & Ferkingstad, E. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00515.x · Cited by 316
How to report statistics in medicine: annotated guidelines for authors, editors, and reviewers
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1556 · Cited by 308
OLAV: Towards high‐throughput tandem mass spectrometry data identification
Colinge, J., Masselot, A., Giron, M., Dessingy, T., & Magnin, J. (2003) · PROTEOMICS · doi:10.1002/pmic.200300485 · Cited by 297
Weatherly, D. B., Atwood, J. A., Minning, T. A., Cavola, C., Tarleton, R. L., & Orlando, R. (2005) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m400215-mcp200 · Cited by 210
How to Report Statistics in Medicine: Annotated Guidelines for Authors
Lang, T. A., & Secic, M. (1997) · The Nurse Practitioner · doi:10.1097/00006205-199705000-00022 · Cited by 209
Sadygov, R. G., & Yates, J. R. (2003) · Analytical Chemistry · doi:10.1021/ac034157w · Cited by 206
Meinshausen, N., & Rice, J. (2006) · The Annals of Statistics · doi:10.1214/009053605000000741 · Cited by 204
Bioinformatics: The machine learning approach
(1998) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(98)90194-8 · Cited by 188
Effects of Modified Digestion Schemes on the Identification of Proteins from Complex Mixtures
Klammer, A. A., & MacCoss, M. J. (2006) · Journal of Proteome Research · doi:10.1021/pr050315j · Cited by 164
Self-citationNielsen, M. L., Savitski, M. M., & Zubarev, R. A. (2005) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t400022-mcp200 · Cited by 149
Comparison of Methods for Estimating the Number of True Null Hypotheses in Multiplicity Testing
Hsueh, H., Chen, J. J., & Kodell, R. L. (2003) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-120024202 · Cited by 116
Statistical “Discoveries” and Effect-Size Estimation
Sorić, B. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478811 · Cited by 114
Finkelstein, M. O., & Levin, B. (1990) · Statistics for social and behavioral sciences · doi:10.1007/978-1-0716-4156-9 · Cited by 102
Assessing stability of gene selection in microarray data analysis
Qiu, X., Xiao, Y., Gordon, A. Y., & Yakovlev, A. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-50 · Cited by 84
Encyclopedia of Clinical Child and Pediatric Psychology
Ollendick, T. H., & Schroeder, C. S. (2003) · Springer eBooks · doi:10.1007/978-1-4615-0107-7 · Cited by 73
Higgs, R. E., Knierman, M. D., Freeman, A. B., Gelbert, L. M., Patil, S. T., & Hale, J. E. (2007) · Journal of Proteome Research · doi:10.1021/pr0605320 · Cited by 72
How To Report Statistics In Medicine: Annotated Guidelines for Authors, Editors, and Reviewers
Bradley, J. M. K. (1998) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/55.1.94 · Cited by 71
EBP, a Program for Protein Identification Using Multiple Tandem Mass Spectrometry Datasets
Price, T. S., Lucitt, M. B., Wu, W., Austin, D. J., Pizarro, A., Yocum, A. K., Blair, I. A., FitzGerald, G. A., & Großer, T. (2006) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t600049-mcp200 · Cited by 61
Nguyen, D. V. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2004.01.006 · Cited by 27
Klebanov, L. B., & Yakovlev, A. (2006) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1185 · Cited by 22
Research works printed but not linked: 3
- Soric B., 1989, J. Am. Stat. Assoc., 84, 608
- Meinshausen N., 2006, Ann. Statist., 34, 373
- Klebanov L., 2006, Stat. Appl. Genet. Mol. Biol., 5, 9
Cited by
Cox, J., & Mann, M. (2008) · Nature Biotechnology · doi:10.1038/nbt.1511 · Cited by 14,855
“We use a database containing all true protein sequences, concatenated with reversed nonsense versions of these sequence”
MethodProtein Analysis by Shotgun/Bottom-up Proteomics
Zhang, Y., Fonslow, B. R., Shan, B., Baek, M.-C., & Yates, J. R. (2013) · Chemical Reviews · doi:10.1021/cr3003533 · Cited by 1,491
Untargeted Metabolomics Strategies—Challenges and Emerging Directions
Schrimpe-Rutledge, A. C., Codreanu, S. G., Sherrod, S. D., & McLean, J. A. (2016) · Journal of the American Society for Mass Spectrometry · doi:10.1007/s13361-016-1469-y · Cited by 1,372
“In MS-based proteomic studies, targetdecoy search-based FDR calculations are widely accepted [34, 35].”
BackgroundZhang, J., Xin, L., Shan, B., Chen, W., Xie, M., Yuen, D., Zhang, W., Zhang, Z., Lajoie, G. A., & Ma, B. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.010587 · Cited by 1,081
“achieved by the target decoy method (18, 19).”
MethodTarget-Decoy Search Strategy for Mass Spectrometry-Based Proteomics
Elias, J. E., & Gygi, S. P. (2010) · Methods in Molecular Biology · doi:10.1007/978-1-60761-444-9_5 · Cited by 644
“Proteins— Protein shuffling is another method used for creating decoy sequences (16) in which the amino acids of each input target protein are randomly rearranged to yield a new decoy protein.”
Method
Metadata
- Authors
- Käll, L., Storey, J. D., MacCoss, M. J., & Noble, W. S.
- Affiliations
- University of Washington (US)
- Corresponding author
- Noble, William Stafford
- Venue
- Journal of Proteome Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2007-12-08
- Volume
- 7
- Issue
- 1
- Pages
- 29-34
- ISSN
- 1535-3893 (ISSN-L)
- 1535-3907
- OpenAlex
- W2147698768
- Cited by
- 607
- References
- 37
- Citations by year
- 2026: 16 · 2025: 19 · 2024: 20 · 2023: 39 · 2022: 36 · 2021: 24 · 2020: 34 · 2019: 33 · 2018: 18 · 2017: 27 · 2016: 35 · 2015: 41 · 2014: 33 · 2013: 44 · 2012: 48
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Proteome Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r01eb007057-01)
- National Institute of Biomedical Imaging and Bioengineering (R01-EB007057)
- National Center for Research Resources (P41 RR 11823, P41RR011823)
- Topics
- Physical Sciences › Chemistry › Spectroscopy › Advanced Proteomics Techniques and Applications
- Physical Sciences › Chemistry › Spectroscopy › Mass Spectrometry Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- peptide identification, tandem mass spectrometry, decoy database, false discovery rate, multiple testing correction, peptide-spectrum matches, statistical significance, null hypothesis, spectral library search, statistical power
- MeSH terms
- Peptides, Models, Statistical, Databases, Protein, Tandem Mass Spectrometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.