The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
A Scalable Approach for Protein False Discovery Rate Estimation in Large Proteomic Data Sets
Open accessAbstract
Calculating the number of confidently identified proteins and estimating false discovery rate (FDR) is a challenge when analyzing very large proteomic data sets such as entire human proteomes. Biological and technical heterogeneity in proteomic experiments further add to the challenge and there are strong differences in opinion regarding the conceptual validity of a protein FDR and no consensus regarding the methodology for protein FDR determination. There are also limitations inherent to the widely used classic target-decoy strategy that particularly show when analyzing very large data sets and that lead to a strong over-representation of decoy identifications. In this study, we investigated the merits of the classic, as well as a novel target-decoy-based protein FDR estimation approach, taking advantage of a heterogeneous data collection comprised of ∼19,000 LC-MS/MS runs deposited in ProteomicsDB (https://www.proteomicsdb.org). The "picked" protein FDR approach treats target and decoy sequences of the same protein as a pair rather than as individual entities and chooses either the target or the decoy sequence depending on which receives the highest score. We investigated the performance of this approach in combination with q-value based peptide scoring to normalize sample-, instrument-, and search engine-specific differences. The "picked" target-decoy strategy performed best when protein scoring was based on the best peptide q-value for each protein yielding a stable number of true positive protein identifications over a wide range of q-value thresholds. We show that this simple and unbiased strategy eliminates a conceptual issue in the commonly used "classic" protein FDR approach that causes overprediction of false-positive protein identification in large data sets. The approach scales from small to very large data sets without losing performance, consistently increases the number of true-positive protein identifications and is readily implemented in proteomics analysis software.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cox, J., & Mann, M. (2008) · Nature Biotechnology · doi:10.1038/nbt.1511 · Cited by 14,855
Perkins, D. N., Pappin, D. J. C., Creasy, D. M., & Cottrell, J. S. (1999) · Electrophoresis · doi:10.1002/(sici)1522-2683(19991201)20:18<3551::aid-elps3551>3.0.co;2-2 · Cited by 8,203
Eng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484
Andromeda: A Peptide Search Engine Integrated into the MaxQuant Environment
Cox, J., Neuhauser, N., Michalski, A., Scheltema, R. A., Olsen, J. V., & Mann, M. (2011) · Journal of Proteome Research · doi:10.1021/pr101065j · Cited by 5,500
Keller, A., Nesvizhskii, A. I., Kolker, E., & Aebersold, R. (2002) · Analytical Chemistry · doi:10.1021/ac025747h · Cited by 4,830
Elias, J. E., & Gygi, S. P. (2007) · Nature Methods · doi:10.1038/nmeth1019 · Cited by 3,925
TANDEM: matching proteins with tandem mass spectra
Craig, R., & Beavis, R. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth092 · Cited by 2,536
A draft map of the human proteome
Kim, M.-S., Pinto, S. M., Getnet, D., Nirujogi, R. S., Manda, S. S., Chaerkady, R., Madugundu, A. K., Kelkar, D. S., Isserlin, R., Jain, S., et al. (2014) · Nature · doi:10.1038/nature13302 · Cited by 2,198
Mass-spectrometry-based draft of the human proteome
Wilhelm, M., Schlegl, J., Hahne, H., Gholami, A. M., Lieberenz, M., Savitski, M. M., Ziegler, E., Butzmann, L., Gessulat, S., Marx, H., et al. (2014) · Nature · doi:10.1038/nature13319 · Cited by 1,820
Self-citationKulak, N. A., Pichler, G., Paron, I., Nagaraj, N., & Mann, M. (2014) · Nature Methods · doi:10.1038/nmeth.2834 · Cited by 1,719
Open Mass Spectrometry Search Algorithm
Geer, L. Y., Markey, S. P., Kowalak, J. A., Wagner, L., Xu, M., Maynard, D. M., Yang, X., Shi, W., & Bryant, S. H. (2004) · Journal of Proteome Research · doi:10.1021/pr0499491 · Cited by 1,431
Tracking cancer drugs in living cells by thermal profiling of the proteome
Savitski, M. M., Reinhard, F. B. M., Franken, H., Werner, T., Savitski, M. F., Eberhard, D., Molina, D. M., Jafari, R., Dovega, R. B., Klaeger, S., et al. (2014) · Science · doi:10.1126/science.1255784 · Cited by 1,187
Self-citationZhang, J., Xin, L., Shan, B., Chen, W., Xie, M., Yuen, D., Zhang, W., Zhang, Z., Lajoie, G. A., & Ma, B. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.010587 · Cited by 1,081
Interpretation of Shotgun Proteomic Data
Nesvizhskii, A. I., & Aebersold, R. (2005) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r500012-mcp200 · Cited by 1,025
Deep proteome and transcriptome mapping of a human cancer cell line
Nagaraj, N., Wisniewski, J. R., Geiger, T., Cox, J., Kircher, M., Kelso, J., Pääbo, S., & Mann, M. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.81 · Cited by 979
Geiger, T., Wehner, A., Schaab, C., Cox, J., & Mann, M. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.014050 · Cited by 797
Analysis and validation of proteomic data generated by tandem mass spectrometry
Nesvizhskii, A. I., Vitek, O., & Aebersold, R. (2007) · Nature Methods · doi:10.1038/nmeth1088 · Cited by 629
Integrated proteomic analysis of post-translational modifications by serial enrichment
Mertins, P., Qiao, J. W., Patel, J., Udeshi, N. D., Clauser, K. R., Mani, D. R., Burgess, M. W., Gillette, M. A., Jaffe, J. D., & Carr, S. A. (2013) · Nature Methods · doi:10.1038/nmeth.2518 · Cited by 618
Shteynberg, D., Deutsch, E. W., Lam, H., Eng, J. K., Sun, Z., Tasman, N., Mendoza, L., Moritz, R. L., Aebersold, R., & Nesvizhskii, A. I. (2011) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.007690 · Cited by 565
Nesvizhskii, A. I. (2010) · Journal of Proteomics · doi:10.1016/j.jprot.2010.08.009 · Cited by 536
Hebert, A. S., Richards, A. L., Bailey, D. J., Ulbrich, A., Coughlin, E. E., Westphall, M. S., & Coon, J. J. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m113.034769 · Cited by 528
Scheltema, R. A., Hauschild, J.-P., Lange, O., Hornburg, D., Denisov, E., Damoc, E., Kuehn, A., Makarov, A., & Mann, M. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m114.043489 · Cited by 323
Reiter, L., Claassen, M., Schrimpf, S. P., Jovanovic, M., Schmidt, A., Buhmann, J. M., Hengartner, M. O., & Aebersold, R. (2009) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m900317-mcp200 · Cited by 312 · cited 4×
“mation of false positive protein hits termed MAYU (27).”
BackgroundInfluentialGlobal Proteome Analysis of the NCI-60 Cell Line Panel
Gholami, A. M., Hahne, H., Wu, Z., Auer, F. J., Meng, C., Wilhelm, M., & Kuster, B. (2013) · Cell Reports · doi:10.1016/j.celrep.2013.07.018 · Cited by 302
Self-citationPosterior Error Probabilities and False Discovery Rates: Two Sides of the Same Coin
Käll, L., Storey, J. D., MacCoss, M. J., & Noble, W. S. (2008) · Journal of Proteome Research · doi:10.1021/pr700739d · Cited by 293
Proteomic and phosphoproteomic comparison of human ES and iPS cells
Phanstiel, D. H., Brumbaugh, J., Wenger, C. D., Tian, S., Probasco, M. D., Bailey, D. J., Swaney, D. L., Tervo, M. A., Bolin, J. M., Ruotti, V., et al. (2011) · Nature Methods · doi:10.1038/nmeth.1699 · Cited by 259
False Discovery Rates and Related Statistical Concepts in Mass Spectrometry-Based Proteomics
Choi, H., & Nesvizhskii, A. I. (2008) · Journal of Proteome Research · doi:10.1021/pr700747q · Cited by 217
Combining Results of Multiple Search Engines in Proteomics
Shteynberg, D., Nesvizhskii, A. I., Moritz, R. L., & Deutsch, E. W. (2013) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r113.027797 · Cited by 187
Kelstrup, C. D., Jersie-Christensen, R. R., Batth, T. S., Arrey, T. N., Kuehn, A., Kellmann, M., & Olsen, J. V. (2014) · Journal of Proteome Research · doi:10.1021/pr500985w · Cited by 173
Target-Decoy Approach and False Discovery Rate: When Things May Go Wrong
Gupta, N., Bandeira, N., Keich, U., & Pevzner, P. A. (2011) · Journal of the American Society for Mass Spectrometry · doi:10.1007/s13361-011-0139-3 · Cited by 171
Proteomic Portrait of Human Breast Cancer Progression Identifies Novel Prognostic Markers
Geiger, T., Madden, S. F., Gallagher, W. M., Cox, J., & Mann, M. (2012) · Cancer Research · doi:10.1158/0008-5472.can-11-3711 · Cited by 163
False discovery rates in spectral identification
Jeong, K., Kim, S., & Bandeira, N. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-s16-s2 · Cited by 159
The quantitative proteomes of human‐induced pluripotent stem cells and embryonic stem cells
Muñoz, J., Low, T. Y., Kok, Y. J., Chin, A. C. P., Frese, C. K., Ding, V., Choo, A. B. H., & Heck, A. J. R. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.84 · Cited by 144
Farrah, T., Deutsch, E. W., Omenn, G. S., Sun, Z., Watts, J. D., Yamamoto, T., Shteynberg, D. D., Harris, M., & Moritz, R. L. (2013) · Journal of Proteome Research · doi:10.1021/pr4010037 · Cited by 137
Shiromizu, T., Adachi, J., Watanabe, S., Murakami, T., Kuga, T., Muraoka, S., & Tomonaga, T. (2013) · Journal of Proteome Research · doi:10.1021/pr300825v · Cited by 133
Ion Mobility Tandem Mass Spectrometry Enhances Performance of Bottom-up Proteomics
Helm, D., Vissers, J. P. C., Hughes, C. J., Hahne, H., Ruprecht, B., Pachl, F., Grzyb, A., Richardson, K., Wildgoose, J. L., Maier, S. K., et al. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m114.041038 · Cited by 111
Self-citationDecoy Methods for Assessing False Positives and False Discovery Rates in Shotgun Proteomics
Wang, G., Wu, W. W., Zhang, Z., Masilamani, S. M. E., & Shen, R. (2008) · Analytical Chemistry · doi:10.1021/ac801664q · Cited by 101
A review of statistical methods for protein identification using tandem mass spectrometry
Noble, W. S., & Serang, O. (2012) · Statistics and Its Interface · doi:10.4310/sii.2012.v5.n1.a2 · Cited by 78
Yamana, R., Iwasaki, M., Wakabayashi, M., Nakagawa, M., Yamanaka, S., & Ishihama, Y. (2012) · Journal of Proteome Research · doi:10.1021/pr300837u · Cited by 67
Ritorto, M. S., Cook, K., Tyagi, K., Pedrioli, P. G. A., & Trost, M. (2013) · Journal of Proteome Research · doi:10.1021/pr301011r · Cited by 64
Granholm, V., Navarro, J. F., Noble, W. S., & Käll, L. (2012) · Journal of Proteomics · doi:10.1016/j.jprot.2012.12.007 · Cited by 57
Bianco, L., Mead, J. A., & Bessant, C. (2009) · Journal of Proteome Research · doi:10.1021/pr800792z · Cited by 35
Shanmugam, A. K., Yocum, A. K., & Nesvizhskii, A. I. (2014) · Journal of Proteome Research · doi:10.1021/pr500496p · Cited by 30
Evaluation of Data Analysis Strategies for Improved Mass Spectrometry-Based Phosphoproteomics
Savitski, M. M., Scholten, A., Sweetman, G. M. A., Mathieson, T., & Bantscheff, M. (2010) · Analytical Chemistry · doi:10.1021/ac102083q · Cited by 7
Self-citation
Cited by
Quantitative Proteomics of the Cancer Cell Line Encyclopedia
Nusinow, D. P., Szpyt, J., Ghandi, M., Rose, C. M., McDonald, E. R., Kalocsay, M., Jané-Valbuena, J., Gelfand, E., Schweppe, D. K., Jedrychowski, M., et al. (2020) · Cell · doi:10.1016/j.cell.2019.12.023 · Cited by 957
“Using the Picked FDR method (Savitski et al., 2015) proteins were filtered to the target 1% level.”
Proteogenomic Analysis of Human Colon Cancer Reveals New Therapeutic Opportunities
Vasaikar, S., Huang, C., Wang, X., Petyuk, V. A., Savage, S. R., Wen, B., Dou, Y., Zhang, Y., Shi, Z., Arshad, O. A., et al. (2019) · Cell · doi:10.1016/j.cell.2019.03.030 · Cited by 799
Integrated Proteogenomic Characterization of Clear Cell Renal Cell Carcinoma
Clark, D. J., Dhanasekaran, S. M., Petralia, F., Pan, J., Song, X., Hu, Y., da Veiga Leprevost, F., Reva, B., Lih, T.-S. M., Chang, H.-Y., et al. (2019) · Cell · doi:10.1016/j.cell.2019.10.007 · Cited by 730
The Translational Landscape of the Human Heart
van Heesch, S., Witte, F., Schneider-Lunitz, V., Schulz, J. F., Adami, E., Faber, A. B., Kirchner, M., Maatz, H., Blachut, S., Sandmann, C.-L., et al. (2019) · Cell · doi:10.1016/j.cell.2019.05.010 · Cited by 626
Collins, B. C., Hunter, C. L., Liu, Y., Schilling, B., Rosenberger, G., Bader, S. L., Chan, D. W., Gibson, B. W., Gingras, A.-C., Held, J. M., et al. (2017) · Nature Communications · doi:10.1038/s41467-017-00249-5 · Cited by 576
Metadata
- Authors
- Savitski, M. M., Wilhelm, M., Hahne, H., Kuster, B., & Bantscheff, M.
- Venue
- Molecular & Cellular Proteomics
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 14
- Issue
- 9
- Pages
- 2394-2404
- ISSN
- 1535-9476 (ISSN-L)
- OpenAlex
- W2108508103
- Cited by
- 445
- References
- 44
- FWCI
- 10.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.