The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
An evaluation, comparison, and accurate benchmarking of several publicly available MS/MS search algorithms: Sensitivity and specificity analysis
Open accessAbstract
MS/MS and associated database search algorithms are essential proteomic tools for identifying peptides. Due to their widespread use, it is now time to perform a systematic analysis of the various algorithms currently in use. Using blood specimens used in the HUPO Plasma Proteome Project, we have evaluated five search algorithms with respect to their sensitivity and specificity, and have also accurately benchmarked them based on specified false‐positive (FP) rates. Spectrum Mill and SEQUEST performed well in terms of sensitivity, but were inferior to MASCOT, X!Tandem, and Sonar in terms of specificity. Overall, MASCOT, a probabilistic search algorithm, correctly identified most peptides based on a specified FP rate. The rescoring algorithm, PeptideProphet, enhanced the overall performance of the SEQUEST algorithm, as well as provided predictable FP error rates. Ideally, score thresholds should be calculated for each peptide spectrum or minimally, derived from a reversed‐sequence search as demonstrated in this study based on a validated data set. The availability of open‐source search algorithms, such as X!Tandem, makes it feasible to further improve the validation process (manual or automatic) on the basis of “consensus scoring”, i.e., the use of multiple (at least two) search algorithms to reduce the number of FPs.∁
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perkins, D. N., Pappin, D. J. C., Creasy, D. M., & Cottrell, J. S. (1999) · Electrophoresis · doi:10.1002/(sici)1522-2683(19991201)20:18<3551::aid-elps3551>3.0.co;2-2 · Cited by 8,203
Eng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484
Self-citationKeller, A., Nesvizhskii, A. I., Kolker, E., & Aebersold, R. (2002) · Analytical Chemistry · doi:10.1021/ac025747h · Cited by 4,830
A Statistical Model for Identifying Proteins by Tandem Mass Spectrometry
Nesvizhskii, A. I., Keller, A., Kolker, E., & Aebersold, R. (2003) · Analytical Chemistry · doi:10.1021/ac0341261 · Cited by 4,809
Large-scale analysis of the yeast proteome by multidimensional protein identification technology
Washburn, M. P., Wolters, D., & Yates, J. R. (2001) · Nature Biotechnology · doi:10.1038/85686 · Cited by 4,752
Anderson, N. L., & Anderson, N. G. (2002) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r200007-mcp200 · Cited by 4,414
TANDEM: matching proteins with tandem mass spectra
Craig, R., & Beavis, R. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth092 · Cited by 2,536
Direct analysis of protein complexes using mass spectrometry
Link, A. J., Eng, J., Schieltz, D. M., Carmack, E., Mize, G. J., Morris, D. R., Garvik, B. M., & Yates, J. R. (1999) · Nature Biotechnology · doi:10.1038/10890 · Cited by 2,237
Self-citationPeng, J., Elias, J. E., Thoreen, C. C., Licklider, L. J., & Gygi, S. P. (2003) · Journal of Proteome Research · doi:10.1021/pr025556v · Cited by 1,647
Rapid identification of proteins by peptide-mass fingerprinting
Pappin, D. J. C., Hojrup, P., & Bleasby, A. J. (1993) · Current Biology · doi:10.1016/0960-9822(93)90195-t · Cited by 1,615
Open Mass Spectrometry Search Algorithm
Geer, L. Y., Markey, S. P., Kowalak, J. A., Wagner, L., Xu, M., Maynard, D. M., Yang, X., Shi, W., & Bryant, S. H. (2004) · Journal of Proteome Research · doi:10.1021/pr0499491 · Cited by 1,431
Trypsin Cleaves Exclusively C-terminal to Arginine and Lysine Residues
Olsen, J. V., Ong, S.-E., & Mann, M. (2004) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t400003-mcp200 · Cited by 1,254
Anderson, N. L., Polanski, M., Pieper, R., Gatlin, T., Tirumalai, R. S., Conrads, T. P., Veenstra, T. D., Adkins, J. N., Pounds, J. G., Fagan, R., et al. (2004) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m300127-mcp200 · Cited by 1,006
Self-citationMobile and localized protons: a framework for understanding peptide dissociation
Wysocki, V. H., Tsaprailis, G., Smith, L. L., & Breci, L. A. (2000) · Journal of Mass Spectrometry · doi:10.1002/1096-9888(200012)35:12<1399::aid-jms86>3.0.co;2-r · Cited by 997
Toward a Human Blood Serum Proteome
Adkins, J. N., Varnum, S. M., Auberry, K. J., Moore, R. J., Angell, N. H., Smith, R. D., Springer, D. L., & Pounds, J. G. (2002) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m200066-mcp200 · Cited by 793
Self-citationA common open representation of mass spectrometry data and its application to proteomics research
Pedrioli, P. G. A., Eng, J. K., Hubley, R., Vogelzang, M., Deutsch, E. W., Raught, B., Pratt, B., Nilsson, E., Angeletti, R. H., Apweiler, R., et al. (2004) · Nature Biotechnology · doi:10.1038/nbt1031 · Cited by 780
Self-citationThe International Protein Index: An integrated database for proteomics experiments
Kersey, P. J., Duarte, J., Williams, A., Karavidopoulou, Y., Birney, E., & Apweiler, R. (2004) · PROTEOMICS · doi:10.1002/pmic.200300721 · Cited by 693
A method for reducing the time required to match protein sequences with tandem mass spectra
Craig, R., & Beavis, R. C. (2003) · Rapid Communications in Mass Spectrometry · doi:10.1002/rcm.1198 · Cited by 504
The Need for Guidelines in Publication of Peptide and Protein Identification Data
Carr, S., Aebersold, R., Baldwin, M., Burlingame, A., Clauser, K., & Nesvizhskii, A. (2004) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t400006-mcp200 · Cited by 499
Fenyö, D., & Beavis, R. C. (2003) · Analytical Chemistry · doi:10.1021/ac0258709 · Cited by 480
Keil, B. (1992) · Springer eBooks · doi:10.1007/978-3-642-48380-6 · Cited by 412
Sadygov, R. G., Cociorva, D., & Yates, J. R. (2004) · Nature Methods · doi:10.1038/nmeth725 · Cited by 408
Qian, W.-J., Liu, T., Monroe, M. E., Strittmatter, E. F., Jacobs, J. M., Kangas, L. J., Petritis, K., Camp, D. G., & Smith, R. D. (2005) · Journal of Proteome Research · doi:10.1021/pr0498638 · Cited by 317
Experimental Protein Mixture for Validating Tandem Mass Spectral Analysis
Keller, A., Purvine, S., Nesvizhskii, A. I., Stolyar, S., Goodlett, D. R., & Kolker, E. (2002) · OMICS: A Journal of Integrative Biology · doi:10.1089/153623102760092805 · Cited by 261
Kapp, E. A., Schütz, F., Reid, G. E., Eddes, J. S., Moritz, R. L., O'Hair, R. A. J., Speed, T. P., & Simpson, R. J. (2003) · Analytical Chemistry · doi:10.1021/ac034616t · Cited by 255
Self-citationProtein Identification by Mass Spectrometry
Baldwin, M. A. (2004) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r300012-mcp200 · Cited by 229
Improving Reproducibility and Sensitivity in Identifying Human Proteins by Shotgun Proteomics
Resing, K. A., Meyer-Arendt, K., Mendoza, A. M., Aveline-Wolf, L. D., Jonscher, K. R., Pierce, K. G., Old, W. M., Cheung, H. T., Russell, S., Wattawa, J. L., et al. (2004) · Analytical Chemistry · doi:10.1021/ac035229m · Cited by 228
Field, H. I., Fenyö, D., & Beavis, R. C. (2002) · PROTEOMICS · doi:10.1002/1615-9861(200201)2:1<36::aid-prot36>3.0.co;2-w · Cited by 217
Simpson, R. J., Connolly, L. M., Eddes, J. S., Pereira, J. J., Moritz, R. L., & Reid, G. E. (2000) · Electrophoresis · doi:10.1002/(sici)1522-2683(20000501)21:9<1707::aid-elps1707>3.0.co;2-q · Cited by 206
Self-citationPotential for False Positive Identifications from Large Databases through Tandem Mass Spectrometry
Cargile, B. J., Bundy, J. L., & Stephenson, J. L. (2004) · Journal of Proteome Research · doi:10.1021/pr049946o · Cited by 197
Improving large‐scale proteomics by clustering of mass spectrometry data
Beer, I., Barnea, E., Ziv, T., & Admon, A. (2004) · PROTEOMICS · doi:10.1002/pmic.200300652 · Cited by 183
Nesvizhskii, A. I., & Aebersold, R. (2004) · Drug Discovery Today · doi:10.1016/s1359-6446(03)02978-7 · Cited by 172
Tabb, D. L., MacCoss, M. J., Wu, C. C., Anderson, S. D., & Yates, J. R. (2003) · Analytical Chemistry · doi:10.1021/ac026424o · Cited by 163
Omenn, G. S. (2004) · PROTEOMICS · doi:10.1002/pmic.200300686 · Cited by 136
Self-citationMoritz, R. L., Ji, H., Schütz, F., Connolly, L., Kapp, E. A., Speed, T. P., & Simpson, R. J. (2004) · Analytical Chemistry · doi:10.1021/ac049717l · Cited by 111
Self-citationWhat to do with “one‐hit wonders”?
Veenstra, T. D., Conrads, T. P., & Issaq, H. J. (2004) · Electrophoresis · doi:10.1002/elps.200490007 · Cited by 68
Reid, G. E., Roberts, K. D., Kapp, E. A., & Simpson, R. J. (2004) · Journal of Proteome Research · doi:10.1021/pr0499646 · Cited by 67
Self-citation
Cited by
Shilov, I. V., Seymour, S. L., Patel, A. A., Loboda, A., Tang, W. H., Keating, S. P., Hunter, C. L., Nuwaysir, L. M., & Schaeffer, D. A. (2007) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t600050-mcp200 · Cited by 1,298
Zhang, J., Xin, L., Shan, B., Chen, W., Xie, M., Yuen, D., Zhang, W., Zhang, Z., Lajoie, G. A., & Ma, B. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.010587 · Cited by 1,081
Omenn, G. S., States, D. J., Adamski, M., Blackwell, T. W., Menon, R., Hermjakob, H., Apweiler, R., Haab, B. B., Simpson, R. J., Eddes, J. S., et al. (2005) · PROTEOMICS · doi:10.1002/pmic.200500358 · Cited by 787
Self-citationOpenMS – An open-source software framework for mass spectrometry
Sturm, M., Bertsch, A., Gröpl, C., Hildebrandt, A., Hussong, R., Lange, E., Pfeifer, N., Schulz-Trieglaff, O., Zerck, A., Reinert, K., et al. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-163 · Cited by 644
Analysis and validation of proteomic data generated by tandem mass spectrometry
Nesvizhskii, A. I., Vitek, O., & Aebersold, R. (2007) · Nature Methods · doi:10.1038/nmeth1088 · Cited by 629
Metadata
- Authors
- Kapp, E. A., Schütz, F., Connolly, L. M., Chakel, J. A., Meza, J. E., Miller, C. A., Fenyo, D., Eng, J. K., Adkins, J. N., Omenn, G. S., & Simpson, R. J.
- Venue
- PROTEOMICS
- Publisher
- Wiley
- Published
- 2005-08
- Volume
- 5
- Issue
- 13
- Pages
- 3475-3490
- ISSN
- 1615-9853 (ISSN-L)
- 1615-9861
- OpenAlex
- W2148632411
- Cited by
- 344
- References
- 37
- FWCI
- 15.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.