The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
An evaluation, comparison, and accurate benchmarking of several publicly available MS/MS search algorithms: Sensitivity and specificity analysis
Open accessAbstract
MS/MS and associated database search algorithms are essential proteomic tools for identifying peptides. Due to their widespread use, it is now time to perform a systematic analysis of the various algorithms currently in use. Using blood specimens used in the HUPO Plasma Proteome Project, we have evaluated five search algorithms with respect to their sensitivity and specificity, and have also accurately benchmarked them based on specified false‐positive (FP) rates. Spectrum Mill and SEQUEST performed well in terms of sensitivity, but were inferior to MASCOT, X!Tandem, and Sonar in terms of specificity. Overall, MASCOT, a probabilistic search algorithm, correctly identified most peptides based on a specified FP rate. The rescoring algorithm, PeptideProphet, enhanced the overall performance of the SEQUEST algorithm, as well as provided predictable FP error rates. Ideally, score thresholds should be calculated for each peptide spectrum or minimally, derived from a reversed‐sequence search as demonstrated in this study based on a validated data set. The availability of open‐source search algorithms, such as X!Tandem, makes it feasible to further improve the validation process (manual or automatic) on the basis of “consensus scoring”, i.e., the use of multiple (at least two) search algorithms to reduce the number of FPs.∁
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perkins, D. N., Pappin, D. J. C., Creasy, D. M., & Cottrell, J. S. (1999) · Electrophoresis · doi:10.1002/(sici)1522-2683(19991201)20:18<3551::aid-elps3551>3.0.co;2-2 · Cited by 8,203
Eng, J. K., McCormack, A. L., & Yates, J. R. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)80016-2 · Cited by 6,484
Self-citationKeller, A., Nesvizhskii, A. I., Kolker, E., & Aebersold, R. (2002) · Analytical Chemistry · doi:10.1021/ac025747h · Cited by 4,830
A Statistical Model for Identifying Proteins by Tandem Mass Spectrometry
Nesvizhskii, A. I., Keller, A., Kolker, E., & Aebersold, R. (2003) · Analytical Chemistry · doi:10.1021/ac0341261 · Cited by 4,809
Large-scale analysis of the yeast proteome by multidimensional protein identification technology
Washburn, M. P., Wolters, D., & Yates, J. R. (2001) · Nature Biotechnology · doi:10.1038/85686 · Cited by 4,752
Anderson, N. L., & Anderson, N. G. (2002) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r200007-mcp200 · Cited by 4,414
TANDEM: matching proteins with tandem mass spectra
Craig, R., & Beavis, R. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth092 · Cited by 2,536
Direct analysis of protein complexes using mass spectrometry
Link, A. J., Eng, J., Schieltz, D. M., Carmack, E., Mize, G. J., Morris, D. R., Garvik, B. M., & Yates, J. R. (1999) · Nature Biotechnology · doi:10.1038/10890 · Cited by 2,237
Self-citationPeng, J., Elias, J. E., Thoreen, C. C., Licklider, L. J., & Gygi, S. P. (2003) · Journal of Proteome Research · doi:10.1021/pr025556v · Cited by 1,647
Rapid identification of proteins by peptide-mass fingerprinting
Pappin, D. J. C., Hojrup, P., & Bleasby, A. J. (1993) · Current Biology · doi:10.1016/0960-9822(93)90195-t · Cited by 1,615
Cited by
Shilov, I. V., Seymour, S. L., Patel, A. A., Loboda, A., Tang, W. H., Keating, S. P., Hunter, C. L., Nuwaysir, L. M., & Schaeffer, D. A. (2007) · Molecular & Cellular Proteomics · doi:10.1074/mcp.t600050-mcp200 · Cited by 1,298
Zhang, J., Xin, L., Shan, B., Chen, W., Xie, M., Yuen, D., Zhang, W., Zhang, Z., Lajoie, G. A., & Ma, B. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.010587 · Cited by 1,081
Omenn, G. S., States, D. J., Adamski, M., Blackwell, T. W., Menon, R., Hermjakob, H., Apweiler, R., Haab, B. B., Simpson, R. J., Eddes, J. S., et al. (2005) · PROTEOMICS · doi:10.1002/pmic.200500358 · Cited by 787
Self-citationOpenMS – An open-source software framework for mass spectrometry
Sturm, M., Bertsch, A., Gröpl, C., Hildebrandt, A., Hussong, R., Lange, E., Pfeifer, N., Schulz-Trieglaff, O., Zerck, A., Reinert, K., et al. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-163 · Cited by 644
Analysis and validation of proteomic data generated by tandem mass spectrometry
Nesvizhskii, A. I., Vitek, O., & Aebersold, R. (2007) · Nature Methods · doi:10.1038/nmeth1088 · Cited by 629
Tabb, D. L., Vega-Montoto, L., Rudnick, P. A., Variyath, A. M., Ham, A.-J. L., Bunk, D. M., Kilpatrick, L. E., Billheimer, D. D., Blackman, R. K., Cardasis, H. L., et al. (2010) · Journal of Proteome Research · doi:10.1021/pr9006365 · Cited by 551
Lam, H., Deutsch, E. W., Eddes, J. S., Eng, J. K., King, N., Stein, S. E., & Aebersold, R. (2007) · PROTEOMICS · doi:10.1002/pmic.200600625 · Cited by 517
Self-citationNesvizhskii, A. I. (2010) · Journal of Proteomics · doi:10.1016/j.jprot.2010.08.009 · Cited by 536
Human body fluid proteome analysis
Hu, S., Loo, J. A., & Wong, D. T. (2006) · PROTEOMICS · doi:10.1002/pmic.200600284 · Cited by 533
ProLuCID: An improved SEQUEST-like algorithm with enhanced sensitivity and specificity
Xu, T., Park, S. K., Venable, J. D., Wohlschlegel, J. A., Diedrich, J. K., Cociorva, D., Lu, B., Liao, L., Hewel, J., Han, X., et al. (2015) · Journal of Proteomics · doi:10.1016/j.jprot.2015.07.001 · Cited by 511
Advances in structure elucidation of small molecules using mass spectrometry
Kind, T., & Fiehn, O. (2010) · Bioanalytical Reviews · doi:10.1007/s12566-010-0015-9 · Cited by 480
Quantitative Proteomic Analysis of Histone Modifications
Huang, H., Lin, S., Garcia, B. A., & Zhao, Y. (2015) · Chemical Reviews · doi:10.1021/cr500491u · Cited by 370
A HUPO test sample study reveals common problems in mass spectrometry–based proteomics
HUPO Test Sample Working Group, Bell, A. W., Deutsch, E. W., Au, C. E., Kearney, R. E., Beavis, R., Sechi, S., Nilsson, T., & Bergeron, J. J. M. (2009) · Nature Methods · doi:10.1038/nmeth.1333 · Cited by 351
Guidelines for the next 10 years of proteomics
Wilkins, M. R., Appel, R. D., Van Eyk, J. E., Chung, M. C. M., Görg, A., Hecker, M., Huber, L. A., Langen, H., Link, A. J., Paik, Y., et al. (2006) · PROTEOMICS · doi:10.1002/pmic.200500856 · Cited by 307
Self-citationSurvivin is released from cancer cells via exosomes
Khan, S., Jutzy, J. M. S., Aspe, J. R., McGregor, D. W., Neidigh, J. W., & Wall, N. R. (2011) · Apoptosis · doi:10.1007/s10495-010-0534-4 · Cited by 265
Identification of tumor antigens with immunopeptidomics
Chong, C., Coukos, G., & Bassani-Sternberg, M. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01038-8 · Cited by 232
JUMP: a tag-based database search tool for peptide identification with high sensitivity and accuracy
Wang, X., Li, Y., Wu, Z., Wang, H., Tan, H., & Peng, J. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.o114.039586 · Cited by 194
Manes, N. P., Estep, R. D., Mottaz, H. M., Moore, R. J., Clauss, T. R. W., Monroe, M. E., Du, X., Adkins, J. N., Wong, S. W., & Smith, R. D. (2008) · Journal of Proteome Research · doi:10.1021/pr070432+ · Cited by 103
Self-citationKellie, J. F., Tran, J. C., Lee, J. E., Ahlf, D. R., Thomas, H. M., Ntai, I., Catherman, A. D., Durbin, K. R., Zamdborg, L., Vellaichamy, A., et al. (2010) · Molecular BioSystems · doi:10.1039/c000896f · Cited by 99
Paleoproteomic study of the Iceman’s brain tissue
Maixner, F., Overath, T., Linke, D., Janko, M., Guerriero, G., van den Berg, B. H. J., Stade, B., Leidinger, P., Backes, C., Jaremek, M., et al. (2013) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-013-1360-y · Cited by 56
Systems approach to explore components and interactions in the presynapse
Abul‐Husn, N. S., Bushlin, I., Morón, J. A., Jenkins, S. L., Dolios, G., Wang, R., Iyengar, R., Ma'ayan, A., & Devi, L. A. (2009) · PROTEOMICS · doi:10.1002/pmic.200800767 · Cited by 53
Release of the cell envelope protease PrtS in the growth medium of Streptococcus thermophilus 4F44
Chang, O. K., Perrin, C., Galia, W., Saulnier, F., Miclo, L., Roux, E., Driou, A., Humbert, G., & Dary, A. (2012) · International Dairy Journal · doi:10.1016/j.idairyj.2011.10.014 · Cited by 31
Metadata
- Authors
- Kapp, E. A., Schütz, F., Connolly, L. M., Chakel, J. A., Meza, J. E., Miller, C. A., Fenyo, D., Eng, J. K., Adkins, J. N., Omenn, G. S., & Simpson, R. J.
- Venue
- PROTEOMICS
- Publisher
- Wiley
- Published
- 2005-08
- Volume
- 5
- Issue
- 13
- Pages
- 3475-3490
- ISSN
- 1615-9853 (ISSN-L)
- 1615-9861
- OpenAlex
- W2148632411
- Cited by
- 344
- References
- 37
- FWCI
- 15.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.