The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A Community Resource Benchmarking Predictions of Peptide Binding to MHC-I Molecules
Open accessAbstract
Recognition of peptides bound to major histocompatibility complex (MHC) class I molecules by T lymphocytes is an essential part of immune surveillance. Each MHC allele has a characteristic peptide binding preference, which can be captured in prediction algorithms, allowing for the rapid scan of entire pathogen proteomes for peptide likely to bind MHC. Here we make public a large set of 48,828 quantitative peptide-binding affinity measurements relating to 48 different mouse, human, macaque, and chimpanzee MHC class I alleles. We use this data to establish a set of benchmark predictions with one neural network method and two matrix-based prediction methods extensively utilized in our groups. In general, the neural network outperforms the matrix-based predictions mainly due to its ability to generalize even on a small amount of data. We also retrieved predictions from tools publicly available on the internet. While differences in the data used to generate these predictions hamper direct comparisons, we do conclude that tools based on combinatorial peptide libraries perform remarkably well. The transparent prediction evaluation on this dataset provides tool developers with a benchmark for comparison of newly developed prediction methods. In addition, to generate and evaluate our own prediction methods, we have established an easily extensible web-based prediction framework that allows automated side-by-side comparisons of prediction methods implemented by experts. This is an advance over the current practice of tool developers having to generate reference predictions themselves, which can lead to underestimating the performance of prediction methods they are not as familiar with as their own. The overall goal of this effort is to provide a transparent prediction evaluation allowing bioinformaticians to identify promising features of prediction methods and providing guidance to immunologists regarding the reliability of prediction tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
SYFPEITHI: database for MHC ligands and peptide motifs
Rammensee, H. G., Bachmann, J., Emmerich, N. P. N., Bachor, O. A., & Stevanović, S. (1999) · Immunogenetics · doi:10.1007/s002510050595 · Cited by 2,314
Parker, K. C., Bednarek, M. A., & Coligan, J. E. (1994) · The Journal of Immunology · doi:10.4049/jimmunol.152.1.163 · Cited by 1,370
Reliable prediction of T‐cell epitopes using neural networks with novel sequence representations
Nielsen, M., Lundegaard, C., Worning, P., Lauemøller, S. L., Lamberth, K., Buus, S., Brunak, S., & Lund, O. (2003) · Protein Science · doi:10.1110/ps.0239403 · Cited by 1,074
Self-citationSette, A., Vitiello, A., Reherman, B., Fowler, P., Nayersina, R., Kast, W. M., Melief, C. J. M., Oseroff, C., Yuan, L., Ruppert, J., et al. (1994) · The Journal of Immunology · doi:10.4049/jimmunol.153.12.5586 · Cited by 830
Self-citationPeters, B., & Sette, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-132 · Cited by 512
Self-citationNielsen, M., Lundegaard, C., Lund, O., & Keşmir, C. (2005) · Immunogenetics · doi:10.1007/s00251-005-0781-7 · Cited by 491
Self-citationProPred1: prediction of promiscuous MHC Class-I binding sites
Singh, H., & Raghava, G. P. S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg108 · Cited by 441
Shen, L., Sigal, L. J., Boes, M., & Rock, K. L. (2004) · Immunity · doi:10.1016/j.immuni.2004.07.004 · Cited by 391
Reche, P., Glutting, J.-P., Zhang, H., & Reinherz, E. (2004) · Immunogenetics · doi:10.1007/s00251-004-0709-7 · Cited by 386
The Immune Epitope Database and Analysis Resource: From Vision to Blueprint
Peters, B., Sidney, J., Bourne, P., Bui, H.-H., Buus, S., Doh, G., Fleri, W., Kronenberg, M., Kubo, R., Lund, O., et al. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030091 · Cited by 373
Self-citationTenzer, S., Peters, B., Bulik, S., Schoor, O., Lemmel, C., Schatz, M. M., Kloetzel, P.-M., Rammensee, H.-G., Schild, H., & Holzhütter, H.-G. (2005) · CMLS Cellular and Molecular Life Sciences · doi:10.1007/s00018-005-4528-2 · Cited by 349
Self-citationIdentifying MHC Class I Epitopes by Predicting the TAP Transport Efficiency of Epitope Precursors
Peters, B., Bulik, S., Tampe, R., van Endert, P. M., & Holzhütter, H.-G. (2003) · The Journal of Immunology · doi:10.4049/jimmunol.171.4.1741 · Cited by 339
Self-citationPrediction of MHC class I binding peptides, using SVMHC
Dönnes, P., & Elofsson, A. (2002) · BMC Bioinformatics · doi:10.1186/1471-2105-3-25 · Cited by 330
Buus, S., Lauemøller, S. L., Worning, P., Kesmir, C., Frimurer, T., Corbet, S., Fomsgaard, A., Hilden, J., Holm, A., & Brunak, S. (2003) · Tissue Antigens · doi:10.1034/j.1399-0039.2003.00112.x · Cited by 329
Self-citationLarsen, M. V., Lundegaard, C., Lamberth, K., Buus, S., Brunak, S., Lund, O., & Nielsen, M. (2005) · European Journal of Immunology · doi:10.1002/eji.200425811 · Cited by 313
Self-citationProducing Nature’s Gene-Chips: The Generation of Peptides for Display by MHC Class I Molecules
Shastri, N., Schwab, S., & Serwold, T. (2002) · Annual Review of Immunology · doi:10.1146/annurev.immunol.20.100301.064819 · Cited by 305
Prediction of proteasome cleavage motifs by neural networks
Keşmir, C., Nussbaum, A. K., Schild, H., Detours, V., & Brunak, S. (2002) · Protein Engineering, Design and Selection · doi:10.1093/protein/15.4.287 · Cited by 282
Improved prediction of MHC class I and class II epitopes using a novel Gibbs sampling approach
Nielsen, M., Lundegaard, C., Worning, P., Hvid, C. S., Lamberth, K., Buus, S., Brunak, S., & Lund, O. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth100 · Cited by 278
Self-citationBui, H.-H., Sidney, J., Peters, B., Sathiamurthy, M., Sinichi, A., Purton, K.-A., Mothé, B. R., Chisari, F. V., Watkins, D. I., & Sette, A. (2005) · Immunogenetics · doi:10.1007/s00251-005-0798-y · Cited by 263
Self-citationTwo complementary methods for predicting peptides binding major histocompatibility complex molecules
Gulukota, K., Sidney, J., Sette, A., & DeLisi, C. (1997) · Journal of Molecular Biology · doi:10.1006/jmbi.1997.0937 · Cited by 259
Self-citationAn essential role for tripeptidyl peptidase in the generation of an MHC class I epitope
Seifert, U., Marañón, C., Shmueli, A., Desoutter, J.-F., Wesoloski, L., Janek, K., Henklein, P., Diescher, S., Andrieu, M., de la Salle, H., et al. (2003) · Nature Immunology · doi:10.1038/ni905 · Cited by 232
Tumors as elusive targets of T-cell-based active immunotherapy
Marincola, F. M., Wang, E., Herlyn, M., Seliger, B., & Ferrone, S. (2003) · Trends in Immunology · doi:10.1016/s1471-4906(03)00116-9 · Cited by 202
MHCBN: a comprehensive database of MHC binding and non-binding peptides
Bhasin, M., Singh, H., & Raghava, G. P. S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg055 · Cited by 201
PAProC: a prediction algorithm for proteasomal cleavages available on the WWW
Nussbaum, A. K., Kuttler, C., Hadeler, K.-P., Rammensee, H.-G., & Schild, H. (2001) · Immunogenetics · doi:10.1007/s002510100300 · Cited by 190
Toseland, C. P., Clayton, D. J., McSparron, H., Hemsley, S. L., Blythe, M., Paine, K., Doytchinova, I. A., Guan, P., Hattotuwagama, C. K., & Flower, D. R. (2005) · Immunome Research · doi:10.1186/1745-7580-1-4 · Cited by 182
SVM based method for predicting HLA-DRB1*0401 binding peptides in an antigen sequence
Bhasin, M., & Raghava, G. P. S. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg424 · Cited by 162
Measurement of MHC/Peptide Interactions by Gel Filtration
Sidney, J., Southwood, S., Oseroff, C., del Guercio, M., Sette, A., & Grey, H. M. (1999) · Current Protocols in Immunology · doi:10.1002/0471142735.im1803s31 · Cited by 152
Self-citationMULTIPRED: a computational system for prediction of promiscuous HLA binding peptides
Zhang, G. L., Khan, A. M., Srinivasan, K. N., August, J. T., & Brusić, V. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki452 · Cited by 141
Methods for Prediction of Peptide Binding to MHC Molecules: A Comparative Study
Yu, K., Petrovsky, N., Schönbach, C., Koh, J. L. Y., & Brusić, V. (2002) · Molecular Medicine · doi:10.1007/bf03402006 · Cited by 137
Examining the independent binding assumption for binding of peptide epitopes to MHC-I molecules
Peters, B., Tong, W., Sidney, J., Sette, A., & Weng, Z. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg247 · Cited by 128
Self-citationThe design and implementation of the immune epitope database and analysis resource
Peters, B., Sidney, J., Bourne, P. E., Bui, H., Buus, S., Doh, G., Fleri, W., Kronenberg, M., Kubo, R. T., Lund, O., et al. (2005) · Immunogenetics · doi:10.1007/s00251-005-0803-5 · Cited by 120
Self-citationMAPPP: MHC class I antigenic peptide processing prediction.
Hakenberg, J., Nussbaum, A. K., Schild, H., et al. (2003) · PubMed · Cited by 111
Establishment of a quantitative ELISA capable of determining peptide – MHC class I interaction
Sylvester‐Hvid, C., Kristensen, N. N., Blicher, T. H., Ferré, H., Lauemøller, S. L., Wolf, X., Lamberth, K., Nissen, M. H., Pedersen, L. Ø., & Buus, S. (2002) · Tissue Antigens · doi:10.1034/j.1399-0039.2002.590402.x · Cited by 93
Self-citationUdaka, K., Wiesmüller, K., Kienle, S., Jung, G., Tamamura, H., Yamagishi, H., Okumura, K., Walden, P., Suto, T., & Kawasaki, T. (2000) · Immunogenetics · doi:10.1007/s002510000217 · Cited by 82
D, A. G. M., & Barrett, R. W. (1987) · Molecular Pharmacology · doi:10.1016/s0026-895x(25)10476-8 · Cited by 70
TAP-independent antigen presentation on MHC class I molecules: lessons from Epstein–Barr virus
Lautscham, G., Rickinson, A. B., & BLAKE, N. W. (2003) · Microbes and Infection · doi:10.1016/s1286-4579(03)00031-5 · Cited by 63
Population of the HLA Ligand Database
Sathiamurthy, M., Hickman, H. D., Cavett, J. W., Zahoor, A. F., Prilliman, K. R., Metcalf, S., Fernández-Viña, M., & Hildebrand, W. H. (2003) · Tissue Antigens · doi:10.1034/j.1399-0039.2003.610102.x · Cited by 54
A Neural Network Model Approach to the Study of Human TAP Transporter
Brusić, V., Endert, P. V., Zeleznikow, J., Daniel, S., Hammer, J., & Petrovsky, N. (1999) · In Silico Biology · doi:10.3233/isb-00010 · Cited by 52
Simultaneous Prediction of Binding Capacity for Multiple Molecules of the HLA B44 Supertype
Sidney, J., Southwood, S., Pasquetto, V., & Sette, A. (2003) · The Journal of Immunology · doi:10.4049/jimmunol.171.11.5964 · Cited by 49
Self-citationSidney, J., Southwood, S., & Sette, A. (2005) · Immunogenetics · doi:10.1007/s00251-005-0004-2 · Cited by 45
Self-citationHertz, T., & Yanover, C. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-s1-s3 · Cited by 35
Remnant Epitopes Generate Autoimmunity: From Rheumatoid Arthritis and Multiple Sclerosis to Diabetes
Descamps, F. J., den Steen, P. E. V., Nelissen, I., Damme, J. V., & Opdenakker, G. (2003) · Advances in experimental medicine and biology · doi:10.1007/978-1-4615-0065-0_5 · Cited by 34
The immune epitope database and analysis resource: from vision to blueprint.
Sette, A. (2004) · PubMed · Cited by 22
Self-citationHattotuwagama, C. K., Doytchinova, I. A., & Flower, D. R. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049667l · Cited by 14
Proteasomes Get By with Lots of Help from Their Friends
Yewdell, J. W., & Princiotta, M. F. (2004) · Immunity · doi:10.1016/s1074-7613(04)00086-x · Cited by 10
Cited by
Gapped sequence alignment using artificial neural networks: application to the MHC class I system
Andreatta, M., & Nielsen, M. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv639 · Cited by 1,087
Self-citationLarge-scale validation of methods for cytotoxic T-lymphocyte epitope prediction
Larsen, M. V., Lundegaard, C., Lamberth, K., Buus, S., Lund, O., & Nielsen, M. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-424 · Cited by 982
Self-citationProperties of MHC Class I Presented Peptides That Enhance Immunogenicity
Calis, J. J. A., Maybeno, M., Greenbaum, J. A., Weiskopf, D., De Silva, A. D., Sette, A., Keşmir, C., & Peters, B. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003266 · Cited by 923
Self-citationMore than one reason to rethink the use of peptides in vaccine design
Purcell, A. W., McCluskey, J., & Rossjohn, J. (2007) · Nature Reviews Drug Discovery · doi:10.1038/nrd2224 · Cited by 860
Wang, P., Sidney, J., Dow, C., Mothé, B., Sette, A., & Peters, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000048 · Cited by 844
Self-citation
Metadata
- Authors
- Peters, B., Bui, H.-H., Frankild, S., Nielsen, M., Lundegaard, C., Kostem, E., Basch, D., Lamberth, K., Harndahl, M., Fleri, W., Wilson, S. S., Sidney, J., Lund, O., Buus, S., & Sette, A.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2006-06-09
- Volume
- 2
- Issue
- 6
- Pages
- e65
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2094706980
- Cited by
- 288
- References
- 46
- FWCI
- 11.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.