The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A Systematic Assessment of MHC Class II Peptide Binding Predictions and Evaluation of a Consensus Approach
Open accessAbstract
The identification of MHC class II restricted peptide epitopes is an important goal in immunological research. A number of computational tools have been developed for this purpose, but there is a lack of large-scale systematic evaluation of their performance. Herein, we used a comprehensive dataset consisting of more than 10,000 previously unpublished MHC-peptide binding affinities, 29 peptide/MHC crystal structures, and 664 peptides experimentally tested for CD4+ T cell responses to systematically evaluate the performances of publicly available MHC class II binding prediction tools. While in selected instances the best tools were associated with AUC values up to 0.86, in general, class II predictions did not perform as well as historically noted for class I predictions. It appears that the ability of MHC class II molecules to bind variable length peptides, which requires the correct assignment of peptide binding cores, is a critical factor limiting the performance of existing prediction tools. To improve performance, we implemented a consensus prediction approach that combines methods with top performances. We show that this consensus approach achieved best overall performance. Finally, we make the large datasets used publicly available as a benchmark to facilitate further development of MHC class II binding peptide prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Dranoff, G., Jaffee, E., Lazenby, A., Golumbek, P., Levitsky, H., Brose, K., Jackson, V, Hamada, H., Pardoll, D., & Mulligan, R. C. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.8.3539 · Cited by 2,818
SYFPEITHI: database for MHC ligands and peptide motifs
Rammensee, H. G., Bachmann, J., Emmerich, N. P. N., Bachor, O. A., & Stevanović, S. (1999) · Immunogenetics · doi:10.1007/s002510050595 · Cited by 2,314
Vigorous HIV-1-Specific CD4 + T Cell Responses Associated with Control of Viremia
Rosenberg, E. S., Billingsley, J. M., Caliendo, A. M., Boswell, S. L., Sax, P. E., Kalams, S. A., & Walker, B. D. (1997) · Science · doi:10.1126/science.278.5342.1447 · Cited by 1,835
Stern, L. J., Brown, J. H., Jardetzky, T. S., Gorga, J. C., Urban, R. G., Strominger, J. L., & Wiley, D. C. (1994) · Nature · doi:10.1038/368215a0 · Cited by 1,555
Germain, R. N. (1994) · Cell · doi:10.1016/0092-8674(94)90336-0 · Cited by 1,434
HOW TCRS BIND MHCS, PEPTIDES, AND CORECEPTORS
Rudolph, M. G., Stanfield, R. L., & Wilson, I. A. (2006) · Annual Review of Immunology · doi:10.1146/annurev.immunol.23.021704.115658 · Cited by 1,310
Chambers, C. A., Kuhns, M. S., Egen, J. G., & Allison, J. P. (2001) · Annual Review of Immunology · doi:10.1146/annurev.immunol.19.1.565 · Cited by 998
ProPred: prediction of HLA-DR binding sites
Singh, H., & Raghava, G. P. S. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.12.1236 · Cited by 841
Assembly, Transport, and Function of MHC Class II Molecules
Cresswell, P. (1994) · Annual Review of Immunology · doi:10.1146/annurev.immunol.12.1.259 · Cited by 807
Sturniolo, T., Bono, E., Ding, J., Raddrizzani, L., Tuereci, O., Sahin, U., Braxenthaler, M., Gallazzi, F., Protti, M. P., Sinigaglia, F., et al. (1999) · Nature Biotechnology · doi:10.1038/9858 · Cited by 743
Nielsen, M., Lundegaard, C., & Lund, O. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-238 · Cited by 594
Signal Transduction Mediated by the T Cell Antigen Receptor: The Role of Adapter Proteins
Samelson, L. E. (2002) · Annual Review of Immunology · doi:10.1146/annurev.immunol.20.092601.111357 · Cited by 573
Moutaftsi, M., Peters, B., Pasquetto, V., Tscharke, D. C., Sidney, J., Bui, H.-H., Grey, H., & Sette, A. (2006) · Nature Biotechnology · doi:10.1038/nbt1215 · Cited by 557
Self-citationIn Vivo Activation of Antigen-Specific CD4 T Cells
Jenkins, M. K., Khoruts, A., Ingulli, E., Mueller, D. L., McSorley, S. J., Reinhardt, R. L., Itano, A., & Pape, K. A. (2001) · Annual Review of Immunology · doi:10.1146/annurev.immunol.19.1.23 · Cited by 512
Peters, B., & Sette, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-132 · Cited by 512
Self-citationMolecular Interactions Mediating T Cell Antigen Recognition
Merwe, P. A. V. D., & Davis, S. J. (2003) · Annual Review of Immunology · doi:10.1146/annurev.immunol.21.120601.141036 · Cited by 501
MHC class II proteins and disease: a structural perspective
Jones, E. Y., Fugger, L., Strominger, J. L., & Siebold, C. (2006) · Nature Reviews Immunology · doi:10.1038/nri1805 · Cited by 411
Reche, P., Glutting, J.-P., Zhang, H., & Reinherz, E. (2004) · Immunogenetics · doi:10.1007/s00251-004-0709-7 · Cited by 386
Prediction of MHC class I binding peptides using profile motifs
Reche, P. A., Glutting, J.-P., & Reinherz, E. L. (2002) · Human Immunology · doi:10.1016/s0198-8859(02)00432-9 · Cited by 375
The Immune Epitope Database and Analysis Resource: From Vision to Blueprint
Peters, B., Sidney, J., Bourne, P., Bui, H.-H., Buus, S., Doh, G., Fleri, W., Kronenberg, M., Kubo, R., Lund, O., et al. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030091 · Cited by 373
Self-citationSette, A., Buus, S., Colon, S., Smith, J. A., Miles, C., & Grey, H. M. (1987) · Nature · doi:10.1038/328395a0 · Cited by 364
Self-citationBrusic, V, Rudy, G., Honeyman, G., Hammer, J., & Harrison, L. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.2.121 · Cited by 292
Hammer, J., Bono, E., Gallazzi, F., Belunis, C., Nagy, Z., & Sinigaglia, F. (1994) · The Journal of experimental medicine · doi:10.1084/jem.180.6.2353 · Cited by 290
A Community Resource Benchmarking Predictions of Peptide Binding to MHC-I Molecules
Peters, B., Bui, H.-H., Frankild, S., Nielsen, M., Lundegaard, C., Kostem, E., Basch, D., Lamberth, K., Harndahl, M., Fleri, W., et al. (2006) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020065 · Cited by 288
Self-citationT Cell Activation and the Cytoskeleton
Acuto, O., & Cantrell, D. (2000) · Annual Review of Immunology · doi:10.1146/annurev.immunol.18.1.165 · Cited by 264
Bui, H.-H., Sidney, J., Peters, B., Sathiamurthy, M., Sinichi, A., Purton, K.-A., Mothé, B. R., Chisari, F. V., Watkins, D. I., & Sette, A. (2005) · Immunogenetics · doi:10.1007/s00251-005-0798-y · Cited by 263
Self-citationMHCPred: a server for quantitative prediction of peptide-MHC binding
Guan, P. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg510 · Cited by 260
Identification of Plasmodium falciparum antigens by antigenic analysis of genomic and proteomic data
Doolan, D. L., Southwood, S., Freilich, D. A., Sidney, J., Graber, N. L., Shatney, L., Bebris, L., Florens, L., Dobano, C., Witney, A. A., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1633254100 · Cited by 237
Self-citationMHCBN: a comprehensive database of MHC binding and non-binding peptides
Bhasin, M., Singh, H., & Raghava, G. P. S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg055 · Cited by 201
Toseland, C. P., Clayton, D. J., McSparron, H., Hemsley, S. L., Blythe, M., Paine, K., Doytchinova, I. A., Guan, P., Hattotuwagama, C. K., & Flower, D. R. (2005) · Immunome Research · doi:10.1186/1745-7580-1-4 · Cited by 182
Neural network-based prediction of candidate T-cell epitopes
Honeyman, M. C., Brusic, V., Stone, N. L., & Harrison, L. C. (1998) · Nature Biotechnology · doi:10.1038/nbt1098-966 · Cited by 176
Rationally Engineered Therapeutic Proteins with Reduced Immunogenicity
Tangri, S., Mothé, B. R., Eisenbraun, J., Sidney, J., Southwood, S., Briggs, K., Zinckgraf, J., Bilsel, P., Newman, M., Chesnut, R., et al. (2005) · The Journal of Immunology · doi:10.4049/jimmunol.174.6.3187 · Cited by 169
Self-citationSVM based method for predicting HLA-DRB1*0401 binding peptides in an antigen sequence
Bhasin, M., & Raghava, G. P. S. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg424 · Cited by 162
Measurement of MHC/Peptide Interactions by Gel Filtration
Sidney, J., Southwood, S., Oseroff, C., del Guercio, M., Sette, A., & Grey, H. M. (1999) · Current Protocols in Immunology · doi:10.1002/0471142735.im1803s31 · Cited by 152
Self-citationMULTIPRED: a computational system for prediction of promiscuous HLA binding peptides
Zhang, G. L., Khan, A. M., Srinivasan, K. N., August, J. T., & Brusić, V. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki452 · Cited by 141
Godkin, A. J., Smith, K. J., Willis, A., Tejada-Simon, M. V., Zhang, J., Elliott, T. J., & Hill, A. V. S. (2001) · The Journal of Immunology · doi:10.4049/jimmunol.166.11.6720 · Cited by 125
Assessment of progress over the CASP experiments
Venclovas, ?., Zemla, A. T., Fidelis, K. A., & Moult, J. (2003) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.10530 · Cited by 116
Consogno, G., Manici, S., Facchinetti, V., Bachi, A., Hammer, J., Conti‐Fine, B. M., Rugarli, C., Traversari, C., & Protti, M. P. (2003) · Blood · doi:10.1182/blood-2002-03-0933 · Cited by 103
SVRMHC prediction server for MHC-binding peptides
Wan, J., Liu, W., Xu, Q., Ren, Y., Flower, D. R., & Li, T. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-463 · Cited by 100
Zhu, Y., Rudensky, A. Y., Corper, A. L., Teyton, L., & Wilson, I. A. (2003) · Journal of Molecular Biology · doi:10.1016/s0022-2836(02)01437-7 · Cited by 97
Establishment of a quantitative ELISA capable of determining peptide – MHC class I interaction
Sylvester‐Hvid, C., Kristensen, N. N., Blicher, T. H., Ferré, H., Lauemøller, S. L., Wolf, X., Lamberth, K., Nissen, M. H., Pedersen, L. Ø., & Buus, S. (2002) · Tissue Antigens · doi:10.1034/j.1399-0039.2002.590402.x · Cited by 93
Hidden Markov model-based prediction of antigenic peptides that interact with MHC class II molecules
Noguchi, H., Kato, R., Hanai, T., et al. (2002) · Journal of Bioscience and Bioengineering · doi:10.1016/s1389-1723(02)80160-8 · Cited by 90
Gowthaman, U., & Agrewala, J. N. (2007) · Journal of Proteome Research · doi:10.1021/pr070527b · Cited by 90
SVMHC: a server for prediction of MHC-binding peptides
Dönnes, P., & Kohlbacher, O. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkl284 · Cited by 88
Prediction of peptide affinity to HLA DRB1*0401.
Marshall, K. W., Wilson, K. J., Liang, J., Woods, A., Zaller, D. M., & Rothbard, J. B. (1995) · The Journal of Immunology · doi:10.4049/jimmunol.154.11.5927 · Cited by 74
FIMM, a database of functional molecular immunology
Schönbach, C. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.222 · Cited by 70
Integrating epitope data into the emerging web of biomedical knowledge resources
Peters, B., & Sette, A. (2007) · Nature reviews. Immunology · doi:10.1038/nri2092 · Cited by 63
Self-citationHuman CD4+ T Cell Epitopes from Vaccinia Virus Induced by Vaccination or Infection
Calvo‐Calle, J. M., Strug, I., Nastke, M.-D., Baker, S. P., & Stern, L. J. (2007) · PLoS Pathogens · doi:10.1371/journal.ppat.0030144 · Cited by 56
Population of the HLA Ligand Database
Sathiamurthy, M., Hickman, H. D., Cavett, J. W., Zahoor, A. F., Prilliman, K. R., Metcalf, S., Fernández-Viña, M., & Hildebrand, W. H. (2003) · Tissue Antigens · doi:10.1034/j.1399-0039.2003.610102.x · Cited by 54
Sidney, J., del Guercio, M., Southwood, S., & Sette, A. (2002) · The Journal of Immunology · doi:10.4049/jimmunol.169.9.5098 · Cited by 50
Self-citationPredictive Bayesian neural network models of MHC class II peptide binding
Burden, F. R., & Winkler, D. A. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.03.001 · Cited by 36
Hertz, T., & Yanover, C. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-s1-s3 · Cited by 35
Cited by
Improved methods for predicting peptide binding affinity to MHC class II molecules
Jensen, K. K., Andreatta, M., Marcatili, P., Buus, S., Greenbaum, J. A., Yan, Z., Sette, A., Peters, B., & Nielsen, M. (2018) · Immunology · doi:10.1111/imm.12889 · Cited by 794
Self-citationPeptide binding predictions for HLA DR, DP and DQ molecules
Wang, P., Sidney, J., Kim, Y., Sette, A., Lund, O., Nielsen, M., & Peters, B. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-568 · Cited by 681
Self-citationFundamentals and Methods for T- and B-Cell Epitope Prediction
Sanchez-Trincado, J. L., Gomez-Perosanz, M., & Reche, P. A. (2017) · Journal of Immunology Research · doi:10.1155/2017/2680160 · Cited by 674
Reverse Vaccinology: Developing Vaccines in the Era of Genomics
Sette, A., & Rappuoli, R. (2010) · Immunity · doi:10.1016/j.immuni.2010.09.017 · Cited by 559
Self-citationNielsen, M., & Lund, O. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-296 · Cited by 510
Metadata
- Authors
- Wang, P., Sidney, J., Dow, C., Mothé, B., Sette, A., & Peters, B.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-04-04
- Volume
- 4
- Issue
- 4
- Pages
- e1000048
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2100350770
- Cited by
- 844
- References
- 55
- FWCI
- 12.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.