The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A Systematic Assessment of MHC Class II Peptide Binding Predictions and Evaluation of a Consensus Approach
Open accessAbstract
The identification of MHC class II restricted peptide epitopes is an important goal in immunological research. A number of computational tools have been developed for this purpose, but there is a lack of large-scale systematic evaluation of their performance. Herein, we used a comprehensive dataset consisting of more than 10,000 previously unpublished MHC-peptide binding affinities, 29 peptide/MHC crystal structures, and 664 peptides experimentally tested for CD4+ T cell responses to systematically evaluate the performances of publicly available MHC class II binding prediction tools. While in selected instances the best tools were associated with AUC values up to 0.86, in general, class II predictions did not perform as well as historically noted for class I predictions. It appears that the ability of MHC class II molecules to bind variable length peptides, which requires the correct assignment of peptide binding cores, is a critical factor limiting the performance of existing prediction tools. To improve performance, we implemented a consensus prediction approach that combines methods with top performances. We show that this consensus approach achieved best overall performance. Finally, we make the large datasets used publicly available as a benchmark to facilitate further development of MHC class II binding peptide prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Dranoff, G., Jaffee, E., Lazenby, A., Golumbek, P., Levitsky, H., Brose, K., Jackson, V, Hamada, H., Pardoll, D., & Mulligan, R. C. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.8.3539 · Cited by 2,818
SYFPEITHI: database for MHC ligands and peptide motifs
Rammensee, H. G., Bachmann, J., Emmerich, N. P. N., Bachor, O. A., & Stevanović, S. (1999) · Immunogenetics · doi:10.1007/s002510050595 · Cited by 2,314
Vigorous HIV-1-Specific CD4 + T Cell Responses Associated with Control of Viremia
Rosenberg, E. S., Billingsley, J. M., Caliendo, A. M., Boswell, S. L., Sax, P. E., Kalams, S. A., & Walker, B. D. (1997) · Science · doi:10.1126/science.278.5342.1447 · Cited by 1,835
Stern, L. J., Brown, J. H., Jardetzky, T. S., Gorga, J. C., Urban, R. G., Strominger, J. L., & Wiley, D. C. (1994) · Nature · doi:10.1038/368215a0 · Cited by 1,555
Germain, R. N. (1994) · Cell · doi:10.1016/0092-8674(94)90336-0 · Cited by 1,434
HOW TCRS BIND MHCS, PEPTIDES, AND CORECEPTORS
Rudolph, M. G., Stanfield, R. L., & Wilson, I. A. (2006) · Annual Review of Immunology · doi:10.1146/annurev.immunol.23.021704.115658 · Cited by 1,310
Chambers, C. A., Kuhns, M. S., Egen, J. G., & Allison, J. P. (2001) · Annual Review of Immunology · doi:10.1146/annurev.immunol.19.1.565 · Cited by 998
Cited by
Improved methods for predicting peptide binding affinity to MHC class II molecules
Jensen, K. K., Andreatta, M., Marcatili, P., Buus, S., Greenbaum, J. A., Yan, Z., Sette, A., Peters, B., & Nielsen, M. (2018) · Immunology · doi:10.1111/imm.12889 · Cited by 794
Self-citationPeptide binding predictions for HLA DR, DP and DQ molecules
Wang, P., Sidney, J., Kim, Y., Sette, A., Lund, O., Nielsen, M., & Peters, B. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-568 · Cited by 681
Self-citationFundamentals and Methods for T- and B-Cell Epitope Prediction
Sanchez-Trincado, J. L., Gomez-Perosanz, M., & Reche, P. A. (2017) · Journal of Immunology Research · doi:10.1155/2017/2680160 · Cited by 674
Reverse Vaccinology: Developing Vaccines in the Era of Genomics
Sette, A., & Rappuoli, R. (2010) · Immunity · doi:10.1016/j.immuni.2010.09.017 · Cited by 559
Self-citationNielsen, M., & Lund, O. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-296 · Cited by 510
The Immune Epitope Database and Analysis Resource in Epitope Discovery and Synthetic Vaccine Design
Fleri, W., Paul, S., Dhanda, S. K., Mahajan, S., Xu, X., Peters, B., & Sette, A. (2017) · Frontiers in Immunology · doi:10.3389/fimmu.2017.00278 · Cited by 500
Self-citationJiménez-Sánchez, A., Memon, D., Pourpe, S., Veeraraghavan, H., Li, Y., Vargas, H. A., Gill, M. B., Park, K. J., Zivanovic, O., Konner, J., et al. (2017) · Cell · doi:10.1016/j.cell.2017.07.025 · Cited by 458
An overview of bioinformatics tools for epitope prediction: Implications on vaccine development
Soria-Guerra, R. E., Nieto-Gomez, R., Govea-Alonso, D. O., & Rosales-Mendoza, S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.003 · Cited by 445
Association of the Autoimmune Disease Scleroderma with an Immunologic Response to Cancer
Joseph, C. G., Darrah, E., Shah, A. A., Skora, A. D., Casciola-Rosen, L. A., Wigley, F. M., Boin, F., Fava, A., Thoburn, C., Kinde, I., et al. (2014) · Science · doi:10.1126/science.1246886 · Cited by 436
NetMHCcons: a consensus method for the major histocompatibility complex class I predictions
Karosiene, E., Lundegaard, C., Lund, O., & Nielsen, M. (2012) · Immunogenetics · doi:10.1007/s00251-011-0579-8 · Cited by 396
Stevanović, S., Pasetto, A., Helman, S. R., Gartner, J. J., Prickett, T. D., Howie, B., Robins, H. S., Robbins, P. F., Klebanoff, C. A., Rosenberg, S. A., et al. (2017) · Science · doi:10.1126/science.aak9510 · Cited by 383
SARS-CoV-2 human T cell epitopes: Adaptive immune response against COVID-19
Grifoni, A., Sidney, J., Vita, R., Peters, B., Crotty, S., Weiskopf, D., & Sette, A. (2021) · Cell Host & Microbe · doi:10.1016/j.chom.2021.05.010 · Cited by 314
Self-citationWatson, D. S., Endsley, A. N., & Huang, L. (2012) · Vaccine · doi:10.1016/j.vaccine.2012.01.070 · Cited by 322
Weiskopf, D., Bangs, D. J., Sidney, J., Kolla, R. V., De Silva, A. D., de Silva, A. M., Crotty, S., Peters, B., & Sette, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1505956112 · Cited by 303
Self-citationCross-reactive CD4 + T cells enhance SARS-CoV-2 immune responses upon infection and vaccination
Loyal, L., Braun, J., Henze, L., Kruse, B., Dingeldey, M., Reimer, U., Kern, F., Schwarz, T., Mangold, M., Unger, C., et al. (2021) · Science · doi:10.1126/science.abh1823 · Cited by 297
TepiTool: A Pipeline for Computational Prediction of T Cell Epitope Candidates
Paul, S., Sidney, J., Sette, A., & Peters, B. (2016) · Current Protocols in Immunology · doi:10.1002/cpim.12 · Cited by 274
Self-citationT-cell dependent immunogenicity of protein therapeutics: Preclinical assessment and mitigation
Jawa, V., Cousens, L. P., Awwad, M., Wakshull, E., Kropshofer, H., & De Groot, A. S. (2013) · Clinical Immunology · doi:10.1016/j.clim.2013.09.006 · Cited by 270
Computational genomics tools for dissecting tumour–immune cell interactions
Hackl, H., Charoentong, P., Finotello, F., & Trajanoski, Z. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.67 · Cited by 270
Peters, B., Nielsen, M., & Sette, A. (2020) · Annual Review of Immunology · doi:10.1146/annurev-immunol-082119-124838 · Cited by 270
Self-citationImmunogenicity assessment during the development of protein therapeutics
Rosenberg, A. S., & Sauna, Z. E. (2018) · Journal of Pharmacy and Pharmacology · doi:10.1111/jphp.12810 · Cited by 131
Evaluating and mitigating the immunogenicity of therapeutic proteins
Sauna, Z. E., Lagassé, D., Pedras-Vasconcelos, J., Golding, B., & Rosenberg, A. S. (2018) · Trends in biotechnology · doi:10.1016/j.tibtech.2018.05.008 · Cited by 118
Peptide-based vaccine for cancer therapies
Buonaguro, L., & Tagliamonte, M. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1210044 · Cited by 110
Weiskopf, D., Angelo, M. A., Sidney, J., Peters, B., Shresta, S., & Sette, A. (2014) · Journal of Virology · doi:10.1128/jvi.01108-14 · Cited by 90
Self-citationChen, X., Hickling, T., & Vicini, P. (2014) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2014.31 · Cited by 49
Humanization of antibodies using a statistical inference approach
Clavero-Álvarez, A., Di Mambro, T., Perez-Gaviro, S., Magnani, M., & Bruscolini, P. (2018) · Scientific Reports · doi:10.1038/s41598-018-32986-y · Cited by 47
Kumar, S., Mitchell, M. A., Rup, B., & Singh, S. K. (2012) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.23169 · Cited by 33
Azam, A., Mallart, S., Illiano, S., Duclos, O., Prades, C., & Maillère, B. (2021) · Frontiers in Immunology · doi:10.3389/fimmu.2021.637963 · Cited by 22
Garzon, T., Ortega-Tirado, D., Lopez-Romero, G., Alday, E., Robles-Zepeda, R. E., Garibay-Escobar, A., & Velazquez, C. (2021) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2021.769446 · Cited by 14
Metadata
- Authors
- Wang, P., Sidney, J., Dow, C., Mothé, B., Sette, A., & Peters, B.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-04-04
- Volume
- 4
- Issue
- 4
- Pages
- e1000048
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2100350770
- Cited by
- 844
- References
- 55
- FWCI
- 12.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.