The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A Community Resource Benchmarking Predictions of Peptide Binding to MHC-I Molecules
Open accessAbstract
Recognition of peptides bound to major histocompatibility complex (MHC) class I molecules by T lymphocytes is an essential part of immune surveillance. Each MHC allele has a characteristic peptide binding preference, which can be captured in prediction algorithms, allowing for the rapid scan of entire pathogen proteomes for peptide likely to bind MHC. Here we make public a large set of 48,828 quantitative peptide-binding affinity measurements relating to 48 different mouse, human, macaque, and chimpanzee MHC class I alleles. We use this data to establish a set of benchmark predictions with one neural network method and two matrix-based prediction methods extensively utilized in our groups. In general, the neural network outperforms the matrix-based predictions mainly due to its ability to generalize even on a small amount of data. We also retrieved predictions from tools publicly available on the internet. While differences in the data used to generate these predictions hamper direct comparisons, we do conclude that tools based on combinatorial peptide libraries perform remarkably well. The transparent prediction evaluation on this dataset provides tool developers with a benchmark for comparison of newly developed prediction methods. In addition, to generate and evaluate our own prediction methods, we have established an easily extensible web-based prediction framework that allows automated side-by-side comparisons of prediction methods implemented by experts. This is an advance over the current practice of tool developers having to generate reference predictions themselves, which can lead to underestimating the performance of prediction methods they are not as familiar with as their own. The overall goal of this effort is to provide a transparent prediction evaluation allowing bioinformaticians to identify promising features of prediction methods and providing guidance to immunologists regarding the reliability of prediction tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
SYFPEITHI: database for MHC ligands and peptide motifs
Rammensee, H. G., Bachmann, J., Emmerich, N. P. N., Bachor, O. A., & Stevanović, S. (1999) · Immunogenetics · doi:10.1007/s002510050595 · Cited by 2,314
Parker, K. C., Bednarek, M. A., & Coligan, J. E. (1994) · The Journal of Immunology · doi:10.4049/jimmunol.152.1.163 · Cited by 1,370
Reliable prediction of T‐cell epitopes using neural networks with novel sequence representations
Nielsen, M., Lundegaard, C., Worning, P., Lauemøller, S. L., Lamberth, K., Buus, S., Brunak, S., & Lund, O. (2003) · Protein Science · doi:10.1110/ps.0239403 · Cited by 1,074
Self-citationSette, A., Vitiello, A., Reherman, B., Fowler, P., Nayersina, R., Kast, W. M., Melief, C. J. M., Oseroff, C., Yuan, L., Ruppert, J., et al. (1994) · The Journal of Immunology · doi:10.4049/jimmunol.153.12.5586 · Cited by 830
Self-citationPeters, B., & Sette, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-132 · Cited by 512
Self-citationNielsen, M., Lundegaard, C., Lund, O., & Keşmir, C. (2005) · Immunogenetics · doi:10.1007/s00251-005-0781-7 · Cited by 491
Self-citationProPred1: prediction of promiscuous MHC Class-I binding sites
Singh, H., & Raghava, G. P. S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg108 · Cited by 441
Shen, L., Sigal, L. J., Boes, M., & Rock, K. L. (2004) · Immunity · doi:10.1016/j.immuni.2004.07.004 · Cited by 391
Reche, P., Glutting, J.-P., Zhang, H., & Reinherz, E. (2004) · Immunogenetics · doi:10.1007/s00251-004-0709-7 · Cited by 386
Cited by
Gapped sequence alignment using artificial neural networks: application to the MHC class I system
Andreatta, M., & Nielsen, M. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv639 · Cited by 1,087
Self-citationLarge-scale validation of methods for cytotoxic T-lymphocyte epitope prediction
Larsen, M. V., Lundegaard, C., Lamberth, K., Buus, S., Lund, O., & Nielsen, M. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-424 · Cited by 982
Self-citationProperties of MHC Class I Presented Peptides That Enhance Immunogenicity
Calis, J. J. A., Maybeno, M., Greenbaum, J. A., Weiskopf, D., De Silva, A. D., Sette, A., Keşmir, C., & Peters, B. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003266 · Cited by 923
Self-citationMore than one reason to rethink the use of peptides in vaccine design
Purcell, A. W., McCluskey, J., & Rossjohn, J. (2007) · Nature Reviews Drug Discovery · doi:10.1038/nrd2224 · Cited by 860
Wang, P., Sidney, J., Dow, C., Mothé, B., Sette, A., & Peters, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000048 · Cited by 844
Self-citationLundegaard, C., Lamberth, K., Harndahl, M., Buus, S., Lund, O., & Nielsen, M. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn202 · Cited by 808
Self-citationNielsen, M., Lundegaard, C., Blicher, T., Lamberth, K., Harndahl, M., Justesen, S., Røder, G., Peters, B., Sette, A., Lund, O., et al. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000796 · Cited by 719
Self-citationPeptide binding predictions for HLA DR, DP and DQ molecules
Wang, P., Sidney, J., Kim, Y., Sette, A., Lund, O., Nielsen, M., & Peters, B. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-568 · Cited by 681
Self-citationNielsen, M., Lundegaard, C., & Lund, O. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-238 · Cited by 594
Self-citationReverse Vaccinology: Developing Vaccines in the Era of Genomics
Sette, A., & Rappuoli, R. (2010) · Immunity · doi:10.1016/j.immuni.2010.09.017 · Cited by 559
Self-citationThe Immune Epitope Database and Analysis Resource in Epitope Discovery and Synthetic Vaccine Design
Fleri, W., Paul, S., Dhanda, S. K., Mahajan, S., Xu, X., Peters, B., & Sette, A. (2017) · Frontiers in Immunology · doi:10.3389/fimmu.2017.00278 · Cited by 500
Self-citationClustered Multi-Task Learning: A Convex Formulation
Jacob, L., Bach, F., & Vert, J. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0809.2085 · Cited by 400
Immune epitope database analysis resource (IEDB-AR)
Zhang, Q., Wang, P., Kim, Y., Haste-Andersen, P., Beaver, J., Bourne, P. E., Bui, H.-H., Buus, S., Frankild, S., Greenbaum, J., et al. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn254 · Cited by 399
Self-citationNetMHCcons: a consensus method for the major histocompatibility complex class I predictions
Karosiene, E., Lundegaard, C., Lund, O., & Nielsen, M. (2012) · Immunogenetics · doi:10.1007/s00251-011-0579-8 · Cited by 396
Self-citationNitrated α–Synuclein Immunity Accelerates Degeneration of Nigral Dopaminergic Neurons
Benner, E. J., Banerjee, R., Reynolds, A. D., Sherman, S., Pisarev, V. M., Tsiperson, V., Nemachek, C., Ciborowski, P., Przedborski, S., Mosley, R. L., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001376 · Cited by 362
He, Y., Xiang, Z., & Mobley, H. L. T. (2010) · Journal of Biomedicine and Biotechnology · doi:10.1155/2010/297505 · Cited by 355
Sidney, J., Assarsson, E., Moore, C., Ngo, S., Pinilla, C., Sette, A., & Peters, B. (2008) · Immunome Research · doi:10.1186/1745-7580-4-2 · Cited by 326
Self-citationKošmrlj, A., Read, E. L., Qi, Y., Allen, T. M., Altfeld, M., Deeks, S. G., Pereyra, F., Carrington, M., Walker, B. D., & Chakraborty, A. K. (2010) · Nature · doi:10.1038/nature08997 · Cited by 302
Paul, S., Weiskopf, D., Angelo, M. A., Sidney, J., Peters, B., & Sette, A. (2013) · The Journal of Immunology · doi:10.4049/jimmunol.1302101 · Cited by 298
Self-citationQuantitative Predictions of Peptide Binding to Any HLA-DR Molecule of Known Sequence: NetMHCIIpan
Nielsen, M., Lundegaard, C., Blicher, T., Peters, B., Sette, A., Justesen, S., Buus, S., & Lund, O. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000107 · Cited by 292
Self-citationComputational genomics tools for dissecting tumour–immune cell interactions
Hackl, H., Charoentong, P., Finotello, F., & Trajanoski, Z. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.67 · Cited by 270
Peters, B., Nielsen, M., & Sette, A. (2020) · Annual Review of Immunology · doi:10.1146/annurev-immunol-082119-124838 · Cited by 270
Self-citationZhang, H., Lund, O., & Nielsen, M. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp137 · Cited by 255
Self-citationGeometric deep learning improves generalizability of MHC-bound peptide predictions
(2024) · doi:10.1038/s42003-024-07292-1 · Cited by 18
Machine Learning Applications in Lung Cancer Diagnosis, Treatment and Prognosis
Li, Y., Wu, X., Yang, P., Jiang, G., & Luo, Y. (2022) · arXiv · doi:10.48550/arxiv.2203.02794 · Cited by 2
Metadata
- Authors
- Peters, B., Bui, H.-H., Frankild, S., Nielsen, M., Lundegaard, C., Kostem, E., Basch, D., Lamberth, K., Harndahl, M., Fleri, W., Wilson, S. S., Sidney, J., Lund, O., Buus, S., & Sette, A.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2006-06-09
- Volume
- 2
- Issue
- 6
- Pages
- e65
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2094706980
- Cited by
- 288
- References
- 46
- FWCI
- 11.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.