The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Systematically benchmarking peptide-MHC binding predictors: From synthetic to naturally processed epitopes
Open accessAbstract
A number of machine learning-based predictors have been developed for identifying immunogenic T-cell epitopes based on major histocompatibility complex (MHC) class I and II binding affinities. Rationally selecting the most appropriate tool has been complicated by the evolving training data and machine learning methods. Despite the recent advances made in generating high-quality MHC-eluted, naturally processed ligandome, the reliability of new predictors on these epitopes has yet to be evaluated. This study reports the latest benchmarking on an extensive set of MHC-binding predictors by using newly available, untested data of both synthetic and naturally processed epitopes. 32 human leukocyte antigen (HLA) class I and 24 HLA class II alleles are included in the blind test set. Artificial neural network (ANN)-based approaches demonstrated better performance than regression-based machine learning and structural modeling. Among the 18 predictors benchmarked, ANN-based mhcflurry and nn_align perform the best for MHC class I 9-mer and class II 15-mer predictions, respectively, on binding/non-binding classification (Area Under Curves = 0.911). NetMHCpan4 also demonstrated comparable predictive power. Our customization of mhcflurry to a pan-HLA predictor has achieved similar accuracy to NetMHCpan. The overall accuracy of these methods are comparable between 9-mer and 10-mer testing data. However, the top methods deliver low correlations between the predicted versus the experimental affinities for strong MHC binders. When used on naturally processed MHC-ligands, tools that have been trained on elution data (NetMHCpan4 and MixMHCpred) shows better accuracy than pure binding affinity predictor. The variability of false prediction rate is considerable among HLA types and datasets. Finally, structure-based predictor of Rosetta FlexPepDock is less optimal compared to the machine learning approaches. With our benchmarking of MHC-binding and MHC-elution predictors using a comprehensive metrics, a unbiased view for establishing best practice of T-cell epitope predictions is presented, facilitating future development of methods in immunogenomics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326
Predicting immunogenic tumour mutations by combining mass spectrometry and exome sequencing
Yadav, M., Jhunjhunwala, S., Phung, Q. T., Lupardus, P., Tanguay, J., Bumbaca, S., Franci, C., Cheung, T. K., Fritsche, J., Weinschenk, T., et al. (2014) · Nature · doi:10.1038/nature14001 · Cited by 1,186
Blank, C. U., Haanen, J. B., Ribas, A., & Schumacher, T. N. (2016) · Science · doi:10.1126/science.aaf2834 · Cited by 748
Cited by
Therapeutic cancer vaccines: Advancements, challenges, and prospects
Fan, T., Zhang, M., Yang, J., Zhu, Z., Cao, W., & Dong, C. (2023) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-023-01674-3 · Cited by 597
Identification of neoantigens for individualized therapeutic cancer vaccines
Lang, F., Schrörs, B., Löwer, M., Türeci, Ö., & Sahin, U. (2022) · Nature Reviews Drug Discovery · doi:10.1038/s41573-021-00387-y · Cited by 534
Predicting HLA class II antigen presentation through integrated deep learning
Chen, B., Khodadoust, M. S., Olsson, N., Wagar, L. E., Fast, E., Liu, C. L., Muftuoglu, Y., Sworder, B. J., Diehn, M., Levy, R., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0280-2 · Cited by 314
Machine Learning for Lung Cancer Diagnosis, Treatment, and Prognosis
Li, Y., Wu, X., Yang, P., Jiang, G., & Luo, Y. (2022) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.11.003 · Cited by 263
Challenges targeting cancer neoantigens in 2021: a systematic literature review
Chen, I., Chen, M. Y., Goedegebuure, S. P., & Gillanders, W. E. (2021) · Expert Review of Vaccines · doi:10.1080/14760584.2021.1935248 · Cited by 39
Metadata
- Authors
- Zhao, W., & Sher, X.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-11-08
- Volume
- 14
- Issue
- 11
- Pages
- e1006457
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2900127803
- Cited by
- 168
- References
- 3
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.