AMP‐BERT: Prediction of antimicrobial peptide function based on a BERT model
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Antimicrobial resistance is a growing health concern. Antimicrobial peptides (AMPs) disrupt harmful microorganisms by nonspecific mechanisms, making it difficult for microbes to develop resistance. Accordingly, they are promising alternatives to traditional antimicrobial drugs. In this study, we developed an improved AMP classification model, called AMP‐BERT. We propose a deep learning model with a fine‐tuned bidirectional encoder representations from transformers (BERT) architecture designed to extract structural/functional information from input peptides and identify each input as AMP or non‐AMP. We compared the performance of our proposed model and other machine/deep learning‐based methods. Our model, AMP‐BERT, yielded the best prediction results among all models evaluated with our curated external dataset. In addition, we utilized the attention mechanism in BERT to implement an interpretable feature analysis and determine the specific residues in known AMPs that contribute to peptide structure and antimicrobial function. The results show that AMP‐BERT can capture the structural properties of peptides for model learning, enabling the prediction of AMPs or non‐AMPs from input sequences. AMP‐BERT is expected to contribute to the identification of candidate AMPs for functional validation and drug development. The code and dataset for the fine‐tuning of AMP‐BERT is publicly available at https://github.com/GIST-CSBL/AMP-BERT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Antimicrobial peptides of multicellular organisms
Zasloff, M. (2002) · Nature · doi:10.1038/415389a · Cited by 8,457 · cited 2×
“Unlike traditional anti-biotics, AMPs typically kill bacteria and other harmful microbes by disrupting general components of a cell, such as the membrane and DNA duplication mechanisms (Zasloff, 2002).”
BackgroundUniProt: a worldwide hub of protein knowledge
The UniProt Consortium (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1049 · Cited by 7,698
UniRef: comprehensive and non-redundant UniProt reference clusters
Suzek, B. E., Huang, H., McGarvey, P., Mazumder, R., & Wu, C. H. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm098 · Cited by 1,613
Clustering huge protein sequence sets in linear time
Steinegger, M., & Söding, J. (2018) · Nature Communications · doi:10.1038/s41467-018-04964-5 · Cited by 875 · cited 6×
“…fine-tuning task in our research, we utilize the Hugging Face Transformers API (Wolf et al., 2019) and ProtBERT-BFD, a BERT-based model that was pre-trained with approximately 2.1 billion protein sequences from the Big Fantastic Database (BFD) (Steinegger & Söding, 2018; Steinegger et al., 2019).”
MethodInfluentialCAMP R3 : a database on sequences, structures and signatures of antimicrobial peptides: Table 1.
Waghu, F. H., Barai, R. S., Gurung, P., & Idicula-Thomas, S. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1051 · Cited by 715
A Multiscale Visualization of Attention in the Transformer Model
Vig, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/p19-3007 · Cited by 600 · cited 1×
“The supplementary figures consist of visualizations of self-attention values across all 30 layers with 16 heads for external test sequence DRAMP18350, produced using BertViz (Vig, 2019), and additional self-attention Circos plots for DRAMP00293, DRAMP02743, DRAMP03120, and DRAMP04398.”
MethodProtein-level assembly increases protein sequence recovery from metagenomic samples manyfold
Steinegger, M., Mirdita, M., & Söding, J. (2019) · Nature Methods · doi:10.1038/s41592-019-0437-4 · Cited by 445 · cited 2×
“…fine-tuning task in our research, we utilize the Hugging Face Transformers API (Wolf et al., 2019) and ProtBERT-BFD, a BERT-based model that was pre-trained with approximately 2.1 billion protein sequences from the Big Fantastic Database (BFD) (Steinegger & Söding, 2018; Steinegger et al., 2019).”
MethodInfluential
Cited by
SBSM-Pro: support bio-sequence machine for proteins
Wang, Y., Zhai, Y., Ding, Y., & Zou, Q. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4171-9 · Cited by 370
Peptipedia v2.0: a peptide sequence database and user-friendly web platform. A major update
Cabas-Mora, G., Daza, A., Soto-García, N., Garrido, V., Alvarez, D., Navarrete, M., Sarmiento-Varón, L., Sepúlveda Yañez, J. H., Davari, M. D., Cadet, F., et al. (2024) · Database · doi:10.1093/database/baae113 · Cited by 35
Prediction of antibiotic resistance mechanisms using a protein language model
Yagimoto, K., Hosoda, S., Sato, M., & Hamada, M. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae550 · Cited by 25
Li, W., Huang, B., Guo, M., Zeng, Z., Cai, T., Feng, L., Zhang, X., Guo, L., Jiang, X., Yin, Y., et al. (2025) · Cell Reports · doi:10.1016/j.celrep.2025.115773 · Cited by 13
Plant-associated fungi co-opt ancient antimicrobials for host manipulation
Mesny, F., Wolf, V., López-Moral, A., Kraege, A., Punt, W., Liu, S., Zhu, J., Park, J., Sato, Y., & Thomma, B. P. H. J. (2026) · Science Advances · doi:10.1126/sciadv.aec1406 · Cited by 11
Metadata
- Authors
- Lee, H., Lee, S., Lee, I., & Nam, H.
- Venue
- Protein Science
- Publisher
- Wiley
- Published
- 2022-12-19
- Volume
- 32
- Issue
- 1
- Pages
- e4529-e4529
- ISSN
- 0961-8368 (ISSN-L)
- 1469-896X
- OpenAlex
- W4310641985
- Cited by
- 119
- References
- 11
- FWCI
- 10.21
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.