Recurrent Neural Network Model for Constructive Peptide Design
The DOI matches its Crossref record; 47 of the 50 references it cites were found in a registry or an index.
Abstract
We present a generative long short-term memory (LSTM) recurrent neural network (RNN) for combinatorial de novo peptide design. RNN models capture patterns in sequential data and generate new data instances from the learned context. Amino acid sequences represent a suitable input for these machine-learning models. Generative models trained on peptide sequences could therefore facilitate the design of bespoke peptide libraries. We trained RNNs with LSTM units on pattern recognition of helical antimicrobial peptides and used the resulting model for de novo sequence generation. Of these sequences, 82% were predicted to be active antimicrobial peptides compared to 65% of randomly sampled sequences with the same amino acid distribution as the training set. The generated sequences also lie closer to the training data than manually designed amphipathic helices. The results of this study showcase the ability of LSTM RNNs to construct new amino acid sequences within the applicability domain of the model and motivate their prospective application to peptide and protein design without the need for the exhaustive enumeration of sequence libraries.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, it has been verified that LSTM-based neural networks could learn AMP’s amino-acid grammar and create new potential AMP sequences32,33.”
From Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing (2022) · cites this paper as [32]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2014) · Cited by 33,419
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
APD3: the antimicrobial peptide database as a tool for research and education
Wang, G., Li, X., & Wang, Z. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1278 · Cited by 2,388
Designing antimicrobial peptides: form follows function
Fjell, C. D., Hiss, J. A., Hancock, R. E. W., & Schneider, G. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3591 · Cited by 2,035
Self-citationA Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Predicting the secondary structure of globular proteins using neural network models
Qian, N., & Sejnowski, T. J. (1988) · Journal of Molecular Biology · doi:10.1016/0022-2836(88)90564-5 · Cited by 1,227
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,201
The helical hydrophobic moment: a measure of the amphiphilicity of a helix
Eisenberg, D., Weiss, R. M., & Terwilliger, T. C. (1982) · Nature · doi:10.1038/299371a0 · Cited by 1,056
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723
Self-citationCAMP R3 : a database on sequences, structures and signatures of antimicrobial peptides: Table 1.
Waghu, F. H., Barai, R. S., Gurung, P., & Idicula-Thomas, S. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1051 · Cited by 715
Control of cell selectivity of antimicrobial peptides
Matsuzaki, K. (2009) · Biochimica et Biophysica Acta (BBA) - Biomembranes · doi:10.1016/j.bbamem.2008.09.013 · Cited by 713
Lipid domains in bacterial membranes and the action of antimicrobial agents
Epand, R. M., & Epand, R. F. (2009) · Biochimica et Biophysica Acta (BBA) - Biomembranes · doi:10.1016/j.bbamem.2008.08.023 · Cited by 624
Generative Recurrent Networks for De Novo Drug Design
Gupta, A., Müller, A. T., Huisman, B. J. H., Fuchs, J. A., Schneider, P., & Schneider, G. (2018) · Molecular Informatics · doi:10.1002/minf.201700111 · Cited by 441
Self-citationAn overview of topic modeling and its current applications in bioinformatics
Liu, L., Tang, L., Dong, W., Yao, S., & Zhou, W. (2016) · SpringerPlus · doi:10.1186/s40064-016-3252-8 · Cited by 392
Heffernan, R., Yang, Y., Paliwal, K., & Zhou, Y. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx218 · Cited by 357
Rozek, T., Wegener, K. L., Bowie, J. H., Olver, I. N., Carver, J. A., Wallace, J. C., & Tyler, M. J. (2000) · European Journal of Biochemistry · doi:10.1046/j.1432-1327.2000.01536.x · Cited by 288
Gesell, J., Zasloff, M., & Opella, S. J. (1997) · Journal of Biomolecular NMR · doi:10.1023/a:1018698002314 · Cited by 274
CAMP: Collection of sequences and structures of antimicrobial peptides
Waghu, F. H., Gopi, L., Barai, R. S., Ramteke, P., Nizami, B., & Idicula-Thomas, S. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1157 · Cited by 271
Wieprecht, T., Dathe, M., Beyermann, M., Krause, E., Maloy, W. L., MacDonald, D. L., & Bienert, M. (1997) · Biochemistry · doi:10.1021/bi9619987 · Cited by 252
A renaissance of neural networks in drug discovery
Baskin, I. I., Winkler, D., & Tetko, I. V. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1201262 · Cited by 235
DADP: the database of anuran defense peptides
Novković, M., Simunić, J., Bojović, V., Tossi, A., & Juretić, D. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts141 · Cited by 218
modlAMP: Python for antimicrobial peptides
Müller, A. T., Gabernet, G., Hiss, J. A., & Schneider, G. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx285 · Cited by 215
Self-citationA Large-Scale Structural Classification of Antimicrobial Peptides
Lee, H.-T., Lee, C.-C., Yang, J.-R., Lai, J. Z. C., & Chang, K. Y. (2015) · BioMed Research International · doi:10.1155/2015/475062 · Cited by 211
Solution NMR studies of amphibian antimicrobial peptides: Linking structure to function?
Haney, E. F., Hunter, H. N., Matsuzaki, K., & Vogel, H. J. (2009) · Biochimica et Biophysica Acta (BBA) - Biomembranes · doi:10.1016/j.bbamem.2009.01.002 · Cited by 169
De Novo Design at the Edge of Chaos: Miniperspective
Schneider, P., & Schneider, G. (2016) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.5b01849 · Cited by 164
Self-citationChemoinformatic Classification Methods and their Applicability Domain
Mathea, M., Klingspohn, W., & Baumann, K. (2016) · Molecular Informatics · doi:10.1002/minf.201501019 · Cited by 163
Schneider, G., & Wrede, P. (1994) · Biophysical Journal · doi:10.1016/s0006-3495(94)80782-9 · Cited by 161
Self-citationRole of helicity of α-helical antimicrobial peptides to improve specificity
Yi, H., He, L., Li, G., Zhai, N., Jiang, H., & Chen, Y. (2014) · Protein & Cell · doi:10.1007/s13238-014-0061-0 · Cited by 146
Wong, H., Bowie, J. H., & Carver, J. A. (1997) · European Journal of Biochemistry · doi:10.1111/j.1432-1033.1997.00545.x · Cited by 141
Empirical comparison of web-based antimicrobial peptide prediction tools
Gabere, M. N., & Noble, W. S. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx081 · Cited by 133
Fast model-based protein homology detection without alignment
Hochreiter, S., Heusel, M., & Obermayer, K. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm247 · Cited by 128
Wang, G., Hanke, M. L., Mishra, B., Lushnikova, T., Heim, C. E., Chittezham Thomas, V., Bayles, K. W., & Kielian, T. (2014) · ACS Chemical Biology · doi:10.1021/cb500475y · Cited by 119
Protein Secondary Structure Prediction with Long Short Term Memory Networks
Sønderby, S. K., & Winther, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7828 · Cited by 100
Computational Creativity: Coming of Age
Colton, S., de Mántaras, R. L., & Stock, O. (2009) · AI Magazine · doi:10.1609/aimag.v30i3.2257 · Cited by 92
Schneider, G., Schuchhardt, J., & Wrede, P. (1994) · Computer applications in the biosciences · doi:10.1093/bioinformatics/10.6.635 · Cited by 43
Self-citationMultidimensional Design of Anticancer Peptides
Lin, Y., Lim, Y. F., Russo, E., Schneider, P., Bolliger, L., Edenharter, A., Altmann, K., Halin, C., Hiss, J. A., & Schneider, G. (2015) · Angewandte Chemie International Edition · doi:10.1002/anie.201504018 · Cited by 40
Self-citationGenerative Models for Chemical Structures
White, D., & Wilson, R. C. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci9004089 · Cited by 29
Sparse Neural Network Models of Antimicrobial Peptide‐Activity Relationships
Müller, A. T., Kaymaz, A. C., Gabernet, G., Posselt, G., Weßler, S., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201600029 · Cited by 21
Self-citationPeptide–Membrane Interaction between Targeting and Lysis
Stutz, K., Müller, A. T., Hiss, J. A., Schneider, P., Blatter, M., Pfeiffer, B., Posselt, G., Kanfer, G., Kornmann, B., Wrede, P., et al. (2017) · ACS Chemical Biology · doi:10.1021/acschembio.7b00504 · Cited by 16
Self-citationFinding Chemical Structures Corresponding to a Set of Coordinates in Chemical Descriptor Space
Miyao, T., & Funatsu, K. (2017) · Molecular Informatics · doi:10.1002/minf.201700030 · Cited by 11
Attractors in Sequence Space: Peptide Morphing by Directed Simulated Evolution
Hiss, J. A., Stutz, K., Posselt, G., Weßler, S., & Schneider, G. (2015) · Molecular Informatics · doi:10.1002/minf.201500089 · Cited by 5
Self-citation
Research works printed but not linked: 16
- Lipton, Z. C.; Berkowitz, J.; Elkan, C.A Critical Review of Recurrent Neural Networks for Sequence Learning.arXiv:1506.00019, 2015.
- Brown P. F., 1992, Comput. Linquistics, 18, 467
- Boulanger-Lewandowski N., 2012, Proc. 29th Int. Conf. Mach. Learn., 1159
- Sutskever I., 2011, Proc. 28th Int. Conf. Mach. Learn., 1017
- Segler M. H. S., 2017, ACS Cent. Sci.
- Baldi P., 2003, J. Mach. Learn. Res., 4, 575
- Sønderby S. K., 2015, Algorithms for Computational Biology. AlCoB 2015. Lecture Notes in Computer Science, 9199, 68
- Jozefowicz R., 2015, Proc. 32nd Int. Conf. Mach. Learn. Lille, Fr., 37
- Srivastava N., 2014, J. Mach. Learn. Res., 15, 1929
- Gal Y., 2016, Adv. Neural Inf. Process. Syst., 1019
- Kingma, D. P.; Ba, J.Adam: A Method for Stochastic Optimization.arXiv:1412.6980, 2014.
- Chollet F., 2015, Keras
- Abadi, M.; Agarwal, A.; Barham, P.; Brevdo, E.; Chen, Z.; Citro, C.; Corrado, G. S.; Davis, A.; Dean, J.; Devin, M.TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems.arXiv:1603.04467, 2016.
- Graves, A.Generating Sequences With Recurrent Neural Networks.arXiv:1308.0850, 2013.
- McKinney W., 2010, Proc. 9th Python Sci. Conf., 51
- Goodfellow I. J., 2014, Adv. Neural Inf. Process. Syst., 2, 2672
Cited by
A guide to machine learning for biologists
Greener, J. G., Kandathil, S. M., Moffat, L., & Jones, D. T. (2022) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-021-00407-0 · Cited by 2,127
DeepDTA: deep drug–target binding affinity prediction
Öztürk, H., Özgür, A., & Ozkirimli, E. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty593 · Cited by 1,696
“structive peptide design [41] and function prediction [39] that utilize amino-acid sequences.”
BackgroundAntimicrobial Peptides: Classification, Design, Application and Research Progress in Multiple Fields
Huan, Y., Kong, Q., Mou, H., & Yi, H. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.582779 · Cited by 1,595
Artificial intelligence to deep learning: machine intelligence approach for drug discovery
Gupta, R., Srivastava, D., Sahu, M., Tiwari, S., Ambasta, R. K., & Kumar, P. (2021) · Molecular Diversity · doi:10.1007/s11030-021-10217-3 · Cited by 1,473
“It was observed that RNNs have the potential to utilize SMILES strings for drug designing [429].”
MethodMachine-learning-guided directed evolution for protein engineering
Yang, K. K., Wu, Z., & Arnold, F. H. (2019) · Nature Methods · doi:10.1038/s41592-019-0496-6 · Cited by 1,130
Metadata
- Authors
- Müller, A. T., Hiss, J. A., & Schneider, G.
- Affiliations
- ETH Zurich (CH)
- Corresponding author
- Schneider, Gisbert
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2018-01-22
- Volume
- 58
- Issue
- 2
- Pages
- 472-479
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2784920021
- Cited by
- 270
- References
- 50
- Citations by year
- 2026: 31 · 2025: 40 · 2024: 39 · 2023: 33 · 2022: 31 · 2021: 37 · 2020: 17 · 2019: 29 · 2018: 13
- FWCI
- 17.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Chemical Information and Modeling (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Schweizerischer Nationalfonds zur F?rderung der Wissenschaftlichen Forschung (200021_157190)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Life Sciences › Immunology and Microbiology › Microbiology › Antimicrobial Peptides and Activities
- Physical Sciences › Chemistry › Organic Chemistry › Chemical Synthesis and Analysis
- Keywords
- de novo peptide design, long short-term memory, antimicrobial peptides, helical peptides, sequence generation, peptide libraries, amphipathic helix, applicability domain, protein design
- MeSH terms
- Machine Learning, Amino Acid Sequence, Anti-Infective Agents, Models, Chemical, Peptides, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.