Hybrid Network Model for “Deep Learning” of Chemical Data: Application to Antimicrobial Peptides
The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Abstract
We present a “deep” network architecture for chemical data analysis and classification together with a prospective proof‐of‐concept application. The model features a self‐organizing map (SOM) as the input layer of a feedforward neural network. The SOM converts molecular descriptors to a two‐dimensional image for further processing. We implemented lateral neuron inhibition for contrast enhancement. The model achieved improved classification accuracy and predictive robustness compared to feedforward network classifiers lacking the SOM layer. By nonlinear dimensionality reduction the networks extracted meaningful chemical features from the data and outperformed linear principal component analysis (PCA). The learning machine was trained on the sequence‐length independent recognition of antibacterial peptides and correctly predicted the killing activity of a synthetic test peptide against Staphylococcus aureus in an in vitro experiment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, it has been verified that LSTM-based neural networks could learn AMP’s amino-acid grammar and create new potential AMP sequences32,33.”
From Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing (2022) · cites this paper as [33]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Self-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399
Using circular dichroism spectra to estimate protein secondary structure
Greenfield, N. J. (2006) · Nature Protocols · doi:10.1038/nprot.2006.202 · Cited by 4,014
Self-organized formation of topographically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · Cited by 2,995
Evolution strategies – A comprehensive introduction
Beyer, H.-G., & Schwefel, H.-P. (2002) · Natural Computing · doi:10.1023/a:1015059928466 · Cited by 2,790
Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution
Rechenberg, I. (1973) · Frommann-Holzboog eBooks · Cited by 2,440
Whitmore, L., & Wallace, B. A. (2008) · Biopolymers · doi:10.1002/bip.20853 · Cited by 2,243
Estimation of globular protein secondary structure from circular dichroism
Provencher, S. W., & Gloeckner, J. (1981) · Biochemistry · doi:10.1021/bi00504a006 · Cited by 2,155
Designing antimicrobial peptides: form follows function
Fjell, C. D., Hiss, J. A., Hancock, R. E. W., & Schneider, G. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3591 · Cited by 2,035
Self-citationShao, J., & Tu, D. (1995) · Springer Series in Statistics · doi:10.1007/978-1-4612-0795-5 · Cited by 1,985
Agatonovic-Kustrin, S., & Beresford, R. (2000) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/s0731-7085(99)00272-1 · Cited by 1,957
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159
APD2: the updated antimicrobial peptide database and its application in peptide design.
Wang, G., Li, X., & Wang, Z. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn823 · Cited by 941
Neural Networks: Algorithms, Applications and Programming Techniques.
Leave, C., Freeman, J. A., & Skapura, D. M. (1992) · The Journal of the Operational Research Society · doi:10.2307/2584109 · Cited by 924
Fukushima, K., & Miyake, S. (1982) · Pattern Recognition · doi:10.1016/0031-3203(82)90024-3 · Cited by 742
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723
Self-citationNeural networks in chemistry and drug design
Zupan, J., & Gasteiger, J. (1999) · Medical Entomology and Zoology · Cited by 718
The RCSB Protein Data Bank: new resources for research and education
Rose, P. W., Bi, C., Bluhm, W. F., Christie, C. H., Dimitropoulos, D., Dutta, S., Green, R. K., Goodsell, D. S., Prlić, A., Quesada, M., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1200 · Cited by 527
Neural Networks in QSAR and Drug Design
(1996) · Elsevier eBooks · doi:10.1016/b978-0-12-213815-7.x5000-6 · Cited by 221
Artificial neural networks for computer-based molecular design
Schneider, G., & Wrede, P. (1998) · Progress in Biophysics and Molecular Biology · doi:10.1016/s0079-6107(98)00026-1 · Cited by 213
Self-citationContrasting network and modular perspectives on inhibitory control
Hampshire, A., & Sharp, D. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.06.006 · Cited by 210
Stepping out of the box: information processing in the neural networks of the basal ganglia
Bar-Gad, I., & Bergman, H. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(01)00270-7 · Cited by 209
Machine Learning in Virtual Screening
Melville, J., Burke, E., & Hirst, J. (2009) · Combinatorial Chemistry & High Throughput Screening · doi:10.2174/138620709788167980 · Cited by 203
Bioinformatics: The machine learning approach
(1998) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(98)90194-8 · Cited by 188
Machine Learning Techniques and Drug Design
Gertrudes, J. C., Maltarollo, V. G., Silva, R. A., Oliveira, P. R., Honorio, K. M., & da Silva, A. B. F. (2012) · Current Medicinal Chemistry · doi:10.2174/092986712802884259 · Cited by 182
Kireeva, N. V., Baskin, I. I., Gaspar, H. A., Horvath, D., Marcou, G., & Varnek, A. A. (2012) · Molecular Informatics · doi:10.1002/minf.201100163 · Cited by 156
Artificial vision by multi-layered neural networks: Neocognitron and its advances
Fukushima, K. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.09.016 · Cited by 115
Linster, C., Sachse, S., & Galizia, C. G. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01285.2004 · Cited by 113
Hinton, G. (2014) · Cognitive Science · doi:10.1111/cogs.12049 · Cited by 106
Learning nonlinear image manifolds by global alignment of local linear models
Verbeek, J. J. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.166 · Cited by 95
Processing and classification of chemical data inspired by insect olfaction
Schmuker, M., & Schneider, G. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705683104 · Cited by 94
Self-citationMinovski, N., Župerl, Š., Drgan, V., & Novič, M. (2012) · Analytica Chimica Acta · doi:10.1016/j.aca.2012.11.002 · Cited by 93
Nonlinear dimensionality reduction and mapping of compound libraries for drug discovery
Reutlinger, M., & Schneider, G. (2012) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2011.12.006 · Cited by 72
Self-citationGaspar, H. A., Marcou, G., Horvath, D., Arault, A., Lozano, S., Vayer, P., & Varnek, A. A. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400423c · Cited by 70
Jenssen, H., Lejon, T., Hilpert, K., Fjell, C. D., Cherkasov, A. R., & Hancock, R. E. W. (2007) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2007.00543.x · Cited by 62
Predicting olfactory receptor neuron responses from odorant structure
Schmuker, M., de Bruyne, M., Hähnel, M., & Schneider, G. (2007) · Chemistry Central Journal · doi:10.1186/1752-153x-1-11 · Cited by 60
Self-citationSun, J., Xia, Y., Li, D., Du, Q., & Liang, D. (2014) · Biochimica et Biophysica Acta (BBA) - Biomembranes · doi:10.1016/j.bbamem.2014.08.018 · Cited by 52
Short Linear Cationic Antimicrobial Peptides: Screening, Optimizing, and Prediction
Hilpert, K., Fjell, C. D., & Cherkasov, A. R. (2008) · Methods in molecular biology · doi:10.1007/978-1-59745-419-3_8 · Cited by 49
Adaptive Systems in Drug Design
Schneider, G. (2002) · CRC Press eBooks · doi:10.1201/9781498713702 · Cited by 47
Self-citationUse of Structure Descriptors To Discriminate between Modes of Toxic Action of Phenols
Spycher, S., Pellegrini, E., & Gasteiger, J. (2004) · Journal of Chemical Information and Modeling · doi:10.1021/ci0497915 · Cited by 45
Lateral Inhibition Pyramidal Neural Network for Image Classification
Fernandes, B. J. T., Cavalcanti, G. D. C., & Ren, T. I. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2240295 · Cited by 37
Schneider, G., Tanrikulu, Y., & Schneider, P. (2009) · Future Medicinal Chemistry · doi:10.4155/fmc.09.11 · Cited by 31
Self-citationChemography of Natural Product Space
Miyao, T., Reker, D., Schneider, P., Funatsu, K., & Schneider, G. (2015) · Planta Medica · doi:10.1055/s-0034-1396322 · Cited by 25
Self-citationDevelopment of models for prediction of the antioxidant activity of derivatives of natural compounds
Martinčič, R., Kuzmanovski, I., Wagner, A., & Novič, M. (2015) · Analytica Chimica Acta · doi:10.1016/j.aca.2015.01.050 · Cited by 24
Learning with hidden variables
Roudi, Y., & Taylor, G. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.07.006 · Cited by 23
Development of simple fitness landscapes for peptides by artificial neural filter systems
Schneider, G., Schuchhardt, J., & Wrede, P. (1995) · Biological Cybernetics · doi:10.1007/bf00201426 · Cited by 22
Self-citationThai, K., Huynh, N., Ngo, T.-D., Mai, T.-T., Nguyen, T.-Q., & Tran, T. (2015) · SAR and QSAR in environmental research · doi:10.1080/1062936x.2014.995701 · Cited by 16
Wagner, S., Arce, R., Murillo, R., Terfloth, L., Gasteiger, J., & Merfort, I. (2008) · Journal of Medicinal Chemistry · doi:10.1021/jm701318x · Cited by 16
Neural Mechanisms of Odor Rule Learning
Barkai, E. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63350-7.00010-3 · Cited by 15
Exhaustive Proteome Mining for Functional MHC-I Ligands
Koch, C. P., Perna, A. M., Weißmüller, S., Bauer, S., Pillong, M., Baleeiro, R. B., Reutlinger, M., Folkers, G., Walden, P., Wrede, P., et al. (2013) · ACS Chemical Biology · doi:10.1021/cb400252t · Cited by 12
Self-citationKireeva, N. V., Ovchinnikova, S. I., Tetko, I. V., Asiri, A. M., Balakin, K. V., & Tsivadze, A. Y. (2014) · ChemMedChem · doi:10.1002/cmdc.201400027 · Cited by 11
Piloting the Membranolytic Activities of Peptides with a Self‐organizing Map
Lin, Y., Hiss, J. A., Schneider, P., Thelesklaf, P., Lim, Y. F., Pillong, M., Koehler, F. M., Dittrich, P. S., Halin, C., Weßler, S., et al. (2014) · ChemBioChem · doi:10.1002/cbic.201402231 · Cited by 10
Self-citationHaraszti, T., Grunze, M., & Anderson, M. G. (2010) · Chemistry Central Journal · doi:10.1186/1752-153x-4-11 · Cited by 6
Research works printed but not linked: 3
- Hecht-Nielsen R., 1987, Proceedings of the IEEE First International Conference on Neural Networks, 19
- Kernighan B. W., 1988, The C Programming Language
- Schneider G., 1999, From Symbiosis to Eukaryotism – Endocytobiology, 589
Cited by
Generating Focused Molecule Libraries for Drug Discovery with Recurrent Neural Networks
Segler, M. H. S., Kogej, T., Tyrchan, C., & Waller, M. P. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00512 · Cited by 1,537
Peptide Design Principles for Antimicrobial Applications
Torres, M. D. T., Sothiselvam, S., Lu, T. K., & de la Fuente-Nunez, C. (2019) · Journal of Molecular Biology · doi:10.1016/j.jmb.2018.12.015 · Cited by 438
Park, S.-O., Jeong, H., Park, J., Bae, J., & Choi, S. (2022) · Nature Communications · doi:10.1038/s41467-022-30539-6 · Cited by 331
“In previous studies, it has been veri fi ed that LSTM-based neural networks could learn AMP ’ s amino-acid grammar and create new potential AMP sequences 32,33 .”
A renaissance of neural networks in drug discovery
Baskin, I. I., Winkler, D., & Tetko, I. V. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1201262 · Cited by 235
“At the present time, however, there is a clear trend towards their convergence [80].”
BackgroundMachine learning designs non-hemolytic antimicrobial peptides
Capecchi, A., Cai, X., Personne, H., Köhler, T., van Delden, C., & Reymond, J.-L. (2021) · Chemical Science · doi:10.1039/d1sc01713f · Cited by 173
Metadata
- Authors
- Schneider, P., Müller, A. T., Gabernet, G., Button, A. L., Posselt, G., Wessler, S., Hiss, J. A., & Schneider, G.
- Affiliations
- ETH Zurich (CH)
- University of Salzburg (AT)
- Corresponding author
- Schneider, Gisbert
- ORCID
- Venue
- Molecular Informatics
- Publisher
- Wiley
- Published
- 2016-03-10
- Volume
- 36
- Issue
- 1-2
- ISSN
- 1868-1743 (ISSN-L)
- 1868-1751
- OpenAlex
- W2302124239
- Cited by
- 52
- References
- 59
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 3 · 2023: 2 · 2022: 10 · 2021: 4 · 2020: 9 · 2019: 8 · 2018: 4 · 2017: 4 · 2016: 3
- FWCI
- 5.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Molecular Informatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Swiss National Science Foundation (200021_157190, CRSII2_160699)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Life Sciences › Immunology and Microbiology › Microbiology › Antimicrobial Peptides and Activities
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- hybrid network architecture, self-organizing maps, feedforward neural networks, molecular descriptors, nonlinear dimensionality reduction, antibacterial peptides, antimicrobial peptide prediction, Staphylococcus aureus, principal component analysis comparison
- MeSH terms
- Machine Learning, Staphylococcus aureus, Antimicrobial Cationic Peptides, Principal Component Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.