The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Pushing the Boundaries of Molecular Representation for Drug Discovery with the Graph Attention Mechanism
Abstract
Hunting for chemicals with favorable pharmacological, toxicological, and pharmacokinetic properties remains a formidable challenge for drug discovery. Deep learning provides us with powerful tools to build predictive models that are appropriate for the rising amounts of data, but the gap between what these neural networks learn and what human beings can comprehend is growing. Moreover, this gap may induce distrust and restrict deep learning applications in practice. Here, we introduce a new graph neural network architecture called Attentive FP for molecular representation that uses a graph attention mechanism to learn from relevant drug discovery data sets. We demonstrate that Attentive FP achieves state-of-the-art predictive performances on a variety of data sets and that what it learns is interpretable. The feature visualization for Attentive FP suggests that it automatically learns nonlocal intramolecular interactions from specified tasks, which can help us gain chemical insights directly from data beyond human perception.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 8,657
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968
Neural Message Passing for Quantum Chemistry
Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O., & Dahl, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01212 · Cited by 3,440
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Gaulton, A., Hersey, A., Nowotka, M., Bento, A. P., Chambers, J., Mendez, D., Mutowo, P., Atkinson, F., Bellis, L. J., Cibrián-Uhalte, E., et al. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw1074 · Cited by 2,330
Empirical Evaluation of Rectified Activations in Convolutional Network
Xu, B., Wang, N., Chen, T., & Li, M. (2015) · arXiv · doi:10.48550/arxiv.1505.00853 · Cited by 2,264
SchNet – A deep learning architecture for molecules and materials
Schütt, K. T., Sauceda, H. E., Kindermans, P.-J., Tkatchenko, A., & Müller, K.-R. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5019779 · Cited by 2,217
Quantum chemistry structures and properties of 134 kilo molecules
Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. (2014) · Scientific Data · doi:10.1038/sdata.2014.22 · Cited by 1,966
Planning chemical syntheses with deep neural networks and symbolic AI
Segler, M. H. S., Preuss, M., & Waller, M. P. (2018) · Nature · doi:10.1038/nature25978 · Cited by 1,847
Molecular graph convolutions: moving beyond fingerprints
Kearnes, S., McCloskey, K., Berndl, M., Pande, V., & Riley, P. (2016) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-016-9938-8 · Cited by 1,631
Quantum-Chemical Descriptors in QSAR/QSPR Studies
Karelson, M., Lobanov, V. S., & Katritzky, A. R. (1996) · Chemical Reviews · doi:10.1021/cr950202r · Cited by 1,622
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17
Ruddigkeit, L., van Deursen, R., Blum, L. C., & Reymond, J.-L. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300415d · Cited by 1,505
The SIDER database of drugs and side effects
Kuhn, M., Letunic, I., Jensen, L. J., & Bork, P. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1075 · Cited by 1,451
Quantum-chemical insights from deep tensor neural networks
Schütt, K. T., Arbabzadah, F., Chmiela, S., Müller, K. R., & Tkatchenko, A. (2017) · Nature Communications · doi:10.1038/ncomms13890 · Cited by 1,445
PubChem: Integrated Platform of Small Molecules and Biological Activities
(2008) · Annual Reports in Computational Chemistry · doi:10.1016/s1574-1400(08)00012-1 · Cited by 1,263
Predicting reaction performance in C–N cross-coupling using machine learning
Ahneman, D. T., Estrada, J. G., Lin, S., Dreher, S. D., & Doyle, A. G. (2018) · Science · doi:10.1126/science.aar5169 · Cited by 1,058
On Early Stopping in Gradient Descent Learning
Yao, Y., Rosasco, L., & Caponnetto, A. (2007) · Constructive Approximation · doi:10.1007/s00365-006-0663-2 · Cited by 970
Low Data Drug Discovery with One-Shot Learning
Altae-Tran, H., Ramsundar, B., Pappu, A. S., & Pande, V. (2017) · ACS Central Science · doi:10.1021/acscentsci.6b00367 · Cited by 799
Wang, Y., Xiao, J., Suzek, T. O., Zhang, J., Wang, J., Zhou, Z., Han, L., Karapetyan, K., Dracheva, S., Shoemaker, B. A., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr1132 · Cited by 659
Retrosynthetic Reaction Prediction Using Neural Sequence-to-Sequence Models
Liu, B., Ramsundar, B., Kawthekar, P., Shi, J., Gomes, J., Luu Nguyen, Q., Ho, S., Sloane, J., Wender, P., & Pande, V. (2017) · ACS Central Science · doi:10.1021/acscentsci.7b00303 · Cited by 536
Convolutional embedding of attributed molecular graphs for physical property prediction
Coley, C. W., Barzilay, R., Green, W. H., Jaakkola, T. S., & Jensen, K. F. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00601 · Cited by 470
Light Gated Recurrent Units for Speech Recognition
Ravanelli, M., Brakel, P., Omologo, M., & Bengio, Y. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2762739 · Cited by 411
Reconstructing quantum states with generative models
Carrasquilla, J., Torlai, G., Melko, R. G., & Aolita, L. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0028-1 · Cited by 317
Hierarchical modeling of molecular energies using a deep neural network
Lubbers, N., Smith, J. S., & Barros, K. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5011181 · Cited by 306
Unified representation of molecules and crystals for machine learning
Huo, H., & Rupp, M. (2022) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/aca005 · Cited by 276
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Huang, R., Xia, M., Sakamuru, S., Zhao, J., Shahane, S. A., Attene-Ramos, M., Zhao, T., Austin, C. P., & Simeonov, A. (2016) · Nature Communications · doi:10.1038/ncomms10425 · Cited by 259
Gedeck, P., Rohde, B., & Bartels, C. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci050413p · Cited by 218
Feedback GAN for DNA optimizes protein functions
Gupta, A., & Zou, J. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0017-4 · Cited by 203
Learning atoms for materials discovery
Zhou, Q., Tang, P., Liu, S., Pan, J., Yan, Q., & Zhang, S.-C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1801181115 · Cited by 200
Parallel Gaussian process optimization with upper confidence bound and pure explorationPreprint
Contal, E., Buffoni, D., Robicquet, R., & Vayatis, N. (2013) · Cited by 151
Inverse QSPR/QSAR Analysis for Chemical Structure Generation (fromytox)
Miyao, T., Kaneko, H., & Funatsu, K. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00628 · Cited by 124
Tuning hERG Out: Antitarget QSAR Models for Drug Development
Braga, R. C., Alves, V. M., da Silva, M. F. B., Muratov, E. N., Fourches, D., Tropsha, A., & Andrade, C. H. (2014) · Current Topics in Medicinal Chemistry · doi:10.2174/1568026614666140506124442 · Cited by 102
Gavaghan, C. L., Arnby, C. H., Blomberg, N., Strandlund, G., & Boyer, S. K. (2007) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-006-9095-6 · Cited by 101
Parallel Gaussian Process Optimization with Upper Confidence Bound and Pure Exploration
Contal, E., Buffoni, D., Robicquet, A., & Vayatis, N. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40988-2_15 · Cited by 85
Mind and machine in drug design
Schneider, G. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0030-7 · Cited by 73
Graph Convolution: A High-Order and Adaptive ApproachPreprint
Zhou, Z., & Li, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.09916 · Cited by 43
Self-citationMurugan, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07233 · Cited by 37
Learning a Local-Variable Model of Aromatic and Conjugated Systems
Matlock, M. K., Dang, N. L., & Swamidass, S. J. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00405 · Cited by 21
Cited by
Graph neural networks for materials science and chemistry
Reiser, P., Neubert, M., Eberhard, A., Torresi, L., Zhou, C., Shao, C., Metni, H., van Hoesel, C., Schopmans, H., Sommer, T., et al. (2022) · Communications Materials · doi:10.1038/s43246-022-00315-6 · Cited by 860
Jiang, D., Wu, Z., Hsieh, C.-Y., Chen, G., Liao, B., Wang, Z., Shen, C., Cao, D., Wu, J., & Hou, T. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-020-00479-8 · Cited by 664
Geometry-enhanced molecular representation learning for property prediction
Fang, X., Liu, L., Lei, J., He, D., Zhang, S., Zhou, J., Wang, F., Wu, H., & Wang, H. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-021-00438-4 · Cited by 597
Large-scale chemical language representations capture molecular structure and properties
Ross, J., Belgodere, B., Chenthamarakshan, V., Padhi, I., Mroueh, Y., & Das, P. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00580-7 · Cited by 590
“Baseline performances are taken from references 28,40 .”
BackgroundIdentification of antimicrobial peptides from the human gut microbiome using deep learning
Ma, Y., Guo, Z., Xia, B., Zhang, Y., Liu, X., Yu, Y., Tang, N., Tong, X., Wang, M., Ye, X., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01226-0 · Cited by 490
Self-citation
Metadata
- Authors
- Xiong, Z., Wang, D., Liu, X., Zhong, F., Wan, X., Li, X., Li, Z., Luo, X., Chen, K., Jiang, H., & Zheng, M.
- Venue
- Journal of Medicinal Chemistry
- Publisher
- American Chemical Society (ACS)
- Published
- 2019-08-13
- Volume
- 63
- Issue
- 16
- Pages
- 8749-8760
- ISSN
- 0022-2623 (ISSN-L)
- 1520-4804
- OpenAlex
- W2968734407
- Cited by
- 1,053
- References
- 47
- FWCI
- 36.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.