Meta Learning With Graph Attention Networks for Low-Data Drug Discovery
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Finding candidate molecules with favorable pharmacological activity, low toxicity, and proper pharmacokinetic properties is an important task in drug discovery. Deep neural networks have made impressive progress in accelerating and improving drug discovery. However, these techniques rely on a large amount of label data to form accurate predictions of molecular properties. At each stage of the drug discovery pipeline, usually, only a few biological data of candidate molecules and derivatives are available, indicating that the application of deep neural networks for low-data drug discovery is still a formidable challenge. Here, we propose a meta learning architecture with graph attention network, Meta-GAT, to predict molecular properties in low-data drug discovery. The GAT captures the local effects of atomic groups at the atom level through the triple attentional mechanism and implicitly captures the interactions between different atomic groups at the molecular level. GAT is used to perceive molecular chemical environment and connectivity, thereby effectively reducing sample complexity. Meta-GAT further develops a meta learning strategy based on bilevel optimization, which transfers meta knowledge from other attribute prediction tasks to low-data target tasks. In summary, our work demonstrates how meta learning can reduce the amount of data required to make meaningful predictions of molecules in low-data scenarios. Meta learning is likely to become the new learning paradigm in low-data drug discovery. The source code is publicly available at: https://github.com/lol88/Meta-GAT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 2×
“Model-agnostic meta-learning (MAML) [47] is used as a base meta learning algorithm for the Meta-GAT framework.”
MethodGeneralizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107 · cited 2×
“All datasets are available for download at the public project MoleculNet [51].”
BackgroundConvolutional Networks on Graphs for Learning Molecular Fingerprints
Duvenaud, D., Maclaurin, D., Aguilera-Iparraguirre, J., Gómez-Bombarelli, R., Hirzel, T., Aspuru-Guzik, A., & Adams, R. P. (2015) · arXiv · doi:10.48550/arxiv.1509.09292 · Cited by 2,628
Molecular graph convolutions: moving beyond fingerprints
Kearnes, S., McCloskey, K., Berndl, M., Pande, V., & Riley, P. (2016) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-016-9938-8 · Cited by 1,631 · cited 1×
“…networks (PN) [58], CHEF [44], attentive fingerprint (Attentive FP) [16], communicative message passing neural network (CMPNN) [59], Weave [60], continuous and data-driven descriptors (CDDD) [49], DeepTox [61], molecule attention trans-former (MAT) [62], molecular prediction model…”
BackgroundAn analysis of the attrition of drug candidates from four major pharmaceutical companies
Waring, M. J., Arrowsmith, J., Leach, A. R., Leeson, P. D., Mandrell, S., Owen, R. M., Pairaudeau, G., Pennie, W. D., Pickett, S. D., Wang, J., et al. (2015) · Nature Reviews Drug Discovery · doi:10.1038/nrd4609 · Cited by 1,450
Wang, L., Wu, Y., Deng, Y., Kim, B., Pierce, L., Krilov, G., Lupyan, D., Robinson, S., Dahlgren, M. K., Greenwood, J., et al. (2015) · Journal of the American Chemical Society · doi:10.1021/ja512751q · Cited by 1,313
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159 · cited 1×
“However, there are usually only a few validated leads and derivatives that can be used for lead optimization [10], [11].”
BackgroundDeepTox: toxicity prediction using deep learning
Mayr, A., Klambauer, G., Unterthiner, T., & Hochreiter, S. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2015.00080 · Cited by 1,081 · cited 1×
“…FP) [16], communicative message passing neural network (CMPNN) [59], Weave [60], continuous and data-driven descriptors (CDDD) [49], DeepTox [61], molecule attention trans-former (MAT) [62], molecular prediction model fine-tuning (MolPMoFiT) [63], N-Gram [64], molecular to context vector…”
Background
Cited by
Explainable artificial intelligence for drug discovery and development: a comprehensive survey
Alizadehsani, R., Oyelere, S. S., Hussain, S., Jagatheesaperumal, S. K., Calixto, R. R., Rahouti, M., Roshanzamir, M., & De Albuquerque, V. H. C. (2024) · IEEE Access · doi:10.1109/access.2024.3373195 · Cited by 124
Deep learning for low-data drug discovery: Hurdles and opportunities
van Tilborg, D., Brinkmann, H., Criscuolo, E., Rossen, L., Özçelik, R., & Grisoni, F. (2024) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2024.102818 · Cited by 61
FlatProt: 2D visualization eases protein structure comparison
Olenyi, T., Carl, C., Senoner, T., Koludarov, I., & Rost, B. (2025) · BMC Bioinformatics · doi:10.1186/s12859-025-06233-x · Cited by 2
Metadata
- Authors
- Lv, Q., Chen, G., Yang, Z., Zhong, W., & Chen, C. Y.-C.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2024-08
- Volume
- 35
- Issue
- 8
- Pages
- 11218-11230
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W4323338513
- Cited by
- 106
- References
- 16
- FWCI
- 13.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta Learning With Graph Attention Networks for Low-Data Drug Discovery. https://app.cochat.ai/papers/10.1109/tnnls.2023.3250324
- The paper
- Lv, Q., Chen, G., Yang, Z., Zhong, W., & Chen, C. Y.-C. (2024). Meta Learning With Graph Attention Networks for Low-Data Drug Discovery. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/tnnls.2023.3250324
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.