The DOI matches its Crossref record; 190 of the 190 references it cites were found in a registry or an index.
Attention is all you need: utilizing attention in AI-enabled drug discovery
Open accessAbstract
Recently, attention mechanism and derived models have gained significant traction in drug development due to their outstanding performance and interpretability in handling complex data structures. This review offers an in-depth exploration of the principles underlying attention-based models and their advantages in drug discovery. We further elaborate on their applications in various aspects of drug development, from molecular screening and target binding to property prediction and molecule generation. Finally, we discuss the current challenges faced in the application of attention mechanisms and Artificial Intelligence technologies, including data quality, model interpretability and computational resource constraints, along with future directions for research. Given the accelerating pace of technological advancement, we believe that attention-based models will have an increasingly prominent role in future drug discovery. We anticipate that these models will usher in revolutionary breakthroughs in the pharmaceutical domain, significantly accelerating the pace of drug development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 8,657
Explainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922
Why 90% of clinical drug development fails and how to improve it?
Sun, D., Gao, W., Hu, H., & Zhou, S. (2022) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2022.02.002 · Cited by 1,763
Estimated Research and Development Investment Needed to Bring a New Medicine to Market, 2009-2018
Wouters, O. J., McKee, M., & Luyten, J. (2020) · JAMA · doi:10.1001/jama.2020.1166 · Cited by 1,531
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422
Drug discovery with explainable artificial intelligence
Jiménez-Luna, J., Grisoni, F., & Schneider, G. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00236-4 · Cited by 1,063
Taye, M. M. (2023) · Computers · doi:10.3390/computers12050091 · Cited by 1,057
The role of AI in drug discovery: challenges, opportunities, and strategies
Blanco-González, A., Cabezón, A., Seco-González, A., Conde-Torres, D., Antelo-Riveiro, P., Piñeiro, Á., & Garcia-Fandino, R. (2023) · Pharmaceuticals · doi:10.3390/ph16060891 · Cited by 690
Tsubaki, M., Tomii, K., & Sese, J. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty535 · Cited by 688
MolTrans: Molecular Interaction Transformer for drug–target interaction prediction
Huang, K., Xiao, C., Glass, L. M., & Sun, J. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa880 · Cited by 653
Large-scale chemical language representations capture molecular structure and properties
Ross, J., Belgodere, B., Chenthamarakshan, V., Padhi, I., Mroueh, Y., & Das, P. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00580-7 · Cited by 590
MolGPT: Molecular Generation Using a Transformer-Decoder Model
Bagal, V., Aggarwal, R., Vinod, P. K., & Priyakumar, U. D. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00600 · Cited by 543
ChemBERTa-2: Towards Chemical Foundation ModelsPreprint
Ahmad, W., Simon, E. P., Chithrananda, S., Grand, G., & Ramsundar, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.01712 · Cited by 474
SMILES-BERT: Large Scale Unsupervised Pre-Training for Molecular Property Prediction
Wang, S., Guo, Y., Wang, Y., Sun, H., & Huang, J. (2019) · Proceedings of the 10th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics · doi:10.1145/3307339.3342186 · Cited by 406
Bender, A., & Cortés-Ciriano, I. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2020.12.009 · Cited by 405
Self-Supervised Graph Transformer on Large-Scale Molecular Data
Rong, Y., Bian, Y., Xu, T., Xie, W., Wei, Y., Huang, W., & Huang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02835 · Cited by 388
Lecler, A., Duron, L., & Soyer, P. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.003 · Cited by 385 · cited 1×
“…spectrum, the attention mechanism and its derived models such as Transformer, Graph Attention Networks (GATs), Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT) have gained substantial traction in drug development in recent years [15–20].”
Background2011 IEEE International Conference on Bioinformatics and Biomedicine
(2011) · doi:10.1109/bibm19472.2011 · Cited by 380
ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction
Chithrananda, S., Grand, G., & Ramsundar, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09885 · Cited by 379
SBSM-Pro: support bio-sequence machine for proteins
Wang, Y., Zhai, Y., Ding, Y., & Zou, Q. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4171-9 · Cited by 370
AI in drug discovery and its clinical relevance
Qureshi, R., Irfan, M., Gondal, T. M., Khan, S., Wu, J., Hadi, M. U., Heymach, J., Le, X., Yan, H., & Alam, T. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e17575 · Cited by 319
Are innovation and new technologies in precision medicine paving a new era in patients centric care?
Seyhan, A. A., & Carini, C. (2019) · Journal of Translational Medicine · doi:10.1186/s12967-019-1864-9 · Cited by 299
AMMU: A survey of transformer-based biomedical pretrained language models
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103982 · Cited by 278
Zhao, Q., Zhao, H., Zheng, K., & Wang, J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab715 · Cited by 274
DeepDDS: deep graph neural network with attention mechanism to predict synergistic drug combinations
Wang, J., Liu, X., Shen, S., Deng, L., & Liu, H. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab390 · Cited by 261
Zhang, Y., Liu, T., Hu, X., Wang, M., Wang, J., Zou, B., Tan, P., Cui, T., Dou, Y., Ning, L., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab638 · Cited by 252
Self-citationFP-GNN: a versatile deep learning architecture for enhanced molecular property prediction
Cai, H., Zhang, H., Zhao, D., Wu, J., & Wang, L. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac408 · Cited by 251
Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
Choi, S. R., & Lee, M. (2023) · Biology · doi:10.3390/biology12071033 · Cited by 235
Generative Models for De Novo Drug Design
Tong, X., Liu, X., Tan, X., Li, X., Jiang, J., Xiong, Z., Xu, T., Jiang, H., Qiao, N., & Zheng, M. (2021) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.1c00927 · Cited by 233
Withnall, M., Lindelöf, E., Engkvist, O., & Chen, H. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-019-0407-y · Cited by 225
Grechishnikova, D. (2021) · Scientific Reports · doi:10.1038/s41598-020-79682-4 · Cited by 222
Artificial intelligence in drug discovery: applications and techniques
Deng, J., Yang, Z., Ojima, I., Samaras, D., & Wang, F. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab430 · Cited by 220
Lin, S., Wang, Y., Zhang, L., Chu, Y., Liu, Y., Fang, Y., Jiang, M., Wang, Q., Zhao, B., Xiong, Y., et al. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab421 · Cited by 205
Liu, Q., & Xie, L. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008653 · Cited by 203
Graph neural networks for automated de novo drug design
Xiong, J., Xiong, Z., Chen, K., Jiang, H., & Zheng, M. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.02.011 · Cited by 192
SumGNN: multi-typed drug interaction prediction via efficient knowledge graph summarization
Yu, Y., Huang, K., Zhang, C., Glass, L. M., Sun, J., & Xiao, C. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab207 · Cited by 191
Wang, J., Hsieh, C.-Y., Wang, M., Wang, X., Wu, Z., Jiang, D., Liao, B., Zhang, X., Yang, B., He, Q., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00403-1 · Cited by 191
Wu, Z., Wang, J., Du, H., Jiang, D., Kang, Y., Li, D., Pan, P., Deng, Y., Cao, D., Hsieh, C.-Y., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-38192-3 · Cited by 191
Graph neural network approaches for drug-target interactions
Zhang, Z., Chen, L., Zhong, F., Wang, D., Jiang, J., Zhang, S., Jiang, H., Zheng, M., & Li, X. (2022) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.102327 · Cited by 180
Applications of transformer-based language models in bioinformatics: a survey
Zhang, S., Fan, R., Liu, Y., Chen, S., Liu, Q., & Zeng, W. (2023) · Bioinformatics Advances · doi:10.1093/bioadv/vbad001 · Cited by 176
Han, R., Yoon, H., Kim, G., Lee, H., & Lee, Y. (2023) · Pharmaceuticals · doi:10.3390/ph16091259 · Cited by 176
AI-based language models powering drug discovery and development
Liu, Z., Roberts, R. A., Lal-Nag, M., Chen, X., Huang, R., & Tong, W. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.06.009 · Cited by 167
Manica, M., Oskooei, A., Born, J., Subramanian, V., Sáez-Rodríguez, J., & Martínez, M. R. (2019) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.9b00520 · Cited by 163
Tang, B., Kramer, S. T., Fang, M., Qiu, Y., Wu, Z., & Xu, D. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-0414-z · Cited by 163
MG-BERT: leveraging unsupervised atomic representation learning for molecular property prediction
Zhang, X.-C., Wu, C.-K., Yang, Z.-J., Wu, Z.-X., Yi, J.-C., Hsieh, C.-Y., Hou, T.-J., & Cao, D.-S. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab152 · Cited by 163
TALE: Transformer-based protein function Annotation with joint sequence–Label Embedding
Cao, Y., & Shen, Y. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab198 · Cited by 162
An attention-based effective neural model for drug-drug interactions extraction
Zheng, W., Lin, H., Luo, L., Zhao, Z., Li, Z., Zhang, Y., Yang, Z., & Wang, J. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1855-x · Cited by 148
Self-citationZhao, Q., Duan, G., Yang, M., Cheng, Z. A., Li, Y., & Wang, J. (2022) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2022.3170365 · Cited by 145
Recent progress in transformer-based medical image analysis
Liu, Z., Lv, Q., Yang, Z., Li, Y., Lee, C. H., & Shen, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107268 · Cited by 142
AlphaFold2-aware protein–DNA binding site prediction using graph transformer
Yuan, Q., Chen, S., Rao, J., Zheng, S., Zhao, H., & Yang, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab564 · Cited by 137
DeepTTA: a transformer-based model for predicting cancer drug response
Jiang, L., Jiang, C., Yu, X., Fu, R., Jin, S., & Liu, X. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac100 · Cited by 136
Yang, Z., Zhong, W., Lv, Q., & Chen, C. Y. (2022) · Chemical Science · doi:10.1039/d2sc02023h · Cited by 133
Yazdani-Jahromi, M., Yousefi, N., Tayebi, A., Kolanthai, E., Neal, C. J., Seal, S., & Garibay, Ö. Ö. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac272 · Cited by 131
Attention-based Knowledge Graph Representation Learning for Predicting Drug-drug Interactions
Su, X., Hu, L., You, Z., Hu, P., & Zhao, B.-W. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac140 · Cited by 125
GraphSynergy: a network-inspired deep learning model for anticancer drug combination prediction
Yang, J., Xu, Z., Wu, W. K. K., Chu, Q., & Zhang, Q. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab162 · Cited by 124
Ma, M., & Lei, X. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010812 · Cited by 119
Drug-Target Interaction Prediction Using Multi-Head Self-Attention and Graph Attention Network
Cheng, Z. A., Yan, C., Wu, F., & Wang, J. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3077905 · Cited by 118
Automated Chemical Reaction Extraction from Scientific Literature
Guo, J., Ibanez-Lopez, A. S., Gao, H., Quach, V., Coley, C. W., Jensen, K. F., & Barzilay, R. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00284 · Cited by 116
Zhang, L., Wang, C.-C., & Chen, X. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac468 · Cited by 114
The Cost of Training NLP Models: A Concise Overview
Sharir, O., Peleg, B., & Shoham, Y. (2020) · arXiv · doi:10.48550/arxiv.2004.08900 · Cited by 113
Drug–target interaction predication via multi-channel graph neural networks
Li, Y., Qiao, G., Wang, K., & Wang, G. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab346 · Cited by 112
Li, M., Lu, Z., Wu, Y., & Li, Y. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac035 · Cited by 109
Li, J., Wang, J., Lv, H., Zhang, Z., & Wang, Z. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3088614 · Cited by 108
Lv, H., Shi, L., Berkenpas, J. W., Dao, F.-Y., Zulfiqar, H., Ding, H., Zhang, Y., Yang, L., & Cao, R. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab320 · Cited by 107
Self-citationDrug-Drug Adverse Effect Prediction with Graph Co-AttentionPreprint
Deac, A., Huang, Y.-H. J., Veličković, P., Lió, P., & Tang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.00534 · Cited by 104
DTI-HETA: prediction of drug–target interactions based on GCN and GAT on heterogeneous graph
Shao, K., Zhang, Y., Wen, Y., Zhang, Z., He, S., & Bo, X. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac109 · Cited by 103
Self-citationJin, Z. J., Wu, T., Chen, T., Pan, D., Wang, X., Xie, J., Quan, L., & Lyu, Q. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad049 · Cited by 102
Attention-based generative models for de novo molecular design
Dollar, O., Joshi, N., Beck, D. A. C., & Pfaendtner, J. (2021) · Chemical Science · doi:10.1039/d1sc01050f · Cited by 101
DrugEx v3: scaffold-constrained drug design with graph transformer-based reinforcement learning
Liu, X., Ye, K., van Vlijmen, H., IJzerman, A. P., & van Westen, G. J. P. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00694-z · Cited by 97
Wang, Y., Zhao, H., Sciabola, S., & Wang, W. (2023) · Molecules · doi:10.3390/molecules28114430 · Cited by 96
GEFA: Early Fusion Approach in Drug-Target Affinity Prediction
Nguyen, T. M., Nguyen, T., Le, T. M., & Tran, T. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3094217 · Cited by 94
DeepTraSynergy: drug combinations using multimodal deep learning with transformers
Rafiei, F., Zeraati, H., Abbasi, K., Ghasemi, J. B., Parsaeian, M., & Masoudi‐Nejad, A. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad438 · Cited by 94
Edge Attention-based Multi-Relational Graph Convolutional NetworksPreprint
Shang, C., Liu, Q., Chen, K., Sun, J., Lü, J., Yi, J., & Bi, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04944 · Cited by 93
Transformer-based molecular optimization beyond matched molecular pairs
He, J., Nittinger, E., Tyrchan, C., Czechtizky, W., Patronov, A., Bjerrum, E. J., & Engkvist, O. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00599-3 · Cited by 93
Knowledge-based BERT: a method to extract molecular features like computational chemists
Wu, Z., Jiang, D., Wang, J., Zhang, X., Du, H., Pan, L., Hsieh, C., Cao, D., & Hou, T. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac131 · Cited by 93
Zhu, W., Zhang, Y., Zhao, D., Xu, J., & Wang, L. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.2c01099 · Cited by 92
Self-citationMolecule generation using transformers and policy gradient reinforcement learning
Mazuz, E., Shtar, G., Shapira, B., & Rokach, L. (2023) · Scientific Reports · doi:10.1038/s41598-023-35648-w · Cited by 89
Pang, S., Zhang, Y., Song, T., Zhang, X., Wang, X., & Rodríguez‐Patón, A. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab545 · Cited by 88
Self-citationDrug discovery companies are customizing ChatGPT: here’s how
Savage, N. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01788-7 · Cited by 86
PaccMann: a web service for interpretable anticancer compound sensitivity prediction
Cadow, J., Born, J., Manica, M., Oskooei, A., & Martínez, M. R. (2020) · Nucleic Acids Research · doi:10.1093/nar/gkaa327 · Cited by 85
Perceiver CPI: a nested cross-attention network for compound–protein interaction prediction
Nguyen, N.-Q., Jang, G., Kim, H., & Kang, J. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac731 · Cited by 83
A fingerprints based molecular property prediction method using the BERT model
Wen, N., Liu, G., Zhang, J., Zhang, R., Fu, Y., & Han, X. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00650-3 · Cited by 83
FraGAT: a fragment-oriented multi-scale graph attention model for molecular property prediction
Zhang, Z., Guan, J., & Zhou, S. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab195 · Cited by 82
Transformer-Based Molecular Generative Model for Antiviral Drug Design
Mao, J., Wang, J., Zeb, A., Cho, K., Jin, H., Kim, J., Lee, O., Wang, Y., & No, K. T. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00536 · Cited by 81
LaGAT: link-aware graph attention network for drug–drug interaction prediction
Hong, Y., Luo, P., Jin, S., & Liu, X. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac682 · Cited by 80
DTITR: End-to-end drug–target binding affinity prediction with transformers
Monteiro, N. R. C., Oliveira, J. L., & Arrais, J. P. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105772 · Cited by 77
Prediction of Drug Side Effects with a Refined Negative Sample Selection Strategy
Liang, H., Chen, L., Zhao, X., & Zhang, X. (2020) · Computational and Mathematical Methods in Medicine · doi:10.1155/2020/1573543 · Cited by 76
Kalakoti, Y., Yadav, S., & Sundar, D. (2022) · ACS Omega · doi:10.1021/acsomega.1c05203 · Cited by 76
Pharmacophoric-constrained heterogeneous graph transformer model for molecular property prediction
Jiang, Y., Jin, S., Jin, X., Xiao, X., Wu, W., Liu, X., Zhang, Q., Zeng, X., Yang, G., & Niu, Z. (2023) · Communications Chemistry · doi:10.1038/s42004-023-00857-x · Cited by 76
Zhang, R., Wang, Z., Wang, X., Meng, Z., & Cui, W. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad079 · Cited by 75
DFFNDDS: prediction of synergistic drug combinations with dual feature fusion networks
Xu, M., Zhao, X., Wang, J., Feng, W. Q., Wen, N., Wang, C., Wang, J., Liu, Y., & Zhao, L. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00690-3 · Cited by 75
Kim, H., Na, J., & Lee, W. B. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01289 · Cited by 72
Sequence-based prediction of protein binding regions and drug–target interactions
Lee, I., & Nam, H. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00584-w · Cited by 72
The Potential Applications of Artificial Intelligence in Drug Discovery and Development
Farghali, H., Kutinová Canová, N., & Arora, M. (2021) · Physiological Research · doi:10.33549/physiolres.934765 · Cited by 72
SAG-DTA: Prediction of Drug–Target Affinity Using Self-Attention Graph Network
Zhang, S., Jiang, M., Wang, S., Wang, X., Wei, Z., & Li, Z. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22168993 · Cited by 70
Wang, T., Wang, R., & Wei, L. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00709 · Cited by 68
Wang, J., Wen, N., Wang, C., Zhao, L., & Cheng, L. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00591-x · Cited by 67
Protein Structure Prediction: Challenges, Advances, and the Shift of Research Paradigms
Huang, B., Kong, L., Wang, C., Ju, F., Zhang, Q., Zhu, J., Gong, T., Zhang, H., Yu, C., Zheng, W., et al. (2023) · Genomics Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.11.014 · Cited by 67
He, H., Chen, G., & Chen, C. Y. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad355 · Cited by 67
DTSyn: a dual-transformer-based neural network to predict synergistic drug combinations
Hu, J., Gao, J., Fang, X., Liu, Z., Wang, F., Huang, W., Wu, H., & Zhao, G. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac302 · Cited by 65
Zhang, P., & Tu, S. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010951 · Cited by 64
Yenduri, G., Ramalingam, M., G, C. S., Supriya, Y., Srivastava, G., Maddikunta, P. K. R., Raj, G. D., Jhaveri, R. H., Prabadevi, B., Wang, W., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.10435 · Cited by 63
Feng, Y.-H., & Zhang, S. (2022) · Molecules · doi:10.3390/molecules27093004 · Cited by 62
Shin, J., Piao, Y., Bang, D., Kim, S., & Jo, K. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms232213919 · Cited by 61
Graph Transformer for Drug Response Prediction
Chu, T., Nguyen, T. T., Hải, B. D., Nguyen, Q. H., & Nguyen, T. (2022) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2022.3206888 · Cited by 57
Liu, C., Sun, Y., Davis, R. L., Cardona, S. T., & Hu, P. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00698-9 · Cited by 57
Self-citationDrugGPT: A GPT-based Strategy for Designing Potential Ligands Targeting Specific ProteinsPreprint
Li, Y., Gao, C., Song, X. G., Xiangyu, W., Xu, Y., & Han, S. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.06.29.543848 · Cited by 56
AlphaDrug: protein target specific de novo molecular generation
Qian, H., Lin, C., Zhao, D., Tu, S., & Xu, L. (2022) · PNAS Nexus · doi:10.1093/pnasnexus/pgac227 · Cited by 55
AttentionDDI: Siamese attention-based deep learning method for drug–drug interaction predictions
Schwarz, K., Allam, A., Gonzalez, N. A. P., & Krauthammer, M. O. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04325-y · Cited by 54
Liu, Y., Zhang, R., Li, T., Jiang, J., Ma, J., & Wang, P. (2022) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2022.108344 · Cited by 54
Qian, Y., Li, X., Wu, J., & Zhang, Q. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05447-1 · Cited by 51
Novel Transformer Networks for Improved Sequence Labeling in genomics
Clauwaert, J., & Waegeman, W. (2020) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2020.3035021 · Cited by 50
Transformer-Based Generative Model Accelerating the Development of Novel BRAF Inhibitors
Yang, L., Yang, G., Bing, Z., Tian, Y., Niu, Y., Yang, L., & Yang, L. (2021) · ACS Omega · doi:10.1021/acsomega.1c05145 · Cited by 49
Directed graph attention networks for predicting asymmetric drug–drug interactions
Feng, Y.-Y., Yu, H., Feng, Y.-H., & Shi, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac151 · Cited by 47
Attention-wise masked graph contrastive learning for predicting molecular property
Liu, H., Huang, Y., Liu, X., & Deng, L. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac303 · Cited by 47
Transformers in Reinforcement Learning: A SurveyPreprint
Agarwal, P., Rahman, A. A., St-Charles, P.-L., Prince, S. J. D., & Kahou, S. E. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.05979 · Cited by 46
PETrans: De Novo Drug Design with Protein-Specific Encoding Based on Transfer Learning
Wang, X., Gao, C., Han, P., Li, X., Chen, W., Rodríguez‐Patón, A., Wang, S., & Zheng, P. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24021146 · Cited by 42
TransFoxMol: predicting molecular property with focused attention
Gao, J., Shen, Z., Xie, Y., Lu, J., Lu, Y., Chen, S., Bian, Q., Guo, Y., Shen, L., Wu, J. F., et al. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad306 · Cited by 42
Zhao, H., Ni, P., Zhao, Q., Liang, X., Ai, D., Erhardt, S., Wang, J., Li, Y., & Wang, J. (2023) · Communications Biology · doi:10.1038/s42003-023-05243-w · Cited by 42
Yu, L., Qiu, W., Lin, W., Cheng, X., Xiao, X., & Dai, J. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04655-5 · Cited by 39
Fang, K., Zhang, Y., Du, S., & He, J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107372 · Cited by 39
Self-citationZhang, P., Tu, S., Zhang, W., & Xu, L. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac403 · Cited by 38
Teng, S., Yin, C., Wang, Y., Chen, X., Yan, Z., Cui, L., & Wei, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106904 · Cited by 38
Generative Pre-trained Transformer (GPT) based model with relative attention for de novo drug design
Haroon, S., Hafsath, C. A., & Jereesh, A. S. (2023) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2023.107911 · Cited by 38
Pretraining model for biological sequence data
Song, B., Li, Z., Lin, X., Wang, J., Wang, T., & Fu, X. (2021) · Briefings in Functional Genomics · doi:10.1093/bfgp/elab025 · Cited by 37
Multi-View Graph Neural Networks for Molecular Property PredictionPreprint
Ma, H., Bian, Y., Rong, Y., Huang, W., Xu, T., Xie, W., Ye, G., & Huang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13607 · Cited by 36
Xuan, P., Fan, M., Cui, H., Zhang, T., & Nakaguchi, T. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab453 · Cited by 36
MDL-CPI: Multi-view deep learning model for compound-protein interaction prediction
Wei, L., Long, W., & Wei, L. (2022) · Methods · doi:10.1016/j.ymeth.2022.01.008 · Cited by 36
Tian, Z., Peng, X., Fang, H., Zhang, W., Dai, Q., & Ye, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac434 · Cited by 36
Ruan, D., Ji, S., Yan, C. C., Zhu, J., Zhao, X., Yang, Y., Gao, Y., Zou, C., & Dai, Q. (2021) · Patterns · doi:10.1016/j.patter.2021.100390 · Cited by 35
SSGraphCPI: A Novel Model for Predicting Compound-Protein Interactions Based on Deep Learning
Wang, X., Liu, J., Zhang, C., & Wang, S. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23073780 · Cited by 35
Equivariant Graph Attention Networks for Molecular Property PredictionPreprint
Le, T., Noé, F., & Clevert, D.-A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.09891 · Cited by 34
DrugChat: Towards Enabling ChatGPT-Like Capabilities on Drug Molecule GraphsPreprint
Liang, Y., Zhang, R., Zhang, L., & Xie, P. (2023) · doi:10.36227/techrxiv.22945922 · Cited by 33
Deng, D., Lei, Z., Hong, X., Zhang, R., & Zhou, F. (2022) · ACS Omega · doi:10.1021/acsomega.1c06389 · Cited by 32
Future implications of ChatGPT in pharmaceutical industry: drug discovery and development
Zhao, A., & Wu, Y. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1194216 · Cited by 32
Chen, J., Gu, Z., Xu, Y., Deng, M., Lai, L., & Pei, J. (2022) · Protein Science · doi:10.1002/pro.4555 · Cited by 31
Protein–ligand binding affinity prediction with edge awareness and supervised attention
Gu, Y., Zhang, X., Xu, A., Chen, W., Liu, K., Wu, L., Mo, S., Hu, Y. Q., Liu, M., & Luo, Q. (2022) · iScience · doi:10.1016/j.isci.2022.105892 · Cited by 31
Self-citationExplore drug-like space with deep generative models
Wang, J., Mao, J., Wang, M., Le, X., & Wang, Y. (2023) · Methods · doi:10.1016/j.ymeth.2023.01.004 · Cited by 31
Wang, X., Zhu, H., Chen, D., Yu, Y., Liu, Q., & Liu, Q. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad351 · Cited by 31
Jiang, J., Zhang, R., Ma, J., Liu, Y., Yang, E., Du, S., Zhao, Z., & Yuan, Y. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04280-y · Cited by 30
DrugormerDTI: Drug Graphormer for drug–target interaction prediction
Hu, J., Yu, W., Pang, C., Jin, J., Pham, N. T., Manavalan, B., & Wei, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106946 · Cited by 30
Gim, M., Choe, J., Baek, S., Park, J., Lee, C., Ju, M., Lee, S., & Kang, J. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad207 · Cited by 30
MGPLI: exploring multigranular representations for protein–ligand interaction prediction
Wang, J., Hu, J., Sun, H., Xu, M., Yu, Y., Liu, Y., & Cheng, L. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac597 · Cited by 29
Yousefi, N., Yazdani-Jahromi, M., Tayebi, A., Kolanthai, E., Neal, C. J., Banerjee, T., Gosai, A., Balasubramanian, G., Seal, S., & Garibay, Ö. Ö. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad136 · Cited by 29
Cai, T., Lim, H., Abbu, K. A., Qiu, Y., Nussinov, R., & Xie, L. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01285 · Cited by 28
MultiGML: Multimodal graph machine learning for prediction of adverse drug events
Krix, S., DeLong, L. N., Madan, S., Domingo‐Fernándéz, D., Ahmad, A., Gul, S., Zaliani, A., & Fröhlich, H. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e19441 · Cited by 28
Huang, Z., Zhang, P., & Deng, L. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad244 · Cited by 26
Wan, X., Wu, X., Wang, D., Tan, X., Liu, X., Fu, Z., Jiang, H., Zheng, M., & Li, X. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac073 · Cited by 25
Multi-view feature representation and fusion for drug-drug interactions prediction
Wang, J., Zhang, S., Li, R., Chen, G., Yan, S., & Ma, L. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05212-4 · Cited by 25
Lin, S., Zhang, G., Wei, D., & Xiong, Y. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105984 · Cited by 24
Exploiting pretrained biochemical language models for targeted drug design
Uludoğan, G., Özkırımlı, E., Ülgen, K. Ö., Karalı, N., & Özgür, A. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac482 · Cited by 24
Zheng, Z., Tan, Y., Wang, H., Yu, S., Liu, T., & Liang, C. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbac566 · Cited by 24
Self-citationMulti-order graph attention network for water solubility prediction and interpretation
Lee, S., Park, H., Choi, C., Kim, W., Kim, K. K., Han, Y., Kang, J., Kang, C., & Son, Y. (2023) · Scientific Reports · doi:10.1038/s41598-022-25701-5 · Cited by 24
GCHN-DTI: Predicting drug-target interactions by graph convolution on heterogeneous networks
Wang, W., Liang, S., Yu, M., Liu, D., Zhang, H., Wang, X., & Zhou, Y. (2022) · Methods · doi:10.1016/j.ymeth.2022.08.016 · Cited by 23
Double-head transformer neural network for molecular property prediction
Song, Y., Chen, J., Wang, W., Chen, G., & Ma, Z. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00700-4 · Cited by 23
Wang, X., Liu, D., Zhu, J., Rodríguez‐Patón, A., & Song, T. (2021) · Biomolecules · doi:10.3390/biom11050643 · Cited by 22
MSEDDI: Multi-Scale Embedding for Predicting Drug—Drug Interaction Events
Yu, L., Xu, Z., Cheng, M., Lin, W., Qiu, W., & Xiao, X. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24054500 · Cited by 22
Kalakoti, Y., Yadav, S., & Sundar, D. (2022) · ACS Omega · doi:10.1021/acsomega.2c00424 · Cited by 21
Xuan, P., Wang, M., Liu, Y., Wang, D., Zhang, T., & Nakaguchi, T. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac126 · Cited by 21
Hi-MGT: A hybrid molecule graph transformer for toxicity identification
Tan, Z., Zhao, Y., Zhou, T., & Lin, K. (2023) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2023.131808 · Cited by 20
A-Prot: protein structure modeling using MSA transformer
Hong, Y., Lee, J., & Ko, J. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04628-8 · Cited by 19
Qian, Y., Wu, J., & Zhang, Q. (2022) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2022.963912 · Cited by 19
ICAN: Interpretable cross-attention network for identifying drug and target protein interactions
(2022) · doi:10.1371/journal.pone.0276609 · Cited by 19
Graph–sequence attention and transformer for predicting drug–target affinity
Yan, X., & Liu, Y. (2022) · RSC Advances · doi:10.1039/d2ra05566j · Cited by 19
Chen, H., Li, D., Liao, J., Wei, L., & Wei, L. (2022) · Methods · doi:10.1016/j.ymeth.2022.09.006 · Cited by 17
Bae, H., & Nam, H. (2022) · Biomedicines · doi:10.3390/biomedicines11010067 · Cited by 17
Li, J.-N., Yang, G. C., Zhao, P., Wei, X.-X., & Shi, J. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad222 · Cited by 17
Dong, Z., Zhang, H., Chen, Y., Payne, P., & Li, F. (2023) · Cancers · doi:10.3390/cancers15174210 · Cited by 17
DCE-DForest: A Deep Forest Model for the Prediction of Anticancer Drug Combination Effects
Zhang, W., Xue, Z., Li, Z., & Yin, H. (2022) · Computational and Mathematical Methods in Medicine · doi:10.1155/2022/8693746 · Cited by 16
Extracting representative subset from extensive text data for training pre-trained language models
Suzuki, J., Zen, H., & Kazawa, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103249 · Cited by 16
Adaptive language model training for molecular design
Blanchard, A. E., Bhowmik, D., Fox, Z., Gounley, J. P., Gläser, J., Akpa, B. S., & Irle, S. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00719-7 · Cited by 16
Yoshimori, A., & Bajorath, J. (2023) · Biomolecules · doi:10.3390/biom13050833 · Cited by 14
Research and Development Costs of New Drugs
Dominguez, L. W., & Willis, J. (2020) · JAMA · doi:10.1001/jama.2020.8645 · Cited by 13
Cheng, X., Cheng, M., Yu, L., & Xiao, X. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms232416216 · Cited by 13
Wen, J., Gan, H., Yang, Z. Y., Zhou, R., Zhao, J., & Ye, Z. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023469 · Cited by 13
Yuan, Y., Zhang, Y., Meng, X., Liu, Z., Wang, B., Miao, R., Zhang, R., Su, W., & Liu, L. (2023) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2023.108498 · Cited by 13
Self-citationZhang, J., Du, W., Yang, X., Wu, D., Li, J., Wang, K., & Wang, Y. (2023) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2023.1216765 · Cited by 11
PredPS: Attention-based graph neural network for predicting stability of compounds in human plasma
Jang, W. D., Jang, J., Song, J. S., Ahn, S., & Oh, K. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.07.008 · Cited by 11
Property Prediction of Molecules in Graph Convolutional Neural Network Expansion
Meng, M., Wei, Z., Li, Z., Jiang, M., & Bian, Y. (2019) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess47205.2019.9040723 · Cited by 10
Xuan, P., Zhang, X., Zhang, Y., Hu, K., Nakaguchi, T., & Zhang, T. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac120 · Cited by 10
Self-citationRanjan, A., Kumar, H., Kumari, D., Anand, A., & Misra, R. (2023) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-023-00409-2 · Cited by 10
FastDTI: Drug-Target Interaction Prediction using Multimodality and Transformers
Boezer, M., Tavakol, M., & Sajadi, Z. (2023) · Proceedings of the Northern Lights Deep Learning Workshop · doi:10.7557/18.6788 · Cited by 7
Muniyappan, S., Rayan, A. X. A., & Varrieth, G. T. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023419 · Cited by 6
TCR: A Transformer Based Deep Network for Predicting Cancer Drugs ResponsePreprint
Gao, J., Hu, J. Y., Sun, W., Shen, Y., Zhang, X., Fang, X., Wang, F., & Zhao, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.04457 · Cited by 3
Cited by
Qu, B., Liang, X., Sun, S., & Gao, W. (2024) · arXiv · doi:10.48550/arxiv.2404.13573 · Cited by 44
An in-depth review of AI-powered advancements in cancer drug discovery
Le, M. H. N., Nguyen, P. K., Nguyen, T. P. T., Nguyen, H. Q., Tam, D. N. H., Huynh, H. H., Huynh, P. K., & Le, N. Q. K. (2025) · Biochimica et Biophysica Acta (BBA) - Molecular Basis of Disease · doi:10.1016/j.bbadis.2025.167680 · Cited by 15
Bootstrapping Language-Audio Pre-training for Music Captioning
Lanzendörfer, L. A., Pinkl, C., Perraudin, N., & Wattenhofer, R. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10887618 · Cited by 3
Metadata
- Authors
- Zhang, Y., Liu, C., Liu, M., Liu, T., Lin, H., Huang, C.-B., & Ning, L.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-11-22
- Volume
- 25
- Issue
- 1
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4390678101
- Cited by
- 377
- References
- 190
- FWCI
- 49.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.