The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation
Open accessAbstract
Generating long and coherent reports to describe medical images poses challenges to bridging visual patterns with informative human linguistic descriptions. We propose a novel Hybrid Retrieval-Generation Reinforced Agent (HRGR-Agent) which reconciles traditional retrieval-based approaches populated with human prior knowledge, with modern learning-based approaches to achieve structured, robust, and diverse report generation. HRGR-Agent employs a hierarchical decision-making procedure. For each sentence, a high-level retrieval policy module chooses to either retrieve a template sentence from an off-the-shelf template database, or invoke a low-level generation module to generate a new sentence. HRGR-Agent is updated via reinforcement learning, guided by sentence-level and word-level rewards. Experiments show that our approach achieves the state-of-the-art results on two medical report datasets, generating well-balanced structured sentences with robust coverage of heterogeneous medical report contents. In addition, our model achieves the highest detection accuracy of medical terminologies, and improved human evaluation performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, deep learning methods have also been used for automated generation of radiology reports , typically incorporating long-short-term-memory (LSTM) network models to generate the textual paragraphs [314, 315, 316, 317], and also to identify findings in radiology reports [318, 319, 320].”
From An overview of deep learning in medical imaging focusing on MRI (2019) · cites this paper as [315]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
(2004) · Cited by 9,718
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2018) · NORA - Norwegian Open Research Archives · Cited by 1,012
Generating Radiology Reports via Memory-driven Transformer
Chen, Z., Song, Y., Chang, T.-H., & Wan, X. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.112 · Cited by 693
Solving inverse problems using data-driven models
Arridge, S., Maaß, P., Öktem, O., & Schönlieb, C. (2019) · Acta Numerica · doi:10.1017/s0962492919000059 · Cited by 767
Advances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 557
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation
Liu, F., Wu, X., Ge, S., Fan, W., & Zou, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01354 · Cited by 422
Cross-modal Memory Networks for Radiology Report Generation
Chen, Z., Shen, Y., Song, Y., & Wan, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.459 · Cited by 369
Knowledge-Driven Encode, Retrieve, Paraphrase for Medical Image Report Generation
Li, C. Y., Liang, X., Hu, Z., & Xing, E. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016666 · Cited by 316
Self-citationA survey on incorporating domain knowledge into deep learning for medical image analysis
Xie, X., Niu, J., Liu, X., Chen, Z., Tang, S., & Yu, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101985 · Cited by 331
Li, C. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351006620-6 · Cited by 257
Self-citationKnowledge matters: Chest radiology report generation with general and specific knowledge
Yang, S., Wu, X., Ge, S., Zhou, S. K., & Xiao, L. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102510 · Cited by 225
Interactive and Explainable Region-guided Radiology Report Generation
Tanida, T., Müller, P., Kaissis, G. A., & Rueckert, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00718 · Cited by 247
Clinically Accurate Chest X-Ray Report GenerationPreprint
Liu, G., Hsu, T.-M. H., McDermott, M. B. A., Boag, W., Weng, W., Peter Szolovits, B., & Ghassemi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02633 · Cited by 212
Dynamic Graph Enhanced Contrastive Learning for Chest X-Ray Report Generation
Li, M., Lin, B., Chen, Z., Lin, H., Liang, X., & Chang, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00325 · Cited by 206
Self-citationRadiology report generation with a learned knowledge base and multi-modal alignment
Yang, S., Wu, X., Ge, S., Zheng, Z., Zhou, S. K., & Xiao, L. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102798 · Cited by 199
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning
Chen, J., Guo, H., Yi, K., Li, B., & Elhoseiny, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01750 · Cited by 222
Deep learning in generating radiology reports: A survey
Monshi, M. M. A., Poon, J., & Chung, Y. Y. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101878 · Cited by 201
METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokens
Wang, Z., Liu, L., Wang, L., & Zhou, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01112 · Cited by 184
“CoAtt [12] and HGRNAgent [17] only report results on IU-Xray in their original paper.”
BackgroundMethodInfluentialContrastive Attention for Automatic Chest X-ray Report Generation
Liu, F., Yin, C., Wu, X., Ge, S., Zhang, P., & Sun, X. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.23 · Cited by 180
Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports
Zhang, Y., Merck, D., Tsai, E., Manning, C. D., & Langlotz, C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.458 · Cited by 171
Improving chest X-ray report generation by leveraging warm starting
Nicolson, A., Dowling, J., & Koopman, B. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102633 · Cited by 161
KiUT: Knowledge-injected U-Transformer for Radiology Report Generation
Huang, Z., Zhang, X., & Zhang, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01897 · Cited by 162
Triple attention learning for classification of 14 thoracic diseases using chest radiography
Wang, H., Wang, S., Qin, Z., Zhang, Y., Li, R., & Xia, Y. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101846 · Cited by 145
Competence-based Multimodal Curriculum Learning for Medical Report Generation
Liu, F., Ge, S., & Wu, X. (2021) · doi:10.18653/v1/2021.acl-long.234 · Cited by 153
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation
Miura, Y., Zhang, Y., Tsai, E., Langlotz, C., & Jurafsky, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.416 · Cited by 149
Reinforced Cross-modal Alignment for Radiology Report Generation
Qin, H., & Song, Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.38 · Cited by 145
Jiang, H., Shen, F., Gao, F., & Han, W. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107825 · Cited by 120
Progressive Transformer-Based Generation of Radiology Reports
Nooralahzadeh, F., Gonzalez, N. A. P., Frauenfelder, T., Fujimoto, K., & Krauthammer, M. O. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.241 · Cited by 121
Automatic Generation of Medical Imaging Diagnostic Report with Hierarchical Recurrent Neural Network
Yin, C., Qian, B., Wei, J., Li, X., Zhang, X., Li, Y., & Zheng, Q. (2019) · Proceedings · doi:10.1109/icdm.2019.00083 · Cited by 116
Automated Radiographic Report Generation Purely on Transformer: A Multicriteria Supervised Approach
Wang, Z., Han, H., Wang, L., Li, X., & Zhou, L. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3171661 · Cited by 118
Reinforced Transformer for Medical Image Captioning
Xiong, Y., Du, B., & Yan, P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32692-0_77 · Cited by 94
A Self-boosting Framework for Automated Radiographic Report Generation
Wang, Z., Zhou, L., Wang, L., & Li, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00246 · Cited by 95
Automated Radiology Report Generation: A Review of Recent Advances
Sloan, P., Clatworthy, P. L., Simpson, E., & Mirmehdi, M. (2024) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2024.3408456 · Cited by 106
PRIOR: Prototype Representation Joint Learning from Medical Images and Reports
Cheng, P., Lin, L., Lyu, J., Huang, Y., Luo, W., & Tang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01953 · Cited by 93
Liu, G., Liao, Y., Wang, F., Zhang, B., Zhang, L., Liang, X., Wan, X., Li, S., Li, Z., Zhang, S., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3099165 · Cited by 81
Self-citationA survey on automatic generation of medical imaging reports based on deep learning
Pang, T., Li, P., & Zhao, L. (2023) · BioMedical Engineering OnLine · doi:10.1186/s12938-023-01113-y · Cited by 88
Attentive and ensemble 3D dual path networks for pulmonary nodules classification
Jiang, H., Gao, F., Xu, X., Huang, F., & Zhu, S. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.103 · Cited by 77
Bootstrapping Large Language Models for Radiology Report Generation
Liu, C., Tian, Y., Chen, W., Song, Y., & Zhang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29826 · Cited by 99
Joint Embedding of Deep Visual and Semantic Features for Medical Image Report Generation
Yang, Y. Q., Yu, J., Zhang, J., Han, W., Jiang, H., & Huang, Q. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3122542 · Cited by 78
ChestXRayBERT: A Pretrained Language Model for Chest Radiology Report Summarization
Cai, X., Liu, S., Han, J., Yang, L., Liu, Z., & Liu, T. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3132724 · Cited by 72
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation
Yan, A., He, Z., Lü, X., Jiang, D., Chang, E., Gentili, A., McAuley, J., & Hsu, C. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.336 · Cited by 79
Reale-Nosei, G., Amador-Domínguez, E., & Serrano, E. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103264 · Cited by 72
Learning to Generate Clinically Coherent Chest X-Ray Reports
Lovelace, J., & Mortazavi, B. J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.110 · Cited by 66
Huang, X., Yan, F., Xu, W., & Li, M. (2019) · IEEE Access · doi:10.1109/access.2019.2947134 · Cited by 65
Unifying neural learning and symbolic reasoning for spinal medical report generation
Han, Z., Wei, B., Xi, X., Chen, B., Yin, Y., & Li, S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101872 · Cited by 69
CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation
Wang, J., Bhalerao, A. H., Yin, T., See, S. C. W., & He, Y. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3354712 · Cited by 72
Semi-Supervised Medical Report Generation via Graph-Guided Hybrid Feature Consistency
Zhang, K., Jiang, H., Zhang, J., Huang, Q., Jianping Fan, B., Yu, J., & Han, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3273390 · Cited by 64
TSGET: Two-Stage Global Enhanced Transformer for Automatic Radiology Report Generation
Yi, X., Fu, Y., Liu, R., Zhang, H., & Hua, R. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3350077 · Cited by 64
MMTN: Multi-Modal Memory Transformer Network for Image-Report Consistent Medical Report Generation
Cao, Y., Cui, L., Zhang, L., Yu, F., Li, Z., & Xu, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25100 · Cited by 60
Chest X-Ray Report Generation Through Fine-Grained Label Learning
Syeda-Mahmood, T. F., Wong, K. C. L., Gur, Y., Wu, J. T.-Y., Jadhav, A., Kashyap, S., Karargyris, A., Pillai, A., Sharma, A., Syed, A., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59713-9_54 · Cited by 57
Memory Guided Transformer With Spatio-Semantic Visual Extractor for Medical Report Generation
Divya, P., Yenduri, S., Vishnu, C., Mohan, C. K., & Chen, Y. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3371894 · Cited by 62
Automated Generation of Accurate & Fluent Medical X-ray Reports
Nguyen, H. N., Nie, D., Badamdorj, T., Liu, Y., Zhu, Y., Truong, J., & Li, C. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.288 · Cited by 60
Self-citationContrast-Attentive Thoracic Disease Recognition With Dual-Weighting Graph Reasoning
Zhou, Y., Zhou, T., Zhou, T., Fu, H., Liu, J., & Shao, L. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3049498 · Cited by 54
Multi-Grained Radiology Report Generation With Sentence-Level Image-Language Contrastive Learning
Liu, A., Guo, Y., Yong, J., & Xu, F. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3372638 · Cited by 55
Generating Radiology Report Via Auxiliary Signal Guidance and Memory-Driven Network
Xue, Y., Tan, Y., Tan, L., Qin, J., & Xiang, X. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121260 · Cited by 55
Multi-task paired masking with alignment modeling for medical vision-language pre-training
Zhang, K., Yang, Y., Yu, J., Jiang, H., Fan, J., Huang, Q., & Han, W. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3325965 · Cited by 51
Park, H., Kim, K. M., Park, S., & Choi, J. (2021) · IEEE Access · doi:10.1109/access.2021.3124564 · Cited by 52
Attention based automated radiology report generation using CNN and LSTM
Sirshar, M., Paracha, M. F. K., Akram, M. U., Alghamdi, N. S., Zaidi, S. Z. Y., & Fatima, T. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262209 · Cited by 54
Abbass, M. A. B., & Kang, H. (2023) · Drones · doi:10.3390/drones7040225 · Cited by 52
ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning
Hou, W., Xu, K., Cheng, Y., Li, W., & Liu, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.451 · Cited by 63
SODA: Detecting COVID-19 in Chest X-Rays With Semi-Supervised Open Set Domain Adaptation
Zhou, J., Jing, B., Wang, Z., Xin, H., & Tong, H. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3066331 · Cited by 50
Automatic ultrasound image report generation with adaptive multimodal attention mechanism
Yang, S., Niu, J., Wu, J., Wang, Y., Liu, X., & Li, Q. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.084 · Cited by 49
MKCL: Medical Knowledge with Contrastive Learning model for radiology report generation
Hou, X., Liu, Z., Li, X., Li, X., Sang, S., & Zhang, Y. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104496 · Cited by 49
Reinforcement Learning ApplicationsPreprint
Li, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06973 · Cited by 77
Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation
Yang, X., Ye, M., You, Q., & Ma, F. (2021) · doi:10.18653/v1/2021.acl-long.387 · Cited by 54
Kaur, N., Mittal, A., & Singh, G. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11272-6 · Cited by 45
Nam, W. K., & Jang, B. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121168 · Cited by 49
Unify, Align and Refine: Multi-Level Semantic Alignment for Radiology Report Generation
Li, Y., Yang, B., Cheng, X., Zhu, Z., Li, H., & Zou, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00268 · Cited by 48
AnaXNet: Anatomy Aware Multi-label Finding Classification in Chest X-Ray
Agu, N. N., Wu, J. T.-Y., Chao, H., Lourentzou, I., Sharma, A., Moradi, M., Yan, P., & Hendler, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87240-3_77 · Cited by 42
Unifying Relational Sentence Generation and Retrieval for Medical Image Report Composition
Wang, F., Liang, X., Xu, L. H., & Lin, L. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3026098 · Cited by 43
Self-citationPrior Guided Transformer for Accurate Radiology Reports Generation
Yan, B., Pei, M., Zhao, M., Shan, C., & Tian, Z. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3197162 · Cited by 42
Uncertainty-aware report generation for chest X-rays by variational topic inference
Najdenkoska, I., Zhen, X., Worring, M., & Shao, L. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102603 · Cited by 43
Deep learning approaches to automatic radiology report generation: A systematic review
Liao, Y., Liu, H., & Spasić, . (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101273 · Cited by 47
Reinforcement learning approaches for efficient and secure blockchain-powered smart health systems
Al-Marridi, A. Z., Mohamed, A. M. S., & Erbad, A. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108279 · Cited by 44
Lin, Z., Zhang, D., Shi, D., Xu, R., Tao, Q., Wu, L., He, M., & Ge, Z. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104281 · Cited by 39
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays
Ni, J., Hsu, C., Gentili, A., & McAuley, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.176 · Cited by 44
Evaluating diagnostic content of AI-generated radiology reports of chest X-rays
Babar, Z., van Laarhoven, T., Zanzotto, F. M., & Marchiori, E. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102075 · Cited by 37
Al-Marridi, A. Z., Mohamed, A. M. S., & Erbad, A. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.103834 · Cited by 43
Utilizing Longitudinal Chest X-Rays and Reports to Pre-fill Radiology Reports
Zhu, Q., Mathai, T. S., Mukherjee, P., Peng, Y., Summers, R. M., & Lu, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43904-9_19 · Cited by 38
From Observation to Concept: A Flexible Multi-View Paradigm for Medical Report Generation
Liu, Z., Zhu, Z., Zheng, S., Zhao, Y., He, K., & Zhao, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3342691 · Cited by 38
RepsNet: Combining Vision with Language for Automated Medical Reports
Tanwani, A. K., Barral, J. K., & Freedman, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16443-9_68 · Cited by 39
CADxReport: Chest x-ray report generation using co-attention mechanism and reinforcement learning
Kaur, N., & Mittal, A. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105498 · Cited by 34
Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation
Yan, S., Cheung, W. K., Chiu, K. W.-H., Tong, T. M., Cheung, K. C., & See, S. C. W. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3245608 · Cited by 38
Diagnostic captioning: a survey
Pavlopoulos, J., Kougia, V., Androutsopoulos, I., & Papamichail, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01684-7 · Cited by 38
Variational Topic Inference for Chest X-Ray Report Generation
Najdenkoska, I., Zhen, X., Worring, M., & Shao, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87199-4_59 · Cited by 33
A Novel Deep Learning Model for Medical Report Generation by Inter-Intra Information Calibration
Zhang, J., Shen, X., Wan, S., Goudos, S. K., Wu, J., Cheng, M., & Zhang, W. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3236661 · Cited by 33
Visual-Textual Attentive Semantic Consistency for Medical Report Generation
Zhou, Y., Huang, L., Zhou, T., Fu, H., & Shao, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00395 · Cited by 32
A Self-guided Framework for Radiology Report Generation
Li, J., Li, S., Hu, Y., & Tao, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_56 · Cited by 34
Zhao, G., Zhao, Z., Gong, W., & Li, F. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102714 · Cited by 30
A Self-training Framework for Automated Medical Report Generation
Wang, S., Liu, Z., & Peng, B. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.1024 · Cited by 32
CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation
Alqahtani, F. F., Mohsan, M. M., Alshamrani, K. A., Zeb, J., Alhamami, S. A., & Alqarni, D. (2024) · IEEE Access · doi:10.1109/access.2024.3367360 · Cited by 36
Hybrid Reinforced Medical Report Generation With M-Linear Attention and Repetition Penalty
Xu, Z., Xu, W., Wang, R., Chen, J., Chang, Q., & Lukasiewicz, T. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3343391 · Cited by 34
Tang, Y., Yang, H., Zhang, L., & Yuan, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121442 · Cited by 31
Hierarchical X-Ray Report Generation via Pathology Tags and Multi Head Attention
Srinivasan, P., Thapar, D., Bhavsar, A. V., & Nigam, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_36 · Cited by 29
CLARA: Clinical Report Auto-completion
Biswal, S., Xiao, C., Glass, L. M., Westover, M. B., & Sun, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380137 · Cited by 28
Efficient Evolving Deep Ensemble Medical Image Captioning Network
Singh, D., Kaur, M., Alanazi, J. M., AlZubi, A. A., & Lee, H.-N. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3223181 · Cited by 28
Contextualized Keyword Representations for Multi-modal Retinal Image Captioning
Huang, J.-H., Wu, T.-W., & Worring, M. (2021) · International Conference on Multimedia Retrieval · doi:10.1145/3460426.3463667 · Cited by 28
A Comprehensive Study of GPT-4V’s Multimodal Capabilities in Medical ImagingPreprint
Li, Y., Liu, Y., Wang, Z., Liang, X., Liu, L., Wang, L., Cui, L., Tu, Z., Wang, L., & Zhou, L. (2023) · medRxiv · doi:10.1101/2023.11.03.23298067 · Cited by 28
Self-citationDeep Context-Encoding Network For Retinal Image Captioning
Huang, J.-H., Wu, T.-W., Yang, C.-H. H., & Worring, M. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506803 · Cited by 34
Retracted: Deep Learning in Dynamic Modeling of Medical Imaging: A Review Study
Swarna, S. R., Boyapati, S., Dutt, V., & Bajaj, K. (2020) · International Conference on Intelligent Sustainable Systems (ICISS) · doi:10.1109/iciss49785.2020.9315990 · Cited by 28
Retracted
Metadata
- Authors
- Li, C. Y., Liang, X., Hu, Z., & Xing, E. P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1530-1540
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1805.08298
- OpenAlex
- W2803411968
- Cited by
- 271
- References
- 45
- Citations by year
- 2026: 2 · 2025: 32 · 2024: 54 · 2023: 62 · 2022: 33 · 2021: 48 · 2020: 23 · 2019: 15 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- medical report generation, retrieval-augmented generation, reinforcement learning, hierarchical decision-making, structured report generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
