The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation
Open accessAbstract
Generating long and coherent reports to describe medical images poses challenges to bridging visual patterns with informative human linguistic descriptions. We propose a novel Hybrid Retrieval-Generation Reinforced Agent (HRGR-Agent) which reconciles traditional retrieval-based approaches populated with human prior knowledge, with modern learning-based approaches to achieve structured, robust, and diverse report generation. HRGR-Agent employs a hierarchical decision-making procedure. For each sentence, a high-level retrieval policy module chooses to either retrieve a template sentence from an off-the-shelf template database, or invoke a low-level generation module to generate a new sentence. HRGR-Agent is updated via reinforcement learning, guided by sentence-level and word-level rewards. Experiments show that our approach achieves the state-of-the-art results on two medical report datasets, generating well-balanced structured sentences with robust coverage of heterogeneous medical report contents. In addition, our model achieves the highest detection accuracy of medical terminologies, and improved human evaluation performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, deep learning methods have also been used for automated generation of radiology reports , typically incorporating long-short-term-memory (LSTM) network models to generate the textual paragraphs [314, 315, 316, 317], and also to identify findings in radiology reports [318, 319, 320].”
From An overview of deep learning in medical imaging focusing on MRI (2019) · cites this paper as [315]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
(2004) · Cited by 9,718
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Cited by
Sorted by citations
Items 101–200 of 271
Gao, D., Kong, M. C., Zhao, Y., Huang, J.-Z. J., Huang, Z., Kuang, K., Wu, F. Q., & Zhu, Q. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102982 · Cited by 31
Cross Encoder-Decoder Transformer with Global-Local Visual Extractor for Medical Image Captioning
Lee, H., Cho, H., Park, J., Chae, J., & Kim, J. (2022) · Sensors · doi:10.3390/s22041429 · Cited by 29
Deep learning for report generation on chest X-ray images
Ouis, M. Y., & A. Akhloufi, M. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2023.102320 · Cited by 25
Context-enhanced framework for medical image report generation using multimodal contexts
Li, H., Wang, H., Sun, X., He, H., & Feng, J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112913 · Cited by 28
S3-Net: A Self-Supervised Dual-Stream Network for Radiology Report Generation
Pan, R., Ran, R., Hu, W., Zhang, W., Qin, Q., & Cui, S. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3345932 · Cited by 27
Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring
Qiu, J., Lo, F. P.-W., Gu, X., Jobarteh, M. L., Jia, W., Baranowski, T., Steiner‐Asiedu, M., Anderson, A. K., McCrory, M. A., Sazonov, E. E., et al. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3243999 · Cited by 25
Automatic Generation of Chest X-ray Reports Using a Transformer-based Deep Learning Model
Amjoud, A. B., & Amrouch, M. (2021) · International Conference on Intelligent Computing in Data Sciences (ICDS) · doi:10.1109/icds53782.2021.9626725 · Cited by 25
A systematic evaluation of GPT-4V's multimodal capability for chest X-ray image analysis
Liu, Y., Li, Y., Wang, Z., Liang, X., Liu, L., Wang, L., Cui, L., Tu, Z., Wang, L., & Zhou, L. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100099 · Cited by 25
Self-citationImproving Medical X-ray Report Generation by Using Knowledge Graph
Zhang, D., Ren, A., Liang, J., Liu, Q., Wang, H., & Ma, Y. (2022) · Applied Sciences · doi:10.3390/app122111111 · Cited by 23
Integrating domain knowledge for biomedical text analysis into deep learning: A survey
Cai, L., Li, J., Lv, H., Liu, W., Niu, H., & Wang, Z. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104418 · Cited by 25
XRaySwinGen: Automatic medical reporting for X-ray exams with multimodal model
Magalhães, G. V., Santos, R. L. D. S., Vogado, L. H. S., de Paiva, A. C., & Neto, P. D. A. D. S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e27516 · Cited by 24
Learning Hierarchical Representations of Electronic Health Records for Clinical Outcome Prediction
Liu, L., Li, H., Hu, Z., Shi, H., Wang, Z., Tang, J., & Zhang, M. (2019) · PubMed Central · doi:10.48550/arxiv.1903.08652 · Cited by 22
Self-citationImproving Joint Learning of Chest X-Ray and Radiology Report by Word Region Alignment
Ji, Z., Shaikh, M. A., Moukheiber, D., Srihari, S. N., Peng, Y., & Gao, M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87589-3_12 · Cited by 21
Customized Impression Prediction From Radiology Reports Using BERT and LSTMs
Gündoğdu, B., Pamuksuz, U., Chung, J. H., Telleria, J. M., Liu, P., Khan, F., & Chang, P. J. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3086435 · Cited by 23
Translating medical image to radiological report: Adaptive multilevel multi-attention approach
Gajbhiye, G. O., Nandedkar, A. V., & Faye, I. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106853 · Cited by 22
Wang, H., Jin, Y., & Zhu, L. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160647 · Cited by 21
DACG: Dual Attention and Context Guidance model for radiology report generation
Lang, W., Liu, Z., & Zhang, Y. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103377 · Cited by 20
Hou, X., Li, X., Liu, Z., Sang, S., Lu, M., & Zhang, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126394 · Cited by 20
Show, tell and summarise: learning to generate and summarise radiology findings from medical images
Singh, S., Karimi, S., Ho‐Shon, K., & Hamey, L. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-05943-6 · Cited by 23
Improving radiology report generation with multi-grained abnormality prediction
Jin, Y., Chen, W., Tian, Y., Song, Y., & Yan, C. C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128122 · Cited by 23
Vispi: Automatic Visual Perception and Interpretation of Chest X-raysPreprint
Li, X. S., Cao, R., & Zhu, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05190 · Cited by 20
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report GenerationPreprint
Liu, F., Wu, X., Ge, S., Fan, W., & Zou, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06963 · Cited by 20
RRGMambaFormer: A hybrid Transformer-Mamba architecture for radiology report generation
Li, H., Liu, S., Wang, H., Jiang, X., Jiu, M., Chen, L., Lu, Y., Lu, Y., & Xu, M. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127419 · Cited by 19
Non-local Attention Improves Description Generation for Retinal Images
Huang, J.-H., Wu, T.-W., Yang, C.-H. H., Shi, Z., Lin, I.-H., Tegner, J. N., & Worring, M. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00331 · Cited by 19
Unsupervised disease tags for automatic radiology report generation
Yi, X., Fu, Y., Hua, R., Liu, R., & Zhang, H. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105742 · Cited by 19
RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning
Hou, W., Cheng, Y., Xu, K., Li, W., & Liu, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.140 · Cited by 27
MATNet: Exploiting Multi-Modal Features for Radiology Report Generation
Shang, C., Cui, S., Li, T., Wang, X., Li, Y., & Jiang, J. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3229844 · Cited by 18
An Organ-Aware Diagnosis Framework for Radiology Report Generation
Li, S., Qiao, P., Wang, L., Ning, M., Yuan, L., Zheng, Y., & Chen, J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3421599 · Cited by 23
Contrastive Attention for Automatic Chest X-ray Report GenerationPreprint
Liu, F., Yin, C., Wu, X., Ge, S., Zou, Y., Zhang, P., Zou, Y., & Sun, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06965 · Cited by 51
Automatic Medical Image Report Generation with Multi-view and Multi-modal Attention Mechanism
Yang, S., Niu, J., Wu, J., & Liu, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60248-2_48 · Cited by 17
Adapter-Enhanced Hierarchical Cross-Modal Pre-Training for Lightweight Medical Report Generation
Yu, T., Lu, W., Yang, Y. Q., Han, W., Huang, Q., Yu, J., & Zhang, K. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3535699 · Cited by 18
Automatic Report Generation for Chest X-Ray Images: A Multilevel Multi-attention Approach
Gajbhiye, G. O., Nandedkar, A. V., & Faye, I. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-4015-8_15 · Cited by 17
Few-shot Radiology Report Generation for Rare Diseases
Jia, X., Xiong, Y., Zhang, J., Zhang, Y., & Zhu, Y. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313563 · Cited by 17
ACapMed: Automatic Captioning for Medical Imaging
Beddiar, D. R., Oussalah, M., Seppänen, T., & Jennane, R. (2022) · Applied Sciences · doi:10.3390/app122111092 · Cited by 17
PreGenerator : TCM Prescription Recommendation Model Based on Retrieval and Generation Method
Zhao, Z., Ren, X., Song, K., Qiang, Y., Zhao, J., Zhang, J., & Peng, H. (2023) · IEEE Access · doi:10.1109/access.2023.3316219 · Cited by 17
Chest radiology report generation based on cross-modal multi-scale feature fusion
Pan, Y., Liu, L., Yang, X.-B., Peng, W., & Huang, Q. (2024) · Journal of Radiation Research and Applied Sciences · doi:10.1016/j.jrras.2024.100823 · Cited by 19
Automatic medical report generation based on deep learning: A state of the art survey
Liu, X., Xin, J., Shen, Q., Huang, Z., & Wang, Z. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2024.102486 · Cited by 22
QIAI at MEDIQA 2021: Multimodal Radiology Report Summarization
Delbrouck, J.-B., Zhang, C., & Rubin, D. L. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.33 · Cited by 17
Automatic Radiology Report Generation by Learning with Increasingly Hard Negatives
Voutharoja, B. P., Wang, L., & Zhou, L. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230545 · Cited by 16
PhraseAug: An Augmented Medical Report Generation Model With Phrasebook
Mei, X., Yang, L., Gao, D., Cai, X., Han, J., & Liu, T. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3416190 · Cited by 18
Automatic Medical Report Generation: Methods and Applications
Li, G., Tahir, A. M., Zhang, D., Wang, Z. J., & Ward, R. K. (2024) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.20240044 · Cited by 20
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report GenerationPreprint
Miura, Y., Zhang, Y., Tsai, E., Langlotz, C., & Jurafsky, D. (2020) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2010.10042 · Cited by 264
Weakly Supervised Contrastive Learning for Chest X-Ray Report GenerationPreprint
Yan, A., He, Z., Lü, X., Du, J., Chang, E., Gentili, A., McAuley, J., & Hsu, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12242 · Cited by 20
AIMNet: Adaptive Image-Tag Merging Network For Automatic Medical Report Generation
Shi, J., Wang, S., Wang, R., & Ma, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747702 · Cited by 16
Visual prior-based cross-modal alignment network for radiology report generation
Zhang, S., Zhou, C., Chen, L., Li, Z.-Y., Gao, Y., & Chen, Y. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107522 · Cited by 15
A contrastive triplet network for automatic chest X-ray reporting
Yang, Y. Q., Yu, J. Y., Jiang, H., Han, W., Zhang, J., & Jiang, W. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.063 · Cited by 14
GREN: Graph-Regularized Embedding Network for Weakly-Supervised Disease Localization in X-Ray Images
Qi, B., Zhao, G., Wei, X., Du, C., Pan, C., Yu, Y., & Li, J. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3193108 · Cited by 16
Paalvast, O., Nauta, M., Koelle, M., Geerdink, J., Vijlbrief, O., Hegeman, J. H., & Seifert, C. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102281 · Cited by 13
A label information fused medical image report generation framework
Sun, S., Mei, Z., Li, X., Tang, T., Su, Z., & Wu, Y. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102823 · Cited by 13
Parres, D., Albiol, A., & Paredes, R. (2024) · Bioengineering · doi:10.3390/bioengineering11040351 · Cited by 18
Label correlated contrastive learning for medical report generation
Liu, X., Xin, J., Dai, B. T., Shen, Q., Huang, Z., & Wang, Z. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108482 · Cited by 15
Pre-training on high-resolution X-ray images: an experimental study
Wang, X., Li, Y., Wu, W., Jin, J., Rong, Y., Jiang, B., Li, C., & Tang, J. (2025) · Visual Intelligence · doi:10.1007/s44267-025-00080-3 · Cited by 16
Self-citationA Primer on Large Language Models and their LimitationsPreprint
Johnson, S., & Hyland-Wood, D. (2025) · Qeios · doi:10.32388/nhjyvs · Cited by 20
Improving Radiology Report Generation with D2-Net: When Diffusion Meets Discriminator
Jin, Y., Chen, W., Tian, Y., Song, Y., Yan, C. C., & Mao, Z. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448326 · Cited by 12
Automatic medical report generation combining contrastive learning and feature difference
Lyu, C., Qiu, C., Han, K., Li, S., Sheng, V. S., Rong, H., Song, Y., Liu, Y., & Qiu, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112630 · Cited by 11
Auto-Rad: End-to-End Report Generation from Lumber Spine MRI Using Vision–Language Model
Yeasin, M., Moinuddin, K. A., Havugimana, F., Wang, L., & Park, P. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13237092 · Cited by 11
Izhar, A., Idris, N. B., & Japar, N. B. (2025) · Cognitive Computation · doi:10.1007/s12559-025-10404-6 · Cited by 11
GIT-CXR: End-to-End Transformer for Chest X-Ray Report Generation
Sîrbu, I., Sîrbu, I.-R., Bogojeska, J., & Rebedea, T. E. (2025) · Information · doi:10.3390/info16070524 · Cited by 13
Aligning, Autoencoding and Prompting Large Language Models for Novel Disease Reporting
Liu, F., Wu, X., Huang, J., Yang, B., Branson, K., Schwab, P., Clifton, L., Zhang, P., Luo, J., Zheng, Y., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3534586 · Cited by 13
ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training
Wang, R., Yao, Q., Jiang, Z., Lai, H., He, Z., Tao, X., & Zhou, S. K. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103690 · Cited by 17
Gu, Y., Li, R., Wang, X., & Zhou, Z. (2023) · Bioengineering · doi:10.3390/bioengineering10080966 · Cited by 10
Texar: A Modularized, Versatile, and Extensible Toolkit for Text GenerationPreprint
Hu, Z., Shi, H., Tan, B., Wang, W., Yang, Z., Zhao, T., He, J., Qin, L., Wang, D., Ma, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00794 · Cited by 31
Self-citationChen, J., Guo, H., Yi, K., Li, B., & Elhoseiny, M. (2021) · arXiv (Cornell University) · Cited by 11
Guo, K., Zheng, S., Huang, R., & Gao, R. (2023) · IEEE Access · doi:10.1109/access.2023.3322425 · Cited by 10
Fine-grained Medical Vision-Language Representation Learning for Radiology Report Generation
Wang, S., Peng, B., Liu, Y., & Peng, Q. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.989 · Cited by 10
Multi-Level Objective Alignment Transformer for Fine-Grained Oral Panoramic X-Ray Report Generation
Gao, N., Yao, R., Liang, R., Chen, P., Liu, T., & Dang, Y. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3368922 · Cited by 9
Huang, J.-H., Zhu, H., Shen, Y., Rudinac, S., & Kanoulas, E. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2071-5_30 · Cited by 14
Combating medical noisy labels by disentangled distribution learning and consistency regularization
Zhou, Y., Huang, L., Zhou, T., & Sun, H. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.12.018 · Cited by 10
Automatic Generation of Pulmonary Radiology Reports with Semantic Tags
Gu, M., Huang, X., & Fang, Y. K. (2019) · IEEE International Conference on Advanced Infocomm Technology · doi:10.1109/icait.2019.8935910 · Cited by 8
A Study on Automatic Generation of Chinese Discharge Summary
Xiong, Y., Tang, B., Chen, Q., Wang, X., & Yan, J. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983293 · Cited by 9
Bridging the Gap: Cross-modal Knowledge Driven Network for Radiology Report Generation
Kang, B., Xiong, Y., Jiao, J., Zhang, Y., Jia, X., & Li, J. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385967 · Cited by 8
Medical Image Description Based on Multimodal Auxiliary Signals and Transformer
Tan, Y., Li, C., Qin, J., Xue, Y., & Xiang, X. (2024) · International Journal of Intelligent Systems · doi:10.1155/2024/6680546 · Cited by 9
Self-citationGenerating Medical Report via Joint Probability Graph Reasoning
Zhang, J., Cheng, M., Li, X., Shen, X., Liu, Y., & Wan, Y. (2025) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010058 · Cited by 9
Wang, H., Niu, J., Liu, X., & Wang, Y. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995003 · Cited by 8
Symptom and Pathology Report Generation for Ophthalmic Diseases in Fundus Images
Wen, Y., Chen, L., Qiao, L., Deng, Y., Dai, S., Chen, J., & Zhou, C. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313481 · Cited by 8
Topicwise Separable Sentence Retrieval for Medical Report Generation
Zhao, J., Yang, Z., Chen, Z., Fu, H., & Wan, L. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3507076 · Cited by 9
A general framework for reinforcement learning in cognitive architectures
Morais, G., Sakabe, E. Y., Costa, P. D. P., Simões, A. D. S., Gudwin, R., & Colombini, E. L. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101354 · Cited by 7
Out-of-Distribution Generalized Dynamic Graph Neural Network for Human Albumin Prediction
Zhang, Z., Lin, N., Li, X., Zhu, X., Teng, F., Wang, X. Y., & Zhu, W. (2023) · IEEE International Conference on Medical Artificial Intelligence (MedAI) · doi:10.1109/medai59581.2023.00028 · Cited by 7
Shahzadi, I., Madni, T. M., Janjua, U. I., Batool, G., Naz, B., & Ali, M. Q. (2024) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-024-01126-6 · Cited by 7
Co-Occurrence Relationship Driven Hierarchical Attention Network for Brain CT Report Generation
Zhang, X., Dou, S., Ji, J., Liu, Y., & Wang, Z. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3413002 · Cited by 7
Chest X-Ray Caption Generation with CheXNet
Wijerathna, V., Raveen, H., Abeygunawardhana, S., & Ambegoda, T. D. (2022) · Moratuwa Engineering Research Conference (MERCon) · doi:10.1109/mercon55799.2022.9906263 · Cited by 9
Zhou, Y., Huang, L., Zhou, T., & Shao, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16158 · Cited by 10
A Survey on Deep Learning and Explainability for Automatic Image-based Medical Report GenerationPreprint
Messina, P., Pino, P., Parra, D., Soto, Á., Besa, C., Uribe, S. A., Andía, M. E., Cristián Tejos, N., Prieto, C., & Daniel Capurro, N. (2020) · arXiv (Cornell University) · Cited by 7
CLR2G: Cross modal Contrastive Learning on Radiology Report Generation
Xue, H., Ma, Q., Liu, G., Qu, J., Liu, Y., & Liu, A. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679668 · Cited by 8
Enhanced Knowledge Injection for Radiology Report Generation
Li, Q., Xu, J., Yuan, R., Chen, M., Zhang, Y., Feng, R., Zhang, X., & Gao, S. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385817 · Cited by 6
Visual-linguistic Diagnostic Semantic Enhancement for medical report generation
Chen, J., Huang, G., Yuan, X., Zhong, G., Tan, Z., Pun, C., & Yang, Q. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104764 · Cited by 6
Abnormal-region-aware Multi-modal Feature Fusion for medical report generation
Gao, Y., Ni, Z., Liu, W., Ni, L., Xin, L., Hu, L., & Zhang, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113538 · Cited by 6
EDDIE-Transformer: Enriched Disease Embedding Transformer for X-Ray Report Generation
Nguyen, H. T., Nie, D., Badamdorj, T., Liu, Y., Hong, L., Truong, J., & Cheng, L. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761459 · Cited by 6
Hassan, A., Sirshar, M., Akram, M. U., & Farooq, M. U. (2022) · International Bhurban Conference on Applied Sciences and Technology (IBCAST) · doi:10.1109/ibcast54850.2022.9990154 · Cited by 6
A medical report generation method integrating teacher–student model and encoder–decoder network
Zhang, S., Han, Q., Li, J., Sun, Y., & Qin, Y. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106251 · Cited by 6
Attention-based CNN-GRU Model For Automatic Medical Images Captioning: ImageCLEF 2021.
Beddiar, D. R., Oussalah, M., & Seppänen, T. (2021) · CLEF (Working Notes) · Cited by 6
Confidence-Guided Radiology Report Generation.Preprint
Wang, Y., Lin, Z., Tian, J., Shi, Z., Zhang, Y., Jianping Fan, B., & He, Z. (2021) · arXiv (Cornell University) · Cited by 6
Yin, H., Wu, W., & Hao, Y. (2024) · Electronics · doi:10.3390/electronics13163306 · Cited by 7
Report Generation on Chest X-rays using Deep Learning
Kumar, M. A., Ganta, S., & Chinni, G. R. (2023) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs56967.2023.10142637 · Cited by 5
Iqbal, S., Qureshi, A. N., Khan, F. N., Aurangzeb, K., & Akbar, M. A. (2024) · IEEE Access · doi:10.1109/access.2024.3449929 · Cited by 6
AHIVE: Anatomy-Aware Hierarchical Vision Encoding for Interactive Radiology Report Retrieval
Yan, S., Cheung, W. K., Tsang, I. W.-H., Chin, K., Tong, T. M., Cheung, K. C., & See, S. C. W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01358 · Cited by 5
Automatic Generation of Electromyogram Diagnosis Report
Gu, Q., Nie, C., Zou, R., Chen, W., Zheng, C., Zhu, D., Mao, X., Wei, Z., & Tian, D. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313133 · Cited by 5
Reinforced Medical Report Generation with X-Linear Attention and Repetition PenaltyPreprint
Xu, W., Chang, Q., Xu, Z., & Lukasiewicz, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07680 · Cited by 7
Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards
Delbrouck, J.-B., Chambon, P., Bluethgen, C., Tsai, E., Almusa, O., & Langlotz, C. P. (2022) · arXiv · doi:10.48550/arxiv.2210.12186 · Cited by 63
Intensive vision-guided network for radiology report generation
Zheng, F., Li, M., Wang, Y., Yu, W., Wang, R., Chen, Z., Xiao, N., & Lu, Y. (2023) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad1995 · Cited by 5
Metadata
- Authors
- Li, C. Y., Liang, X., Hu, Z., & Xing, E. P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1530-1540
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1805.08298
- OpenAlex
- W2803411968
- Cited by
- 271
- References
- 45
- Citations by year
- 2026: 2 · 2025: 32 · 2024: 54 · 2023: 62 · 2022: 33 · 2021: 48 · 2020: 23 · 2019: 15 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- medical report generation, retrieval-augmented generation, reinforcement learning, hierarchical decision-making, structured report generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review