Cited by 199Multimodal Machine Learning ApplicationsArtificial Intelligence in Healthcare and EducationRadiomics and Machine Learning in Medical Imaging

The DOI matches its Crossref record; 46 of the 47 references it cites were found in a registry or an index.

Radiology report generation with a learned knowledge base and multi-modal alignment

Open access

Yang, Shuxin, Wu, Xian, Ge, Shen, Zheng, Zhuozhao, Zhou, S. Kevin, Xiao, Li·2023·Medical Image Analysis

DOI 10.1016/j.media.2023.102798

Open this paper in CoChat — free account

Abstract

In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a chest x-ray. Our approach, motivated by the observation that the descriptions in radiology reports are highly correlated with specific information of the x-ray images, features two distinct modules: (i) Learned knowledge base: To absorb the knowledge embedded in the radiology reports, we build a knowledge base that can automatically distill and restore medical knowledge from textual embedding without manual labor; (ii) Multi-modal alignment: to promote the semantic alignment among reports, disease labels, and images, we explicitly utilize textual embedding to guide the learning of the visual feature space. We evaluate the performance of the proposed model using metrics from both natural language generation and clinic efficacy on the public IU-Xray and MIMIC-CXR datasets. Our ablation study shows that each module contributes to improving the quality of generated reports. Furthermore, the assistance of both modules, our approach outperforms state-of-the-art methods over almost all the metrics. Code is available at https://github.com/LX-doctorAI1/M2KT.

Integrity signals

Registry

Crossref · 10.1016/j.media.2023.102798

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Untitled work
(2004) · Cited by 9,718
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
Improved Baselines with Momentum Contrastive LearningPreprint
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 3,497

Show all 47 references

Sorted by citations

Items 101–199 of 199

Generative AI for healthcare: fundamentals, challenges, and perspectives
Chen, G., Liu, C., Anne, O. G., Tan, M., Xie, Z., Yin, J., Yip, J. W. L., Zhang, W., ZHU, J., & Ooi, B. C. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4927-2 · Cited by 9
GHCL: Gaussian heuristic curriculum learning for Brain CT report generation
Shen, Q., Shi, Y., Zhang, X., Ji, J., Liu, Y., & Xu, H. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01266-3 · Cited by 2
Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation
Zhu, D., Liu, L., Yang, X., Liu, L., & Peng, W. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01422-9 · Cited by 2
A spatiotemporal feature-based early-stage cervical cancer diagnostic report generation method using bimodal image
Su, J., Chen, C., Lin, Y., Song, Z., Li, M., & Cao, W. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107805 · Cited by 2
Rethinking Domain‐Specific Pretraining by Supervised or Self‐Supervised Learning for Chest Radiograph Classification: A Comparative Study Against ImageNet Counterparts in Cold‐Start Active Learning
Yuan, H., Zhu, M., Yang, R., Liu, H., Li, I., & Hong, C. (2025) · Health care science · doi:10.1002/hcs2.70009 · Cited by 6
A Novel Transformer-Based Framework for Chest X-Ray Captioning with Clinical Sign Detection
Tran, T. T., Nguyen, D. V. M., & Huynh, H. T. (2025) · SN Computer Science · doi:10.1007/s42979-025-04032-y · Cited by 2
OS-RRG: Observation State-Aware Radiology Report Generation With Balanced Diagnosis and Attention Intervention
Yang, H., Tang, H., Song, S., & Li, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3589103 · Cited by 4
Dual-level semantic collaboration and inference network for medical image report generation
Zhang, J., Liu, Y., Shao, M., Chen, C., Wang, Z., Li, J., Wan, Y., & Yu, P. S. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114278 · Cited by 2
Semantic-Aware Chest X-ray Report Generation with Domain-Specific Lexicon and Diversity-Controlled Retrieval
Zhang, B., Chen, J., Liu, S., Schunkert, H., & Navab, N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04978-0_58 · Cited by 2
Dynamic Traceback Learning for Medical Report Generation
Ye, S., Meng, M., Li, M., Feng, D. D., Naseem, U., & Kim, J. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3668644 · Cited by 3
Trust it or Not: Confidence-Guided Automatic Radiology Report GenerationPreprint
Wang, Y., Lin, Z., Xu, Z., Dong, H., Luo, J. D., Tian, J., Shi, Z., Zhang, Y., Jianping Fan, B., & He, Z. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4482859 · Cited by 2
Benchmarking Radiology Report Generation From Noisy Free-Texts
Yuan, Y., Zheng, Y., & Qu, L. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3569428 · Cited by 1
ClearView: A Quality-aware Cross-modal Alignment Framework for CT Report Generation
Qingyong, S., Feng, C., Wang, B., Shi, G., & Zhuang, Y. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733287 · Cited by 1
MambaGen: Efficient visual representation learning for automatic radiology report generation
Hou, X., Li, X., Wang, S., Lu, M., Lin, H., & Zhang, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129537 · Cited by 1
ECG Report Generation with Diagnostic Knowledge Enhanced Prompt Learning
Fan, P., Yue, X., Chen, Y., Wei, Z., Shi, J., & Xu, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05479-1_2 · Cited by 1
DC-RRG: Diagnosis-centered cascaded radiology report generation
Lin, Z., Hong, Z., Zhou, Z., Shi, M., Yu, J.-G., Yun, J., & Huang, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129884 · Cited by 1
Graph-Driven Medical Report Generation with Adaptive Knowledge Distillation
Chen, J., Huang, X., Jiang, M., Li, Y., Zou, Z., & Qian, D. (2025) · Applied Sciences · doi:10.3390/app152010974 · Cited by 1
Automated Radiology Report Generation Based on Topic-Keyword Semantic Guidance
Xiao, J., Liu, H., Dong, R., Liu, J., & Yu, H. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209777 · Cited by 1
Bridging Visual Analysis and Text Generation: A Hierarchical Multi-scale Visual Feature Flow Model for Accessible Radiographic Report Automation
Zuo, H., Weng, Z., Duan, Y., Lv, Z., Bi, F., & Zheng, Z. (2025) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2025.108328 · Cited by 1
Self-citation
DM-RRG: Radiology image report generation with disease-topic guidance and multi-grained Image–Text alignment
Ju, S., Wang, M., Xiao, Y., Shen, Y., Cheng, J., Su, Y., & Liao, X. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109322 · Cited by 2
Wholistic report generation for Breast ultrasound using LangChain
Huh, J., Ahn, H. S., Park, H. J., & YE, J. C. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102697 · Cited by 1
Automated X-Ray Chest Report Generation
Fahmy, A. M., & Mashaad, M. M. E. (2025) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis66182.2025.11313183 · Cited by 1
Contrastive Learning with Feature Space Interpolation for Retrieval-Based Chest X-Ray Report Generation
Rahman, Z. U., Yu, G.-H., Lee, J., & Kim, J.-Y. (2026) · Applied Sciences · doi:10.3390/app16010470 · Cited by 1
Integrating Clinical Knowledge into Radiology Report Generation to Enhance Diagnosis
Cao, Z., Yue, X., Chen, Y., Xu, Z., Wei, Z., & Li, Z. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11355985 · Cited by 1
ITAdapter: Image-Tag adapter framework with retrieval knowledge enhancer for radiology report generation
Ding, S., Shui, J., Ge, M., Fan, M., Li, X., Zhu, Y., & Li, M. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131494 · Cited by 1
FiR-Rad: Fine-Grained Reinforcement With Structured Reasoning for Chest X-Ray Report Generation
Mei, X., Yang, L., Gao, D., Cai, X., Han, J., & Liu, T. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3665561 · Cited by 2
Review of generative AI for lesion localization and automatic report generation
Sun, K., Wang, Y., Huang, S., Liu, Y., Chen, H., Lian, Z., Tan, M., Lin, X., Zhou, W., Qiu, Z., et al. (2026) · Med-X · doi:10.1007/s44258-026-00076-8 · Cited by 1
Bridging the image–text gap: Reinforced Cross-modal Abnormality Driven Transformer for automatic chest X-ray report generation
Yi, X., Fu, Y., Wang, R., Bi, E., Zhang, H., Liang, J., & Hua, R. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115207 · Cited by 1
Prior tissue knowledge-driven contrastive learning for brain CT report generation
Shi, Y., Ji, J., Zhang, X., Liu, Y., Wang, Z., & Xu, H. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01289-w · Cited by 2
Automatic Radiology Report Generation Based on State-Space Model
Zhang, D., Tan, Y., Qin, J., & Xiang, X. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3579888 · Cited by 3
A Hybrid Deep Learning Approach for Improving Medical Image Captioning Using Convolutional Vision Transformer
Ramadan, W., & Akay, B. (2025) · International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA) · doi:10.1109/acdsa65407.2025.11166431 · Cited by 1
[Research on automatic generation of multimodal medical image reports based on memory driven].
Xing, S., Fang, J., Ju, Z., Guo, Z., & Wang, Y. (2024) · PubMed Central · doi:10.7507/1001-5515.202304001
MR Altyazılama için Çoklu Dikkat Tabanlı Derin Öğrenme Modeli
Maraş, B., Karatorak, S., Karaca, K. Ö., Gedik, A. O., & Akcayol, M. A. (2024) · Muş Alparslan Üniversitesi Fen Bilimleri Dergisi · doi:10.18586/msufbd.1532112
Data-Efficient Radiology Report Generation via Similar Report Features Enhancement
Li, Y., Sun, J., & Wang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-82007-6_24
Improving the CXR Reports Generation with Multi-modal feature Alignment and Self-Refining strategy
Cheddi, F., Habbani, A., & Nait‐Charif, H. (2024) · International Conference on Embedded Systems and Artificial Intelligence (ESAI) · doi:10.1109/esai62891.2024.10913509 · Cited by 1
Streamlined Speech Recognition Model for Automated Radiology Reporting Employing Combined Automatic Speech Recognition Model, Large Language Model, and Prompt Engineering
Dabass, M., Jabeer, M. M., Chandalia, A., & Mahapatra, D. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-97-9507-9_26
Blix-Ray: Chest P with Vision-Language Models and Reinforcement LearningPreprint
Akan, T., Orujpour, M., Salehpour, P., Montalvo, S. A., & Bhuiyan, M. A. N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5249928
CXR ‐ ODDet : An Omni‐Decoupled Multi‐Class Lesion Localization Framework for Automatic Chest X‐Ray Analysis
Zhang, Q., Liu, L., Lu, X., Que, X. B., & Zhang, Y. (2025) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70178
Graph-guided topic modeling and multi-level context-aware framework for automated radiology report generation
Liu, J., Deng, Y., Liu, J., Song, D., Duan, X., & Li, J. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108553
From Detection to Radiology Report Generation: Fine-Grained Multi-Modal Alignment with Semi-Supervised Learning
Tang, Q., Liu, L., Yang, X., Liu, L., & Peng, W. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01650-z
ITAdaptor: Image-Tag Adapter Framework with Knowledge Enhancement for Radiology Report Generation
Ding, S., Fan, M., Li, M., & Wang, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04978-0_34
A cross-modal Chinese radiology report generation approach for cervical cancer
Lin, Y., Li, H., Chen, C., Qiu, J., Hong, J., & Dong, B. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108887
Soft label-guided transformer for radiology report generation
Liu, X., Xin, J., Shen, Q., Huang, Z., & Wang, Z. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104924
Convergent Generative Adversarial Networks for Medical Report Generation with Visual Manifold GraphPreprint
Xu, L., Wang, Y., Liu, H., Yan, H., Zeng, X., & Li, W. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5615151
RankRRG: A Rank-Aware Framework for Automated Radiology Report Generation
Qiu, M., Li, Y., Fan, X., Liu, Y., Cao, J., Zhang, B., Wang, R., Ma, W., & Lei, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3456-2_4
Adaptive Semantic Alignment for Automated Radiology Report Generation via Cross-Modal Knowledge Integration
Ju, S., Chen, Z., Xiao, Y., Shen, Y., Su, Y., Chen, K., & Liao, X. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209540
MFDP: Multi-View Feature Integration and Enhanced Disease Prompting for Radiology Report Generation
Zhao, Y., Yang, K., Wu, Y., & Li, X. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3632356 · Cited by 1
Focusing on Abnormal: Visual Contrastive Classification and Semantic Enhancement for Medical Report Generation
Chen, H., Pei, M., & Nie, Z. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4100-3_10
Semantic-assisted report generation with memory enhanced transformer using context-aware visual extractor
Divya, P., Chakraborty, P. S., Chalavadi, K. M., & Chen, Y. (2025) · Applied Intelligence · doi:10.1007/s10489-025-07031-x
Medical Concept Guided Frequency Representation for Chest X-ray Report Generation
Huang, L., Zhao, X., Liu, X., & Li, C. (2025) · Cognitive Computation · doi:10.1007/s12559-025-10537-8
Mwcl: Memory-driven and mapping alignment with weighted contrastive learning for radiology reports
Usman, M., Ma, Z., & Yijia, Z. (2025) · Multimedia Systems · doi:10.1007/s00530-025-02040-9
X-Gen: Enhancing Radiology Report Generation via LLM-Driven Data Augmentation and Decoupled Training
Wang, C., Chen, Q., To, M., Kutaiba, N., Yoo, J.-G., Xie, Y., & Wu, Q. (2025) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta68720.2025.11302459
Textual Medical History Summarization for Diagnosis
Deepika, R., & S., P. K. T. (2025) · Innovations in Power and Advanced Computing Technologies (i-PACT) · doi:10.1109/i-pact65952.2025.11307960
OBUSight: Clinically Aligned Generative AI for Ophthalmic Ultrasound Interpretation and Diagnosis
Liu, X., Shao, A., Guan, B., Luo, Z., Lai, W., Huang, X., Liu, J., Yan, J., Li, H., Pan, X., et al. (2026) · Advanced Science · doi:10.1002/advs.202515864
Cross-modal Memory Alignment Framework With Disease Aware Contrastive Learning for Radiology Report Generation
Ding, S., Fan, M., & Li, M. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5631-1_10
Align Modalities: Advancing Medical Report Generation with Unified Encoder and Inter-Case Contrastive Learning
Chen, H., Pei, M., & Nie, Z. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11342904
A Triplet Optimization and Difference Detail Perception Network with Adaptive Feature Enhancement for Radiology Report Generation
Zeng, Y., Zhang, Z., Jiang, W., & Liu, S. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343253
MENet: Memory Enhanced Network for Chest Radiology Report Generation
Dong, C., Wang, S., Li, G., Ba, C., & Li, W. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11357108
Enhanced radiology report generation via comprehensive sequence rearrangement and multi-scale cross-region attention
Deng, Y., Qin, Q., Hu, W., Hu, J., Dengwei, Y., Zhang, W., & Qiao, J. (2026) · The Visual Computer · doi:10.1007/s00371-026-04384-3
Automatic Generation of Medical Imaging Diagnostic Report using BLIP Model
Ponsubash Raj, R., Thenmozhi, E., & Mirunalini, P. (2026) · International Conference on Computational Intelligence in Data Science (ICCIDS) · doi:10.1109/iccids69108.2026.11407634
Unsupervised Contrastive Refinement With Graph-Aware Multimodal Interaction for Radiology Report Generation
Daydar, A., Reddy, M. G. C. K., Kumar, S., Laskar, H., Sur, A., & Kanagaraj, S. (2026) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2026.3670375
Navigating the utility of generative artificial intelligence in healthcare delivery
Kulkarni, M., Sheth, M., & Chaudhary, P. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-45252-9.00015-3
MP-CXR: A Modular Pipeline with Multi-Label Disease-State Classification and Image-Label Alignment for Chest X-Ray Report Generation
Zhao, H., Zhang, Y., Ma, L., Xu, S., & Sun, D. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460414
Radiology Report Generation via Multi-Path Modeling with Medical Language Priors and Semantic Guidance
Zhao, L., & Liu, X. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460330
DVPAlign: Dual-Flow Visual Graph Encoding with Diagnostic-Driven Prompt Alignment For Medical Report Generation
Sun, D., Chen, Z., Mu, C., Liu, Y., Dong, C., & Luo, B. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463043
Persistent Homology as a Diagnostic Lens in Vision-Language Medical Systems
Aguilar-Ortíz, J., Díaz-Parra, O., Ruíz-Vanoye, J. A., Trejo-Macotela, F. R., Vera-Jiménez, M. A., Zamudio-García, V. M., & Domínguez-Mayorga, C. R. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7315-7.ch005
Latent diffusion-augmented cross-modal representation learning for radiology report generation
Hou, X., Li, X., Wang, S., Lu, M., Lin, H., & Zhang, Y. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104863
Category-Guided Vision-Language Model for IoMT-Enabled Medical Report Generation Under Heterogeneous Imaging Data
Liu, X., Jin, Q., Zhang, T.-T., Tang, Z., Chen, Y., & Liu, Z. H. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3699691
MMG-RAG: Multimodal Graph RAG for Medical Report Generation
Liu, G., Tang, X., Gan, J., Ren, T., Liu, T., & Zhong, S. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810644
Automated radiology report generation: A comprehensive review
Huang, L., Islam, T., Miron, A., HONE, K. S., & Li, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133320
Vision-language foundation models for 3D neuroradiological interpretation: A systematic review
Gurary, S. T., Ndengera, M., Korchi, A., Reith, N., Esparza, J. F. O., Botta, D., Lövblad, K. O., & Kurz, F. T. (2026) · European Journal of Radiology Artificial Intelligence · doi:10.1016/j.ejrai.2026.100111
Collaborative cross-modal fusion network for medical report generation
Hou, X., Li, X. J., Lu, M., Cui, H. N., Lin, H., & Zhang, Y. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104576
Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation
Chen, Y., Zhu, J., Yu, Y., Shi, Y., Naghshbandi, H., Liu, J., Koh, A. S.-M., Fang, F., Ong, K. E., & Yeo, S. C. K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38059-3_54
Seeing What Matters: Lesion-Aware High-Resolution Patch Discovery and Fusion for Chest X-Ray Report Generation
Li, Y., Liu, Y., Chen, Z., Chen, T., Chen, Z., Liu, L., Wang, L., & Zhou, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37422-6_12 · Cited by 1
Cross-modal Orthogonal Adaptive Contrastive Learning for robust chest radiology report generation
Tang, Q., Liu, L., Zhu, D., Ding, J., Peng, W., & Liu, L. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115620
REVA-PO: Stabilizing Reinforcement Learning for Chest X-Ray Report Generation
Guo, L., Tahir, A. M., & Wang, Z. J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37321-2_31
Boltzmann-driven dynamic annealing network for knowledge-guided radiology report generation
Xiao, W., Liu, M., Zhu, H., & Zhang, J. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02524-2
MG-Hybrid: mask-guided hybrid state space models with semantic alignment for radiology report generation
Li, Y., Zhao, Z., Yuan, Y., & Yan, Y. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07395-8
Dual-View Vision Transformer with Cross-Modal Memory for Radiology Report Generation
Lamred, N., Ayed, N. G. B., & Charfi, N. (2026) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit70676.2026.11631055
Convergent Generative Adversarial Networks for Medical Report Generation With Visual Manifold Graph
Wang, Y., Xu, S., Zhou, K., & Li, D. (2026) · IEEE Access · doi:10.1109/access.2026.3721550
Cross-Model Attention-based Vision–Language Fusion for Interpretable Multi-Label Chest Disease Diagnosis
Saka, N., Vijetha, S. L., Maddala, J. B., Lalitha, C. S., Santhi, M. V. B. T., & Kumar, J. D. S. (2026) · International Conference on Intelligent and Sustainable AI Systems (ICOSAAS) · doi:10.1109/icosaas68663.2026.11648625
Analysis of Large Language Models for Magnetic Resonance Imaging Brain Tumor Segmentation Reporting
Vennila, M., & Kalaiselvi, T. (2026) · Cureus Journal of Computer Science. · doi:10.7759/s44389-026-00225-5
Risk Aware Prompt-Guided CNN–LLM Framework for Brain MRI Diagnostic Report GenerationPreprint
Senthamilselvi, M., & Palanisamy, K. (2026) · Research Square · doi:10.21203/rs.3.rs-10802065/v1
KDMG: knowledge-enhanced dynamic memory and gated fusion for chest X-ray report generation
Xiong, J., Wei, C., & Liu, H. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01184-6
Enhancing Image-Text Alignment in Chest X-ray Datasets by Reducing External References via a Fine-Tuned Large Language Model Pipeline
Chen, Y.-R., Kuo, C., & Lin, C.-H. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02244-z
Lesion-aware visio-linguistic context regularization for radiology report generation
Sun, G., Tu, Y., Zhu, Y., Wan, L., Jin, Q., & Ma, J. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104302
Cross-Modal Retrieval for Radiology Report Generation from Chest X-Ray: A Framework Using Contrastive Learning Between Image Patches and Report Sentences
Khalid, O., Nadeem, S., Farooq, B., & Saeed, H. (2024) · Journal of Artificial Intelligence for Healthcare Systems · doi:10.68159/s049146327
Deep learning-based diagnostic report generation for low-resolution functional medical images via cross-modal visual and textual alignment
Song, T., Lin, Q., Li, T., Zeng, X., Cao, Y., Man, Z., Liu, C., Cai, Z., & Huang, X. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07456-y
Wavelet-Enhanced Coarse-to-Fine Radiology Report Generation with Large Language Models
Yang, S., Deng, Y., Qin, Q., Zeng, P., Zhang, H., Hu, W., & Zhang, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38062-3_62
Self-citation
Disease-Consistent Visual-Text Alignment and Fusion for Reliable Radiology Report Generation
Shao, J., & Tian, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38062-3_18
Mimicking Radiologists: A Coarse-to-Fine Framework with Structural Sparse Tokens for Dual-LLM Computed Tomography Report Generation
Liu, H., Wei, D., Zheng, Y., Wu, X., & Wang, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37531-5_21
Self-citation
RadLens: Radiology Report Generation Using a Vision Transformer and Retrieval-Augmented Generation
Nithianandan, P. N., Tiwari, J., Davarpanah, S., & Norouzifard, M. (2026) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr70517.2026.00081
Prototype-Guided Visual Recalibration for LLM-based Medical Report GenerationPreprint
Li, L., Shi, Y., An, K., Zhu, X., Yun, X., & Liu, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7584765
Vision-Language Models for Automated 3D PET/CT Report Generation
Jiao, W., Yan, K., Zhang, J., Jin, D., & Xie, Z. (2026) · doi:10.1109/cvprf71909.2026.00509 · Cited by 1
Clinical-context guidance and hyperbolic prototype learning for long-tailed radiology report generation
Yang, F., Li, G., He, Z., Wu, R., Luo, G., Yue, Y., Ji, D., Wu, J., & Zhang, H. (2026) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2026.102834
Fluent but not fail-safe: machine-translated radiology reports still need expert review
Seibold, C., Leichenich, T., Stein, P., Atsiatorme, E., Kliesch, P., Sevim, G. A., Trauth, P., Kremer, A., Bischoff, A., Kauczor, H.-U., et al. (2026) · European Radiology Experimental · doi:10.1186/s41747-026-00827-7
BLIX-Ray: Chest X-Ray Report Generation with Vision-Language Models and Reinforcement Learning
Akan, T., Orujpour, M., Salehpour, P., Montalvo, S. A., & Bhuiyan, M. A. N. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02317-z
TACMRN: Triple-Attention Contrastive Memory Retrieval Network for Brain CT Report Generation
He, X., Xueying, D., Zhou, Y., Bao, J., Cai, C., & Cai, S. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02436-7
ClinX ‐Net: Multimodal Visual–Language Feature Fusion for Chest X‐Ray Report Generation
Khan, M. S., Imran, A., Usman, S. M., Alshammari, A., Zheng, Y., & Hassan, B. (2026) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70469

Authors: Yang, S., Wu, X., Ge, S., Zheng, Z., Zhou, S. K., & Xiao, L.
Affiliations: Chinese Academy of Sciences (CN)
Tencent (China) (CN)
Beijing Tsinghua Chang Gung Hospital (CN)
University of Science and Technology of China (CN)
Beijing University of Posts and Telecommunications (CN)
Corresponding author: Xiao, Li
ORCID: Yang, Shuxin
Wu, Xian
Ge, Shen
Zheng, Zhuozhao
Zhou, S. Kevin
Xiao, Li
Venue: Medical Image Analysis
Publisher: Elsevier BV
Published: 2023-05
Volume: 86
Pages: 102798
ISSN: 1361-8415 (ISSN-L)
DOI: 10.1016/j.media.2023.102798
OpenAlex: W4360604432
Cited by: 199
References: 47
Citations by year: 2026: 58 · 2025: 89 · 2024: 41 · 2023: 11
FWCI: 18.03
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by-nc-nd
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
Locations: Medical Image Analysis (publishedVersion, cc-by-nc-nd)
PubMed (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University) (cc-by)
Funders: Tencent
National Natural Science Foundation of China (31900979)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords: radiology report generation, chest radiography, knowledge distillation, multimodal alignment, text embeddings, semantic alignment, natural language generation
MeSH terms: Humans, Learning, Radiography, Radiology, Benchmarking, Knowledge Bases

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Radiology report generation with a learned knowledge base and multi-modal alignment

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks