Radiology Report Generation via Self‐Critical Multisource Knowledge Reasoning With Large Language Models
Open accessAbstract
Automated radiology report generation (RRG) aims to reduce radiologist workload while improving reporting consistency and clinical reliability. Despite its importance for diagnosis, manual reporting remains time‐consuming and error‐prone. Existing encoder–decoder models often struggle to align visual and textual representations, resulting in incomplete or inconsistent reports. Large language models (LLMs) provide strong linguistic fluency for automated RRG, but most existing approaches still follow a linear generation paradigm and lack explicit reasoning, self‐evaluation, and structured clinical grounding. To address these limitations, we propose SMK–RRG, a self‐critical multisource Knowledge framework for RRG. The proposed framework integrates structured clinical knowledge, pathology‐aware visual evidence, and iterative self‐refinement within a unified LLM‐driven architecture. It is implemented through self‐critical thought (SCT) prompting, which performs multistage candidate report generation, LLM‐based self‐critique, and CheXbert‐guided clinical selection among candidate reports. By enabling critique‐guided prompt evolution across refinement stages, SCT moves beyond conventional chain‐based prompting and supports nonlinear, clinically grounded reasoning. Experiments on public chest X‐ray benchmarks demonstrate that SMK–RRG produces more accurate, interpretable, and clinically consistent reports, highlighting the effectiveness of self‐critique and structured information integration for reliable clinical reports.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534 · see citing works
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513 · see citing works
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · see citing works
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845 · see citing works
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505 · see citing works
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · see citing works
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604 · see citing works
MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports
Johnson, A. E. W., Pollard, T. J., Berkowitz, S. J., Greenbaum, N. R., Lungren, M. P., Deng, C.-Y., Mark, R. G., & Horng, S. (2019) · Scientific Data · doi:10.1038/s41597-019-0322-0 · Cited by 1,816 · see citing works
Meshed-Memory Transformer for Image Captioning
Cornia, M., Stefanini, M., Baraldi, L., & Cucchiara, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01059 · Cited by 1,259 · see citing works
Preparing a collection of radiology examinations for distribution and retrieval
Demner-Fushman, D., Kohli, M. D., Rosenman, M. B., Shooshan, S. E., Rodriguez, L., Antani, S., Thoma, G. R., & McDonald, C. J. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv080 · Cited by 1,164 · see citing works
Medical image segmentation using deep learning: A survey
Wang, R., Lei, T., Cui, R., Zhang, B., Meng, H., & Nandi, A. K. (2022) · IET Image Processing · doi:10.1049/ipr2.12419 · Cited by 947 · see citing works
Generating Radiology Reports via Memory-driven Transformer
Chen, Z., Song, Y., Chang, T.-H., & Wan, X. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.112 · Cited by 693 · see citing works
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation
Liu, F., Wu, X., Ge, S., Fan, W., & Zou, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01354 · Cited by 396 · see citing works
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392 · see citing works
Cross-modal Memory Networks for Radiology Report Generation
Chen, Z., Shen, Y., Song, Y., & Wan, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.459 · Cited by 369 · see citing works
Smit, A., Jain, S., Rajpurkar, P., Pareek, A., Ng, A., & Lungren, M. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.117 · Cited by 262 · see citing works
Knowledge matters: Chest radiology report generation with general and specific knowledge
Yang, S., Wu, X., Ge, S., Zhou, S. K., & Xiao, L. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102510 · Cited by 225 · see citing works
R2GenGPT: Radiology Report Generation with frozen LLMs
Wang, Z., Liu, L., Wang, L., & Zhou, L. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100033 · Cited by 205 · see citing works
Evaluating progress in automatic chest X-ray radiology report generation
Yu, F., Endo, M., Krishnan, R., Pan, I., Tsai, A., Reis, E. P., Fonseca, E. K. U. N., Lee, H. M. H., Abad, Z. S. H., Ng, A. Y., et al. (2023) · Patterns · doi:10.1016/j.patter.2023.100802 · Cited by 200 · see citing works
Collaboration between clinicians and vision–language models in radiology report generation
Tanno, R., Barrett, D. G. T., Sellergren, A., Ghaisas, S., Dathathri, S., See, A., Welbl, J., Lau, C., Tu, T., Azizi, S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03302-1 · Cited by 186 · see citing works
METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokens
Wang, Z., Liu, L., Wang, L., & Zhou, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01112 · Cited by 184 · see citing works
Automated radiology report generation using conditioned transformers
Alfarghaly, O., Khaled, R., Elkorany, A., Helal, M., & Fahmy, A. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100557 · Cited by 183 · see citing works
Improving chest X-ray report generation by leveraging warm starting
Nicolson, A., Dowling, J., & Koopman, B. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102633 · Cited by 161 · see citing works
A Self-boosting Framework for Automated Radiographic Report Generation
Wang, Z., Zhou, L., Wang, L., & Li, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00246 · Cited by 92 · see citing works
A Medical Semantic-Assisted Transformer for Radiographic Report Generation
Wang, Z., Tang, M., Wang, L., Li, X., & Zhou, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16437-8_63 · Cited by 81 · see citing works
Bootstrapping Large Language Models for Radiology Report Generation
Liu, C., Tian, Y., Chen, W., Song, Y., & Zhang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29826 · Cited by 78 · see citing works
Reale-Nosei, G., Amador-Domínguez, E., & Serrano, E. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103264 · Cited by 68 · see citing works
Contestable AI needs Computational Argumentation
Leofante, F., Ayoobi, H., Dejl, A., Freedman, G., Gorur, D., Jiang, J., Paulino-Passos, G., Rago, A., Rapberger, A., Russo, F., et al. (2024) · International Conference on Principles of Knowledge Representation and Reasoning · doi:10.24963/kr.2024/83 · Cited by 29 · see citing works
KARGEN: Knowledge-Enhanced Automated Radiology Report Generation Using Large Language Models
Li, Y., Wang, Z., Liu, Y., Wang, L., Liu, L., & Zhou, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72086-4_36 · Cited by 27 · see citing works
Data augmentation with attention framework for robust deepfake detection
Mamarasulov, S., Chen, L., Chen, C., Li, Y., & Wang, C. (2024) · The Visual Computer · doi:10.1007/s00371-024-03690-y · Cited by 16 · see citing works
Pellegrini, C., Özsoy, E., Busam, B., Navab, N., & Keicher, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.18681 · Cited by 15 · see citing works
Yun, H., Maeng, J., Kang, E., & Suk, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04981-0_15 · Cited by 8 · see citing works
Machine Learning and Knowledge Graphs: Existing Gaps and Future Research Challenges
d’Amato, C., Mahon, L., Monnin, P., et al. (2023) · HAL · doi:10.4230/tgdk.1.1.8 · Cited by 8
Speeded-Up Robust Feature Matching Algorithm Based on Image Improvement Technology
Allaberdiev, S., Yakhyoev, S., Fatkhullayev, R., et al. (2019) · Journal of Computer and Communications · doi:10.4236/jcc.2019.712001 · Cited by 6 · see citing works
Self-citationAli, S., Ali, A., Uzair, M., et al. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-66705-3_7 · Cited by 6 · see citing works
Self-citationArgumentative review aggregation and dialogical explanations
Rago, A., Cocarascu, O., Oksanen, J., & Toni, F. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2025.104291 · Cited by 6 · see citing works
Allaberdiev, S., Khan, A., Mamarasulov, S., & Chen, X. (2025) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2026-0003 · Cited by 6 · see citing works
Self-citationWang, Y., Sun, Y., Tan, T., Hao, C., Cui, Y., Su, X., Xie, W., Shen, L., & Yu, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04981-0_61 · Cited by 4 · see citing works
Lung Disease Detection Using Hybrid CNN‐XGBoost Classifier With New Loss Function
Tabaghsar, B. J., Forghani, Y., Sheibani, R., & Tavoli, R. (2026) · IET Software · doi:10.1049/sfw2/6391804 · Cited by 3 · see citing works
Can LLMs Solve ASP Problems? Insights from a Benchmarking Study
Ren, L., Xiao, G., Qi, G., et al. (2025) · doi:10.24963/kr.2025/60 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- YinH. ZhouS. WangP. WuZ. andHaoY. Kia: Knowledge-Guided Implicit Vision-Language Alignment for Chest X-ray Report Generation Proceedings of the 31st International Conference on Computational Linguistics 2025 4096–4108.
- Avazov K., 2024, Efficient Image Classification Through Collaborative Knowledge Distillation: A Novel Alexnet Modification Approach, Heliyon, 10
- Lin C. Y., 2004, Rouge: A Package for Automatic Evaluation of Summaries, Association for Computational Linguistics, 27, 74
- BanerjeeS.andLavieA. Meteor: An Automatic Metric for Mt Evaluation With Improved Correlation With Human Judgments Proceedings of the Acl Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization 2005 65–72.
- JainS. AgrawalA. andSaportaA. et al.Radgraph: Extracting Clinical Entities and Relations from Radiology Reports 35th Conference on Neural Information Processing Systems 2021.
Cited by
Sorted by citations
Erdağı, E. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1919939
- Authors
- Allaberdiev, S., Chen, X., Mamatov, D., Abdusalomov, A., Ubaydullaev, U., & Khan, A.
- Affiliations
- Shenzhen University (CN)
- Ajou University in Tashkent
- Tashkent University of Information Technology (UZ)
- Tashkent State Technical University named after Islam Karimov (UZ)
- Technological University Dublin (IE)
- Corresponding author
- Chen, Xiaojun
- Khan, Asif
- ORCID
- Venue
- IET Software
- Published
- 2026-01
- Volume
- 2026
- Issue
- 1
- ISSN
- 1751-8806 (ISSN-L)
- 1751-8814
- OpenAlex
- W7165752694
- Semantic Scholar
- 1748c6aedeac175fc293b6a325d67e8314e33ef0
- Cited by
- 1
- References
- 36
- Citations by year
- 2026: 1
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IET Software (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (62476174, 92270122, 62201179)
- Natural Science Foundation of Guangdong Province (2023A1515012584)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- automated radiology report generation, large language models, self-criticism, chest X-ray reports, visual-textual alignment, radiologist workload reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review