Swin-Qwen3: a three-stage vision–language framework for automated radiology report generation with multi-agent verification
Open accessAbstract
Background: Automated chest x-ray reporting could substantially reduce the burden on radiology services worldwide; however, the implementation of current vision–language models (VLMs) in clinical workflows remains limited by factual errors, hallucinations, and inadequate clinical reliability. Bridging this implementation gap requires frameworks that are not only technically sound but also designed for safe integration into real-world healthcare settings. Objective: This study aimed to improve the clinical accuracy and factual consistency of radiology report generation by introducing an agent-inspired, three-stage reasoning framework and evaluating its feasibility as research prototype for potential implementation in resource-constrained and high-throughput clinical environments. Methods: We propose the Swin-Qwen3 vision–language architecture, which integrates a Swin Transformer visual encoder with a Q-Former-style query-driven cross-attention module aligned with a large language model (Qwen3-0.6B). A three-stage generation strategy—comprising initial report drafting, clinical verification, and structured refinement—was guided by role-specific prompts to simulate distinct clinical reasoning behaviours. Parameter-efficient fine-tuning via low-rank adaptation (LoRA) enabled training within standard GPU constraints. The framework was evaluated on the full IU x-Ray test set (321 Samples) using lexical, semantic, clinical, and factuality metrics and compared with one- and two-stage ablations. Computational feasibility and inference overhead were assessed for offline or batch processing contexts. Results: The three-stage framework showed modest but consistent improvements over ablation baselines. CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage), Clinical-F1 reached 0.5401 (compared to 0.5478 for one-stage and 0.5449 for two-stage), and RadGraph-F1 scored 0.5467 (compared to 0.5478 for one-stage and 0.5445 for two-stage). The factuality score reached 0.843 (compared to 0.845 for one-stage and 0.845 for two-stage), while the hallucination rate remained at 0.6116 (compared to 0.6109 for one-stage and 0.6109 for two-stage). Clinical recall decreased from 0.8361 (one-stage) and 0.8337 (two-stage) to 0.8044 (three-stage), reflecting a trade-off between sensitivity and precision. However, the clinical verifier demonstrated substantial effectiveness, correcting 85.6% of identified hallucinations. Lexical quality improved: BLEU-4 was 0.0628 (+10.9% vs. one-stage; +13.1% vs. two-stage), ROUGE-2-F was 0.0957 (+10.2% vs. one-stage; +13.1% vs. two-stage), and METEOR was 0.3728 (+4.5% vs. one-stage; +6.3% vs. two-stage). Improvements in METEOR ( p < 0.001) and ROUGE-2-F ( p < 0.05) were statistically significant. A 14.8 × inference overhead was identified, indicating suitability for offline reporting contexts. Conclusions: The Swin-Qwen3 three-stage framework demonstrates that explicit clinical verification and iterative refinement can modestly enhance the clinical reliability of VLMs for automated radiology reporting. The parameter-efficient design is scalable across diverse clinical settings, including resource-limited environments, and supports a practical deployment pathway aligned with SDGs 3 (Good Health and Well-being), 9 (Industry, Innovation and Infrastructure), and 17 (Partnerships for the Goals). However, the residual hallucination rate of 61.2% indicates that the current system is a promising research prototype rather than a clinically deployable tool. Future work should prioritize multi-institutional validation on larger datasets (e.g., MIMIC-CXR) with radiologist expert review, regulatory evaluation, and prospective clinical integration studies.
AI snapshot
Written from the paper’s full text.
TL;DR
Swin-Qwen3 is a three-stage vision–language framework combining a frozen Swin Transformer, Q-Former-style cross-attention, and LoRA-adapted Qwen3-0.6B for chest x-ray report generation, evaluated on the full IU x-Ray test set (321 samples). It improved lexical metrics and corrected 85.6% of identified hallucinations, but the residual hallucination rate remained 61.2%, so the authors describe it as a research prototype rather than a clinically deployable tool.
Key findings
- The three-stage system improved lexical quality over one- and two-stage ablations: BLEU-4 = 0.0628 (+10.9% vs. one-stage; +13.1% vs. two-stage), ROUGE-2-F = 0.0957 (+10.2%; +13.1%), and METEOR = 0.3728 (+4.5%; +6.3%). METEOR and ROUGE-2-F improvements were statistically significant relative to the two-stage baseline (p < 0.001 and p < 0.05, respectively).
- Clinical and factuality metrics were mixed or slightly lower: CheXpert-F1 = 0.7038 vs. 0.7154 one-stage and 0.7123 two-stage; Clinical-F1 = 0.5401 vs. 0.5478 and 0.5449; RadGraph-F1 = 0.5467 vs. 0.5478 and 0.5445; Clinical Recall decreased to 0.8044 from 0.8361 and 0.8337. Factuality Score = 0.843 vs. 0.845 and 0.845, and Hallucination Rate = 0.6116 vs. 0.6109 and 0.6109.
- The clinical verifier corrected 85.6% of identified hallucinations, with precision, recall, and F1 of 0.8563; it corrected an average of 5.52 true hallucinations per sample while making 0.86 false corrections. Critical hallucinations (1,186) outnumbered moderate ones (855), and 99.7% of samples contained residual hallucinations.
- A 14.8× inference overhead was identified, indicating suitability for offline or batch processing contexts rather than real-time point-of-care use.
Methods
- Dataset: IU x-Ray, filtered to 2,134 diagnostic reports paired with frontal and lateral chest radiographs (4,268 images total), split at report level 75%/15%/15% into 1,493 training, 320 validation, and 321 test samples. Images were resized to 224 × 224, normalized with ImageNet statistics, and augmented during training; reports were tokenized with the Qwen3 tokenizer at maximum length 128.
- Architecture and training: a frozen Swin Transformer encoded dual-view images; a Q-Former-style query-driven cross-attention module produced visual prefixes for Qwen3-0.6B. LoRA was applied to attention projections (q_proj, k_proj, v_proj, o_proj) with rank r = 8, α = 16, dropout 0.1, and 0.53% trainable parameters. Training used AdamW for eight epochs, learning rate 1 × 10⁻⁴, weight decay 0.01, effective batch size four via gradient accumulation, and FP16.
- Generation and evaluation: a three-stage inference pipeline used role-specific prompts for draft generation, clinical verification, and refinement. Evaluation on the 321-sample IU x-Ray test set used lexical, semantic, clinical, and factuality metrics, compared against one- and two-stage ablations, with Shapiro–Wilk, Wilcoxon/paired t-tests, Cohen’s d, McNemar tests, and Cohen’s Kappa.
Limitations
- Stated: evaluation was limited to the IU x-Ray test set (321 samples); external validation on MIMIC-CXR or CheXpert Plus is needed. The study relied primarily on automated text-comparison metrics rather than expert clinical review, and prospective clinical studies are required.
- Stated: the residual hallucination rate of 61.2% indicates the system is a research prototype, not clinically deployable; Clinical Recall decreased by −3.8% (p < 0.001), reflecting a sensitivity–precision trade-off. The 14.8× inference overhead may limit real-time use, and the generalised verifier may lack specialised knowledge for rare pathologies or complex multi-system findings.
- Evident from the text: despite the verifier’s 85.6% correction rate, hallucination rate showed no improvement over baselines, 99.7% of samples had residual hallucinations, and aggregate clinical metrics such as CheXpert-F1 and Clinical-F1 were slightly lower than one- and two-stage baselines.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
32 of 40 cited sources checked · 13 supported · 4 flagged · accuracy not yet measured
- Findingcitation
Our BLEU-4 score of 0.0628 is lower than R2Gen (0.103) and R2GenCMN (0.106) on IU x-ray.
“Our BLEU-4 score of 0.0628 is lower than R2Gen (20) and R2GenCMN (48), which reported BLEU-4 scores of 0.103 and 0.106, respectively, on IU x-ray.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [20] Chen, 2020, Generating radiology reports via memory-driven transformer source
Table 3 (Section 3.2) reports a BLEU-4 score of 0.165 for the paper’s model on IU X-RAY. The claimed 0.103 is its score on MIMIC-CXR, not IU X-RAY. The citing authors’ own score and R2GenCMN’s score are not attributed to this source. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured - cites [48] Chen, 2022, Cross-modal memory networks for radiology report generation source
The results table in §4.1 (p. 6) reports R2GEN’s BLEU-4 score as 0.165 on IU X-RAY, not 0.103; it lists 0.103 for R2GEN on MIMIC-CXR. The claim assigns that score to the wrong dataset, and the cited passage does not establish the claimed 0.106 IU X-RAY score for R2GenCMN. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
- Premisecitation
These delays are particularly pronounced in resource-constrained environments, such as rural hospitals, emergency departments, and low-income regions, where access to experienced radiologists is limited or inconsistent.
“These delays are particularly pronounced in resource-constrained environments, such as rural hospitals, emergency departments, and low-income regions, where access to experienced radiologists is limited or inconsistent (3, 4).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [3] Miles, 2025, Advancing health care delivery in community, rural, and safety-net settings, J Am Coll Radiol source
The Introduction (page unavailable) links access barriers to delayed or missed care, and “Shared Challenges” (page unavailable) identifies radiologist shortages in community, rural, and safety-net settings. The paper does not establish that delays are particularly pronounced in those settings, or that limited access to experienced radiologists causes delays in emergency departments specifically. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [4] Rohatgi, 2015, After-hours radiology: challenges and strategies for the radiologist, Am J Roentgenol source
- Premisecitation
Many existing vision-language models rely on simplistic feature concatenation strategies that fail to capture fine-grained correspondences between localised radiographic findings and their semantic descriptions.
“these models often rely on simplistic feature concatenation strategies that fail to capture fine-grained correspondences between localised radiographic findings and their semantic descriptions (11, 16).”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [11] Artsi, 2025, “Large language models in radiology reporting—a systematic review of performance, limitations, and clinical implications” source
The Discussion addresses input quality and limitations in radiology reporting, but not feature concatenation or fine-grained image–text correspondence. Study Selection and Characteristics describes one model combining regional image features with knowledge-graph features; it does not say this was simplistic concatenation or that it failed to link localised findings to descriptions. Searches for those terms found no supporting passage. Page numbers were unavailable in our copy. (LLM, conf=0.75)
Experimental — accuracy not yet measured - cites [16] Li, 2025, Automatic radiology report generation with deep learning: a comprehensive review of methods and advances, Artif Intell Rev source
Section 4.2.2 describes some report-generation methods that use straightforward concatenation, and §3.1 identifies a deficiency in precise image–text correspondence. The review does not say that many vision-language models use concatenation or establish that concatenation causes the failure to align localized findings with their descriptions. Page numbers were not available in our copy. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
Direct comparisons are difficult due to differing evaluation settings.
“This is lower than MRGAgents' (35) BLEU-4 score of 0.191 on IU x-ray; however, as ReXrank (46) notes, direct comparisons are difficult due to differing evaluation settings.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
- Findingcitation
The BLEU-4 score of 0.0628 is lower than MRGAgents' BLEU-4 score of 0.191 on IU x-ray.
“This is lower than MRGAgents' (35) BLEU-4 score of 0.191 on IU x-ray; however, as ReXrank (46) notes, direct comparisons are difficult due to differing evaluation settings.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [35] Wang, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
- Premisecitation
ReXrank performance varied considerably across different healthcare sites.
“This need for external validation is further supported by studies like ReXrank (46), where performance varied considerably across different healthcare sites.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
The Results section reports substantial performance differences across the four evaluation datasets, and §3.1 says those datasets represent different medical institutions and patient populations. However, the paper does not report performance separately by healthcare site, including for ReXGradient’s 67 sites. Dataset-level variation does not establish the claimed site-level variation. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
EviAgent achieved Semb: 52.2 and RadCliQ-1: 110.2 on IU x-ray using Qwen3-VL-8B as its backbone.
“EviAgent (52), an evidence-driven framework, achieved Semb: 52.2 and RadCliQ-1: 110.2 on IU x-ray using Qwen3-VL-8B as its backbone.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [52] Qi, 2026 source
- Findingown data
The three-stage framework showed modest but consistent improvements over ablation baselines.
“The three-stage framework showed modest but consistent improvements over ablation baselines.”
Quote in the paperSubstantial claim - Findingown data
Clinical recall decreased from 0.8361 for one-stage and 0.8337 for two-stage to 0.8044 for three-stage.
“Clinical recall decreased from 0.8361 (one-stage) and 0.8337 (two-stage) to 0.8044 (three-stage)”
Quote in the paperSubstantial claim - Findingown data
A 14.8 × inference overhead was identified.
“A 14.8 × inference overhead was identified”
Quote in the paperSubstantial claim - Findingown data
The improvement in METEOR was statistically significant (p < 0.001).
“Improvements in METEOR (p < 0.001) and ROUGE-2-F (p < 0.05) were statistically significant.”
Quote in the paperNot a substantial claim - Findingown data
The clinical verifier corrected 85.6% of identified hallucinations.
“the clinical verifier demonstrated substantial effectiveness, correcting 85.6% of identified hallucinations”
Quote in the paperSubstantial claim - Findingown data
The improvement in ROUGE-2-F was statistically significant (p < 0.05).
“Improvements in METEOR (p < 0.001) and ROUGE-2-F (p < 0.05) were statistically significant.”
Quote in the paperNot a substantial claim - Findingown data
Clinical Recall decreased by −3.8% (0.8361 → 0.8044, p < 0.001).
“Clinical Recall decreased by −3.8% (0.8361 → 0.8044, p < 0.001)”
Quote in the paperSubstantial claim - Findingown data
CheXpert-F1 McNemar vs one-stage p < 0.001.
“CheXpert-F1 | Swin-Qwen3 (Three-Stage) vs. One-Stage Baseline | 16 | 49 | <0.001”
Quote in the paperSubstantial claim - Findingown data
CheXpert-F1 showed a small but statistically significant reduction compared with the one-stage baseline (p = 0.048, d = −0.116).
“Similarly, CheXpert-F1 showed a small but statistically significant reduction compared with the one-stage baseline (p = 0.048, d = −0.116), but not with the two-stage framework (p = 0.259).”
Quote in the paperNot a substantial claim - Findingown data
The three-stage framework significantly improved ROUGE-2-F compared to the two-stage framework (p = 0.021, d = 0.233).
“The three-stage framework significantly improved METEOR (p < 0.001, d = 0.285) and ROUGE-2-F (p = 0.021, d = 0.233) compared to the two-stage framework”
Quote in the paperSubstantial claim - Findingown data
Clinical F1 decreased by −1.4%.
“Clinical F1 (−1.4%) and CheXpert-F1 (−1.6%, p < 0.05) slightly decreased”
Quote in the paperNot a substantial claim - Findingown data
METEOR vs two-stage p < 0.001.
“METEOR | Wilcoxon | 0.063 | 0.215 | Wilcoxon | <0.001 | 0.285”
Quote in the paperSubstantial claim - Findingown data
The RaTE metric decreased significantly compared with the one-stage system (p < 0.001).
“The RaTE metric also decreased significantly for both comparisons (p < 0.001 vs. one-stage and p = 0.026 vs. two-stage).”
Quote in the paperSubstantial claim - Findingown data
RadGraph-F1 remained stable (−0.2%).
“while RadGraph-F1 remained stable (−0.2%)”
Quote in the paperNot a substantial claim - Findingown data
RaTE decreased by −3.7%.
“RaTE (−3.7%), Semb (−0.2%), and RadCliQ (−1.1%) showed modest decreases.”
Quote in the paperNot a substantial claim - Findingown data
The three-stage framework significantly improved METEOR compared to the two-stage framework (p < 0.001, d = 0.285).
“The three-stage framework significantly improved METEOR (p < 0.001, d = 0.285) and ROUGE-2-F (p = 0.021, d = 0.233) compared to the two-stage framework”
Quote in the paperSubstantial claim - Findingown data
Residual hallucination types were predominantly clinical entity errors (602 occurrences) and negation errors (584), followed by location (372), severity (280), and temporal (203) errors.
“Residual hallucination types were predominantly clinical entity errors (602 occurrences) and negation errors (584), followed by location (372), severity (280), and temporal (203) errors.”
Quote in the paperNot a substantial claim - Findingown data
Critical hallucinations (1,186) significantly outnumber moderate ones (855).
“critical hallucinations (1,186) significantly outnumber moderate ones (855)”
Quote in the paperSubstantial claim - Findingreasoning
Clinical Recall decreased by −3.8% (p < 0.001).
“The regression in Clinical Recall (−3.8%, p < 0.001) reflects a sensitivity-precision trade-off, where the verifier prioritizes removing unsupported findings over exhaustive enumeration.”
- Also stated in: § Conclusion · plain
“Clinical Recall decreased by −3.8% (p < 0.001)”
Quote in the paperSubstantial claim - Also stated in: § Conclusion · plain
- Findingown data
CheXpert-F1 vs one-stage p = 0.048.
“CheXpert-F1 | Wilcoxon | 0.048 | −0.116 | Wilcoxon | 0.259 | −0.083”
Quote in the paperSubstantial claim - Findingown data
No significant improvement over the one-stage baseline for METEOR (p = 0.063).
“However, no significant improvements were observed over the one-stage baseline for either METEOR (p = 0.063) or ROUGE-2-F (p = 0.589).”
Quote in the paperSubstantial claim - Findingown data
CheXpert-F1 McNemar vs two-stage p < 0.001.
“CheXpert-F1 | Swin-Qwen3 (Three-Stage) vs. Two-Stage Baseline | 16 | 51 | <0.001”
Quote in the paperSubstantial claim - Findingown data
Clinical Recall significantly decreased compared with the two-stage system (p = 0.001, d = −0.187).
“Clinical Recall significantly decreased compared with both the one-stage (p < 0.001, d = −0.208) and two-stage (p = 0.001, d = −0.187) systems.”
Quote in the paperSubstantial claim - Findingown data
The three-stage framework showed modest improvements over both baselines across most lexical overlap metrics.
“The three-stage framework showed modest improvements over both baselines across most lexical overlap metrics.”
Quote in the paperSubstantial claim - Findingown data
Clinical Recall vs one-stage p < 0.001.
“Clinical Recall | Wilcoxon | <0.001 | −0.208 | Wilcoxon | 0.001 | −0.187”
Quote in the paperSubstantial claim - Findingown data
The RaTE metric decreased significantly compared with the two-stage system (p = 0.026).
“The RaTE metric also decreased significantly for both comparisons (p < 0.001 vs. one-stage and p = 0.026 vs. two-stage).”
Quote in the paperSubstantial claim - Findingown data
Semb decreased by −0.2%.
“RaTE (−3.7%), Semb (−0.2%), and RadCliQ (−1.1%) showed modest decreases.”
Quote in the paperNot a substantial claim - Findingown data
CheXpert-F1 decreased by −1.6% (p < 0.05).
“Clinical F1 (−1.4%) and CheXpert-F1 (−1.6%, p < 0.05) slightly decreased”
Quote in the paperNot a substantial claim - Findingown data
ROUGE-2-F vs two-stage p = 0.021.
“ROUGE-2-F | Wilcoxon | 0.589 | 0.189 | Wilcoxon | 0.021 | 0.233”
Quote in the paperSubstantial claim - Findingown data
RadCliQ decreased by −1.1%.
“RaTE (−3.7%), Semb (−0.2%), and RadCliQ (−1.1%) showed modest decreases.”
Quote in the paperNot a substantial claim - Findingown data
No significant improvement over the one-stage baseline for ROUGE-2-F (p = 0.589).
“However, no significant improvements were observed over the one-stage baseline for either METEOR (p = 0.063) or ROUGE-2-F (p = 0.589).”
Quote in the paperSubstantial claim - Findingown data
The verifier achieved an 85.6% correction rate (Precision=0.856, Recall=0.856).
“The verifier achieved an 85.6% correction rate (Precision=0.856, Recall=0.856), but the persistent hallucination rate indicates a transmission problem between the verifier and refiner.”
- Also stated in: § Conclusion · boosted
“The clinical verifier proved substantially effective, correcting 85.6% of identified hallucinations with Precision = 0.856 and Recall = 0.856.”
Quote in the paperSubstantial claim - Also stated in: § Conclusion · boosted
- Findingown data
Cohen's Kappa values ranged from 0.720 to 0.830 across configurations.
“Finally, Cohen's Kappa values ranged from 0.720 to 0.830, corresponding to substantial to almost perfect agreement across configurations.”
Quote in the paperSubstantial claim - Findingown data
RaTE vs one-stage p < 0.001.
“RaTE | Wilcoxon | <0.001 | −0.311 | Wilcoxon | 0.026 | −0.135”
Quote in the paperSubstantial claim - Findingown data
McNemar's test demonstrated that the three-stage framework corrected substantially more clinically relevant predictions than it degraded.
“Although the average CheXpert-F1 score was slightly lower, McNemar's test demonstrated that the three-stage framework corrected substantially more clinically relevant predictions than it degraded.”
Quote in the paperSubstantial claim - Findingown data
RadGraph-F1 remained stable at 0.5467.
“CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage), Clinical-F1 reached 0.5401, and RadGraph-F1 remained stable at 0.5467.”
Quote in the paperNot a substantial claim - Findingown data
Failure cases (320 out of 321, or 99.7%) consistently exhibited residual hallucinations.
“Failure cases (320 out of 321, or 99.7%) consistently exhibited residual hallucinations.”
Quote in the paperSubstantial claim - Findingown data
Clinical Recall significantly decreased compared with the one-stage system (p < 0.001, d = −0.208).
“Clinical Recall significantly decreased compared with both the one-stage (p < 0.001, d = −0.208) and two-stage (p = 0.001, d = −0.187) systems.”
Quote in the paperSubstantial claim - Findingown data
CheXpert-F1 did not show a significant reduction compared with the two-stage framework (p = 0.259).
“Similarly, CheXpert-F1 showed a small but statistically significant reduction compared with the one-stage baseline (p = 0.048, d = −0.116), but not with the two-stage framework (p = 0.259).”
Quote in the paperNot a substantial claim - Findingnone given
Factuality Score remained stable at 0.843.
“Factuality Score remained stable at 0.843”
Quote in the paperNot a substantial claim - Findingown data
Clinical-F1 reached 0.5401.
“CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage), Clinical-F1 reached 0.5401, and RadGraph-F1 remained stable at 0.5467.”
Quote in the paperNot a substantial claim - Findingown data
99.7% of samples contain residual hallucinations.
“99.7% of samples contain residual hallucinations”
Quote in the paperSubstantial claim - Findingown data
The hallucination rate contradicts the previously reported 32% reduction compared to one-stage systems.
“The hallucination rate remained at 61.2%, showing no improvement over baseline models (61.1%) and contradicting the previously reported 32% reduction compared to one-stage systems.”
Quote in the paperSubstantial claim - Findingnone given
The inference overhead is 14.8× compared with single-stage generation.
“Third, the 14.8 × inference overhead compared with single-stage generation warrants attention.”
- Also stated in: § Conclusion · plain
“The 14.8 × inference overhead positions the system for offline batch processing and preliminary documentation support”
Quote in the paperSubstantial claim - Also stated in: § Conclusion · plain
- Findingcitation
Our framework achieves a higher clinical F1 (0.5401 vs. 0.346) than MRGAgents.
“In comparison, MRGAgents (35) reported Clinical F1 scores of 0.346 on IU x-ray, suggesting our framework achieves a higher clinical F1 (0.5401 vs. 0.346).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Wang, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
Critical hallucinations (1,186) were more prevalent than moderate ones (855).
“Our results align with these findings: critical hallucinations (1,186), which directly impact clinical decision-making, were more prevalent than moderate ones (855).”
Quote in the paperNot a substantial claim - Interpretationown data
The Swin-Qwen3 three-stage framework demonstrates that explicit clinical verification and iterative refinement can modestly enhance the clinical reliability of VLMs for automated radiology reporting.
“The Swin-Qwen3 three-stage framework demonstrates that explicit clinical verification and iterative refinement can modestly enhance the clinical reliability of VLMs for automated radiology reporting.”
Quote in the paperSubstantial claim - Premisereasoning
A critical translation gap persists between AI system performance on research benchmarks and their applicability into operational healthcare settings.
“Despite substantial technical progress, a critical translation gap persists between AI system performance on research benchmarks and their applicability into operational healthcare settings.”
Quote in the paperSubstantial claim - Study design and conductnone given
The evaluation relied primarily on automated text-comparison metrics rather than expert clinical review.
“The evaluation relied primarily on automated text-comparison metrics rather than expert clinical review.”
Quote in the paperSubstantial claim - Interpretationreasoning
Achieving clinical accuracy often necessitates phrasing that deviates from reference reports.
“Achieving clinical accuracy often necessitates phrasing that deviates from reference reports.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Negative t-statistics for lexical metrics highlight the inherent tension between clinical fidelity and exact n-gram matching in medical text generation.
“Negative t-statistics for lexical metrics highlight the inherent tension between clinical fidelity and exact n-gram matching in medical text generation.”
Quote in the paperSubstantial claim - Interpretationreasoning
The decrease in RaTE reflects structural modifications rather than a deterioration in report quality.
“This reflects structural modifications rather than a deterioration in report quality.”
Quote in the paperSubstantial claim - Interpretationown data
A relatively high standard deviation (~23%) indicates that some images remain prone to unsupported predictions.
“A relatively high standard deviation (∼23%) indicates that some images remain prone to unsupported predictions.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The evaluation was based on the full IU x-ray test set (321 samples).
“The evaluation was based on the full IU x-ray test set (321 samples), which provides sufficient statistical power for the reported comparisons.”
Quote in the paperSubstantial claim - Interpretationown data
The representative case illustrates progressive improvement in clinical completeness and lexical alignment across the 1-Stage, 2-Stage, and 3-Stage configurations.
“This case compares reports generated by the 1-Stage, 2-Stage, and 3-Stage configurations against the ground truth, illustrating the progressive improvement in clinical completeness and lexical alignment achieved through explicit verification and refinement (Figure 4).”
Quote in the paperNot a substantial claim - Interpretationown data
The three-stage framework's improvements indicate enhanced lexical quality and local text coherence.
“The three-stage framework significantly improved METEOR (p < 0.001, d = 0.285) and ROUGE-2-F (p = 0.021, d = 0.233) compared to the two-stage framework, indicating enhanced lexical quality and local text coherence.”
Quote in the paperSubstantial claim - Interpretationreasoning
This design lowers the infrastructure barrier for adoption in resource-limited healthcare settings.
“First, the parameter-efficient design, Qwen3-0.6B with LoRA adaptation (r = 8, α = 16) and a frozen Swin encoder, requires only commodity GPU hardware for both training and inference, lowering the infrastructure barrier for adoption in resource-limited healthcare settings, including rural hospitals and low-to-middle-income country facilities.”
Quote in the paperSubstantial claim - Interpretationreasoning
The persistent hallucination rate indicates a transmission problem between the verifier and refiner.
“The verifier achieved an 85.6% correction rate (Precision=0.856, Recall=0.856), but the persistent hallucination rate indicates a transmission problem between the verifier and refiner.”
Quote in the paperNot a substantial claim - Interpretationown data
The persistent hallucination rate of 61.2% underscores that this remains a research prototype requiring substantial further validation before any clinical application.
“Nevertheless, the persistent hallucination rate of 61.2% underscores that this remains a research prototype requiring substantial further validation before any clinical application.”
Quote in the paperSubstantial claim - Interpretationown data
The McNemar results indicate meaningful case-level improvements despite small changes in the aggregate metric.
“These results indicate meaningful case-level improvements despite small changes in the aggregate metric.”
Quote in the paperSubstantial claim - Interpretationreasoning
The consistent performance across lexical and clinical metrics suggests that the system can be deployed with adjustable confidence thresholds.
“Fifth, the consistent performance across lexical and clinical metrics suggests that the system can be deployed with adjustable confidence thresholds, allowing institutions to balance speed and accuracy according to their clinical context.”
Quote in the paperSubstantial claim - Interpretationreasoning
The decrease in Clinical Recall suggests a more conservative correction strategy that occasionally removes clinically relevant findings.
“This suggests a more conservative correction strategy that occasionally removes clinically relevant findings.”
Quote in the paperSubstantial claim - Premisecitation
MRGAgents reported Clinical F1 scores of 0.346 on IU x-ray.
“In comparison, MRGAgents (35) reported Clinical F1 scores of 0.346 on IU x-ray, suggesting our framework achieves a higher clinical F1 (0.5401 vs. 0.346).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Wang, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- May combine two claims. 45
- Classified as probably not a substantial claim. 30
May combine two claims.
PremisecitationThese models do not provide comprehensive clinical metrics like CheXpert-F1 or RadGraph-F1, preventing a direct comparison on clinically relevant dimensions.
“However, these models do not provide comprehensive clinical metrics like CheXpert-F1 or RadGraph-F1, preventing a direct comparison on clinically relevant dimensions.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [20] Chen, 2020, Generating radiology reports via memory-driven transformer source
Section 3.2 reports clinical-efficacy precision, recall, and F1 using CheXpert labels, including F1 scores for models on MIMIC-CXR. This contradicts the claim that the paper does not provide CheXpert-F1 or permit comparison on that clinical dimension. The paper notes that these metrics do not apply to IU X-RAY; the cited passages do not report RadGraph-F1. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured - cites [48] Chen, 2022, Cross-modal memory networks for radiology report generation source
Section 3.2 (p. 5) says the paper evaluates clinical efficacy using CheXpert labels and reports precision, recall, and F1. The results table in Section 4.1 (p. 6) gives those clinical metrics for MIMIC-CXR models, contrary to the claim that they provide no CheXpert-F1 for clinical comparison. The paper does not report RadGraph-F1, and its CheXpert-based metrics do not apply to IU X-RAY. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationChest radiography is one of the most frequently performed diagnostic examinations and plays a key role in the detection and monitoring of pulmonary diseases, cardiac abnormalities, infections, and thoracic trauma.
“Chest radiography is one of the most frequently performed diagnostic examinations and plays a key role in the detection and monitoring of pulmonary diseases, cardiac abnormalities, infections, and thoracic trauma (5, 6).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [5] Miró Catalina, 2024, Real-world testing of an artificial intelligence algorithm for the analysis of chest x-rays in primary care settings, Sci Rep source
The Introduction (page unavailable) calls chest X-rays one of the most common tests and says they are used to detect pulmonary and cardiovascular diseases. The copy does not establish their role in monitoring disease or specifically in detecting infections and thoracic trauma; the Results list abnormalities such as consolidation and abnormal ribs without making those broader claims. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites [6] Sargent, 2023, The sensitivity of chest x-ray (CXR) for the detection of significant thoracic injury in children exposed to blast, Injury source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn emergency and intensive care settings, timely interpretation of chest radiographs is essential for guiding clinical decisions, including ventilation management, antibiotic initiation, and imaging referrals.
“In emergency and intensive care settings, timely interpretation of chest radiographs is essential for guiding clinical decisions, including ventilation management, antibiotic initiation, and imaging referrals (7, 8).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [7] Tanabe, 2024, Lung imaging in COPD and asthma, Respir Investig source
- cites [8] Bonaffini, 2023, Chest x-ray at emergency admission and potential association with barotrauma in mechanically ventilated patients: experience from the Italian core of the first pandemic peak, Tomography source
The Discussion says chest X-ray is an early emergency-room investigation and examines whether admission findings identify patients at risk of barotrauma. Methods §2.3 says barotrauma suspected or detected on CXR could prompt CT, supporting the imaging-referral example. The paper does not establish that timely interpretation guides ventilation management or antibiotic initiation. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim. May combine two claims.
PremisecitationThe growing gap between imaging demand and radiologist availability has intensified the challenge of radiology reporting, leading to delayed diagnoses and increased workloads across healthcare systems worldwide.
“The growing gap between imaging demand and radiologist availability has intensified this challenge, leading to delayed diagnoses and increased workloads across healthcare systems worldwide (1, 2).”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [1] Pesapane, 2023, Advancements in standardizing radiological reports: a comprehensive review, Medicina (B Aires) source
The Introduction describes the importance of radiology reports, and Section 4 discusses the effort required to standardize them and mentions workload guidelines. Neither passage addresses a growing gap between imaging demand and radiologist availability or links such a gap to delayed diagnoses and increased workloads worldwide. Searches for those terms and for reporting backlogs found no supporting passage in our copy. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [2] Ouis, 2024, ChestBioX-Gen: contextual biomedical report generation from chest x-ray images using BioGPT and co-attention mechanism, Front Imaging source
The Abstract (page unavailable) says timely radiology reporting matters for diagnosis and describes reducing radiologists’ burden and enabling faster diagnoses. It does not say that imaging demand is outpacing radiologist availability or that this gap has caused delayed diagnoses and increased workloads worldwide. (LLM, conf=0.78)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationKey barriers to translation include the generation of clinically plausible but factually incorrect statements (hallucinations) and the lack of structured frameworks that decompose generation into auditable, verifiable steps amenable to clinical governance.
“Key barriers include the generation of clinically plausible but factually incorrect statements—so-called hallucinations (11, 12)—and the lack of structured frameworks that decompose generation into auditable, verifiable steps amenable to clinical governance.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [11] Artsi, 2025, “Large language models in radiology reporting—a systematic review of performance, limitations, and clinical implications” source
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured - cites [12] Salehi, 2025, Agentic AI and large language models in radiology: opportunities and hallucination challenges, Bioengineering source
May combine two claims.
PremisecitationThe high volume of chest x-rays, combined with the need for detailed narrative reporting, places significant pressure on radiologists, especially during night shifts and peak admission periods.
“The high volume of chest x-rays, combined with the need for detailed narrative reporting, places significant pressure on radiologists, especially during night shifts and peak admission periods (9, 10).”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [9] Naidji, 2024, Automatic detection of COVID-19 from chest x-ray images using EfficientNet-B7 CNN model with channel-wise attention, Int J Com Dig Sys source
The Introduction (page not provided) says the rapid spread of COVID-19 imposed a significant workload on radiologists and discusses faster interpretation of chest radiographs. It does not attribute that workload to detailed narrative reporting or identify night shifts and peak admission periods as especially demanding. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites [10] Schalekamp, 2024, Performance of AI to exclude normal chest radiographs to reduce radiologists' Workload, Eur Radiol source
The Introduction describes increasing radiologist workload and the potential to save time by reducing chest-radiograph reporting; the Discussion explicitly cites the high volume of chest radiographs. Neither section says that detailed narrative reports are required or that pressure is especially high during night shifts or peak admission periods. Page numbers are not available in our copy. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRecent multi-agent frameworks demonstrated that task decomposition improves both precision and comprehensiveness.
“Our results align with recent multi-agent frameworks (35, 49), which demonstrated that task decomposition improves both precision and comprehensiveness.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [35] Wang, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [49] Yi, 2025 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThis is similar to challenges observed in RAG systems where retrieved information is not effectively incorporated.
“This is similar to challenges observed in RAG systems where retrieved information is not effectively incorporated (50, 51).”
Quote in the paperNot a substantial claim2 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationReXrank findings show that even top-performing models struggle with abnormal cases, achieving error rates of 45% for abnormal studies compared to over 90% for normal studies.
“This aligns with ReXrank (46)'s findings that even top-performing models struggle with abnormal cases, achieving error rates of 45% for abnormal studies compared to over 90% for normal studies.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
The Results section compares models across datasets using report-generation metrics, but does not report error rates for abnormal versus normal studies. Searches for abnormal studies and the claimed 45% and over-90% rates found no passage addressing that comparison; a mention of abnormalities in §3.5 describes a model’s architecture, not its results. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationYi et al. noted that incorporating retrieval and refinement can introduce redundancy, affecting overall consistency.
“Similarly, Yi et al. (49) noted that incorporating retrieval and refinement can introduce redundancy, affecting overall consistency.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [49] Yi, 2025 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationEviAgent demonstrated that while evidence-driven frameworks outperform MLLMs, they still face challenges with complex clinical scenarios.
“Similarly, EviAgent (52) demonstrated that while evidence-driven frameworks outperform MLLMs, they still face challenges with complex clinical scenarios.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [52] Qi, 2026 source
Section 4.2 and the Conclusion report that EviAgent outperforms standard MLLM baselines. But Section 4.5 uses a complex ICU case to illustrate EviAgent’s precision, not a challenge it faces in complex clinical scenarios. A separate error analysis describes mislocalization and over-diagnosis caused by its perception tools, without tying those errors to complex scenarios. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe explicit separation of generation, verification, and refinement stages represents a departure from end-to-end approaches.
“The explicit separation of generation, verification, and refinement stages represents a departure from end-to-end approaches (20, 48).”
Quote in the paperNot a substantial claim2 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEviAgent trades inference speed for clinical accuracy.
“ReXrank (46) similarly noted that inference efficiency remains a challenge for multi-stage and agent-based systems, as also observed in EviAgent (52) which trades inference speed for clinical accuracy.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [52] Qi, 2026 source
May combine two claims.
PremisecitationReXrank demonstrated that even top-performing models struggle with abnormal cases, with no significant error rates below 45% for abnormal studies.
“ReXrank (46) demonstrated that even top-performing models struggle with abnormal cases, with no significant error rates below 45% for abnormal studies.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
The Results section compares model performance across datasets but does not report results separately for abnormal studies. Searches for “abnormal,” “45%,” and “significant error” found no abnormal-study error-rate analysis or 45% threshold in our copy; the Metrics section only describes measures that can identify clinically significant errors. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationYi et al. showed that multi-agent collaboration, incorporating retrieval and refinement, produces more clinically grounded reports.
“Similarly, Yi et al. (49) showed that multi-agent collaboration, incorporating retrieval and refinement, produces more clinically grounded reports.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [49] Yi, 2025 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationReXrank noted that inference efficiency remains a challenge for multi-stage and agent-based systems.
“ReXrank (46) similarly noted that inference efficiency remains a challenge for multi-stage and agent-based systems, as also observed in EviAgent (52) which trades inference speed for clinical accuracy.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [46] Zhang, 2024, ReXrank: a public leaderboard for AI-powered radiology report generation source
The Introduction discusses reporting efficiency and benchmarking, while §3.5 describes models used sequentially; neither addresses inference efficiency. Searches for inference speed, computational cost, latency, and agent-based systems found no passage in our copy stating that inference efficiency remains a challenge for those systems. Page numbers were not available in the indexed passages. (LLM, conf=0.72)
Experimental — accuracy not yet measured - cites [52] Qi, 2026 source
May combine two claims.
Findingown dataThe factuality score for the three-stage framework was 0.843, compared to 0.845 for one-stage and 0.845 for two-stage.
“The factuality score reached 0.843 (compared to 0.845 for one-stage and 0.845 for two-stage)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataROUGE-2-F for the three-stage framework was 0.0957, +10.2% vs one-stage and +13.1% vs two-stage.
“ROUGE-2-F was 0.0957 (+10.2% vs. one-stage; +13.1% vs. two-stage)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe hallucination rate for the three-stage framework was 0.6116, compared to 0.6109 for one-stage and 0.6109 for two-stage.
“the hallucination rate remained at 0.6116 (compared to 0.6109 for one-stage and 0.6109 for two-stage)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRadGraph-F1 for the three-stage framework was 0.5467, compared to 0.5478 for one-stage and 0.5445 for two-stage.
“RadGraph-F1 scored 0.5467 (compared to 0.5478 for one-stage and 0.5445 for two-stage)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMETEOR for the three-stage framework was 0.3728, +4.5% vs one-stage and +6.3% vs two-stage.
“METEOR was 0.3728 (+4.5% vs. one-stage; +6.3% vs. two-stage)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCheXpert-F1 for the three-stage framework was 0.7038, compared to 0.7154 for one-stage and 0.7123 for two-stage.
“CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataClinical-F1 for the three-stage framework was 0.5401, compared to 0.5478 for one-stage and 0.5449 for two-stage.
“Clinical-F1 reached 0.5401 (compared to 0.5478 for one-stage and 0.5449 for two-stage)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataBLEU-4 for the three-stage framework was 0.0628, +10.9% vs one-stage and +13.1% vs two-stage.
“BLEU-4 was 0.0628 (+10.9% vs. one-stage; +13.1% vs. two-stage)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMETEOR improved by +4.5% vs one-stage and +6.3% vs two-stage.
“METEOR improved by +4.5% vs. one-stage and +6.3% vs. two-stage”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBLEU-3 improved by +5.0% vs one-stage and +7.8% vs two-stage.
“and BLEU-3 (+5.0% vs. one-stage; +7.8% vs. two-stage)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataROUGE-2-F demonstrated a relative improvement of +10.2% compared to one-stage and +13.1% compared to two-stage.
“ROUGE-2-F demonstrated a substantial relative improvement of +10.2% compared to the one-stage baseline and +13.1% compared to the two-stage baseline”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMcNemar tests confirmed 3-Stage superiority for CheXpert-F1 (p < 0.001), with 49 vs. 16 and 51 vs. 16 improvements over baselines.
“McNemar tests confirmed 3-Stage superiority for CheXpert-F1 (p < 0.001), with 49 vs. 16 and 51 vs. 16 improvements over baselines.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe hallucination rate persisted at 61.2%, showing no improvement over baselines.
“However, the hallucination rate persisted at 61.2%, showing no improvement over baselines.”
- Also stated in: § Architectural performance and clinical utility · plain
“the hallucination rate persisted at 61.2%, showing no improvement over baselines”
Quote in the paperSubstantial claim- Also stated in: § Architectural performance and clinical utility · plain
May combine two claims.
Findingown dataThe 1-Stage generator produces a fluent but incomplete report, omitting the lobulated opacity and hyperexpanded lungs while underestimating severity.
“The 1-Stage generator produces a fluent but incomplete report, omitting the lobulated opacity and hyperexpanded lungs while underestimating severity.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe three-stage system attained METEOR = 0.3728, a +4.5% improvement vs. one-stage (p < 0.001).
“Our three-stage framework achieved modest improvements in lexical quality, as evidenced by BLEU-4 (+10.9%), ROUGE-2-F (+10.2%, p < 0.05), and METEOR (+4.5%, p < 0.001).”
- Also stated in: § Conclusion · plain
“METEOR=0.3728 (+4.5%, p < 0.001)”
Quote in the paperSubstantial claim- Also stated in: § Conclusion · plain
May combine two claims.
Findingown dataThe 2-Stage refiner offers modest terminology improvements but does not address these omissions.
“Although the 2-Stage refiner offers modest terminology improvements, it does not address these omissions.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the top 5 failure cases, correction rates ranged from 0% to 33.3%, significantly below the average of 85.6%.
“In the top 5 failure cases, correction rates ranged from 0% to 33.3%, significantly below the average of 85.6%.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCompared with the one-stage model, 49 cases improved vs. 16 deteriorated (p < 0.001).
“Compared with the one-stage model, 49 cases improved vs. 16 deteriorated (p < 0.001).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe three-stage system attained BLEU-4 = 0.0628, a +10.9% improvement vs. one-stage.
“Our three-stage framework achieved modest improvements in lexical quality, as evidenced by BLEU-4 (+10.9%), ROUGE-2-F (+10.2%, p < 0.05), and METEOR (+4.5%, p < 0.001).”
- Also stated in: § Conclusion · plain
“the three-stage system attained BLEU-4 = 0.0628 (+10.9% vs. one-stage)”
Quote in the paperSubstantial claim- Also stated in: § Conclusion · plain
May combine two claims.
Findingown dataThe 3-Stage framework achieves the closest lexical and structural alignment with the ground truth but introduces a hallucinated finding ("Mild hyperinflation" instead of "hyperexpanded") and still misses the lobulated opacity.
“The 3-Stage framework achieves the closest lexical and structural alignment with the ground truth but introduces a hallucinated finding (“Mild hyperinflation” instead of “hyperexpanded”) and still misses the lobulated opacity.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage).
“CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage), Clinical-F1 reached 0.5401, and RadGraph-F1 remained stable at 0.5467.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataBERTScore-F1 showed a slight decrease of −0.2%.
“BERTScore-F1 showed a slight decrease of −0.2%”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe three-stage system attained ROUGE-2-F = 0.0957, a +10.2% improvement vs. one-stage (p < 0.05).
“Our three-stage framework achieved modest improvements in lexical quality, as evidenced by BLEU-4 (+10.9%), ROUGE-2-F (+10.2%, p < 0.05), and METEOR (+4.5%, p < 0.001).”
- Also stated in: § Conclusion · plain
“ROUGE-2-F = 0.0957 (+10.2%, p < 0.05)”
Quote in the paperSubstantial claim- Also stated in: § Conclusion · plain
May combine two claims.
Findingown dataCompared with the two-stage model, 51 cases improved vs. 16 deteriorated (p < 0.001).
“Likewise, compared with the two-stage model, 51 cases improved vs. 16 deteriorated (p < 0.001).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataHallucination Rate persisted at 61.2%, showing no improvement over baselines (61.1%).
“Hallucination Rate persisted at 61.2%, showing no improvement over baselines (61.1%)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataTwo primary failure modes were identified: verifier omission and verifier hallucination.
“Two primary failure modes were identified: (i) verifier omission, where existing hallucinations were not identified, and (ii) verifier hallucination, where new errors were introduced.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBLEU-4 improved by +10.9% vs one-stage and +13.1% vs two-stage.
“Gains were particularly evident in BLEU-4 (+10.9% vs. one-stage; +13.1% vs. two-stage)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe verifier corrects an average of 5.52 true hallucinations per sample while making only 0.86 false corrections.
“It corrects an average of 5.52 true hallucinations per sample while making only 0.86 false corrections.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOur framework, with a much smaller model (0.6B vs. 8B), demonstrates competitive clinical performance with Semb: 0.656 (scaled: 65.6) and RadCliQ: 0.688 (scaled inverse: ∼145).
“Our framework, with a much smaller model (0.6B vs. 8B), demonstrates competitive clinical performance with Semb: 0.656 (scaled: 65.6) and RadCliQ: 0.688 (scaled inverse: ∼145).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenThe parameter-efficient design (Qwen3-0.6B with LoRA adaptation r = 8, α = 16 and a frozen Swin encoder) requires only commodity GPU hardware for both training and inference.
“First, the parameter-efficient design, Qwen3-0.6B with LoRA adaptation (r = 8, α = 16) and a frozen Swin encoder, requires only commodity GPU hardware for both training and inference, lowering the infrastructure barrier for adoption in resource-limited healthcare settings, including rural hospitals and low-to-middle-income country facilities.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationown dataThe 14.8× inference overhead indicates suitability for offline reporting contexts.
“indicating suitability for offline reporting contexts”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe parameter-efficient design is scalable across diverse clinical settings, including resource-limited environments.
“The parameter-efficient design is scalable across diverse clinical settings, including resource-limited environments”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe residual hallucination rate of 61.2% indicates that the current system is a promising research prototype rather than a clinically deployable tool.
“the residual hallucination rate of 61.2% indicates that the current system is a promising research prototype rather than a clinically deployable tool”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe persistent 61.2% hallucination rate confirms that this remains a research prototype requiring substantial further validation before clinical deployment.
“The persistent 61.2% hallucination rate confirms that this remains a research prototype requiring substantial further validation before clinical deployment.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
Interpretationown dataThe susceptibility to unsupported predictions may stem from limitations in the verifier's encoded clinical knowledge or the inherent ambiguity of certain medical presentations.
“This susceptibility may stem from limitations in the verifier's encoded clinical knowledge or the inherent ambiguity of certain medical presentations.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThe phased approach aligns with established implementation science frameworks for health technology adoption.
“This phased approach aligns with established implementation science frameworks for health technology adoption and supports potential SDG 17 (Partnerships for the Goals) by enabling collaborative, multi-institutional rollout strategies, pending prospective clinical validation.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningReal-time applications at the point of care may find the 14.8× inference overhead limiting.
“Real-time applications at the point of care may find this overhead limiting; however, the framework remains well-suited for batch processing scenarios (e.g., offline preliminary report generation for research purposes).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationMRGAgents observed that their multi-agent framework, despite improving comprehensiveness, resulted in lower ROUGE-L scores due to structural differences in generated reports.
“MRGAgents (53) also observed that their multi-agent framework, despite improving comprehensiveness, resulted in lower ROUGE-L scores due to structural differences in generated reports.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [53] Wang, 2025, Mrgagents: a multi-agent framework for improved medical report generation with med-lvlms
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningPrioritizing clinical accuracy is a justified design choice, supporting the use of clinical metrics over lexical metrics as the primary evaluation criteria for implementation-focused systems.
“These results underscore that prioritizing clinical accuracy is a justified design choice, supporting the use of clinical metrics over lexical metrics as the primary evaluation criteria for implementation-focused systems.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe explicit verification and refinement stages allow researchers to audit where errors occur, facilitating targeted improvements.
“The explicit verification and refinement stages allow researchers to audit where errors occur—whether in the generator, verifier, or refiner—thus facilitating targeted improvements.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe modular three-stage architecture facilitates a staged research roadmap.
“Fourth, the modular three-stage architecture facilitates a staged research roadmap.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe regression in Clinical Recall reflects a sensitivity-precision trade-off, where the verifier prioritizes removing unsupported findings over exhaustive enumeration.
“The regression in Clinical Recall (−3.8%, p < 0.001) reflects a sensitivity-precision trade-off, where the verifier prioritizes removing unsupported findings over exhaustive enumeration.”
Quote in the paperSubstantial claim- Rests on an assumption: In decision-support contexts, false positives are more harmful than missed findings.
Classified as probably not a substantial claim.
InterpretationreasoningThe three-stage pipeline's explicit separation of drafting, verification, and refinement creates natural audit trails and interpretable intermediate outputs.
“Second, the three-stage pipeline's explicit separation of drafting, verification, and refinement creates natural audit trails and interpretable intermediate outputs.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe three-stage architecture enhances linguistic quality and structural coherence, but challenges persist in detecting subtle mediastinal abnormalities and controlling hallucinations.
“These results demonstrate that while the three-stage architecture enhances linguistic quality and structural coherence, challenges persist in detecting subtle mediastinal abnormalities and controlling hallucinations.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe phased approach supports potential SDG 17.
“This phased approach aligns with established implementation science frameworks for health technology adoption and supports potential SDG 17 (Partnerships for the Goals) by enabling collaborative, multi-institutional rollout strategies, pending prospective clinical validation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThe generalised clinical verifier may lack the specialised knowledge required for rare pathologies or complex multi-system findings.
“The generalised clinical verifier may lack the specialised knowledge required for rare pathologies or complex multi-system findings.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThis supports research reproducibility and transparency.
“This supports research reproducibility and transparency, which are essential for scientific validation and regulatory evaluation.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe high Cohen's Kappa agreement levels indicate systematic differences and support the reliability of the comparative evaluation.
“These high agreement levels indicate systematic differences and support the reliability of the comparative evaluation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe framework remains well-suited for batch processing scenarios.
“Real-time applications at the point of care may find this overhead limiting; however, the framework remains well-suited for batch processing scenarios (e.g., offline preliminary report generation for research purposes).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenThe framework advances research in AI-assisted radiology reporting with potential alignment with SDGs 3, 9, and 17.
“This framework advances research in AI-assisted radiology reporting with potential alignment with SDGs 3, 9, and 17, pending prospective clinical validation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThis design supports potential alignment with SDG 3.
“This design supports potential alignment with SDG 3 (Good Health and Well-being) by making AI-assisted radiological research more accessible, pending further validation.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Automated report generation systems can ease the burden on radiologists by providing preliminary diagnostic descriptions that support clinical workflows without replacing expert judgment.
“Automated report generation systems can ease this burden by providing preliminary diagnostic descriptions that support clinical workflows without replacing expert judgment.”
The paper relies on this without support.
In decision-support contexts, false positives are more harmful than missed findings.
“This pattern aligns with clinical priorities in decision-support contexts, where false positives are more harmful than missed findings.”
The paper relies on this without support.
The full IU x-ray test set (321 samples) provides sufficient statistical power for the reported comparisons.
“The evaluation was based on the full IU x-ray test set (321 samples), which provides sufficient statistical power for the reported comparisons.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Abstract claims consistent improvements despite lower clinical and factuality scores
MajorThe abstract calls the three-stage results consistent improvements over the ablations, but its own reported CheXpert-F1, Clinical-F1, factuality score, and hallucination rate are worse than both baselines.
“The three-stage framework showed modest but consistent improvements over ablation baselines.”
“CheXpert-F1 reached 0.7038 (compared to 0.7154 for one-stage and 0.7123 for two-stage), Clinical-F1 reached 0.5401 (compared to 0.5478 for one-stage and 0.5449 for two-stage), and RadGraph-F1 scored 0.5467 (compared to 0.5478 for one-stage and 0.5445 for two-stage).”
METEOR significance claim conflicts with the one-stage comparison
MajorThe discussion and conclusion attach p < 0.001 to the +4.5% METEOR gain over the one-stage baseline, but Table 3 reports p = 0.063 for that comparison. The p < 0.001 result applies to the two-stage comparison.
“METEOR=0.3728 (+4.5%, p < 0.001)”
“| METEOR | Wilcoxon | 0.063 | 0.215 | Wilcoxon | <0.001 | 0.285 |”
Training-set percentage does not match the reported counts
MinorThe reported 1,493 training samples are 69.96% of the 2,134 reports, not 75%. The three stated split percentages also total 105%.
Reported 75 · recomputed 69.962512
“The final dataset comprised 2,134 diagnostic reports, each linked to two paired chest radiographs: frontal (posteroanterior) and lateral views, resulting in a total of 4,268 chest radiographs. The dataset was divided into training, validation and test sets at the report level using a 75%/15%/15% random stratified split, implemented with a fixed random seed for reproducibility. This resulted in 1,493 training samples, 320 validation samples, and 321 test samples.”
Hallucination-rate standard deviation conflicts with its table entry
MinorThe discussion describes a hallucination-rate standard deviation of about 23%, but Table 2 prints zero dispersion for the three-stage hallucination rate.
“A relatively high standard deviation (∼23%) indicates that some images remain prone to unsupported predictions.”
“| Hallucination Rate | 0.6109 ± 0000 | 0.6109 ± 0000 | 0.6116 ± 0000 |”
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · see citing works
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522 · see citing works
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · see citing works
MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports
Johnson, A. E. W., Pollard, T. J., Berkowitz, S. J., Greenbaum, N. R., Lungren, M. P., Deng, C.-Y., Mark, R. G., & Horng, S. (2019) · Scientific Data · doi:10.1038/s41597-019-0322-0 · Cited by 1,816 · see citing works
Generating Radiology Reports via Memory-driven Transformer
Chen, Z., Song, Y., Chang, T.-H., & Wan, X. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.112 · Cited by 693 · see citing works
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392 · see citing works
Cross-modal Memory Networks for Radiology Report Generation
Chen, Z., Shen, Y., Song, Y., & Wan, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.459 · Cited by 369 · see citing works
Clinically Accurate Chest X-Ray Report GenerationPreprint
Liu, G., Hsu, T.-M. H., McDermott, M. B. A., Boag, W., Weng, W., Peter Szolovits, B., & Ghassemi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02633 · Cited by 212 · see citing works
Evaluating progress in automatic chest X-ray radiology report generation
Yu, F., Endo, M., Krishnan, R., Pan, I., Tsai, A., Reis, E. P., Fonseca, E. K. U. N., Lee, H. M. H., Abad, Z. S. H., Ng, A. Y., et al. (2023) · Patterns · doi:10.1016/j.patter.2023.100802 · Cited by 200 · see citing works
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation
Miura, Y., Zhang, Y., Tsai, E., Langlotz, C., & Jurafsky, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.416 · Cited by 149 · see citing works
Medical image captioning via generative pretrained transformers
Selivanov, A., Rogov, O. Y., Chesakov, D., Shelmanov, A., Fedulova, I., & Dylov, D. V. (2023) · Scientific Reports · doi:10.1038/s41598-023-31223-5 · Cited by 119 · see citing works
A survey on retrieval-augmentation generation (RAG) models for healthcare applications
El-Enen, M. A. A., Saad, S., & Nazmy, T. M. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11666-9 · Cited by 78 · see citing works
RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models
Xia, P., Zhu, K., Li, H., Zhu, H., Li, Y., Li, G., Zhang, L., & Yao, H. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.62 · Cited by 67 · see citing works
RadGraph: Extracting Clinical Entities and Relations from Radiology Reports
Jain, S., Agrawal, A., Saporta, A., Truong, S. Q., Duong, D. N., Bui, T., Chambon, P., Zhang, Y., Lungren, M. P., Ng, A. Y., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.14463 · Cited by 66 · see citing works
After-hours radiology: challenges and strategies for the radiologist
Rohatgi, S., Hanna, T. N., Sliker, C. W., Abbott, R. M., & Nicola, R. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.15.14605 · Cited by 62 · see citing works
Advancements in standardizing radiological reports: a comprehensive review
Pesapane, F., Tantrige, P., De Marco, P., Carriero, S., Zugni, F., Nicosia, L., Bozzini, A. C., Rotili, A., Latronico, A., Abbate, F., et al. (2023) · Medicina · doi:10.3390/medicina59091679 · Cited by 50 · see citing works
Ji, J., Hou, Y., Chen, X., Pan, Y., & Xiang, Y. (2024) · JMIR Formative Research · doi:10.2196/32690 · Cited by 48 · see citing works
Unify, Align and Refine: Multi-Level Semantic Alignment for Radiology Report Generation
Li, Y., Yang, B., Cheng, X., Zhu, Z., Li, H., & Zou, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00268 · Cited by 43 · see citing works
RadGraph: Extracting Clinical Entities and Relations from Radiology Reports
Jain, S., Agrawal, A., Saporta, A., Truong, S. Q., Nguyen Duong, D., Bui, T., Chambon, P., Lungren, M., Ng, A., Langlotz, C., et al. (2021) · PhysioNet · doi:10.13026/hm87-5p47 · Cited by 34 · see citing works
Agentic AI and large language models in radiology: opportunities and hallucination challenges
Salehi, S., Singh, Y., Horst, K. K., Hathaway, Q. A., & Erickson, B. J. (2025) · Bioengineering · doi:10.3390/bioengineering12121303 · Cited by 32 · see citing works
RaTEScore: A Metric for Radiology Report Generation
Zhao, W., Wu, C., Zhang, X., Zhang, Y. P., Wang, Y., & Xie, W. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.836 · Cited by 32 · see citing works
SERPENT-VLM : Self-Refining Radiology Report Generation Using Vision Language Models
Kapadnis, M., Patnaik, S., Nandy, A., Ray, S., Goyal, P., & Sheet, D. (2024) · Clinical Natural Language Processing Workshop · doi:10.48550/arxiv.2404.17912 · Cited by 30
Performance of AI to exclude normal chest radiographs to reduce radiologists' Workload
Schalekamp, S., van Leeuwen, K., Calli, E., Murphy, K., Rutten, M., Geurts, B., Peters-Bax, L., van Ginneken, B., & Prokop, M. (2024) · European Radiology · doi:10.1007/s00330-024-10794-5 · Cited by 28 · see citing works
Chest X-Ray Report Generation Using Abnormality Guided Vision Language Model
Edirisinghe, D., Nimalsiri, W., Hennayake, M., Meedeniya, D., & Lim, G. (2025) · IEEE Access · doi:10.1109/access.2025.3606961 · Cited by 28 · see citing works
CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions
Zeiser, F. A., da Costa, C. A., Ramos, G. D. O., Maier, A., & Righi, R. D. R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124644 · Cited by 24 · see citing works
Cross-modal Memory Networks for Radiology Report Generation
Chen, Z., Shen, Y., Song, Y., & Wan, X. (2022) · arXiv · doi:10.48550/arxiv.2204.13258 · Cited by 24 · see citing works
Miró Catalina, Q., Vidal-Alaball, J., Fuster-Casanovas, A., Escalé-Besa, A., Ruiz Comellas, A., & Solé-Casals, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-55792-1 · Cited by 23 · see citing works
Automated image label extraction from radiology reports — A review
Pereira, S. C., Mendonça, A. M., Campilho, A., Sousa, P., & Lopes, C. T. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102814 · Cited by 21 · see citing works
Lung imaging in COPD and asthma
Tanabe, N., Nakagawa, H., Sakao, S., Ohno, Y., Shimizu, K., Nakamura, H., Hanaoka, M., Nakano, Y., & Hirai, T. (2024) · Respiratory Investigation · doi:10.1016/j.resinv.2024.08.014 · Cited by 21 · see citing works
FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Models
Heiman, A., Zhang, X.-M., Chen, E., Kim, S. E., & Rajpurkar, P. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.02867 · Cited by 21 · see citing works
CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generation
Jiang, Y., Chen, J., Yang, D., Li, M., Wang, S., Wu, T., Li, K., & Zhang, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887699 · Cited by 21 · see citing works
SERPENT-VLM : Self-Refining Radiology Report Generation Using Vision Language Models
Kapadnis, M. N., Patnaik, S., Nandy, A., et al. (2024) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2024.clinicalnlp-1.24 · Cited by 17 · see citing works
Dutta, N., Bose, K., Syailendra, E. A., Chu, L. C. H., & Gupta, P. K. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106227 · Cited by 13 · see citing works
Ouis, M. Y., & Akhloufi, M. A. (2024) · Frontiers in Imaging · doi:10.3389/fimag.2024.1373420 · Cited by 12 · see citing works
Yuan, H. (2025) · iRadiology · doi:10.1002/ird3.115 · Cited by 10 · see citing works
Chambon, P., Delbrouck, J.-B., Sounack, T., Huang, S.-C., Chen, Z., Varma, M., Truong, S. Q., Chuong, C. T., & Langlotz, C. P. (2024) · arXiv · doi:10.48550/arxiv.2405.19538 · Cited by 8 · see citing works
Artsi, Y., Klang, E., Collins, J. D., Glicksberg, B. S., Korfiatis, P., Nadkarni, G. N., & Sorin, V. (2025) · medRxiv · doi:10.1101/2025.03.18.25324193 · Cited by 7 · see citing works
Li, Y., Kong, C., Zhao, G., & Zhao, Z. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11337-0 · Cited by 7 · see citing works
MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMs
Wang, P., Ye, S., Naseem, U., & Kim, J. (2025) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta68720.2025.11302496 · Cited by 7 · see citing works
Abdaoui, H., Barki, C., Dergaa, I., Tlili, K., Ceylan, H. İ., Bragazzi, N. L., de Giorgio, A., Ben Salah, R., & Rahmouni, H. B. (2025) · Bioengineering · doi:10.3390/bioengineering13010030 · Cited by 6 · see citing works
Self-citationA medical report generation method integrating teacher–student model and encoder–decoder network
Zhang, S., Han, Q., Li, J., Sun, Y., & Qin, Y. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106251 · Cited by 6 · see citing works
Sargent, W., & Gibb, I. (2023) · Injury · doi:10.1016/j.injury.2022.12.001 · Cited by 5 · see citing works
Rami Naidji, M., & Elberrichi, Z. (2024) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/1501102 · Cited by 4 · see citing works
Optimizing medical image report generation through a discrete diffusion framework
Sun, S., Su, Z., Meizhou, J., Feng, Y., Hu, Q., Luo, J., Hu, K., & Yang, Z. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07111-2 · Cited by 4 · see citing works
MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding
Han, S., Xia, P., Zhang, R., Sun, T., Li, Y., Zhu, H., & Yao, H. (2025) · arXiv · doi:10.48550/arxiv.2503.13964 · Cited by 4 · see citing works
Hierarchical Context Interaction and Reasoning with Transformer for Emotion Recognition
Wang, W., Wang, C., Wang, X., Shen, X., Qing, X., & Qian, X. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889152 · Cited by 2 · see citing works
Advancing health care delivery in community, rural, and safety-net settings
Miles, R. C., & Narayan, A. K. (2025) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2025.05.003 · Cited by 2 · see citing works
R2GenCSR: Mining Contextual and Residual Information for LLMs-based Radiology Report GenerationPreprint
Wang, X., Li, Y., Wang, F., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.09743 · Cited by 2 · see citing works
A Multimodal Multi-Agent Framework for Radiology Report Generation
Yi, Z., Xiao, T., & Albert, M. V. (2025) · arXiv · doi:10.48550/arxiv.2505.09787 · Cited by 2
LLM-Driven Chest X-Ray Report Generation With a Modular, Reduced-Size Architecture
Vargas, T. V., Pedrini, H., & Santanchè, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-79032-4_14 · Cited by 2 · see citing works
Bonaffini, P. A., Stanco, F., Dulcetta, L., Poli, G., Brambilla, P., Marra, P., Valle, C., Lorini, F. L., Mazzoleni, M., Sonzogni, B., et al. (2023) · Tomography · doi:10.3390/tomography9060171 · Cited by 1 · see citing works
Graph-Driven Medical Report Generation with Adaptive Knowledge Distillation
Chen, J., Huang, X., Jiang, M., Li, Y., Zou, Z., & Qian, D. (2025) · Applied Sciences · doi:10.3390/app152010974 · Cited by 1 · see citing works
ReXrank: A Public Leaderboard for AI-Powered Radiology Report Generation
Zhang, X., Zhou, H.-Y., Yang, X., Banerjee, O., Acosta, J. N., Baharoon, M., Miller, J., Huang, O., & Rajpurkar, P. (2024) · arXiv · doi:10.48550/arxiv.2411.15122 · Cited by 1 · see citing works
MedPAO: A Protocol-Driven Agent for Structuring Medical Reports
Vaidya, S. S., Palani, G., Ramesh, S., Balasubramanian, V., Selvam, M., Srinivasaraja, G., & Krishnamurthi, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06004-4_4 · Cited by 1 · see citing works
MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMsPreprint
Wang, P., Ye, S., Naseem, U., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.18530
EviAgent: Evidence-Driven Agent for Radiology Report Generation
Qi, T., Bu, S., Xiang, Y., & Dai, Z. (2026) · arXiv · doi:10.48550/arxiv.2603.13956
Flagged first, then by citations
- Authors
- Abdaoui, H., Barbaria, S., Al Kuwaiti, A., Raouafi, N., Ben Salah, R., & Boussi Rahmouni, H.
- Affiliations
- Tunis El Manar University (TN)
- Department of Dental Education, College of Dentistry, Deanship of Quality and Academic Accreditation, Imam Abdulrahman Bin Faisal University
- Imam Abdulrahman Bin Faisal University (SA)
- Laboratory of Biophysics and Medical Technologies, Higher Institute of Medical Technologies of Tunis (ISTMT), University of Tunis El Manar
- Corresponding author
- Barbaria, Sabri
- Venue
- Frontiers in Radiology
- Publisher
- Frontiers Media SA
- Published
- 2026-07-28
- Volume
- 6
- Pages
- 1875905-1875905
- ISSN
- 2673-8740 (ISSN-L)
- PMC
- PMC13458744
- OpenAlex
- W7171535071
- Semantic Scholar
- 2b447ab99e153b8eae054b1e8acb193ff0b63618
- Cited by
- 0
- References
- 32
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Radiology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Keywords
- automated radiology report generation, vision-language models, Swin Transformer, Q-Former, hallucination mitigation, factuality, large language models, low-rank adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review