Cited by 72Multimodal Machine Learning ApplicationsTopic ModelingArtificial Intelligence in Healthcare and Education

ChestXRayBERT: A Pretrained Language Model for Chest Radiology Report Summarization

Cai, Xiaoyan, Liu, Sen, Han, Junwei, Yang, Libin, Liu, Zhenguo, Liu, Tianming·2023·IEEE Transactions on Multimedia

Abstract

Automatically generating the “impression” section of a radiology report given the “findings” section can summarize as much salient information of the “findings” section as possible, thus promoting more effective communication between radiologists and referring physicians. To significantly reduce the workload of radiologists, we develop and evaluate a novel framework of abstractive summarization methods to automatically generate the “impression” section of chest radiology reports. Despite recent advancements in natural language process (NLP) field such as BERT and its variants, existing abstractive summarization models and methods could not be directly applied to radiology reports, partly due to domain-specific radiology terminology. In response, we develop a pre-trained language model in the chest radiology domain, named ChestXRayBERT, to solve the problem of automatically summarizing chest radiology reports. Specifically, we first collect radiology-related scientific papers as pre-training corpus and pre-train a ChestXRayBERT on it. Then, an abstractive summarization model is proposed, which consists of the pre-trained ChestXRayBERT and a Transformer decoder. Finally, the model is fine-tuned on chest X-ray reports for the abstractive summarization task. When evaluated on the publicly available OPEN-I and MIMIC-CXR datasets, the performance of our proposed model achieves significant improvement compared with other neural networks-based abstractive summarization models. In general, the proposed ChestXRayBERT demonstrates the feasibility and promise of tailoring and extending advanced NLP techniques to the domain of medical imaging and radiology, as well as in the broader biomedicine and healthcare fields in the future.

Integrity signals

Registry

Crossref · 10.1109/tmm.2021.3132724

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Most authors focused on summarization of radiology reports, i.e., on the creation of a shorter version that includes all important aspects at the same level of text complexity.

    “So far, most authors focused on summarization of radiology reports, i.e., on the creation of a shorter version that includes all important aspects at the same level of text complexity [23–26].”

Cites

Flagged first, then by citations

3 of the 61 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Cai, X., Liu, S., Han, J., Yang, L., Liu, Z., & Liu, T.
Affiliations
  • Northwestern Polytechnical University (CN)
  • Shaanxi Provincial People's Hospital (CN)
  • University of Georgia (US)
Venue
IEEE Transactions on Multimedia
Published
2023
Volume
25
Pages
845-855
ISSN
  • 1520-9210 (ISSN-L)
  • 1941-0077
OpenAlex
W4205403018
Cited by
72
References
61
Citations by year
2026: 8 · 2025: 19 · 2024: 26 · 2023: 16 · 2022: 2 · 2021: 1
FWCI
4.04
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Multimedia (publishedVersion)
Funders
  • National Natural Science Foundation of China (61872296, 61772429, U20B2065)
  • Ministry of Education in China (18YJC870001)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
abstractive summarization, radiology terminology, medical report generation, BERT

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review