The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
SACNN: Self-Attention Convolutional Neural Network for Low-Dose CT Denoising With Self-Supervised Perceptual Loss Network
Abstract
Computed tomography (CT) is a widely used screening and diagnostic tool that allows clinicians to obtain a high-resolution, volumetric image of internal structures in a non-invasive manner. Increasingly, efforts have been made to improve the image quality of low-dose CT (LDCT) to reduce the cumulative radiation exposure of patients undergoing routine screening exams. The resurgence of deep learning has yielded a new approach for noise reduction by training a deep multi-layer convolutional neural networks (CNN) to map the low-dose to normal-dose CT images. However, CNN-based methods heavily rely on convolutional kernels, which use fixed-size filters to process one local neighborhood within the receptive field at a time. As a result, they are not efficient at retrieving structural information across large regions. In this paper, we propose a novel 3D self-attention convolutional neural network for the LDCT denoising problem. Our 3D self-attention module leverages the 3D volume of CT images to capture a wide range of spatial information both within CT slices and between CT slices. With the help of the 3D self-attention module, CNNs are able to leverage pixels with stronger relationships regardless of their distance and achieve better denoising results. In addition, we propose a self-supervised learning scheme to train a domain-specific autoencoder as the perceptual loss function. We combine these two methods and demonstrate their effectiveness on both CNN-based neural networks and WGAN-based neural networks with comprehensive experiments. Tested on the AAPM-Mayo Clinic Low Dose CT Grand Challenge data set, our experiments demonstrate that self-attention (SA) module and autoencoder (AE) perceptual loss function can efficiently enhance traditional CNNs and can achieve comparable or better results than the state-of-the-art methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning methods exploited to extract features from medical images impacted the image quality and so the feature importance [79].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [79]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
(2017) · International Conference on Machine Learning · Cited by 6,382
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
Smith-Bindman, R. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.427 · Cited by 2,464
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Sidky, E. Y., & Pan, X. (2008) · Physics in Medicine and Biology · doi:10.1088/0031-9155/53/17/021 · Cited by 1,995
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 1×
“This idea was widely used in applications such as image denoising [46], texture synthesis [47], super-resolution [48], and inpainting [49].”
MethodProjected Cancer Risks From Computed Tomographic Scans Performed in the United States in 2007
Berrington de González, A. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.440 · Cited by 1,888
Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network
Chen, H., Zhang, Y., Kalra, M. K., Lin, F., Chen, Y., Liao, P., Zhou, J., & Wang, G. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2715284 · Cited by 1,866
Yang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang, Y., Sun, L., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2827462 · Cited by 1,630
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
A Decomposable Attention Model for Natural Language Inference
Parikh, A., Täckström, O., Das, D., & Uszkoreit, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1244 · Cited by 1,296
Generative Adversarial Networks for Noise Reduction in Low-Dose CT
Wolterink, J. M., Leiner, T., Viergever, M. A., & Isgum, I. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2708987 · Cited by 1,037
Learned Primal-Dual Reconstruction
Adler, J., & Oktem, O. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2799231 · Cited by 758
aLow-dose CT via convolutional neural network
Chen, H., Zhang, Y., Zhang, W., Liao, P., Li, K., Zhou, J., & Wang, G. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.000679 · Cited by 755
A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction
Kang, E., Min, J., & Ye, J. C. (2017) · Medical Physics · doi:10.1002/mp.12344 · Cited by 709
Low-Dose X-ray CT Reconstruction via Dictionary Learning
Xu, Q., Yu, H., Mou, X., Zhang, L., Hsieh, J., & Wang, G. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2195669 · Cited by 690
Penalized weighted least-squares image reconstruction for dual energy X-ray transmission tomography
Sukovic, P., & Clinthorne, N. H. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.896783 · Cited by 552
Wang, J., Li, T., Lu, H., & Liang, Z. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.882141 · Cited by 533
Liou, C.-Y., Cheng, W.-C., Liou, J.-W., & Liou, D.-R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.09.055 · Cited by 467
Shan, H., Zhang, Y., Yang, Q., Kruger, U., Kalra, M. K., Sun, L., Cong, W., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2832217 · Cited by 411
Low-dose CT reconstruction via edge-preserving total variation regularization
Tian, Z., Jia, X., Yuan, K., Pan, T., & Jiang, S. B. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/18/011 · Cited by 396
cGANs with Projection Discriminator
Miyato, T., & Koyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05637 · Cited by 382
Projection space denoising with bilateral filtering and CT noise modeling for dose reduction in CT
Manduca, A., Yu, L., Trzasko, J. D., Khaylova, N., Kofler, J. M., McCollough, C. M., & Fletcher, J. G. (2009) · Medical Physics · doi:10.1118/1.3232004 · Cited by 360
Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network
Yi, X., & Babyn, P. (2018) · Journal of Digital Imaging · doi:10.1007/s10278-018-0056-0 · Cited by 343
Liu, Y., Ma, J., Fan, Y., & Liang, Z. (2012) · Physics in Medicine and Biology · doi:10.1088/0031-9155/57/23/7923 · Cited by 335
Nonlinear sinogram smoothing for low-dose X-ray CT
Li, T., Li, X., Wang, J., Wen, J., Lu, H., Hsieh, J., & Liang, Z. (2004) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2004.834824 · Cited by 309
Li, Z., Yu, L., Trzasko, J. D., Lake, D. S., Blezek, D. J., Fletcher, J. G., McCollough, C. H., & Manduca, A. (2013) · Medical Physics · doi:10.1118/1.4851635 · Cited by 299
cGANs with Projection Discriminator
Miyato, T., & Koyama, M. (2018) · Cited by 295
Structurally-Sensitive Multi-Scale Deep Neural Network for Low-Dose CT Denoising
You, C., Cong, W., Wang, G., Yang, Q., Shan, H., Gjesteby, L., Li, G., Ju, S., Zhang, Z., Zhao, Z., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2858196 · Cited by 259
Ma, J., Huang, J., Feng, Q., Zhang, H., Lu, H., Liang, Z., & Chen, W. (2011) · Medical Physics · doi:10.1118/1.3638125 · Cited by 249
Improving abdomen tumor low-dose CT images using a fast dictionary learning based processing
Chen, Y., Yin, X., Shi, L., Shu, H., Luo, L., Coatrieux, J.-L., & Toumoulin, C. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/16/5803 · Cited by 223
Tensor-Based Dictionary Learning for Spectral CT Reconstruction
Zhang, Y., Mou, X., Wang, G., & Yu, H. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2600249 · Cited by 198
Block matching 3D random noise filtering for absorption optical projection tomography
Fumene Feruglio, P., Vinegoni, C., Gros, J., Sbarbati, A., & Weissleder, R. (2010) · Physics in Medicine and Biology · doi:10.1088/0031-9155/55/18/009 · Cited by 175
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1326643 · Cited by 164
Ma, J., Zhang, H., Gao, Y., Huang, J., Liang, Z., Feng, Q., & Chen, W. (2012) · Physics in Medicine and Biology · doi:10.1088/0031-9155/57/22/7519 · Cited by 163
Chen, Y., Gao, D., Nie, C., Luo, L., Chen, W., Yin, X., & Lin, Y. (2009) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2008.12.007 · Cited by 158
Ray Contribution Masks for Structure Adaptive Sinogram Filtering
Balda, M., Hornegger, J., & Heismann, B. J. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2187213 · Cited by 145
Kang, D., Slomka, P. J., Nakazato, R., et al. (2013) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2006907 · Cited by 122
Spectral CT Reconstruction With Image Sparsity and Spectral Mean
Zhang, Y., Xi, Y., Yang, Q., Cong, W., Zhou, J., & Wang, G. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2609414 · Cited by 119
Mendrik, A. M., Vonken, E.-J. P. A., Rutten, A., Viergever, M. A., & van Ginneken, B. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2022368 · Cited by 116
Interaction-Aware Spatio-Temporal Pyramid Attention Networks for Action Classification
Du, Y., Yuan, C., Li, B., Zhao, L., Li, Y., & Hu, W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_23 · Cited by 105
A Cascaded Convolutional Neural Network for X-ray Low-dose CT Image DenoisingPreprint
Wu, D., Kim, K. S., Fakhri, G. E., & Li, Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04267 · Cited by 85
Few-view image reconstruction with fractional-order total variation
Zhang, Y., Zhang, W., Lei, Y., & Zhou, J. (2014) · Journal of the Optical Society of America A · doi:10.1364/josaa.31.000981 · Cited by 84
Denoised and texture enhanced MVCT to improve soft tissue conspicuity
Sheng, K., Gou, S., Wu, J., et al. (2014) · Medical Physics · doi:10.1118/1.4894714 · Cited by 76
A Deep Learning Architecture for Limited-Angle Computed Tomography Reconstruction
Hammernik, K., Würfl, T., Pock, T., & Maier, A. (2017) · Informatik aktuell · doi:10.1007/978-3-662-54345-0_25 · Cited by 58
Optimizing non-local means for denoising low dose CT
Kelm, Z. S., Blezek, D. J., Bartholmai, B. J., et al. (2009) · IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI) · doi:10.1109/isbi.2009.5193134 · Cited by 46
Interaction-aware Spatio-temporal Pyramid Attention Networks for Action ClassificationPreprint
Du, Y., Yuan, C., Li, B., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01106 · Cited by 43
Computed Tomography Image Enhancement Using 3D Convolutional Neural Network
Meng, L., Shen, S., Gao, W., Hsu, W. W. Y., & Cong, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_33 · Cited by 23
Self-citationEM+TV Based Reconstruction for Cone-Beam CT with Reduced Radiation
Yan, M., Chen, J., Vese, L. A., Villasenor, J. D., Bui, A. A. T., & Cong, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24028-7_1 · Cited by 15
Self-citation
Cited by
Deep Learning on Image Denoising: An overview
Tian, C., Fei, L., Zheng, W., Xu, Y., Zuo, W., & Lin, C.-W. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.025 · Cited by 1,091
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M., Thai, T. C., Moore, K., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,080
ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Low‐dose CT image and projection dataset
Moen, T. R., Chen, B., Holmes, D. R., Duan, X., Yu, Z., Yu, L., Leng, S., Fletcher, J. G., & McCollough, C. H. (2021) · Medical Physics · doi:10.1002/mp.14594 · Cited by 287
Mehta, N. K., Prasad, S. S., Saurav, S., Saini, R., & Singh, S. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03200-4 · Cited by 97
Metadata
- Authors
- Li, M., Hsu, W., Xie, X., Cong, J., & Gao, W.
- Affiliations
- Peking University (CN)
- University of California, Los Angeles (US)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-07
- Volume
- 39
- Issue
- 7
- Pages
- 2289-2301
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W3002137088
- Cited by
- 321
- References
- 65
- Citations by year
- 2026: 26 · 2025: 49 · 2024: 60 · 2023: 70 · 2022: 61 · 2021: 48 · 2020: 7
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Basic Research Program of China (2016YFB0402001)
- Beijing Major Science and Technology Project (Z191100010618003)
- National Natural Science Foundation of China (61520106004)
- PKU-UCLA Joint Research Institute
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiation Dose and Imaging
- Keywords
- low-dose CT, CT image denoising, self-supervised learning, perceptual loss, autoencoder, WGAN, radiation dose reduction
- MeSH terms
- Attention, Humans, Image Processing, Computer-Assisted, Tomography, X-Ray Computed, Neural Networks, Computer, Signal-To-Noise Ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.