CT Super-Resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE)
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
In this paper, we present a semi-supervised deep learning approach to accurately recover high-resolution (HR) CT images from low-resolution (LR) counterparts. Specifically, with the generative adversarial network (GAN) as the building block, we enforce the cycle-consistency in terms of the Wasserstein distance to establish a nonlinear end-to-end mapping from noisy LR input images to denoised and deblurred HR outputs. We also include the joint constraints in the loss function to facilitate structural preservation. In this process, we incorporate deep convolutional neural network (CNN), residual learning, and network in network techniques for feature extraction and restoration. In contrast to the current trend of increasing network depth and complexity to boost the imaging performance, we apply a parallel 1×1 CNN to compress the output of the hidden layer and optimize the number of layers and the number of filters for each convolutional layer. The quantitative and qualitative evaluative results demonstrate that our proposed model is accurate, efficient and robust for super-resolution (SR) image restoration from noisy LR input images. In particular, we validate our composite SR networks on three large-scale CT datasets, and obtain promising results as compared to the other state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Computed Tomography — An Increasing Source of Radiation Exposure
Brenner, D. J., & Hall, E. J. (2007) · New England Journal of Medicine · doi:10.1056/nejmra072149 · Cited by 8,748
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382 · cited 1×
“Dropout regularization [75] with p = 0 .”
Feldkamp, L. A., Davis, L. C., & Kress, J. W. (1984) · Journal of the Optical Society of America A · doi:10.1364/josaa.1.000612 · Cited by 6,319
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Epidemiology and outcomes of osteoporotic fractures
Cummings, S. R., & Melton, L. J. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08657-9 · Cited by 3,821 · cited 1×
“Osteoporosis, characterized by reduced bone density and structural degeneration of bone, greatly diminishes bone strength and increases the risk of fracture [84].”
BackgroundAccelerating the Super-Resolution Convolutional Neural Network
Dong, C., Loy, C. C., & Tang, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_25 · Cited by 3,786
Estimated Risks of Radiation-Induced Fatal Cancer from Pediatric CT
Brenner, D. J., Elliston, C. D., Hall, E. J., & Berdon, W. E. (2001) · American Journal of Roentgenology · doi:10.2214/ajr.176.2.1760289 · Cited by 3,222 · cited 1×
“X -RAY computed tomography (CT) is one of the most popular medical imaging methods for screening, diagnosis, and image-guided intervention [1].”
BackgroundDeep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
Sidky, E. Y., & Pan, X. (2008) · Physics in Medicine and Biology · doi:10.1088/0031-9155/53/17/021 · Cited by 1,995
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889
Risk of cancer from diagnostic X-rays: estimates for the UK and 14 other countries
de González, A. B., & Darby, S. (2004) · The Lancet · doi:10.1016/s0140-6736(04)15433-0 · Cited by 1,718
Learning a variational network for reconstruction of accelerated MRI data
Hammernik, K., Klatzer, T., Kobler, E., Recht, M. P., Sodickson, D. K., Pock, T., & Knoll, F. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26977 · Cited by 1,713
Yang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang, Y., Sun, L., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2827462 · Cited by 1,630
Self-citationConvolutional neural networks at constrained time cost
He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558 · cited 2×
“2) Number of Layers: Recent studies reported in [72], [73] suggest that training a network could benefit from increasing the network depth moderately.”
BackgroundParfitt, A. M., Mathews, C. H., Villanueva, A. R., Kleerekoper, M., Frame, B., & Rao, D. S. (1983) · Journal of Clinical Investigation · doi:10.1172/jci111096 · Cited by 1,545
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
Chen, G.-H., Tang, J., & Leng, S. (2008) · Medical Physics · doi:10.1118/1.2836423 · Cited by 1,141
Dong, W., Zhang, L., Shi, G., & Wu, X. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2108306 · Cited by 1,124
Strategies for CT Radiation Dose Optimization
Kalra, M. K., Maher, M. M., Toth, T. L., Hamberg, L. M., Blake, M. A., Shepard, J.-A., & Saini, S. (2004) · Radiology · doi:10.1148/radiol.2303021726 · Cited by 1,080
Generative Adversarial Networks for Noise Reduction in Low-Dose CT
Wolterink, J. M., Leiner, T., Viergever, M. A., & Isgum, I. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2708987 · Cited by 1,037
A three‐dimensional statistical approach to improved image quality for multislice helical CT
Thibault, J., Sauer, K. D., Bouman, C. A., & Hsieh, J. (2007) · Medical Physics · doi:10.1118/1.2789499 · Cited by 937
Learned Primal-Dual Reconstruction
Adler, J., & Oktem, O. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2799231 · Cited by 758
Kleerekoper, M., Villanueva, A. R., Stanciu, J., Rao, D. S., & Parfitt, A. M. (1985) · Calcified Tissue International · doi:10.1007/bf02554913 · Cited by 695
Medical Image Synthesis with Deep Convolutional Adversarial Networks
Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2814538 · Cited by 625
Unsupervised Image Super-Resolution Using Cycle-in-Cycle Generative Adversarial Networks
Yuan, Y., Liu, S., Zhang, J., Zhang, Y., Dong, C., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00113 · Cited by 594
Self-citationSuper-Resolution in Medical Imaging
Greenspan, H. (2008) · The Computer Journal · doi:10.1093/comjnl/bxm075 · Cited by 564
Deep Generative Adversarial Neural Networks for Compressive Sensing MRI
Mardani, M., Gong, E., Cheng, J. Y., Vasanawala, S. S., Zaharchuk, G., Xing, L., & Pauly, J. M. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2858752 · Cited by 552
Image Reconstruction is a New Frontier of Machine Learning
Wang, G., Ye, J. C., Mueller, K., & Fessler, J. A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2833635 · Cited by 525
Self-citationA local update strategy for iterative reconstruction from projections
Sauer, K., & Bouman, C. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.193196 · Cited by 494
Wang, G. (2016) · IEEE Access · doi:10.1109/access.2016.2624938 · Cited by 455
Self-citationA unified approach to statistical tomography using coordinate descent optimization
Bouman, C. A., & Sauer, K. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.491321 · Cited by 442
Shan, H., Zhang, Y., Yang, Q., Kruger, U., Kalra, M. K., Sun, L., Cong, W., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2832217 · Cited by 411
Self-citationIterative deblurring for CT metal artifact reduction
Wang, G., Snyder, D. L., O'Sullivan, J. A., & Vannier, M. W. (1996) · IEEE Transactions on Medical Imaging · doi:10.1109/42.538943 · Cited by 409
Self-citationLegrand, E., Chappard, D., Pascaretti, C., Duquenne, M., Krebs, S., Rohmer, V., Basle, M.-F., & Audran, M. (2000) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.2000.15.1.13 · Cited by 381
Reducing Abdominal CT Radiation Dose With Adaptive Statistical Iterative Reconstruction Technique
Prakash, P., Kalra, M. K., Kambadakone, A., et al. (2010) · Investigative Radiology · doi:10.1097/rli.ob013e3181dzfeec · Cited by 366
Fast Model-Based X-Ray CT Reconstruction Using Spatially Nonhomogeneous ICD Optimization
Yu, Z., Thibault, J.-B., Bouman, C. A., Sauer, K. D., & Hsieh, J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2058811 · Cited by 290
A survey on super-resolution imaging
Tian, J., & Ma, K.-K. (2011) · Signal, Image and Video Processing · doi:10.1007/s11760-010-0204-6 · Cited by 281
Structurally-Sensitive Multi-Scale Deep Neural Network for Low-Dose CT Denoising
You, C., Cong, W., Wang, G., Yang, Q., Shan, H., Gjesteby, L., Li, G., Ju, S., Zhang, Z., Zhao, Z., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2858196 · Cited by 259
Self-citationDing, M., & Hvid, I. (2000) · Bone · doi:10.1016/s8756-3282(99)00281-1 · Cited by 231
The Cramer Distance as a Solution to Biased Wasserstein Gradients
Bellemare, M. G., Danihelka, I., Dabney, W., Mohamed, S., Lakshminarayanan, B., Hoyer, S., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1705.10743 · Cited by 223 · cited 1×
“It has been also observed that the recent literature [94] mentions that the Wasserstein distance may yield the biased sample gradients, is subject to the risk of incorrect minimum, and not well suitable for stochastic gradient descent searching.”
BackgroundComputed tomography super-resolution using deep convolutional neural network
Park, J., Hwang, D., Kim, K. Y., Kang, S. K., Kim, Y. K., & Lee, J. S. (2018) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aacdd4 · Cited by 218
Block matching 3D random noise filtering for absorption optical projection tomography
Fumene Feruglio, P., Vinegoni, C., Gros, J., Sbarbati, A., & Weissleder, R. (2010) · Physics in Medicine and Biology · doi:10.1088/0031-9155/55/18/009 · Cited by 175
Hamwood, J., Alonso‐Caneiro, D., Read, S. A., Vincent, S. J., & Collins, M. J. (2018) · Biomedical Optics Express · doi:10.1364/boe.9.003049 · Cited by 129
Zhang, R., Thibault, J., Bouman, C. A., et al. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2282370 · Cited by 124
Vasilescu, D. M., Gao, Z., Saha, P. K., Yin, L., Wang, G., Haefeli‐Bleuer, B., Ochs, M., Weibel, E. R., & Hoffman, E. A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1215112109 · Cited by 118
Self-citationTotal Hip Prosthesis Metal-Artifact Suppression Using Iterative Deblurring Reconstruction
Robertson, D. D., Yuan, J., Wang, G., & Vannier, M. W. (1997) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199703000-00024 · Cited by 115
Self-citationComputed tomography super-resolution using convolutional neural networks
Yu, H., Liu, D., Shi, H., Yu, H., Wang, Z., Wang, X., Cross, B., Bramler, M., & Huang, T. S. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8297022 · Cited by 86
Blind deblurring of spiral CT images
Jiang, M. F., Wang, G., Skinner, M. W., Rubinstein, J. T., & Vannier, M. W. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815075 · Cited by 79
Self-citationMachine learning will transform radiology significantly within the next 5 years
Wang, G., Kalra, M. K., & Orton, C. G. (2017) · Medical Physics · doi:10.1002/mp.12204 · Cited by 60
Self-citationQuantitative imaging of peripheral trabecular bone microarchitecture using MDCT
Chen, C., Zhang, X., Guo, J., Jin, D., Letuchy, E. M., Burns, T. L., Levy, S. M., Hoffman, E. A., & Saha, P. K. (2017) · Medical Physics · doi:10.1002/mp.12632 · Cited by 54
Self-citationTechnical challenges of coronary CT angiography: Today and tomorrow
Hassan, A., Nazir, S. A., & Alkadhi, H. (2010) · European Journal of Radiology · doi:10.1016/j.ejrad.2010.02.011 · Cited by 52
Reconstruction of super-resolution lung 4D-CT using patch-based sparse representation
Zhang, Y., Guorong Wu, A., Yap, P., Feng, Q., Lian, J., Chen, W., & Shen, D. G. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247767 · Cited by 25
Self-citation
Cited by
Real-world single image super-resolution: A brief review
Chen, H., He, X., Qing, L., Wu, Y., Ren, C., Sheriff, R. E., & Zhu, C. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.09.005 · Cited by 405
Automatic multiorgan segmentation in thorax CT images using U‐net‐ GAN
Dong, X., Lei, Y., Wang, T., Thomas, M., Tang, L., Curran, W. J., Liu, T., & Yang, X. (2019) · Medical Physics · doi:10.1002/mp.13458 · Cited by 275
A Comprehensive Survey on Poisoning Attacks and Countermeasures in Machine Learning
Tian, Z., Cui, L., Liang, J., & Yu, S. (2023) · ACM Computing Surveys · doi:10.1145/3551636 · Cited by 271
Deep learning for Alzheimer's disease diagnosis: A survey
Khojaste-Sarakhsi, M., Haghighi, S. S., Ghomi, S. M. T. F., & Marchiori, E. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102332 · Cited by 194
A review of deep learning-based three-dimensional medical image registration methods
Xiao, H., Teng, X., Liu, C., Li, T., Ren, G., Yang, R., Shen, D., & Cai, J. (2021) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-175 · Cited by 77
Metadata
- Authors
- You, C., Cong, W., Vannier, M. W., Saha, P. K., Hoffman, E. A., Wang, G., Li, G., Zhang, Y., Zhang, X., Shan, H., Li, M., Ju, S., Zhao, Z., & Zhang, Z.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-01
- Volume
- 39
- Issue
- 1
- Pages
- 188-203
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2995072672
- Cited by
- 459
- References
- 68
- FWCI
- 22.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.