KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images
Open accessAbstract
Purpose To demonstrate accurate MR image reconstruction from undersampled k‐space data using cross‐domain convolutional neural networks (CNNs) Methods Cross‐domain CNNs consist of 3 components: (1) a deep CNN operating on the k‐space (KCNN), (2) a deep CNN operating on an image domain (ICNN), and (3) an interleaved data consistency operations. These components are alternately applied, and each CNN is trained to minimize the loss between the reconstructed and corresponding fully sampled k‐spaces. The final reconstructed image is obtained by forward‐propagating the undersampled k‐space data through the entire network. Results Performances of K‐net (KCNN with inverse Fourier transform), I‐net (ICNN with interleaved data consistency), and various combinations of the 2 different networks were tested. The test results indicated that K‐net and I‐net have different advantages/disadvantages in terms of tissue‐structure restoration. Consequently, the combination of K‐net and I‐net is superior to single‐domain CNNs. Three MR data sets, the T2 fluid‐attenuated inversion recovery (T2 FLAIR) set from the Alzheimer's Disease Neuroimaging Initiative and 2 data sets acquired at our local institute (T2 FLAIR and T1 weighted), were used to evaluate the performance of 7 conventional reconstruction algorithms and the proposed cross‐domain CNNs, which hereafter is referred to as KIKI‐net. KIKI‐net outperforms conventional algorithms with mean improvements of 2.29 dB in peak SNR and 0.031 in structure similarity. Conclusion KIKI‐net exhibits superior performance over state‐of‐the‐art conventional algorithms in terms of restoring tissue structures and removing aliasing artifacts. The results demonstrate that KIKI‐net is applicable up to a reduction factor of 3 to 4 based on variable‐density Cartesian undersampling.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · see citing works
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105 · see citing works
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · see citing works
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870 · see citing works
Sparse MRI: The application of compressed sensing for rapid MR imaging
Lustig, M., Donoho, D., & Pauly, J. M. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21391 · Cited by 6,952 · see citing works
Generalized autocalibrating partially parallel acquisitions (GRAPPA)
Griswold, M. A., Jakob, P. M., Heidemann, R. M., Nittka, M., Jellús̆, V., Wang, J., Kiefer, B., & Haase, A. (2002) · Magnetic Resonance in Medicine · doi:10.1002/mrm.10171 · Cited by 5,311 · see citing works
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347 · see citing works
Deeply-Recursive Convolutional Network for Image Super-Resolution
Kim, J., Lee, J. K., & Lee, K. M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.181 · Cited by 3,122 · see citing works
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939 · see citing works
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529 · cited 6× · see citing works
“Meanwhile, several recent studies have demonstrated the applicability of deep-learning techniques to the reconstruction of undersampled MR images(19-21) or CT images.(22) In training, tuples of undersampled images and fully sampled images are fed to convolutional neural networks (CNNs) to learn the relationship betwee…”
BackgroundMethodInfluentialImage Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · Cited by 1,233 · see citing works
MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning
Ravishankar, S., & Bresler, Y. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2090538 · Cited by 1,060 · see citing works
Compression Artifacts Reduction by a Deep Convolutional Network
Dong, C., Deng, Y., Loy, C. C., & Tang, X. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.73 · Cited by 898 · see citing works
Accelerating magnetic resonance imaging via deep learning
Wang, S., Su, Z., Ying, L. L., Peng, X., Zhu, S., Liang, F., Feng, D. D., & Liang, D. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493320 · Cited by 871 · see citing works
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836 · see citing works
Iizuka, S., Simo‐Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 816 · see citing works
Otazo, R., Candès, E. J., & Sodickson, D. K. (2014) · Magnetic Resonance in Medicine · doi:10.1002/mrm.25240 · Cited by 697 · see citing works
Echo-Planar Imaging: Magnetic Resonance Imaging in a Fraction of a Second
Stehling, M. K., Turner, R., & Mansfield, P. (1991) · Science · doi:10.1126/science.1925560 · Cited by 623 · see citing works
Otazo, R., Kim, D. C., Axel, L., et al. (2010) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22463 · Cited by 582 · see citing works
Accelerating SENSE using compressed sensing
Liang, D., Liu, B., Wang, J., & Ying, L. L. (2009) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22161 · Cited by 468 · see citing works
Qu, X., Hou, Y., Lam, F., Guo, D., Zhong, J., & Chen, Z. (2013) · Medical Image Analysis · doi:10.1016/j.media.2013.09.007 · Cited by 340 · see citing works
Murphy, M., Alley, M., Demmel, J. W., et al. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2188039 · Cited by 320 · see citing works
Compressed-Sensing MRI With Random Encoding
Haldar, J. P., Hernando, D., & Liang, Z. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2085084 · Cited by 310 · see citing works
Deep residual learning for compressed sensing MRI
Lee, D., Yoo, J., & Ye, J. C. (2017) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2017.7950457 · Cited by 213 · see citing works
Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction
Zhan, Z., Jian-feng Cai, A., Guo, D., Liu, Y., Chen, Z., & Qu, X. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2503756 · Cited by 202 · see citing works
Water diffusion, T2, and compartmentation in frog sciatic nerve
Peled, S., Cory, D. G., Raymond, S. A., Kirschner, D. A., & Jolesz, F. A. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199911)42:5 · Cited by 189 · see citing works
Iterative thresholding compressed sensing MRI based on contourlet transform
Qu, X., Zhang, W., Guo, D., et al. (2010) · Inverse Problems in Science and Engineering · doi:10.1080/17415977.2010.492509 · Cited by 158 · see citing works
Decoupled Algorithm for MRI Reconstruction Using Nonlocal Block Matching Model: BM3D-MRI
Ekşioğlu, E. M. (2016) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-016-0647-7 · Cited by 158 · see citing works
Akçakaya, M., Basha, T., Goddu, B., Goepfert, L. A., Kissinger, K. V., Tarokh, V., Manning, W. J., & Nezafat, R. (2011) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22841 · Cited by 150 · see citing works
Ravishankar, S., & Bresler, Y. (2015) · SIAM Journal on Imaging Sciences · doi:10.1137/141002293 · Cited by 112 · see citing works
Look Wider to Match Image Patches With Convolutional Neural Networks
Park, H., & Lee, K. M. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2637355 · Cited by 103 · see citing works
Ensemble based deep networks for image super-resolution
Wang, L., Huang, Z., Gong, Y., & Pan, C. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.027 · Cited by 65 · see citing works
Combined sparsifying transforms for compressed sensing MRI
Qu, X., Cao, X., Guo, D., et al. (2010) · Electronics Letters · doi:10.1049/el.2010.1845 · Cited by 60 · see citing works
Majumdar, A. (2014) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2014.08.031 · Cited by 46 · see citing works
Compressed sensing MRI based on nonsubsampled contourlet transform
Qu, X., Guo, D., Chen, Z., et al. (2008) · IEEE International Symposium on IT in Medicine and Education (ITME) · doi:10.1109/itme.2008.4743955 · Cited by 25 · see citing works
Sadeghi, Z., & Testolin, A. (2017) · Cognitive Processing · doi:10.1007/s10339-017-0796-7 · Cited by 11 · see citing works
A Local Characteristic Image Restoration Based on Convolutional Neural Network
Lyu, G., Yin, H., Yu, X., et al. (2016) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2016edl8021 · Cited by 8 · see citing works
A Machine Learning Approach for Removal of JPEG Compression Artifacts: A Survey
Anagha, R., Kavya, B., Namratha, M., et al. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016908732 · Cited by 2 · see citing works
Hybrid pre training algorithm of Deep Neural Networks
Drokin, I. (2016) · ITM Web of Conferences · doi:10.1051/itmconf/20160602007 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058 · see citing works
Results of the 2020 fastMRI challenge for machine learning MR image reconstruction
Muckley, M. J., Riemenschneider, B., Radmanesh, A., Kim, S., Jeong, G., Ko, J., Jun, Y., Shin, H., Hwang, D., Mostapha, M., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3075856 · Cited by 313 · see citing works
Self-citationM3T: three-dimensional Medical image classifier using Multi-plane and Multi-slice Transformer
Jang, J., & Hwang, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02006 · Cited by 133 · see citing works
Self-citation
- Authors
- Eo, T., Jun, Y., Kim, T., Jang, J., Lee, H., & Hwang, D.
- Affiliations
- Yonsei University (KR)
- Corresponding author
- Hwang, Dosik
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 2018-04-06
- Volume
- 80
- Issue
- 5
- Pages
- 2188-2201
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2795380527
- Cited by
- 455
- References
- 40
- Citations by year
- 2026: 23 · 2025: 64 · 2024: 78 · 2023: 66 · 2022: 75 · 2021: 64 · 2020: 47 · 2019: 33 · 2018: 5
- FWCI
- 25.74
- Type
- journal article
- Language
- en
- Open access
- Licence
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
- Funders
- National Research Foundation of Korea
- MSIP (2016R1A2B4015016)
- Yonsei University
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Keywords
- MRI reconstruction, k-space undersampling, T2-FLAIR, T1-weighted imaging
- MeSH terms
- Algorithms, Brain, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Databases, Factual, Neural Networks, Computer, Signal-To-Noise Ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
