The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Medical Image Synthesis with Deep Convolutional Adversarial Networks
Open accessAbstract
Medical imaging plays a critical role in various clinical applications. However, due to multiple considerations such as cost and radiation dose, the acquisition of certain image modalities may be limited. Thus, medical image synthesis can be of great benefit by estimating a desired imaging modality without incurring an actual scan. In this paper, we propose a generative adversarial approach to address this challenging problem. Specifically, we train a fully convolutional network (FCN) to generate a target image given a source image. To better model a nonlinear mapping from source to target and to produce more realistic target images, we propose to use the adversarial learning strategy to better model the FCN. Moreover, the FCN is designed to incorporate an image-gradient-difference-based loss function to avoid generating blurry target images. Long-term residual unit is also explored to help the training of the network. We further apply Auto-Context Model to implement a context-aware deep convolutional adversarial network. Experimental results show that our method is accurate and robust for synthesizing target images from the corresponding source images. In particular, we evaluate our method on three datasets, to address the tasks of generating CT from MRI and generating 7T MRI from 3T MRI images. Our method outperforms the state-of-the-art methods under comparison in all datasets and tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
AVANTS, B., EPSTEIN, C., GROSSMAN, M., & GEE, J. (2008) · Medical Image Analysis · doi:10.1016/j.media.2007.06.004 · Cited by 5,669
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Deeply-Recursive Convolutional Network for Image Super-Resolution
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.181 · Cited by 3,025
Diffeomorphic demons: Efficient non-parametric image registration
Vercauteren, T., Pennec, X., Perchant, A., & Ayache, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.040 · Cited by 1,592
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Luo, W., Li, Y., Urtasun, R., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1701.04128 · Cited by 1,575
Attenuation correction for a combined 3D PET/CT scanner
Kinahan, P. E., Townsend, D. W., Beyer, T., & Sashin, D. (1998) · Medical Physics · doi:10.1118/1.598392 · Cited by 946
MR-based synthetic CT generation using a deep convolutional neural network method
Han, X. (2017) · Medical Physics · doi:10.1002/mp.12155 · Cited by 711
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
Heinrich, M. P., Jenkinson, M., Bhushan, M., Matin, T., Gleeson, F. V., Brady, S. M., & Schnabel, J. A. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.05.008 · Cited by 707
Medical Image Synthesis with Context-Aware Generative Adversarial Networks
Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_48 · Cited by 691
Self-citationAdvances and challenges in super‐resolution
Farsiu, S., Robinson, D., Elad, M., et al. (2004) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20007 · Cited by 623
Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation
Tu, Z., & Bai, X. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.186 · Cited by 578
Super-Resolution in Medical Imaging
Greenspan, H. (2008) · The Computer Journal · doi:10.1093/comjnl/bxm075 · Cited by 564
Hofmann, M., Steinke, F., Scheel, V., Charpiat, G., Farquhar, J., Aschoff, P., Brady, M., Schölkopf, B., & Pichler, B. J. (2008) · Journal of Nuclear Medicine · doi:10.2967/jnumed.107.049353 · Cited by 495
Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis
Li, R., Zhang, W., Suk, H.-I., Wang, L., Li, J., Shen, D., & Ji, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10443-0_39 · Cited by 469
Self-citationAttenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain Studies
Burgos, N., Cardoso, M. J., Thielemans, K., Modat, M., Pedemonte, S., Dickson, J., Barnes, A., Ahmed, R., Mahoney, C. J., Schott, J. M., et al. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2340135 · Cited by 364
Catana, C., van der Kouwe, A., Benner, T., Michel, C. J., Hamm, M., Fenchel, M., Fischl, B., Rosen, B., Schmand, M., & Sorensen, A. G. (2010) · Journal of Nuclear Medicine · doi:10.2967/jnumed.109.069112 · Cited by 359
Berker, Y., Franke, J., Salomon, A., Palmowski, M., Donker, H. C. W., Temur, Y., Mottaghy, F. M., Kuhl, C., Izquierdo-Garcia, D., Fayad, Z. A., et al. (2012) · Journal of Nuclear Medicine · doi:10.2967/jnumed.111.092577 · Cited by 344
Fully convolutional networks for multi-modality isointense infant brain image segmentation
Nie, D., Wang, L., Gao, Y., & Shen, D. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493515 · Cited by 304
Self-citationEstimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model
Huynh, T., Gao, Y., Kang, J., Wang, L., Zhang, P., Lian, J., & Shen, D. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2461533 · Cited by 282
Self-citationZhang, Y., Zhou, G., Jin, J., Wang, X., & Cichocki, A. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.08.004 · Cited by 266
Sparse Bayesian Classification of EEG for Brain–Computer Interface
Zhang, Y., Zhou, G., Jin, J., Zhao, Q., Wang, X., & Cichocki, A. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2476656 · Cited by 264
Estimating CT Image from MRI Data Using 3D Fully Convolutional Networks
Nie, D., Cao, X., Gao, Y., Wang, L., & Shen, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_18 · Cited by 256
Self-citationZaidi, H., Montandon, M.-L., & Slosman, D. O. (2003) · Medical Physics · doi:10.1118/1.1569270 · Cited by 233
Huang, Y., Shao, L., & Frangi, A. F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.613 · Cited by 216
3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation
Nie, D., Wang, L., Adeli, E., Lao, C., Lin, W., & Shen, D. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797905 · Cited by 191
Self-citationRepresentation Learning: A Unified Deep Learning Framework for Automatic Prostate MR Segmentation
Liao, S., Gao, Y., Oto, A., & Shen, D. G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40763-5_32 · Cited by 157
Self-citationClinical fMRI: Evidence for a 7T benefit over 3T
Beisteiner, R., Robinson, S., Wurnig, M. C., Hilbert, M., Merksa, K., Rath, J., Hoellinger, I., Klinger, N., Marosi, C., Trattnig, S., et al. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.010 · Cited by 133
MRI Superresolution Using Self‐Similarity and Image Priors
Manjón, J. V., Coupé, P., Buades, A., Collins, D. L., & Robles, M. (2010) · International Journal of Biomedical Imaging · doi:10.1155/2010/425891 · Cited by 124
Bahrami, K., Shi, F., Rekik, I., & Shen, D. G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46976-8_5 · Cited by 118
Self-citationImage Quality Transfer via Random Forest Regression: Applications in Diffusion MRI
Alexander, D. C., Zikic, D., Zhang, J., Zhang, H. G., & Criminisi, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10443-0_29 · Cited by 113
Modality Propagation: Coherent Synthesis of Subject-Specific Scans with Data-Driven Regularization
Ye, D. H., Zikic, D., Glocker, B., Criminisi, A., & Ender Konukoglu, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_76 · Cited by 108
Collaborative patch-based super-resolution for diffusion-weighted images
Coupé, P., Manjón, J. V., Chamberland, M., Descoteaux, M., & Hiba, B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.06.030 · Cited by 103
Reconstruction of 7T-Like Images From 3T MRI
Bahrami, K., Shi, F., Zong, X., Shin, H. W., An, H., & Shen, D. G. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2549918 · Cited by 85
Self-citationSegmenting CT prostate images using population and patient‐specific statistics for radiotherapy
Feng, Q., Foskey, M. S., Chen, W., & Shen, D. G. (2010) · Medical Physics · doi:10.1118/1.3464799 · Cited by 75
Self-citationOptimized prostate biopsy via a statistical atlas of cancer spatial distribution
Shen, D. G., Lao, Z., Zeng, J., et al. (2004) · Medical Image Analysis · doi:10.1016/j.media.2003.11.002 · Cited by 71
Self-citationAutomated Segmentation of 3D US Prostate Images Using Statistical Texture-Based Matching Method
Zhan, Y., & Shen, D. G. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39899-8_84 · Cited by 70
Self-citationUnsupervised Cross-Modal Synthesis of Subject-Specific Scans
Vemulapalli, R., Nguyen, H. V., & Zhou, S. K. (2015) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.79 · Cited by 69
Improving magnetic resonance resolution with supervised learning
Jog, A., Carass, A., & Prince, J. L. (2014) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2014.6868038 · Cited by 46
Hierarchical Reconstruction of 7T-like Images from 3T MRI Using Multi-level CCA and Group Sparsity
Bahrami, K., Shi, F., Zong, X., Shin, H. W., An, H., & Shen, D. G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24571-3_79 · Cited by 18
Self-citation
Cited by
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
Synthetic data in machine learning for medicine and healthcare
Chen, R. J., Lu, M. Y., Chen, T. Y., Williamson, D. F. K., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00751-8 · Cited by 728
Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks
Dar, S. U., Yurt, M., Karacan, L., Erdem, A., Erdem, E., & Cukur, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901750 · Cited by 608
ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
Metadata
- Authors
- Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2018-12
- Volume
- 65
- Issue
- 12
- Pages
- 2720-2730
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2789713147
- Cited by
- 625
- References
- 51
- FWCI
- 29.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.