The DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Open accessAbstract
Generative adversarial models with convolutional neural network (CNN) backbones have recently been established as state-of-the-art in numerous medical image synthesis tasks. However, CNNs are designed to perform local processing with compact filters, and this inductive bias compromises learning of contextual features. Here, we propose a novel generative adversarial approach for medical image synthesis, ResViT, that leverages the contextual sensitivity of vision transformers along with the precision of convolution operators and realism of adversarial learning. ResViT's generator employs a central bottleneck comprising novel aggregated residual transformer (ART) blocks that synergistically combine residual convolutional and transformer modules. Residual connections in ART blocks promote diversity in captured representations, while a channel compression module distills task-relevant information. A weight sharing strategy is introduced among ART blocks to mitigate computational burden. A unified implementation is introduced to avoid the need to rebuild separate synthesis models for varying source-target modality configurations. Comprehensive demonstrations are performed for synthesizing missing sequences in multi-contrast MRI, and CT images from MRI. Our results indicate superiority of ResViT against competing CNN- and transformer-based methods in terms of qualitative observations and quantitative metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Neural networks: A comprehensive foundation
Tadeusiewicz, R. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)90080-2 · Cited by 7,218
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,872
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353 · cited 12×
“ResViT was compared against pGAN, pix2pix, medSynth, A-UNet, SAGAN, TransUNet, and PTNet.”
BackgroundMethodInfluentialBakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J. S., Freymann, J. B., Farahani, K., & Davatzikos, C. (2017) · Scientific Data · doi:10.1038/sdata.2017.117 · Cited by 3,049
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.013 · Cited by 1,938
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.38755 · Cited by 1,441
Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.02629 · Cited by 1,441
Quantifying Attention Flow in Transformers
Abnar, S., & Zuidema, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.385 · Cited by 995
MR-based synthetic CT generation using a deep convolutional neural network method
Han, X. (2017) · Medical Physics · doi:10.1002/mp.12155 · Cited by 711
Sandfort, V., Yan, K., Pickhardt, P. J., & Summers, R. M. (2019) · Scientific Reports · doi:10.1038/s41598-019-52737-x · Cited by 684
Advances and challenges in super‐resolution
Farsiu, S., Robinson, D., Elad, M., & Milanfar, P. (2004) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20007 · Cited by 681
CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
Xie, Y., Zhang, J., Shen, C., & Xia, Y. (2021) · arXiv · doi:10.48550/arxiv.2103.03024 · Cited by 654
CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
Xie, Y., Zhang, J., Shen, C., & Xia, Y. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87199-4_16 · Cited by 653
Medical Image Synthesis with Deep Convolutional Adversarial Networks
Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2814538 · Cited by 625
Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks
Dar, S. U., Yurt, M., Karacan, L., Erdem, A., Erdem, E., & Cukur, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901750 · Cited by 608
Self-citationMedGAN: Medical image translation using GANs
Armanious, K., Jiang, C., Fischer, M., Küstner, T., Hepp, T., Nikolaou, K., Gatidis, S., & Yang, B. (2020) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.101684 · Cited by 598
Deep MR to CT Synthesis Using Unpaired Data
Wolterink, J. M., Dinkla, A. M., Savenije, M. H. F., Seevinck, P. R., van den Berg, C. A. T., & Išgum, I. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68127-6_2 · Cited by 593
Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis
Li, R., Zhang, W., Suk, H.-I., Wang, L., Li, J., Shen, D., & Ji, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10443-0_39 · Cited by 469
TransMed: Transformers Advance Multi-Modal Medical Image Classification
Dai, Y., Gao, Y., & Liu, F. (2021) · Diagnostics · doi:10.3390/diagnostics11081384 · Cited by 467
Hi-Net: Hybrid-Fusion Network for Multi-Modal MR Image Synthesis
Zhou, T., Fu, H., Chen, G., Shen, J., & Shao, L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2975344 · Cited by 399
Catana, C., van der Kouwe, A., Benner, T., Michel, C. J., Hamm, M., Fenchel, M., Fischl, B., Rosen, B., Schmand, M., & Sorensen, A. G. (2010) · Journal of Nuclear Medicine · doi:10.2967/jnumed.109.069112 · Cited by 359
Artifacts in Magnetic Resonance Imaging
Bekiesińska‐Figatowska, M. (2015) · Polish Journal of Radiology · doi:10.12659/pjr.892628 · Cited by 349
Multimodal MR Synthesis via Modality-Invariant Latent Representation
Chartsias, A., Joyce, T., Giuffrida, M. V., & Tsaftaris, S. A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2764326 · Cited by 341
Li, M., Hsu, W., Xie, X., Cong, J., & Gao, W. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2968472 · Cited by 321
Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis
Yu, B., Zhou, L., Wang, L., Shi, Y., Fripp, J., & Bourgeat, P. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2895894 · Cited by 298
Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model
Huynh, T., Gao, Y., Kang, J., Wang, L., Zhang, P., Lian, J., & Shen, D. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2461533 · Cited by 282
Estimating CT Image from MRI Data Using 3D Fully Convolutional Networks
Nie, D., Cao, X., Gao, Y., Wang, L., & Shen, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_18 · Cited by 256
Missing MRI Pulse Sequence Synthesis Using Multi-Modal Generative Adversarial Network
Sharma, A., & Hamarneh, G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2945521 · Cited by 254
Ben-Cohen, A., Klang, E., Raskin, S. P., Soffer, S., Ben-Haim, S., Konen, E., Amitai, M. M., & Greenspan, H. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.11.013 · Cited by 231
Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
Korkmaz, Y., Dar, S. U. H., Yurt, M., Ozbey, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3147426 · Cited by 231
Self-citationDeep CT to MR Synthesis Using Paired and Unpaired Data
Jin, C.-B., Kim, H., Liu, M., Jung, W., Joo, S., Park, E., Ahn, Y., Han, I., Lee, J., & Cui, X. (2019) · Sensors · doi:10.3390/s19102361 · Cited by 224
Hiasa, Y., Otake, Y., Takao, M., Matsuoka, T., Takashima, K., Carass, A., Prince, J. L., Sugano, N., & Sato, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00536-8_4 · Cited by 221
Huang, Y., Shao, L., & Frangi, A. F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.613 · Cited by 216
On Convergence and Stability of GANs
Kodali, N., Abernethy, J., Hays, J. H., & Kira, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07215 · Cited by 214
Random forest regression for magnetic resonance image synthesis
Jog, A., Carass, A., Roy, S., Pham, D. L., & Prince, J. L. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.009 · Cited by 212
Convolution-Free Medical Image Segmentation Using Transformers
Karimi, D., Vasylechko, S., & Gholipour, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_8 · Cited by 197
Adversarial synthesis learning enables segmentation without target modality ground truth
Huo, Y., Xu, Z., Bao, S., Assad, A., Abramson, R. G., & Landman, B. A. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363790 · Cited by 182
CollaGAN: Collaborative GAN for Missing Image Data Imputation
Lee, D., Kim, J., Moon, W.-J., & Ye, J. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00259 · Cited by 181
Unpaired Brain MR-to-CT Synthesis Using a Structure-Constrained CycleGAN
Yang, H., Sun, J., Carass, A., Zhao, C., Lee, J., Xu, Z., & Prince, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_20 · Cited by 180
Adversarial Image Synthesis for Unpaired Multi-modal Cardiac Data
Chartsias, A., Joyce, T., Dharmakumar, R., & Tsaftaris, S. A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68127-6_1 · Cited by 172
mustGAN: multi-stream Generative Adversarial Networks for MR Image Synthesis
Yurt, M., Dar, S. U., Erdem, A., Erdem, E., Oguz, K. K., & Çukur, T. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101944 · Cited by 171
Self-citationTransCT: Dual-Path Transformer for Low Dose Computed Tomography
Zhang, Z., Yu, L., Liang, X., Zhao, W., & Xing, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87231-1_6 · Cited by 163
Multimodal Imaging Approaches: PET/CT and PET/MRI
Pichler, B. J., Judenhofer, M. S., & Pfannenberg, C. (2008) · Handbook of experimental pharmacology · doi:10.1007/978-3-540-72718-7_6 · Cited by 155
Is Synthesizing MRI Contrast Useful for Inter-modality Analysis?
Iglesias, J. E., Konukoğlu, E., Zikic, D., Glocker, B., Leemput, K. V., & Fischl, B. R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_79 · Cited by 147
Synthetic CT generation from non-attenuation corrected PET images for whole-body PET imaging
Dong, X., Wang, T., Lei, Y., Higgins, K. A., Liu, T., Curran, W. J., Mao, H. Z., Nye, J. A., & Yang, X. (2019) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab4eb7 · Cited by 144
Cross-Domain Synthesis of Medical Images Using Efficient Location-Sensitive Deep Network
Nguyen, H. V., Zhou, K., & Vemulapalli, R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_83 · Cited by 140
Image Quality Transfer via Random Forest Regression: Applications in Diffusion MRI
Alexander, D. C., Zikic, D., Zhang, J., Zhang, H. G., & Criminisi, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10443-0_29 · Cited by 134
Problems and preferences in pediatric imaging
Thukral, B. B. (2015) · Indian journal of radiology and imaging - new series/Indian journal of radiology and imaging/Indian Journal of Radiology & Imaging · doi:10.4103/0971-3026.169466 · Cited by 131
Tripartite-GAN: Synthesizing liver contrast-enhanced MRI to improve tumor detection
Zhao, J., Li, D., Kassam, Z., Howey, J., Chong, J., Chen, B., & Li, S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101667 · Cited by 119
Bahrami, K., Shi, F., Rekik, I., & Shen, D. G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46976-8_5 · Cited by 118
VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers
Kamran, S. A., Hossain, K. F., Tavakkoli, A., Zuckerbrod, S. L., & Baker, S. A. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00362 · Cited by 117
Collaborative patch-based super-resolution for diffusion-weighted images
Coupé, P., Manjón, J. V., Chamberland, M., Descoteaux, M., & Hiba, B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.06.030 · Cited by 112
3D cGAN based cross-modality MR image synthesis for brain tumor segmentation
Yu, B., Zhou, L., Wang, L., Fripp, J., & Bourgeat, P. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363653 · Cited by 109
Modality Propagation: Coherent Synthesis of Subject-Specific Scans with Data-Driven Regularization
Ye, D. H., Zikic, D., Glocker, B., Criminisi, A., & Ender Konukoglu, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_76 · Cited by 108
High-resolution medical image synthesis using progressively grown generative adversarial networksPreprint
Beers, A. L., Brown, J. M., Chang, K., Campbell, J. P., Ostmo, S. R., Chiang, M. F., & Kalpathy–Cramer, J. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.18781.31205 · Cited by 108
Lan, H., Initiative, T. A. D. N., Toga, A. W., & Sepehrband, F. (2021) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28819 · Cited by 108
Multi-contrast, isotropic, single-slab 3D MR imaging in multiple sclerosis
Moraal, B., Roosendaal, S. D., Pouwels, P. J. W., Vrenken, H., van Schijndel, R. A., Meier, D., Guttmann, C. R. G., Geurts, J. J. G., & Barkhof, F. (2008) · European Radiology · doi:10.1007/s00330-008-1009-7 · Cited by 106
Nyholm, T., Svensson, S., Andersson, S., Jonsson, J., Sohlin, M., Gustafsson, C., Kjellén, E., Söderström, K., Albertsson, P., Blomqvist, L., et al. (2018) · Medical Physics · doi:10.1002/mp.12748 · Cited by 104 · cited 1×
“org/ixi-dataset/, BRATS [94]) and a multi-modal pelvic MRI-CT dataset [95].”
BackgroundReconstruction of 7T-Like Images From 3T MRI
Bahrami, K., Shi, F., Zong, X., Shin, H. W., An, H., & Shen, D. G. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2549918 · Cited by 102
3D Transformer-GAN for High-Quality PET Reconstruction
Luo, Y., Wang, Y., Zu, C., Zhan, B., Wu, X., Zhou, J., Shen, D. G., & Zhou, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87231-1_27 · Cited by 96
DiamondGAN: Unified Multi-modal Generative Adversarial Networks for MRI Sequences Synthesis
Li, H., Paetzold, J. C., Sekuboyina, A., Kofler, F., Zhang, J., Kirschke, J. S., Wiestler, B., & Menze, B. H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32251-9_87 · Cited by 95
The Devil is in the Decoder: Classification, Regression and GANs
Wojna, Z., Ferrari, V., Guadarrama, S., Silberman, N., Chen, L.-C., Fathi, A., & Uijlings, J. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01170-8 · Cited by 94
Kearney, V. P., Ziemer, B. P., Perry, A., Wang, T., Chan, J. W. S., Ma, L., Morin, O., Yom, S. S., & Solberg, T. D. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020190027 · Cited by 93
Torrado-Carvajal, Á., Herraiz, J. L., Alcaín, E., Montemayor, A. S., García‐Cañamaque, L., Hernandez-Tamames, J. A., Rozenholc, Y., & Malpica, N. (2015) · Journal of Nuclear Medicine · doi:10.2967/jnumed.115.156299 · Cited by 91
Huang, Y., Shao, L., & Frangi, A. F. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2781192 · Cited by 84
Whole Brain Segmentation and Labeling from CT Using Synthetic MR Images
Zhao, C., Carass, A., Lee, J., He, Y., & Prince, J. L. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67389-9_34 · Cited by 79
Unpaired Mr to CT Synthesis with Explicit Structural Constrained Adversarial Learning
Ge, Y., Wei, D., Xue, Z., Wang, Q., Zhou, X. S., Zhan, Y., & Liao, S. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759529 · Cited by 75
Robust Multi-modal MR Image Synthesis
Joyce, T., Chartsias, A., & Tsaftaris, S. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_40 · Cited by 72
Unsupervised Cross-Modal Synthesis of Subject-Specific Scans
Vemulapalli, R., Nguyen, H. V., & Zhou, S. K. (2015) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.79 · Cited by 69
Yuan, Z., Jiang, M., Wang, Y., Wei, B., Li, Y., Wang, P., Menpes-Smith, W., Niu, Z., & Yang, G. (2020) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2020.611666 · Cited by 69
Whole Image Synthesis Using a Deep Encoder-Decoder Network
Sevetlidis, V., Giuffrida, M. V., & Tsaftaris, S. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46630-9_13 · Cited by 68
Wang, G., Gong, E., Banerjee, S., Martin, D., Tong, E., Choi, J., Chen, H., Wintermark, M., Pauly, J. M., & Zaharchuk, G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2987026 · Cited by 67
Adversarial Confidence Learning for Medical Image Segmentation and Synthesis
Nie, D., & Shen, D. G. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01321-2 · Cited by 65
Wei, W., Poirion, É., Bodini, B., Durrleman, S., Olivier Colliot, A., Stankoff, B., & Ayache, N. (2019) · Journal of medical imaging · doi:10.1117/1.jmi.6.1.014005 · Cited by 64
Extended Modality Propagation: Image Synthesis of Pathological Cases
Cordier, N., Delingette, H., Lê, M., & Ayache, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2589760 · Cited by 62
Pseudo-healthy Image Synthesis for White Matter Lesion Segmentation
Bowles, C. T., Qin, C., Ledig, C., Guerrero, R., Gunn, R. N., Hammers, A., Sakka, E., Dickie, D. A., Hernández, M. V., Royle, N. A., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46630-9_9 · Cited by 48
Lee, J., Carass, A., Jog, A., Zhao, C., & Prince, J. L. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2254571 · Cited by 47
Edge-preserving MRI image synthesis via adversarial network with iterative multi-scale fusion
Luo, Y., Nie, D., Zhan, B., Li, Z., Wu, X., Zhou, J., Wang, Y., & Shen, D. G. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.060 · Cited by 45
PTNet: A High-Resolution Infant MRI Synthesizer Based on TransformerPreprint
Zhang, X., He, X.-Z., Guo, J., Ettehadi, N., Aw, N., Semanek, D., Posner, J., Laine, A., & Wang, Y. (2021) · arXiv.org · doi:10.48550/arxiv.2105.13993 · Cited by 39
Unpaired Deep Cross-Modality Synthesis with Fast Training
Xiang, L., Li, Y., Lin, W., Wang, Q., & Shen, D. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_18 · Cited by 37
Dual-domain convolutional neural networks for improving structural information in 3 T MRI
Zhang, Y., Yap, P., Qu, L., Cheng, J.-Z., & Shen, D. G. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.05.023 · Cited by 37
Shin, H.-C., Ihsani, A., Mandava, S., Sreenivas, S. T., Forster, C. J., Cha, J., & Initiative, A. D. N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04393 · Cited by 37
Synthesizing Multi-Contrast MR Images Via Novel 3D Conditional Variational Auto-Encoding GAN
Yang, H., Lu, X., Wang, S., et al. (2020) · Mobile Networks and Applications · doi:10.1007/s11036-020-01678-1 · Cited by 36
Zhan, B., Li, D., Wang, Y., Ma, Z., Wu, X., Zhou, J., & Zhou, L. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102457 · Cited by 30
Atlas Based Intensity Transformation of Brain MR Images
Roy, S., Jog, A., Carass, A., & Prince, J. L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-319-02126-3_6 · Cited by 28
Durall, R., Keuper, M., & Keuper, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00791 · Cited by 26
Improved MR to CT Synthesis for PET/MR Attenuation Correction Using Imitation Learning
Kläser, K., Varsavsky, T., Markiewicz, P. J., Vercauteren, T. K., Atkinson, D., Thielemans, K., Hutton, B. F., Cardoso, M. J., & Sebastien Ourselin, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32778-1_2 · Cited by 18
7T MRI super-resolution with Generative Adversarial Network
Do, H., Bourdon, P., Helbert, D., Naudin, M., & Guillevin, R. (2021) · Electronic Imaging · doi:10.2352/issn.2470-1173.2021.18.3dia-106 · Cited by 13
Semi-Supervised Learning of Mutually Accelerated MRI Synthesis without Fully-Sampled Ground TruthsPreprint
Yurt, M., Dar, S. U. H., Özbey, M., Tınaz, B., Oğuz, K. K., & Çukur, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14347 · Cited by 13
Self-citationUnpaired PET/CT image synthesis of liver region using CycleGAN
Santini, G., Fourcade, C., Moreau, N., Rousseau, C., Ferrer, L., Lacombe, M., Fleury, V., Campone, M., Jézéquel, P., & Rubeaux, M. (2020) · International Symposium on Medical Information Processing and Analysis (SIPAIM) · doi:10.1117/12.2576095 · Cited by 10
Convolutional Block Design for Learned Fractional Downsampling
Chen, L., Bampis, C. G., Li, Z., Chen, C., & Bovik, A. C. (2022) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf56349.2022.10052104 · Cited by 9
Neuropathology: A reference text of CNS pathology
Harper, C. G. (1998) · Pathology · doi:10.1016/s0031-3025(16)34904-2 · Cited by 5
Arabi, H., Zeng, G., Guoyan Zheng, A., & Zaidi, H. (2018) · IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC) · doi:10.1109/nssmic.2018.8824733 · Cited by 5
Cited by
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
Self-citationAdvances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 485
Transformers in medical image analysis
He, K., Gan, C., Li, Z., Rekik, I., Yin, Z., Ji, W., Gao, Y., Wang, Q., Zhang, J., & Shen, D. (2023) · Intelligent Medicine · doi:10.1016/j.imed.2022.07.002 · Cited by 475
Deep learning based synthesis of MRI, CT and PET: Review and analysis
Dayarathna, S., Islam, K. T., Uribe, S., Yang, G., Hayat, M., & Chen, Z. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103046 · Cited by 265
Metadata
- Authors
- Dalmaz, O., Yurt, M., & Cukur, T.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2022-10
- Volume
- 41
- Issue
- 10
- Pages
- 2598-2614
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W3176466780
- Cited by
- 597
- References
- 110
- FWCI
- 39.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.