The DOI matches its Crossref record; 49 of the 51 references it cites were found in a registry or an index.
Missing MRI Pulse Sequence Synthesis Using Multi-Modal Generative Adversarial Network
Open accessAbstract
Magnetic resonance imaging (MRI) is being increasingly utilized to assess, diagnose, and plan treatment for a variety of diseases. The ability to visualize tissue in varied contrasts in the form of MR pulse sequences in a single scan provides valuable insights to physicians, as well as enabling automated systems performing downstream analysis. However, many issues like prohibitive scan time, image corruption, different acquisition protocols, or allergies to certain contrast materials may hinder the process of acquiring multiple sequences for a patient. This poses challenges to both physicians and automated systems since complementary information provided by the missing sequences is lost. In this paper, we propose a variant of generative adversarial network (GAN) capable of leveraging redundant information contained within multiple available sequences in order to generate one or more missing sequences for a patient scan. The proposed network is designed as a multi-input, multi-output network which combines information from all the available pulse sequences and synthesizes the missing ones in a single forward pass. We demonstrate and validate our method on two brain MRI datasets each with four sequences, and show the applicability of the proposed method in simultaneously synthesizing all missing sequences in any possible scenario where either one, two, or three of the four sequences may be missing. We compare our approach with competing unimodal and multi-modal methods, and show that we outperform both quantitatively and qualitatively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Performance of these methods depend on the generation model that imputes the missing modalities.”
From Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation (2025) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1×
“4) Curriculum learning: In order to train our proposed method we use a curriculum learning (CL) [45]”
Instance Normalization: The Missing Ingredient for Fast StylizationPreprint
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 4,325
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311
Research works printed but not linked: 3
- gauthier, 2014, Conditional generative adversarial nets for convolutional face generation, Class Project Stanford CS231N Convolutional Neural Netw Vis Recognit Winter Semester, 2014, 2
- goodfellow, 2014, Generative adversarial nets, Proc Adv Neural Inf Process Syst, 2672
- 2017, 2017 International MICCAI BraTS Challenge
Cited by
Sorted by citations
Items 201–253 of 253
Han, W., Geng, J., Xu, Z., & Jiang, W. R. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3604075 · Cited by 1
Acquisition Parameter-conditioned Magnetic Resonance Image-to-image Translation
Denck, J., Guehring, J., Maier, A., & Rothgang, E. M. (2021) · Informatik aktuell · doi:10.1007/978-3-658-33198-6_49 · Cited by 1
Bottleneck Sharing Generative Adversarial Networks for Unified Multi-Contrast MR Image Synthesis
Dalmaz, O., Sağlam, B., Gönç, K., Dar, S. U. H., & Çukur, T. (2022) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu55565.2022.9864880 · Cited by 1
Deep Learning for Early Diagnosis of Neurological Disorders
Malviya, R., Kumar, S., Solanke, A. S., Goyal, P., & Chauhan, K. (2025) · Wiley eBooks · doi:10.1002/9781394347537.ch4 · Cited by 1
Generating synthetic Gadolinium-Enhanced T1-weighted (Gd-T1w) MRI
Kwon, H. Y. (2020)
Variable Augmented Network for Invertible Modality Synthesis-FusionPreprint
Wang, Y., Liu, R., Li, Z., Yang, C., & Liu, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00670
Mudegaonkar, J. L., & Yadav, D. M. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-7985-8_77
Wang, Y., & Liu, Q. (2024) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-031-51455-5_26
A Review of GAN-Synthesized Brain MR Image Applications
Tiwari, A., Tavse, S., Bachute, M. R., & Bhola, A. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-6303-4.ch006
Partition-based k-space synthesis for multi-contrast parallel imaging
Huang, Y., Wu, Z., Xu, X., Zhang, M., Wang, S., & Liu, Q. (2024) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2024.110297
Prompt-driven transformer for brain tumor segmentation with missing modalities
Mao, K., Xu, Y., Wang, K., & Zhang, B. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.115275
Magnetic Resonance Angiography
Jella, P. K. (2025) · Springer eBooks · doi:10.1007/978-3-031-90554-4_5
Chen, L., Wang, L., & Wang, W. (2025) · Journal of improved oil and gas recovery technology. · doi:10.53469/wjimt.2025.08(07).13
Epileptic Focal Area Segmentation via Multimodal MRI Transfer Learning
He, S., Chang, X., Feng, X., Zhang, Q., & Ran, B. (2025) · International Symposium on Autonomous Decentralized Systems · doi:10.1109/isads66912.2025.00019
Positron Emission Tomography Tracer Conversion via Variable Augmented Invertible Network
Shen, B., Geng, M., Zhang, W., Xu, F., Li, B., & Liu, Q. (2025) · Journal of Shanghai Jiaotong University (Science) · doi:10.1007/s12204-025-2844-2
GEKD: A graph-enhanced knowledge discriminator for universal improvements in medical image synthesis
Zhang, C., Hu, J., Li, Y., Lin, L., & Chen, Y. (2025) · Displays · doi:10.1016/j.displa.2025.103197
CT-MR Synthesis of Medical Images based on Transformer Fusion
Wei, Z., Huang, W., Liu, S., Li, X., Cheng, B., & Zhang, M. (2025) · International Conference on Mechatronics, Robotics, and Artificial Intelligence (MRAI) · doi:10.1109/mrai65197.2025.11135806
High-resolution conditional MR image synthesis through the PACGAN framework
Lai, M., Marzi, C., Citi, L., & Diciotti, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-16257-1
Unified Multi-modal Aggregated-Masked Diffusion Network for MRI Synthesis with Modality Missing
Guo, M., Chen, F., & Wang, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4381-6_12
GL 2 T -Diff: Medical image translation via spatial-frequency fusion diffusion models
Sui, D., Song, N., Tian, X., Zhou, H., Li, Y., Guo, M., Wang, K., & Luo, G. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104586
Imputation of missing pixel art character poses with differentiable palette quantization
Coutinho, F., Chaves, L. G. S., & Chaimowicz, L. (2025) · Entertainment Computing · doi:10.1016/j.entcom.2025.101021
Pang, H., Xu, S., Zhang, X., An, F., Zhang, X., Wang, Y., Liu, F., Yan, T., Marais, P., Qian, Y., et al. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109074
Give me that other image: Machine learning for image-to-image translation
Dalmaz, O., & Çukur, T. (2025) · Advances in magnetic resonance technology and applications · doi:10.1016/b978-0-443-14109-6.00015-8
Cut it here: Image segmentation for MRI
Chen, C. (., & Li, Z. (2025) · Advances in magnetic resonance technology and applications · doi:10.1016/b978-0-443-14109-6.00012-2
Yan, T., Xin, D., Cui, Y., Wu, M., Liu, T., Zhao, D., & Ye, C. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114733
Xi, H., Ye, Y., Zhu, J., & Li, J. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3649819
Huang, Z., & Zheng, W. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-025-08194-7
Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosis
Zhang, L., Yu, H., Wang, Z., Gui, F., Guo, Y., Zhang, W., & Jia, M. J. (2026) · Medical Image Analysis · doi:10.1016/j.media.2025.103886
Song, T., Wu, Y., Hu, M., Luo, X., Wei, L., Wang, G., Guo, Y., Xu, F., & Zhang, S. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3654249
Son, G., Lee, J., & Hwang, D. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108666
Shi, J., Sun, Z., Yu, L., Yang, X., & Yan, Z. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3667605
Cantemir, Z., Karacan, H., Cındıl, E., & Kalafat, B. (2026) · Applied Sciences · doi:10.3390/app16083674
Zhang, S., Guo, Y., Du, Y., & Wang, J. (2026) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001426370012
MedGAN-SSM: Multimodal brain image synthesis network integration using SSM empowered GAN
Song, T., Wang, M., Ren, Z., Li, W., Zhang, J., & Li, K. (2026) · iScience · doi:10.1016/j.isci.2026.115924
Liang, F., Yan, J., Lai, S., Zhang, C., Lin, J., Wei, R., Wu, Y., Cheng, J., Liu, Y., Wang, W., et al. (2026) · European Radiology · doi:10.1007/s00330-026-12622-4 · Cited by 1
Compressive equilibrium unfolding network for unified cross-modal medical image synthesis
Zhang, J., Zeng, X., & Xiang, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133043
Liu, Y., Cui, Z., Li, L., You, J., Feng, X., Huang, R., Wang, J., Wang, X., Liu, Q., & WU, M. (2026) · Medicine Advances · doi:10.1002/med4.70064
Class-Conditional Variational Autoencoder for MRI-Based Brain Tumor Data Augmentation
Charaabi, H., Hamdi, R., Njah, M., Kolsi, F., & Boudawara, M. Z. (2026) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd69655.2026.11558956
Efficient Many-to-Many MRI Modality Translation via a Latent-Conditioned Vector-Quantized Network*
Baker, H., & Brockmeier, A. J. (2025) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner61569.2025.11588989
Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies
Feng, Y., Wang, J., Xu, C., Hou, W., Wang, H., Qian, Y., Liu, Y., Sun, B., Liu, Y., & Wang, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37435-6_31
Zhang, H., Zhang, S., Liang, S., Gao, G., Li, S., Wu, H., Su, X., Li, H., & Chen, D. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104241
MM-FM: Multi-Modal Flow Matching for Brain MRI Missing Modality Synthesis
Lin, B., Cheng, Z., Zhao, J., Li, Y., Miao, Z., Ma, B., & Wang, S. (2026) · Multidimensional Signal Processing Workshop · doi:10.1109/ivmsp68335.2026.11618833
Zeng, G., Li, W., Li, X., Sun, R., Lam, S., Xiong, T., Cheung, H.-Y., Lee, V. H.-F., Lee, K.-H., Cheung, L.-Y., et al. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1859909
V-Ideal: Generative Prompting for Fault-Tolerant Multimodal Web Services Under Microservice Failures
Fan, B., Seah, W. K. G., Xu, G., Xu, X., & Zhang, F. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00069
Multimodal EEG–MRI signal processing approaches for stroke and rehabilitation: a narrative review
Das, H., Bhatia, D., Kumar, V., & Paul, S. (2026) · Scientific Reviews · doi:10.1038/s44573-026-00011-3
Zhou, Z., Song, Y., Liu, R., Cao, X., Jiang, Z., Lü, H., Jiang, D., Liu, Y., & Li, X. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02279-2
Han, L., Min, P., Xie, X., Zhang, T., Wang, X., Gao, Y., Lu, C., Liang, X., Duan, Y., Portaluri, A., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38189-7_3
Ju, M., Gou, S., Jing, J., Fan, H., Li, Y., & Zhang, C. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109695
Unified Multi-plane Autoregressive Diffusion for 3D Multi-contrast MRI Synthesis
Shin, Y., Son, G., Wang, J., Jung, M., Lu, Y., & Hwang, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37450-9_16
A unified and domain-robust framework enables controllable multimodal brain MRI synthesis
Zheng, H., Xing, Z., Zhu, L., Bao, J., He, Y., Wu, Z., Yang, J., Li, H., Zhu, X., Zhou, Y., et al. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104348
D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing ModalitiesPreprint
Ali, D., Mian, A., Akhtar, N., & Hassan, G. M. (2026) · Research Square · doi:10.21203/rs.3.rs-11205011/v1
Jiang, Y., & Zhang, P. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729589
Federated Modality Aware Network for Robust Glioblastoma Survival Prediction
Gulati, R. I. S., Keerthika, P., Gulecha, S., & Baghel, T. (2026) · International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI) · doi:10.1109/icoici69824.2026.11724339
Metadata
- Authors
- Sharma, A., & Hamarneh, G.
- Affiliations
- Simon Fraser University (CA)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-04
- Volume
- 39
- Issue
- 4
- Pages
- 1170-1183
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2941736865
- Cited by
- 254
- References
- 51
- Citations by year
- 2026: 37 · 2025: 66 · 2024: 50 · 2023: 32 · 2022: 31 · 2021: 20 · 2020: 17
- FWCI
- 11.39
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Summit (Simon Fraser University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Nvidia
- Compute Canada
- Western Canada Research Grid
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- brain MRI, scan time reduction, multi-contrast MRI
- MeSH terms
- Deep Learning, Brain, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
