3D cGAN based cross-modality MR image synthesis for brain tumor segmentation
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Different modalities of magnetic resonance imaging (MRI) can indicate tumor-induced tissue changes from different perspectives, thus benefit brain tumor segmentation when they are considered together. Meanwhile, it is always interesting to examine the diagnosis potential from single modality, considering the cost of acquiring multi-modality images. Clinically, T1-weighted MRI is the most commonly used MR imaging modality, although it may not be the best option for contouring brain tumor. In this paper, we investigate whether synthesizing FLAIR images from T1 could help improve brain tumor segmentation from the single modality of T1. This is achieved by designing a 3D conditional Generative Adversarial Network (cGAN) for FLAIR image synthesis and a local adaptive fusion method to better depict the details of the synthesized FLAIR images. The proposed method can effectively handle the segmentation task of brain tumors that vary in appearance, size and location across samples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Performance of these methods depend on the generation model that imputes the missing modalities.”
From Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation (2025) · cites this paper as [24]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 2×
“To evaluate the effectiveness of our proposed method, we compare it with I: 2D cGAN on the whole zero-padded axial slices (256(2)) [14], II: 3D cGAN on small patches (32(3)), III: our proposed 3D cGAN on large patches (128(3)), IV: local non-linear mapping (3D cGAN on 32(3)-size patches) applied after the method III,…”
MethodLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863 · cited 1×
“Recently, conditional Generative Adversarial Network (cGAN) [9] has demonstrated itself to be a promising method for image synthesis.”
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781 · cited 3×
“The effectiveness of the proposed method is demonstrated on the public dataset 2015 Brain Tumor Segmentation Challenge (BRATS) [1].”
BackgroundMethodInfluentialEfficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 2×
“We linearly scale the original intensity values in all images to [−1, 1] according to [16], without any additional contrast.”
MethodMedical Image Synthesis with Context-Aware Generative Adversarial Networks
Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_48 · Cited by 691
Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis
Li, R., Zhang, W., Suk, H.-I., Wang, L., Li, J., Shen, D., & Ji, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10443-0_39 · Cited by 469 · cited 5×
“To effectively segment brain tumor with the synthesized FLAIR-like and T1 MR images, we utilize an 11-layer, twopathway 3D CNN segmentation model [16], which achieves the state-of-the-art performance on brain tumor segmentation1.”
BackgroundInfluentialSelf-citationSharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network
Yi, X., & Babyn, P. (2018) · Journal of Digital Imaging · doi:10.1007/s10278-018-0056-0 · Cited by 343 · cited 1×
“By training the two modules to beat each other, cGAN has achieved excellent performance on medical image synthesis, as shown in [10, 11].”
Huang, Y., Shao, L., & Frangi, A. F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.613 · Cited by 216
Random forest regression for magnetic resonance image synthesis
Jog, A., Carass, A., Roy, S., Pham, D. L., & Prince, J. L. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.009 · Cited by 212 · cited 1×
“For example, T1-weighted (T1w) MR images gives sharp contrast between white and grey matter tissues, while Fluid attenuated inversion recovery (FLAIR) highlights lesion tissues [2].”
BackgroundJoint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation
Tseng, K.-L., Lin, Y.-L., Hsu, W., & Huang, C.-Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.398 · Cited by 190 · cited 1×
“1U-net only shows mediocre performance for brain tumor segmentation (as compared in [17]).”
BackgroundVirtual PET Images from CT Data Using Deep Convolutional Networks: Initial Results
Ben-Cohen, A., Klang, E., Raskin, S. P., Amitai, M. M., & Greenspan, H. K. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68127-6_6 · Cited by 102 · cited 1×
“By training the two modules to beat each other, cGAN has achieved excellent performance on medical image synthesis, as shown in [10, 11].”
Wang, Y., Shen, D., Ma, G., An, L., Shi, F., Zhang, P., Lalush, D. S., Wu, X., Pu, Y., & Zhou, J. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2564440 · Cited by 94 · cited 1×
“Some machine learning methods, like dictionary learning [7] and deep convolutional neural network (CNN) [8], have been proposed for this purpose.”
BackgroundMR to CT registration of brains using image synthesis
Roy, S., Carass, A., Jog, A., Prince, J. L., & Lee, J. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2043954 · Cited by 65 · cited 1×
“The first one is registration based methods that conduct the synthesis through the atlas registration of the involved image types [5,6].”
MethodExtended Modality Propagation: Image Synthesis of Pathological Cases
Cordier, N., Delingette, H., Lê, M., & Ayache, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2589760 · Cited by 62 · cited 1×
“Luping Zhou Image synthesis, which transfers the given images to another specific type, has shown wide applications in medical field [3, 4].”
BackgroundDegen, J., & Heinrich, M. P. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.81 · Cited by 17 · cited 1×
“The first one is registration based methods that conduct the synthesis through the atlas registration of the involved image types [5,6].”
Method
Cited by
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
“proposed a method to generate synthetic abnormal MRI images with brain tumors by training a generative adversarial network using two publicly available data sets of brain MRI. Similarly, other works [42,163,165] have leveraged GANs to synthesize brain MR images. 7. Weakly Supervised Methods Collecting large-scale accu…”
MethodImage Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks
Dar, S. U., Yurt, M., Karacan, L., Erdem, A., Erdem, E., & Cukur, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901750 · Cited by 608
“Perhaps, the closest to our approach are [62] and [73] where conditional”
BackgroundResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
“In recent years, generative adversarial network (GAN) models have been broadly adopted for translation tasks, given their exceptional realism in image synthesis [21], [22], [23], [24], [25], [26].”
Background
Metadata
- Authors
- Yu, B., Zhou, L., Wang, L., Fripp, J., & Bourgeat, P.
- Affiliations
- University of Wollongong (AU)
- Commonwealth Scientific and Industrial Research Organisation (AU)
- Venue
- 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018)
- Publisher
- IEEE
- Published
- 2018-04
- Pages
- 626-630
- OpenAlex
- W2807246925
- Cited by
- 109
- References
- 18
- Citations by year
- 2025: 16 · 2024: 12 · 2023: 20 · 2022: 17 · 2021: 17 · 2020: 14 · 2019: 13
- FWCI
- 6.45
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Symposium on Biomedical Imaging (ISBI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- brain tumor segmentation, T1-weighted imaging, medical image synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.