The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis
Abstract
Magnetic resonance (MR) imaging is a widely used medical imaging protocol that can be configured to provide different contrasts between the tissues in human body. By setting different scanning parameters, each MR imaging modality reflects the unique visual characteristic of scanned body part, benefiting the subsequent analysis from multiple perspectives. To utilize the complementary information from multiple imaging modalities, cross-modality MR image synthesis has aroused increasing research interest recently. However, most existing methods only focus on minimizing pixel/voxel-wise intensity difference but ignore the textural details of image content structure, which affects the quality of synthesized images. In this paper, we propose edge-aware generative adversarial networks (Ea-GANs) for cross-modality MR image synthesis. Specifically, we integrate edge information, which reflects the textural structure of image content and depicts the boundaries of different objects in images, to reduce this gap. Corresponding to different learning strategies, two frameworks are proposed, i.e., a generator-induced Ea-GAN (gEa-GAN) and a discriminator-induced Ea-GAN (dEa-GAN). The gEa-GAN incorporates the edge information via its generator, while the dEa-GAN further does this from both the generator and the discriminator so that the edge similarity is also adversarially learned. In addition, the proposed Ea-GANs are 3D-based and utilize hierarchical features to capture contextual information. The experimental results demonstrate that the proposed Ea-GANs, especially the dEa-GAN, outperform multiple state-of-the-art methods for cross-modality MR image synthesis in both qualitative and quantitative measures. Moreover, the dEa-GAN also shows excellent generality to generic image synthesis tasks on benchmark datasets about facades, maps, and cityscapes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 1×
“Also, the benefits of using multi-modality MR images for brain lesion segmentation have been widely recognised [5], [6].”
BackgroundBrain tumor segmentation with Deep Neural Networks
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., & Larochelle, H. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.05.004 · Cited by 3,278
Prediction of AD with MRI-based hippocampal volume in mild cognitive impairment
Jack, C. R., Petersen, R. C., Xu, Y. C., O’Brien, P. C., Smith, G. E., Ivnik, R. J., Boeve, B. F., Waring, S. C., Tangalos, E. G., & Kokmen, E. (1999) · Neurology · doi:10.1212/wnl.52.7.1397 · Cited by 1,404
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
Sugahara, T., Korogi, Y., Kochi, M., Ikushima, I., Shigematu, Y., Hirai, T., Okuda, T., Liang, L., Ge, Y., Komohara, Y., et al. (1999) · Journal of Magnetic Resonance Imaging · doi:10.1002/(sici)1522-2586(199901)9:1<53::aid-jmri7>3.0.co;2-2 · Cited by 1,163
MRI segmentation: Methods and applications
Clarke, L. P., Velthuizen, R. P., Camacho, M. A., Heine, J. J., Vaidyanathan, M., Hall, L. O., Thatcher, R. W., & Silbiger, M. L. (1995) · Magnetic Resonance Imaging · doi:10.1016/0730-725x(94)00124-l · Cited by 695
Medical Image Synthesis with Deep Convolutional Adversarial Networks
Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2814538 · Cited by 625
Self-citationImage Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks
Dar, S. U., Yurt, M., Karacan, L., Erdem, A., Erdem, E., & Cukur, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901750 · Cited by 608
Deep MR to CT Synthesis Using Unpaired Data
Wolterink, J. M., Dinkla, A. M., Savenije, M. H. F., Seevinck, P. R., van den Berg, C. A. T., & Išgum, I. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68127-6_2 · Cited by 593
Hofmann, M., Steinke, F., Scheel, V., Charpiat, G., Farquhar, J., Aschoff, P., Brady, M., Schölkopf, B., & Pichler, B. J. (2008) · Journal of Nuclear Medicine · doi:10.2967/jnumed.107.049353 · Cited by 495
3D conditional generative adversarial networks for high-quality PET image estimation at low dose
Wang, Y., Yu, B., Wang, L., Zu, C., Lalush, D. S., Lin, W., Wu, X., Zhou, J., Shen, D., & Zhou, L. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.045 · Cited by 449
Self-citationEnd-to-End Adversarial Retinal Image Synthesis
Costa, P., Galdran, A., Meyer, M. I., Niemeijer, M., Abramoff, M., Mendonca, A. M., & Campilho, A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2759102 · Cited by 432
Attenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain Studies
Burgos, N., Cardoso, M. J., Thielemans, K., Modat, M., Pedemonte, S., Dickson, J., Barnes, A., Ahmed, R., Mahoney, C. J., Schott, J. M., et al. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2340135 · Cited by 364
Spatial Pattern Templates for Recognition of Objects with Regular Structure
Tyleček, R., & Šára, R. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40602-7_39 · Cited by 344
GAN-based synthetic brain MR image generation
Han, C., Hayashi, H., Rundo, L., Araki, R., Shimoda, W., Muramatsu, S., Furukawa, Y., Mauri, G., & Nakayama, H. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363678 · Cited by 344
Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network
Yi, X., & Babyn, P. (2018) · Journal of Digital Imaging · doi:10.1007/s10278-018-0056-0 · Cited by 343
Multimodal MR Synthesis via Modality-Invariant Latent Representation
Chartsias, A., Joyce, T., Giuffrida, M. V., & Tsaftaris, S. A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2764326 · Cited by 341
Hofmann, M., Bezrukov, I., Mantlik, F., Aschoff, P., Steinke, F., Beyer, T., Pichler, B. J., & Schölkopf, B. (2011) · Journal of Nuclear Medicine · doi:10.2967/jnumed.110.078949 · Cited by 288
Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model
Huynh, T., Gao, Y., Kang, J., Wang, L., Zhang, P., Lian, J., & Shen, D. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2461533 · Cited by 282
Self-citationKhotanlou, H., Colliot, O., Atif, J., & Bloch, I. (2009) · Fuzzy Sets and Systems · doi:10.1016/j.fss.2008.11.016 · Cited by 261
Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
Mahmood, F., Chen, R., & Durr, N. J. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2842767 · Cited by 257 · cited 2×
“thesis [30]–[48] are 2D models that separately estimate each slice along the image’s trans-axial direction.”
An Introduction to Image Synthesis with Generative Adversarial NetsPreprint
Huang, H., Yu, P. S., & Wang, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04469 · Cited by 230
Huang, Y., Shao, L., & Frangi, A. F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.613 · Cited by 216
Random forest regression for magnetic resonance image synthesis
Jog, A., Carass, A., Roy, S., Pham, D. L., & Prince, J. L. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.009 · Cited by 212 · cited 7×
“Therefore, crossmodality MR image synthesis has recently aroused increasing research interest, and more and more investigations have been conducted to cope with the limitation of insufficient modalities in clinic and research [8], [9].”
InfluentialSynthesizing retinal and neuronal images with generative adversarial nets
Zhao, H., Li, H., Maurer-Stroh, S., & Cheng, L. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.001 · Cited by 210
Synthetic Medical Images from Dual Generative Adversarial NetworksPreprint
Guibas, J., Virdi, T., & Li, P. S. (2017) · arXiv.org · doi:10.48550/arxiv.1709.01872 · Cited by 193
Deep Generative Adversarial Networks for Compressed Sensing Automates MRIPreprint
Mardani, M., Gong, E., Cheng, J. Y., Vasanawala, S., Zaharchuk, G., Alley, M., Thakur, N., Han, S., Dally, W., Pauly, J., et al. (2017) · arXiv.org · doi:10.48550/arxiv.1706.00051 · Cited by 164
Magnetic Resonance Image Example-Based Contrast Synthesis
Roy, S., Carass, A., & Prince, J. L. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2282126 · Cited by 162
Biomedical Data Augmentation Using Generative Adversarial Neural Networks
Calimeri, F., Marzullo, A., Stamile, C., & Terracina, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68612-7_71 · Cited by 157
Adversarial synthesis learning enables segmentation without target modality ground truth
Huo, Y., Xu, Z., Bao, S., Assad, A., Abramson, R. G., & Landman, B. A. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363790 · Cited by 157
Bi, L., Kim, J., Kumar, A., Feng, D. D., & FULHAM, M. J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67564-0_5 · Cited by 157
Neural edge enhancer for supervised edge enhancement from noisy images
Suzuki, K., Horiba, I., & Sugie, N. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251151 · Cited by 152
Generation of Structural MR Images from Amyloid PET: Application to MR-Less Quantification
Choi, H., & Lee, D. S. (2017) · Journal of Nuclear Medicine · doi:10.2967/jnumed.117.199414 · Cited by 122
Why Does Synthesized Data Improve Multi-sequence Classification?
van Tulder, G., & de Bruijne, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_65 · Cited by 111
Dadar, M., Pascoal, T. A., Manitsirikul, S., Misquitta, K., Fonov, V., Tartaglia, M. C., Breitner, J. C. S., Rosa‐Neto, P., Carmichael, O. T., DeCarli, C. S., et al. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2693978 · Cited by 111
3D cGAN based cross-modality MR image synthesis for brain tumor segmentation
Yu, B., Zhou, L., Wang, L., Fripp, J., & Bourgeat, P. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363653 · Cited by 109
Self-citationModality Propagation: Coherent Synthesis of Subject-Specific Scans with Data-Driven Regularization
Ye, D. H., Zikic, D., Glocker, B., Criminisi, A., & Ender Konukoglu, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_76 · Cited by 108
Wang, Y., Shen, D. G., Ma, G., An, L., Shi, F., Zhang, P., Lalush, D. S., Wu, X., Pu, Y., & Zhou, J. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2564440 · Cited by 100
Thung, K.-H., Yap, P.-T., Adeli, E., Lee, S.-W., & Shen, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.002 · Cited by 89
Freehand Ultrasound Image Simulation with Spatially-Conditioned Generative Adversarial Networks
Hu, Y., Gibson, E., Lee, L.-L., Xie, W., Barratt, D. C., Vercauteren, T. K., & Noble, J. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67564-0_11 · Cited by 87
Huang, Y., Shao, L., & Frangi, A. F. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2781192 · Cited by 84
Extended Modality Propagation: Image Synthesis of Pathological Cases
Cordier, N., Delingette, H., Lê, M., & Ayache, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2589760 · Cited by 52
Fu, J. Y., Yang, Y., Singhrao, K., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00131 · Cited by 45
Automatic brain labeling via multi-atlas guided fully convolutional networks
Fang, L., Zhang, L., Nie, D., Cao, X., Rekik, I., Lee, S., He, H., & Shen, D. G. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.10.012 · Cited by 35
Using image synthesis for multi-channel registration of different image modalities
Chen, M., Jog, A., Carass, A., & Prince, J. L. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2082373 · Cited by 24
MRI Image-to-Image Translation for Cross-Modality Image Registration and Segmentation.
Yang, Q., Li, N., Zhao, Z., Fan, X., Chang, E., & Xu, Y. L. (2018) · Cited by 24
Hiasa, Y., Otake, Y., Takao, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.06629 · Cited by 21
Cited by
A survey on active learning and human-in-the-loop deep learning for medical image analysis
Budd, S., Robinson, E. C., & Kainz, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102062 · Cited by 606
ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
Hi-Net: Hybrid-Fusion Network for Multi-Modal MR Image Synthesis
Zhou, T., Fu, H., Chen, G., Shen, J., & Shao, L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2975344 · Cited by 399
On Data Augmentation for GAN Training
Tran, N.-T., Tran, V.-H., Nguyen, N.-B., Nguyen, T.-K., & Cheung, N.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3049346 · Cited by 328
Metadata
- Authors
- Yu, B., Zhou, L., Wang, L., Shi, Y., Fripp, J., & Bourgeat, P.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-07
- Volume
- 38
- Issue
- 7
- Pages
- 1750-1762
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2914057844
- Cited by
- 298
- References
- 61
- FWCI
- 13.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.