The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
GANs for Medical Image Synthesis: An Empirical Study
Open accessAbstract
Generative adversarial networks (GANs) have become increasingly powerful, generating mind-blowing photorealistic images that mimic the content of datasets they have been trained to replicate. One recurrent theme in medical imaging, is whether GANs can also be as effective at generating workable medical data, as they are for generating realistic RGB images. In this paper, we perform a multi-GAN and multi-application study, to gauge the benefits of GANs in medical imaging. We tested various GAN architectures, from basic DCGAN to more sophisticated style-based GANs, on three medical imaging modalities and organs, namely: cardiac cine-MRI, liver CT, and RGB retina images. GANs were trained on well-known and widely utilized datasets, from which their FID scores were computed, to measure the visual acuity of their generated images. We further tested their usefulness by measuring the segmentation accuracy of a U-Net trained on these generated images and the original data. The results reveal that GANs are far from being equal, as some are ill-suited for medical imaging applications, while others performed much better. The top-performing GANs are capable of generating realistic-looking medical images by FID standards, that can fool trained experts in a visual Turing test and comply to some metrics. However, segmentation results suggest that no GAN is capable of reproducing the full richness of medical datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
(2017) · International Conference on Machine Learning · Cited by 6,382
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
Bernard, O., Lalande, A., Zotti, C., Cervenansky, F., Yang, X., Heng, P.-A., Cetin, I., Lekadir, K., Camara, O., Gonzalez Ballester, M. A., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2837502 · Cited by 2,431
Self-citationConditional Image Synthesis With Auxiliary Classifier GANs
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 1,837
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963
Porwal, P., Pachade, S., Kamble, R., Kokare, M., Deshmukh, G., Sahasrabuddhe, V., & Meriaudeau, F. (2018) · Data · doi:10.3390/data3030025 · Cited by 923
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
Shin, H.-C., Tenenholtz, N. A., Rogers, J. K., Schwarz, C. G., Senjem, M. L., Gunter, J. L., Andriole, K. P., & Michalski, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00536-8_1 · Cited by 638
Differentiable Augmentation for Data-Efficient GAN TrainingPreprint
Zhao, S., Liu, Z., Lin, J., Zhu, J.-Y., & Han, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10738 · Cited by 580
GANs for medical image analysis
Kazeminia, S., Baur, C., Kuijper, A., van Ginneken, B., Navab, N., Albarqouni, S., & Mukhopadhyay, A. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101938 · Cited by 534
Shmelkov, K., Schmid, C., & Alahari, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_14 · Cited by 341
Towards Principled Methods for Training Generative Adversarial Networks
Arjovsky, M., & Bottou, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.04862 · Cited by 335
Chuquicusma, M. J. M., Hussein, S., Burt, J., & Bagci, U. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363564 · Cited by 238
Cross-view image synthesis using conditional GANs
Regmi, K., & Borji, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00369 · Cited by 204
Jeong, J., Tariq, A., Adejumo, T., Trivedi, H., Gichoya, J. W., & Banerjee, I. (2022) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-021-00556-w · Cited by 186
Classification Accuracy Score for Conditional Generative ModelsPreprint
Ravuri, S. V., & Vinyals, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10887 · Cited by 179
A Review: Generative Adversarial Networks
Gonog, L., & Zhou, Y. (2019) · 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea.2019.8833686 · Cited by 178
Lim, J. H., & Ye, J. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02894 · Cited by 174
3D Segmentation in the Clinic: A Grand Challenge II: MS lesion segmentation
Styner, M., Lee, J., Chin, B., Chin, M. S., Commowick, O., Tran, H.-H., Markovic-Plese, S., Jewells, V., & Warfield, S. (2008) · The MIDAS Journal · doi:10.54294/lmkqvm · Cited by 167
Biomedical Data Augmentation Using Generative Adversarial Neural Networks
Calimeri, F., Marzullo, A., Stamile, C., & Terracina, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68612-7_71 · Cited by 157
Learning implicit brain MRI manifolds with deep learning
Plassard, A. J., Davis, L. T., Newton, A. T., Resnick, S. M., Landman, B. A., & Bermudez, C. L. (2018) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2293515 · Cited by 143
Simulation and Synthesis in Medical Imaging
Frangi, A. F., Tsaftaris, S. A., & Prince, J. L. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2800298 · Cited by 125
Generating Highly Realistic Images of Skin Lesions with GANs
Baur, C., Albarqouni, S., & Navab, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01201-4_28 · Cited by 116
Generative Adversarial Networks: A Primer for Radiologists
Wolterink, J. M., Mukhopadhyay, A., Leiner, T., Vogl, T. J., Bucher, A. M., & Išgum, I. (2021) · Radiographics · doi:10.1148/rg.2021200151 · Cited by 97
Generative Adversarial Networks in Medical Image Processing
Gong, M., Chen, S., Chen, Q., Zeng, Y., & Zhang, Y. (2020) · Current Pharmaceutical Design · doi:10.2174/1381612826666201125110710 · Cited by 58
On the effectiveness of GAN generated cardiac MRIs for segmentationPreprint
Skandarani, Y., Painchaud, N., Jodoin, P., & Lalande, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09026 · Cited by 34
Self-citation
Cited by
Pinto-Coelho, L. (2023) · Bioengineering · doi:10.3390/bioengineering10121435 · Cited by 676
Deep Learning for Medical Image-Based Cancer Diagnosis
Jiang, X., Hu, Z., Wang, S., & Zhang, Y. (2023) · Cancers · doi:10.3390/cancers15143608 · Cited by 345
Mall, P. K., Singh, P. K., Srivastav, S., Narayan, V., Paprzycki, M., Jaworska, T., & Ganzha, M. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100216 · Cited by 276
Deep learning based synthesis of MRI, CT and PET: Review and analysis
Dayarathna, S., Islam, K. T., Uribe, S., Yang, G., Hayat, M., & Chen, Z. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103046 · Cited by 265
Khosravi, P., Fuchs, T. J., & Ho, D. J. (2025) · Cancer Research · doi:10.1158/0008-5472.can-24-3630 · Cited by 41
Metadata
- Authors
- Skandarani, Y., Jodoin, P.-M., & Lalande, A.
- Venue
- Journal of Imaging
- Publisher
- MDPI AG
- Published
- 2023-03-16
- Volume
- 9
- Issue
- 3
- Pages
- 69
- ISSN
- 2313-433X (ISSN-L)
- OpenAlex
- W3161307971
- Cited by
- 290
- References
- 41
- FWCI
- 25.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.