CoChat

Image synthesis with adversarial networks: A comprehensive survey and case studies

Open access
Shamsolmoali, Pourya, Zareapoor, Masoumeh, Granger, Eric, Zhou, Huiyu, Wang, Ruili, Celebi, M. Emre, Yang, Jie · 2021 · Information Fusion
Cited by 173

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.inffus.2021.02.014

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 101

  1. Q. Hoang, T.D. Nguyen, T. Le, D. Phung, MGAN: Training generative adversarial nets with multiple generators, in: International Conference on Learning Representations, 2018.
  2. Metz, 2016, Unrolled generative adversarial networks, Int. Conf. Learn. Representations
  3. Y. Balaji, H. Hassani, R. Chellappa, S. Feizi, Entropic gans meet vaes: A statistical approach to compute sample likelihoods in gans, in: International Conference on Machine Learning, 2019, pp. 414–423.
  4. Schäfer, 2019, Implicit competitive regularization in GANs, Int. Conf. Learn. Representations
  5. W. Zhao, W. Xu, M. Yang, J. Ye, Z. Zhao, Y. Feng, Y. Qiao, Dual learning for cross-domain image captioning, in: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017, pp. 29–38. · DOI
  6. W. Wang, Q. Huang, S. You, C. Yang, U. Neumann, Shape inpainting using 3D generative adversarial network and recurrent convolutional networks, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2298–2306. · DOI · Paper page
  7. Mokhayeri, 2020, A paired sparse representation model for robust face recognition from a single sample, Pattern Recognit., 100, 10.1016/j.patcog.2019.107129 · DOI
  8. Ma, 2020, Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion, Inf. Fusion, 62, 110, 10.1016/j.inffus.2020.04.006 · DOI · Paper page
  9. F. Zhan, H. Zhu, S. Lu, Spatial fusion gan for image synthesis, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 3653–3662. · DOI · Paper page
  10. D. Joo, D. Kim, J. Kim, Generating a fusion image: One’s identity and another’s shape, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 1635–1643. · DOI
  11. Rey-Area, 2020, FuCiTNet: Improving the generalization of deep learning networks by the fusion of learned class-inherent transformations, Inf. Fusion, 10.1016/j.inffus.2020.06.015 · DOI
  12. Park, 2019, Unpaired image denoising using a generative adversarial network in X-ray CT, IEEE Access, 7
  13. K. Kurach, M. Lučić, X. Zhai, M. Michalski, S. Gelly, A large-scale study on regularization and normalization in GANs, in: International Conference on Machine Learning, 2019, pp. 3581–3590.
  14. Yi, 2019, Generative adversarial network in medical imaging: A review, Med. Image Anal., 58, 10.1016/j.media.2019.101552 · DOI · Paper page
  15. Han, 2019, Adversarial training in affective computing and sentiment analysis: Recent advances and perspectives, IEEE Comput. Intell. Mag., 14, 68, 10.1109/MCI.2019.2901088 · DOI
  16. Hong, 2019, How generative adversarial networks and their variants work: An overview, ACM Comput. Surv., 52, 1, 10.1145/3301282 · DOI · Paper page
  17. Piccialli, 2020, A survey on deep learning in medicine: Why, how and when?, Inf. Fusion
  18. Yang, 2020, Single image deraining: From model-based to data-driven and beyond, IEEE Trans. Pattern Anal. Mach. Intell.
  19. A. Odena, C. Olah, J. Shlens, Conditional image synthesis with auxiliary classifier gans, in: International Conference on Machine Learning, 2017, pp. 2642–2651.
  20. Wu, 2017, A survey of image synthesis and editing with generative adversarial networks, Tsinghua Sci. Technol., 22, 660, 10.23919/TST.2017.8195348 · DOI · Paper page
  21. Chen, 2018, Building occupancy modeling using generative adversarial network, Energy Build., 174, 372, 10.1016/j.enbuild.2018.06.029 · DOI
  22. T. Doan, J. Monteiro, I. Albuquerque, B. Mazoure, A. Durand, J. Pineau, R.D. Hjelm, On-line adaptative curriculum learning for GANs, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, 2019, pp. 3470–3477. · DOI
  23. Wang, 2019, Weakly supervised adversarial domain adaptation for semantic segmentation in urban scenes, IEEE Trans. Image Process., 28, 4376, 10.1109/TIP.2019.2910667 · DOI · Paper page
  24. Qi, 2020, Loss-sensitive generative adversarial networks on lipschitz densities, Int. J. Comput. Vis., 128, 1118, 10.1007/s11263-019-01265-2 · DOI · Paper page
  25. Pu, 2019, Sdf-man: Semi-supervised disparity fusion with multi-scale adversarial networks, Remote Sens., 11, 487, 10.3390/rs11050487 · DOI
  26. Z. Yi, H. Zhang, P. Tan, M. Gong, Dualgan: Unsupervised dual learning for image-to-image translation, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2849–2857. · DOI · Paper page
  27. G. Mordido, H. Yang, C. Meinel, Dropout-gan: Learning from a dynamic ensemble of discriminators, in: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2018.
  28. S. Ma, J. Fu, C. Wen Chen, T. Mei, Da-gan: Instance-level image translation by deep attention generative adversarial networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 5657–5666. · DOI · Paper page
  29. S. Azadi, M. Fisher, V.G. Kim, Z. Wang, E. Shechtman, T. Darrell, Multi-content gan for few-shot font style transfer, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7564–7573. · DOI · Paper page
  30. S.-W. Huang, C.-T. Lin, S.-P. Chen, Y.-Y. Wu, P.-H. Hsu, S.-H. Lai, Auggan: Cross domain adaptation with gan-based data augmentation, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 718–731. · DOI · Paper page
  31. P. Achlioptas, O. Diamanti, I. Mitliagkas, L. Guibas, Learning representations and generative models for 3D point clouds, in: International Conference on Machine Learning, 2018, pp. 40–49.
  32. Lutz, 2018, Alphagan: Generative adversarial networks for natural image matting, Br. Mach. Vis. Conf.
  33. N. Bodla, G. Hua, R. Chellappa, Semi-supervised FusedGAN for conditional image generation, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 669–683. · DOI
  34. S. Liu, V. John, E. Blasch, Z. Liu, Y. Huang, IR2VI: Enhanced night environmental perception by unsupervised thermal image translation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 1153–1160. · DOI
  35. Zhang, 2018, Sch-gan: Semi-supervised cross-modal hashing by generative adversarial network, IEEE Trans. Cybern., 50, 489, 10.1109/TCYB.2018.2868826 · DOI
  36. W.-L. Chang, H.-P. Wang, W.-H. Peng, W.-C. Chiu, All about structure: Adapting structural information across domains for boosting semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 1900–1909. · DOI · Paper page
  37. Shamsolmoali, 2020, Road segmentation for remote sensing images using adversarial spatial pyramid networks, IEEE Trans. Geosci. Remote Sens.
  38. M. Ding, J. Tang, J. Zhang, Semi-supervised learning on graphs with generative adversarial nets, in: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, 2018, pp. 913–922. · DOI
  39. W. Hong, Z. Wang, M. Yang, J. Yuan, Conditional generative adversarial network for structured domain adaptation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 1335–1344. · DOI · Paper page
  40. Jang, 2018, Video prediction with appearance and motion conditions, Int. Conf. Mach. Learn.
  41. Ainam, 2019, Sparse label smoothing regularization for person re-identification, IEEE Access, 7, 27899, 10.1109/ACCESS.2019.2901599 · DOI
  42. Gomez, 2018, Unsupervised cipher cracking using discrete gans, Int. Conf. Learn. Representations
  43. Teng, 2019, Classifier-constrained deep adversarial domain adaptation for cross-domain semisupervised classification in remote sensing images, IEEE Geosci. Remote Sens. Lett., 17, 789, 10.1109/LGRS.2019.2931305 · DOI
  44. Polyak, 2018, Unsupervised generation of free-form and parameterized avatars, IEEE Trans. Pattern Anal. Mach. Intell.
  45. H. Fu, M. Gong, C. Wang, K. Batmanghelich, K. Zhang, D. Tao, Geometry-consistent generative adversarial networks for one-sided unsupervised domain mapping, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 2427–2436. · DOI · Paper page
  46. Jing, 2019, Neural style transfer: A review, IEEE Trans. Vis. Comput. Graphics
  47. Pang, 2018, Visual haze removal by a unified generative adversarial network, IEEE Trans. Circuits Syst. Video Technol., 29, 3211, 10.1109/TCSVT.2018.2880223 · DOI
  48. Li, 2017, WaterGAN: Unsupervised generative network to enable real-time color correction of monocular underwater images, IEEE Robot. Autom. Lett., 3, 387
  49. Liao, 2019, Unsupervised approaches for textual semantic annotation, A survey, ACM Comput. Surv., 52, 1, 10.1145/3324473 · DOI
  50. Spampinato, 2019, Adversarial framework for unsupervised learning of motion dynamics in videos, Int. J. Comput. Vis., 1
  51. Zhou, 2018, Lp-WGAN: Using Lp-norm normalization to stabilize wasserstein generative adversarial networks, Knowl.-Based Syst., 161, 415, 10.1016/j.knosys.2018.08.004 · DOI
  52. Lan, 2018, Demand side data generating based on conditional generative adversarial networks, Energy Procedia, 152, 1188, 10.1016/j.egypro.2018.09.157 · doi:10.1016/j.egypro.2018.09.157
  53. Dai, 2017, Calibrating energy-based generative adversarial networks, Int. Conf. Learn. Representations
  54. A.B.L. Larsen, S.K. Sønderby, H. Larochelle, O. Winther, Autoencoding beyond pixels using a learned similarity metric, in: International Conference on Machine Learning, 2016, pp. 1558–1566.
  55. Karras, 2017, Progressive growing of gans for improved quality, stability, and variation, Int. Conf. Learn. Representations
  56. Shamsolmoali, 2019, G-GANISR: Gradual generative adversarial network for image super resolution, Neurocomputing, 366, 140, 10.1016/j.neucom.2019.07.094 · DOI
  57. Zareapoor, 2019, Perceptual image quality using dual generative adversarial network, Neural Comput. Appl., 1
  58. Shamsolmoali, 2019, A novel deep structure u-net for sea-land segmentation in remote sensing images, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 12, 3219, 10.1109/JSTARS.2019.2925841 · DOI · Paper page
  59. F. Mokhayeri, K. Kamali, E. Granger, Cross-Domain face synthesis using a controllable GAN, in: The IEEE Winter Conference on Applications of Computer Vision, 2020, pp. 252–260. · DOI
  60. Wan, 2020, Deep quantization generative networks, Pattern Recognit., 10.1016/j.patcog.2020.107338 · DOI
  61. X. Mao, Q. Li, H. Xie, R.Y. Lau, Z. Wang, S. Paul Smolley, Least squares generative adversarial networks, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2794–2802. · DOI · Paper page
  62. Zhou, 2017, Activation maximization generative adversarial nets, Int. Conf. Learn. Representations
  63. P. Krähenbühl, Free supervision from video games, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 2955–2964. · DOI · Paper page
  64. S.R. Richter, Z. Hayder, V. Koltun, Playing for benchmarks, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2213–2222. · DOI · Paper page
  65. G. Varol, J. Romero, X. Martin, N. Mahmood, M.J. Black, I. Laptev, C. Schmid, Learning from synthetic humans, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 109–117. · DOI · Paper page
  66. A. Gupta, A. Vedaldi, A. Zisserman, Synthetic data for text localisation in natural images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2315–2324. · DOI · Paper page
  67. Lee, 2019, Controllable generative adversarial network, IEEE Access, 7
  68. S. Mukherjee, H. Asnani, E. Lin, S. Kannan, Clustergan: Latent space clustering in generative adversarial networks, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, 2019, pp. 4610–4617. · DOI · Paper page
  69. Zhong, 2020, Generative adversarial networks with decoder-encoder output noises, Neural Netw., 10.1016/j.neunet.2020.04.005 · DOI
  70. Aafaq, 2019, Video description: A survey of methods, datasets, and evaluation metrics, ACM Comput. Surv., 52, 1, 10.1145/3355390 · DOI · Paper page
  71. Yu, 2019, Exploiting images for video recognition: Heterogeneous feature augmentation via symmetric adversarial learning, IEEE Trans. Image Process., 28, 5308, 10.1109/TIP.2019.2917867 · DOI
  72. Tabik, 2020, MNIST–NET10: A heterogeneous deep networks fusion based on the degree of certainty to reach 0.1% error rate. ensembles overview and proposal, Inf. Fusion, 10.1016/j.inffus.2020.04.002 · DOI
  73. Zhang, 2018, Face sketch synthesis by multidomain adversarial learning, IEEE Trans. Neural Netw. Learn. Syst., 30, 1419, 10.1109/TNNLS.2018.2869574 · DOI
  74. Liu, 2020, TomoGAN: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion, J. Opt. Soc. Amer. A, 37, 422, 10.1364/JOSAA.375595 · DOI
  75. Xue, 2018, Segan: Adversarial network with multi-scale l 1 loss for medical image segmentation, Neuroinformatics, 16, 383, 10.1007/s12021-018-9377-x · DOI · Paper page
  76. Schlegl, 2019, F-anogan: Fast unsupervised anomaly detection with generative adversarial networks, Med. Image Anal., 54, 30, 10.1016/j.media.2019.01.010 · DOI · Paper page
  77. A. Osokin, A. Chessel, R.E. Carazo Salas, F. Vaggi, Gans for biological image synthesis, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2233–2242. · DOI · Paper page
  78. Yang, 2018, Low-dose CT image denoising using a generative adversarial network with wasserstein distance and perceptual loss, IEEE Trans. Med. Imaging, 37, 1348, 10.1109/TMI.2018.2827462 · DOI · Paper page
  79. Dou, 2018, Pnp-adanet: Plug-and-play adversarial domain adaptation network with a benchmark at cross-modality cardiac segmentation, IEEE Access
  80. B. Yang, H. Wen, S. Wang, R. Clark, A. Markham, N. Trigoni, 3D object reconstruction from a single depth view with adversarial learning, in: Proceedings of the IEEE International Conference on Computer Vision Workshops, 2017, pp. 679–688. · DOI · Paper page
  81. Galama, 2019, IterGANs: Iterative GANs to learn and control 3D object transformation, Comput. Vis. Image Underst., 189, 10.1016/j.cviu.2019.102803 · DOI
  82. Ma, 2019, FusionGAN: A generative adversarial network for infrared and visible image fusion, Inf. Fusion, 48, 11, 10.1016/j.inffus.2018.09.004 · DOI · Paper page
  83. Zhang, 2020, MFF–GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion, Inf. Fusion
  84. Y. Li, S. Liu, J. Yang, M.-H. Yang, Generative face completion, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 3911–3919. · DOI · Paper page
  85. C. Zheng, T.-J. Cham, J. Cai, Pluralistic image completion, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 1438–1447. · DOI · Paper page
  86. Wu, 2019, Deep portrait image completion and extrapolation, IEEE Trans. Image Process., 29, 2344, 10.1109/TIP.2019.2945866 · DOI
  87. X. Hong, P. Xiong, R. Ji, H. Fan, Deep fusion network for image completion, in: Proceedings of the 27th ACM International Conference on Multimedia, 2019, pp. 2033–2042. · DOI
  88. L. Ma, Q. Sun, S. Georgoulis, L. Van Gool, B. Schiele, M. Fritz, Disentangled person image generation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 99–108. · DOI · Paper page
  89. Z. Wang, X. Tang, W. Luo, S. Gao, Face aging with identity-preserved conditional generative adversarial networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7939–7947. · DOI · Paper page
  90. Zareapoor, 2020, Oversampling adversarial network for class-imbalanced fault diagnosis, Mech. Syst. Signal Process., 149
  91. Shamsolmoali, 2020, AMIL: Adversarial multi-instance learning for human pose estimation, ACM Trans. Multimedia Comput. Commun. Appl. (TOMM), 16, 1, 10.1145/3355612 · DOI
  92. Shamsolmoali, 2020, Imbalanced data learning by minority class augmentation using capsule adversarial networks, Neurocomputing
  93. González, 2020, Decomposition-fusion for label distribution learning, Inf. Fusion
  94. Zhang, 2018, DRCW–ASEG: One-versus-one distance-based relative competence weighting with adaptive synthetic example generation for multi-class imbalanced datasets, Neurocomputing, 285, 176, 10.1016/j.neucom.2018.01.039 · DOI
  95. J. Lin, Y. Xia, T. Qin, Z. Chen, T.-Y. Liu, Conditional image-to-image translation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 5524–5532. · DOI
  96. A. Anoosheh, E. Agustsson, R. Timofte, L. Van Gool, Combogan: Unrestrained scalability for image domain translation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 783–790. · DOI · Paper page
  97. C. Wang, H. Zheng, Z. Yu, Z. Zheng, Z. Gu, B. Zheng, Discriminative region proposal adversarial networks for high-quality image-to-image translation, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 770–785. · DOI
  98. Armanious, 2020, MedGAN: Medical image translation using GANs, Comput. Med. Imaging Graph., 79, 10.1016/j.compmedimag.2019.101684 · DOI · Paper page
  99. C. Zheng, T.-J. Cham, J. Cai, T2net: Synthetic-to-realistic translation for solving single-image depth estimation tasks, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 767–783. · DOI
  100. S. Liu, Y. Sun, D. Zhu, R. Bao, W. Wang, X. Shu, S. Yan, Face aging with contextual generative adversarial nets, in: Proceedings of the 25th ACM International Conference on Multimedia, 2017, pp. 82–90. · DOI · Paper page
  101. Engel, 2017, Latent constraints: Learning to generate conditionally from unconditional generative models, Int. Conf. Learn. Representations

Cited by

See all 173

Metadata

Authors
Shamsolmoali, P., Zareapoor, M., Granger, E., Zhou, H., Wang, R., Celebi, M. E., & Yang, J.
Venue
Information Fusion
Publisher
Elsevier BV
Published
2021-08
Volume
72
Pages
126-146
ISSN
1566-2535 (ISSN-L)
OpenAlex
W3116868395
Cited by
173
References
27
FWCI
12.17
Type
journal article
Language
en
Open access
green
Funders
National Natural Science Foundation of China

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.