CoChat
Sign Up
PreprintCited by 563Generative Adversarial Networks and Image SynthesisDigital Media Forensic DetectionFace recognition and analysis

Invertible Conditional GANs for image editing

Open access
Perarnau, Guim, van de Weijer, Joost, Raducanu, Bogdan, Álvarez, Jose M.·2016·arXiv
DOI 10.48550/arxiv.1611.06355arXiv 1611.06355
Open this paper in CoChat — free accountOpen PDF

Abstract

Generative Adversarial Networks (GANs) have recently demonstrated to successfully approximate complex data distributions. A relevant extension of this model is conditional GANs (cGANs), where the introduction of external information allows to determine specific representations of the generated images. In this work, we evaluate encoders to inverse the mapping of a cGAN, i.e., mapping a real image into a latent space and a conditional representation. This allows, for example, to reconstruct and modify real images of faces conditioning on arbitrary attributes. Additionally, we evaluate the design of cGANs. The combination of an encoder with a cGAN, which we call Invertible cGAN (IcGAN), enables to re-generate real images with deterministic complex modifications.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1611.06355

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • IcGAN can be time-consuming when it aims to perform the manipulation of multiple facial attributes since each attribute is addressed via an independent deep model.

    “Although effective, IcGAN can be time-consuming when it aims to perform the manipulation of multiple facial attributes since each attribute is addressed via an independent deep model.”

    From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Perarnau et al. 2016

    The paper describes two independent encoders—one for the latent representation z and one for the attribute information y—not a separate deep model for each facial attribute (Section 4.1, p. 3; Section 6, p. 8). It demonstrates edits across 18 CelebA attributes by modifying y (Section 5.4, p. 7). The copy does not assess whether editing multiple attributes is time-consuming, but it contradicts the claimed reason. (LLM, conf=0.86)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • Perarnau et al. start the first work for attribute manipulation, denoted as IcGAN.

    “Perarnau et al. (2016) start the first work for attribute manipulation, which is denoted as IcGAN.”

    From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Perarnau et al. 2016

    The Introduction and §4 identify this paper’s model as IcGAN and say it permits manipulation of image attributes. But §4 claims priority only for incorporating conditional information into the encoding process; the Introduction says earlier cGANs could already control generated-image features. The broader claim that this was the first work on attribute manipulation is not supported. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • IcGAN is the earliest attempt in GAN-based facial attribute manipulation.

    “Invertible conditional GAN (IcGAN) (Perarnau et al. 2016) is the earliest attempt in GAN-based facial attribute manipulation.”

    From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Perarnau et al. 2016

    The Introduction and §5.4 show that IcGAN manipulates facial attributes in real images. Section 4 claims a narrower first: including conditional information in the GAN encoding process. Our copy does not establish that IcGAN was the earliest GAN-based attempt at facial attribute manipulation overall. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 17

  1. [1][1] K. Gregor, I. Danihelka, A. Graves, D. Jimenez Rezende, and D. Wierstra, "DRAW: A Recurrent Neural Network For Image Generation," International Conference on Machine Learning (ICML), pp. 1462–1471, 2015.
  2. [2][2] A. Radford, L. Metz, and S. Chintala, "Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks," International Conference on Learning Representations (ICLR), 2016.
  3. [3][3] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," in Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds. Curran Associates, Inc., 2014, pp. 2672–2680. [Online]. Available: http://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf
  4. [4][4] D. P. Kingma and M. Welling, "Auto-encoding variational bayes," International Conference on Learning Representations (ICLR), 2014. [Online]. Available: http://arxiv.org/abs/1312.6114 · arXiv
  5. [5][5] Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," in Proceedings of the IEEE, 1998, pp. 2278–2324.
  6. [6][6] Z. Liu, P. Luo, X. Wang, and X. Tang, "Deep learning face attributes in the wild," in Proceedings of International Conference on Computer Vision (ICCV), December 2015.
  7. [7][7] D. J. Rezende, S. Mohamed, and D. Wierstra, "Stochastic backpropagation and approximate inference in deep generative models," Proceedings of the 31st International Conference on Machine Learning (ICML), vol. 32, pp. 1278–1286, 2014.
  8. [8][8] D. P. Kingma, D. J. Rezende, S. Mohamed, and M. Welling, "Semi-supervised learning with deep generative models," Proceedings of Neural Information Processing Systems (NIPS), 2014. [Online]. Available: http://arxiv.org/abs/1406.5298 · arXiv
  9. [9][9] T. Salimans, I. J. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen, "Improved techniques for training GANs," Neural Information Processing Systems (NIPS), 2016. [Online]. Available: http://arxiv.org/abs/1606.03498 · arXiv
  10. [10][10] X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel, "InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets," Neural Information Processing Systems (NIPS), 2016. [Online]. Available: http://arxiv.org/abs/1606.03657 · arXiv
  11. [11][11] S. Reed, Z. Akata, S. Mohan, S. Tenka, B. Schiele, and H. Lee, "Learning what and where to draw," in Advances in Neural Information Processing Systems (NIPS), 2016.
  12. [12][12] V. Dumoulin, I. Belghazi, B. Poole, A. Lamb, M. Arjovsky, O. Mastropietro, and A. Courville, "Adversarially Learned Inference," Arxiv, 2016. [Online]. Available: http://arxiv.org/abs/1606.00704 · arXiv
  13. [13][13] J. Donahue, P. Krähenbühl, and T. Darrell, "Adversarial feature learning," CoRR, vol. abs/1605.09782, 2016. [Online]. Available: http://arxiv.org/abs/1605.09782 · arXiv
  14. [14][14] A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow, "Adversarial autoencoders," in International Conference on Learning Representations (ICLR), 2016. [Online]. Available: http://arxiv.org/abs/1511. 05644
  15. [15][15] A. B. L. Larsen, S. K. Sønderby, and O. Winther, "Autoencoding beyond pixels using a learned similarity metric," Proceedings of the 33rd International Conference on Machine Learning (ICML), pp. 1558–1566, 2015. [Online]. Available: http://arxiv.org/abs/1512.09300 · arXiv
  16. [16][16] S. E. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee, "Generative adversarial text to image synthesis," International Conference on Machine Learning (ICML), 2016. [Online]. Available: http://arxiv.org/abs/1605.05396 · arXiv
  17. [17][17] M. Mirza and S. Osindero, "Conditional Generative Adversarial Nets," CoRR, vol. abs/1411.1784, 2014. [Online]. Available: http://arxiv.org/abs/1411.1784 · arXiv

Cited by

Sorted by citations

Authors
Perarnau, G., van de Weijer, J., Raducanu, B., & Álvarez, J. M.
ORCID
Raducanu, Bogdan
Venue
arXiv
Publisher
arXiv
Published
2016
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1611.06355
arXiv
1611.06355
OpenAlex
W2552611751
Cited by
563
References
1
Citations by year
2026: 2 · 2025: 12 · 2024: 33 · 2023: 51 · 2022: 52 · 2021: 111 · 2020: 120 · 2019: 89 · 2018: 75 · 2017: 17
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
Keywords
conditional generative adversarial networks, image editing, image reconstruction, latent space encoding, encoder design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review