The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
VITON: An Image-Based Virtual Try-on Network
Abstract
We present an image-based VIirtual Try-On Network (VITON) without using 3D information in any form, which seamlessly transfers a desired clothing item onto the corresponding region of a person using a coarse-to-fine strategy. Conditioned upon a new clothing-agnostic yet descriptive person representation, our framework first generates a coarse synthesized image with the target clothing item overlaid on that same person in the same pose. We further enhance the initial blurry clothing area with a refinement network. The network is trained to learn how much detail to utilize from the target clothing item, and where to apply to the person in order to synthesize a photo-realistic image in which the target item deforms naturally with clear visual patterns. Experiments on our newly collected Zalando dataset demonstrate its promise in the image-based virtual try-on task over state-of-the-art generative models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks
Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., & Metaxas, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.629 · Cited by 3,021
Generative Adversarial Text to Image Synthesis
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., & Lee, H. (2016) · arXiv · doi:10.48550/arxiv.1605.05396 · Cited by 2,494
Conditional Image Synthesis With Auxiliary Classifier GANs
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 1,837
DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations
Liu, Z., Luo, P., Qiu, S., Wang, X., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.124 · Cited by 1,803
Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., & Black, M. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_34 · Cited by 1,498
Generative Visual Manipulation on the Natural Image Manifold
Zhu, J.-Y., Krähenbühl, P., Shechtman, E., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_36 · Cited by 1,171
Photographic Image Synthesis with Cascaded Refinement Networks
Chen, Q., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.168 · Cited by 887
Learning to generate chairs with convolutional neural networks
Dosovitskiy, A., Springenberg, J. T., & Brox, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298761 · Cited by 640
Effective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613
Pose Guided Person Image Generation
Ma, L., Jia, X., Sun, Q., Schiele, B., Tuytelaars, T., & Gool, L. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09368 · Cited by 590
Invertible Conditional GANs for image editing
Perarnau, G., van de Weijer, J., Raducanu, B., & Álvarez, J. M. (2016) · arXiv · doi:10.48550/arxiv.1611.06355 · Cited by 563
High-fidelity Pose and Expression Normalization for face recognition in the wild
Zhu, X., Lei, Z., Yan, J., Yi, D., & Li, S. Z. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298679 · Cited by 550
Look into Person: Self-Supervised Structure-Sensitive Learning and a New Benchmark for Human Parsing
Gong, K., Liang, X., Zhang, D., Shen, X., & Lin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.715 · Cited by 506
ClothCap: seamless 4D clothing capture and retargeting
Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073711 · Cited by 495
Where to Buy It: Matching Street Clothing Photos in Online Shops
Kiapour, M. H., Han, X., Lazebnik, S., Berg, A. C., & Berg, T. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.382 · Cited by 442
Self-citationLearning Fashion Compatibility with Bidirectional LSTMs
Han, X., Wu, Z., Jiang, Y.-G., & Davis, L. S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123394 · Cited by 325
Self-citationGuan, P., Reiss, L., Hirshberg, D. A., Weiss, A., & Black, M. J. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185531 · Cited by 299
Be Your Own Prada: Fashion Synthesis with Structural Coherence
Zhu, S., Fidler, S., Urtasun, R., Lin, D., & Loy, C. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.186 · Cited by 297
WhittleSearch: Image search with relative attribute feedback
Kovashka, A., Parikh, D., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248026 · Cited by 296
Yoo, D., Kim, N., Park, S., Paek, A. S., & Kweon, I. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_31 · Cited by 290
Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set
Liu, S., Song, Z., Wang, M., Xu, C., Lu, H., & Yan, S. (2012) · Proceedings of the 20th ACM international conference on Multimedia · doi:10.1145/2393347.2396471 · Cited by 283
StyleNet: Generating Attractive Visual Captions with Styles
Gan, C., Gan, Z., He, X., Gao, J., & Deng, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.108 · Cited by 283
Learning Visual Clothing Style with Heterogeneous Dyadic Co-Occurrences
Veit, A., Kovacs, B., Bell, S., McAuley, J., Bala, K., & Belongie, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.527 · Cited by 282
Paper Doll Parsing: Retrieving Similar Styles to Parse Clothing Items
Yamaguchi, K., Kiapour, M. H., & Berg, T. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.437 · Cited by 275
Learning Residual Images for Face Attribute Manipulation
Shen, W., & Liu, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.135 · Cited by 269
A Generative Model of People in Clothing
Lassner, C., Pons-Moll, G., & Gehler, P. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.98 · Cited by 240
Automatic Spatially-Aware Fashion Concept Discovery
Han, X., Wu, Z., Huang, P. X., Zhang, X., Zhu, M., Li, Y., Zhao, Y., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.163 · Cited by 217
Self-citationClothes Co-Parsing Via Joint Image Segmentation and Labeling With Application to Clothing Retrieval
Liang, X., Lin, L., Yang, W., Luo, P., Huang, J., & Yan, S. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2542983 · Cited by 166
Fashion Forward: Forecasting Visual Style in Fashion
Al-Halah, Z., Stiefelhagen, R., & Grauman, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.50 · Cited by 166
The Conditional Analogy GAN: Swapping Fashion Articles on People Images
Jetchev, N., & Bergmann, U. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.269 · Cited by 164
Collaborative Fashion Recommendation: A Functional Tensor Factorization Approach
Hu, Y., Yi, X., & Davis, L. S. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806239 · Cited by 158
Self-citationWarpNet: Weakly Supervised Matching for Single-View Reconstruction
Kanazawa, A., Jacobs, D. W., & Chandraker, M. K. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.354 · Cited by 151
Memory-Augmented Attribute Manipulation Networks for Interactive Fashion Search
Zhao, B., Feng, J., Wu, X. Y., & Yan, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.652 · Cited by 142
Virtual Fitting by Single-Shot Body Shape Estimation
Sekine, M., Sugita, K., Perbet, F., Stenger, B., & Nishiyama, M. (2014) · International Conference on 3D Body Scanning Technologies (3DBST) · doi:10.15221/14.406 · Cited by 69
Detailed Garment Recovery from a Single-View ImagePreprint
Yang, S., Ambert, T., Pan, Z., Wang, K., Yu, L., Berg, T. L., & Lin, M. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.01250 · Cited by 34
Cited by
MaskGAN: Towards Diverse and Interactive Facial Image Manipulation
Lee, C.-H., Liu, Z., Wu, L., & Luo, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00559 · Cited by 1,130
Toward Characteristic-Preserving Image-Based Virtual Try-On Network
Wang, B., Zheng, H., Liang, X., Chen, Y., Lin, L., & Yang, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_36 · Cited by 428
Deep 3D human pose estimation: A review
Wang, J., Tan, S., Zhen, X., Xu, S., Zheng, F., He, Z., & Shao, L. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103225 · Cited by 399
Progressive Pose Attention Transfer for Person Image Generation
Zhu, Z., Huang, T., Shi, B., Yu, M., Wang, B., & Bai, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00245 · Cited by 376
VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization
Choi, S., Park, S., Lee, M., & Choo, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01391 · Cited by 312
Metadata
- Authors
- Han, X., Wu, Z., Wu, Z., Yu, R., & Davis, L. S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 7543-7552
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964050021
- Cited by
- 652
- References
- 51
- FWCI
- 15.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.