Cited by 29Generative Adversarial Networks and Image SynthesisAdvanced Neural Network Applications3D Shape Modeling and Analysis

The DOI matches its Crossref record.

MV-TON: Memory-based Video Virtual Try-on network

Open access
Zhong, Xiaojing, Wu, Zhonghua, Tan, Taizhe, Lin, Guosheng, Wu, Qingyao·2021·Proceedings of the 29th ACM International Conference on Multimedia

Abstract

With the development of Generative Adversarial Network, image-based virtual try-on methods have made great progress. However, limited work has explored the task of video-based virtual try-on while it is important in real-world applications. Most existing video-based virtual try-on methods usually require clothing templates and they can only generate blurred and low-resolution results. To address these challenges, we propose a Memory-based Video virtual Try-On Network (MV-TON), which seamlessly transfers desired clothes to a target person without using any clothing templates and generates high-resolution realistic videos. Specifically, MV-TON consists of two modules: 1) a try-on module that transfers the desired clothes from model images to frame images by pose alignment and region-wise replacing of pixels; 2) a memory refinement module that learns to embed the existing generated frames into the latent space as external memory for the following frame generation. Experimental results show the effectiveness of our method in the video virtual try-on task and its superiority over other existing methods.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3474085.3475269

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 39

  1. Albahar Badour, 2019, Guided Image-to-Image Translation With Bi-Directional Feature Transformation. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  2. T. Brox A. Bruhn N. Papenberg and J. Weickert. 2004. High Accuracy Optical Flow Estimation Based on a Theory for Warping. In ECCV. T. Brox A. Bruhn N. Papenberg and J. Weickert. 2004. High Accuracy Optical Flow Estimation Based on a Theory for Warping. In ECCV. · DOI
  3. 10.1109/CVPR.2017.143 · DOI · Paper page
  4. Dong Haoye, 2018, Soft-gated warping-gan for pose-guided person image synthesis. arXiv preprint arXiv:1810.11610 · arXiv
  5. Dong Haoye, 2019, FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  6. Dong Haoye, 2019, Towards Multi-Pose Guided Virtual Try-On Network. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  7. Ke Gong Xiaodan Liang Y. Li Y. Chen Ming Yang and L. Lin. 2018. Instance-level Human Parsing via Part Grouping Network. ArXiv abs/1808.00157 (2018). Ke Gong Xiaodan Liang Y. Li Y. Chen Ming Yang and L. Lin. 2018. Instance-level Human Parsing via Part Grouping Network. ArXiv abs/1808.00157 (2018). · DOI
  8. 10.5555/2969033.2969125 · DOI
  9. 10.1145/2185520.2185531 · DOI
  10. 10.1109/CVPR.2018.00787 · DOI
  11. 10.5555/3295222.3295408 · DOI
  12. 10.1145/3343031.3351075 · DOI
  13. Isola Phillip, 2017, Image-to- Image Translation with Conditional Adversarial Networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  14. J. Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In ECCV. J. Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In ECCV. · DOI · Paper page
  15. Kanazawa A., 2018, End-to-End Recovery of Human Shape and Pose. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  16. 10.5555/3045390.3045536 · DOI
  17. Lee J., 2019, SFNet: Learning Object-Aware Semantic Correspondence. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  18. Li Y., 2019, Dense Intrinsic Appearance Flow for Human Pose Transfer. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  19. 10.5555/3294771.3294810 · DOI
  20. Ma Liqian, 2018, Disentangled Person Image Generation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  21. Miao Jiaxu, 2020, Memory Aggregation Networks for Efficient Interactive Video Object Segmentation. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  22. Alexander H. Miller A. Fisch Jesse Dodge Amir-Hossein Karimi Antoine Bordes and J. Weston. 2016. Key-Value Memory Networks for Directly Reading Documents. In EMNLP. Alexander H. Miller A. Fisch Jesse Dodge Amir-Hossein Karimi Antoine Bordes and J. Weston. 2016. Key-Value Memory Networks for Directly Reading Documents. In EMNLP. · DOI
  23. Mirza Mehdi, 2014, Conditional Generative Adversarial Nets. ArXiv abs/1411.1784 · arXiv
  24. 10.1109/ICCV.2017.80 · DOI
  25. Oh S., 2019, Video Object Segmentation Using Space-Time Memory Networks. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  26. 10.1145/3072959.3073711 · DOI
  27. Radford A., 2016, Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. CoRR abs/1511.06434 · arXiv
  28. A. Raj Patsorn Sangkloy Huiwen Chang James Hays D. Ceylan and Jingwan Lu. 2018. SwapNet: Image Based Garment Transfer. In ECCV. A. Raj Patsorn Sangkloy Huiwen Chang James Hays D. Ceylan and Jingwan Lu. 2018. SwapNet: Image Based Garment Transfer. In ECCV. · DOI
  29. Masahiro Sekine K. Sugita Frank Perbet B. Stenger and M. Nishiyama. 2014. Virtual Fitting by Single-Shot Body Shape Estimation. Masahiro Sekine K. Sugita Frank Perbet B. Stenger and M. Nishiyama. 2014. Virtual Fitting by Single-Shot Body Shape Estimation. · DOI
  30. Siarohin Aliaksandr, 2018, Deformable GANs for Pose-Based Human Image Generation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  31. 10.1109/CVPR.2016.308 · DOI · Paper page
  32. S. Tripathy Juho Kannala and Esa Rahtu. 2018. Learning image-to-image translation using paired and unpaired training samples. In ACCV. S. Tripathy Juho Kannala and Esa Rahtu. 2018. Learning image-to-image translation using paired and unpaired training samples. In ACCV. · DOI
  33. 10.1007/978-3-030-01261-8_36 · DOI
  34. Wang T., 2018, High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  35. 10.1016/j.imavis.2019.08.005 · DOI
  36. 10.1145/3343031.3351083 · DOI
  37. 10.1109/CVPR42600.2020.01295 · DOI
  38. Yang Tianyu, 2018, Chan
  39. Yu Ruiyun, 2019, VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)

Cited by

Metadata

Authors
Zhong, X., Wu, Z., Tan, T., Lin, G., & Wu, Q.
Affiliations
  • South China University of Technology (CN)
  • Nanyang Technological University (SG)
  • Guangdong University of Technology (CN)
Venue
Proceedings of the 29th ACM International Conference on Multimedia
Publisher
ACM
Published
2021-10-17
Pages
908-916
OpenAlex
W3195594845
Cited by
29
References
0
Citations by year
2026: 2 · 2025: 7 · 2024: 10 · 2023: 5 · 2022: 4 · 2021: 1
FWCI
1.64
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Multimedia (ACM MM) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • MOE Tier-1 research grants (RG22/19 (S), RG95/20, RG28/18 (S))
  • Central Universities of China (D2192860)
  • Key-Area Research and Development Program of Guangdong Province (2018B010108002)
  • RIE2020 Industry Alignment Fund - Industry Collabo- ration Projects (NA)
  • National Natural Science Foundation of China (61876208)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
Keywords
external memory, pose alignment, high-resolution video generation, latent space embedding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review