The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style
Open accessAbstract
In this paper, we present TailorNet, a neural model which predicts clothing deformation in 3D as a function of three factors: pose, shape and style (garment geometry), while retaining wrinkle detail. This goes beyond prior models, which are either specific to one style and shape, or generalize to different shapes producing smooth results, despite being style specific. Our hypothesis is that (even non-linear) combinations of examples smoothes out high frequency components such as fine-wrinkles, which makes learning the three factors jointly hard. At the heart of our technique is a decomposition of deformation into a high frequency and a low frequency component. While the low-frequency component is predicted from pose, shape and style parameters with an MLP, the high-frequency component is predicted with a mixture of shape-style specific pose models. The weights of the mixture are computed with a narrow bandwidth kernel to guarantee that only predictions with similar high-frequency patterns are combined. The style variation is obtained by computing, in a canonical pose, a subspace of deformation, which satisfies physical constraints such as inter-penetration, and draping on the body. TailorNet delivers 3D garments which retain the wrinkles from the physics based simulations (PBS) it is learned from, while running more than 1000 times faster. In contrast to classical PBS, TailorNet is easy to use and fully differentiable, which is crucial for computer vision and learning algorithms. Several experiments demonstrate TailorNet produces more realistic results than prior work, and even generates temporally coherent deformations on sequences of the AMASS dataset, despite being trained on static poses from a different dataset. To stimulate further research in this direction, we will make a dataset consisting of 55800 frames, as well as our model publicly available at https://virtualhumans.mpi-inf.mpg.de/tailornet/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2017) · Cited by 11,625
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Terzopoulos, D., Platt, J., Barr, A., & Fleischer, K. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37427 · Cited by 1,693
Implicit fairing of irregular meshes using diffusion and curvature flow
Desbrun, M., Meyer, M., Schröder, P., & Barr, A. H. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311576 · Cited by 1,538
AMASS: Archive of Motion Capture As Surface Shapes
Mahmood, N., Ghorbani, N., Troje, N. F., Pons-Moll, G., & Black, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00554 · Cited by 1,323
Self-citationTerzopoulos, D., Platt, J., Barr, A., & Fleischer, K. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37427 · Cited by 1,110
Müller, M., Heidelberger, B., Hennix, M., & Ratcliff, J. (2007) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2007.01.005 · Cited by 927
Botsch, M., Kobbelt, L., Pauly, M., Alliez, P., & Levy, B. (2010) · A K Peters/CRC Press eBooks · doi:10.1201/b10688 · Cited by 814
Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior
Provot, X. (1995) · Cited by 701
VITON: An Image-Based Virtual Try-on Network
Han, X., Wu, Z., Wu, Z., Yu, R., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00787 · Cited by 652
Convolutional Mesh Regression for Single-Image Human Shape Reconstruction
Kolotouros, N., Pavlakos, G., & Daniilidis, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00463 · Cited by 548
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
Joo, H., Simon, T., & Sheikh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00868 · Cited by 509
ClothCap: seamless 4D clothing capture and retargeting
Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073711 · Cited by 495
Self-citationVideo Based Reconstruction of 3D People Models
Alldieck, T., Magnor, M., Xu, W., Theobalt, C., & Pons-Moll, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00875 · Cited by 468
Self-citationMulti-Garment Net: Learning to Dress 3D People From Images
Bhatnagar, B., Tiwari, G., Theobalt, C., & Pons-Moll, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00552 · Cited by 439
Self-citationLearning to Dress 3D People in Generative Clothing
Ma, Q., Yang, J., Ranjan, A., Pujades, S., Pons-Moll, G., Tang, S., & Black, M. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00650 · Cited by 364
Self-citationTex2Shape: Detailed Full Human Body Geometry From a Single Image
Alldieck, T., Pons-Moll, G., Theobalt, C., & Magnor, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00238 · Cited by 332
Self-citationLearning to Reconstruct People in Clothing From a Single RGB Camera
Alldieck, T., Magnor, M., Bhatnagar, B. L., Theobalt, C., & Pons-Moll, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00127 · Cited by 326
Self-citationDyna: a model of dynamic human shape in motion
Pons-Moll, G., Romero, J., Mahmood, N., & Black, M. J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766993 · Cited by 323
Self-citationGuan, P., Reiss, L., Hirshberg, D. A., Weiss, A., & Black, M. J. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185531 · Cited by 299
Be Your Own Prada: Fashion Synthesis with Structural Coherence
Zhu, S., Fidler, S., Urtasun, R., Lin, D., & Loy, C. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.186 · Cited by 297
A Generative Model of People in Clothing
Lassner, C., Pons-Moll, G., & Gehler, P. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.98 · Cited by 240
Self-citationLiveCap: Real-Time Human Performance Capture From Monocular Video
Habermann, M., Xu, W., Zollhöfer, M., Pons-Moll, G., & Theobalt, C. (2019) · ACM Transactions on Graphics · doi:10.1145/3311970 · Cited by 230
Self-citationGuide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database
Torre, F. D. L., Hodgins, J. K., Bargteil, A. W., Martin, X., Macey, J., Collado, A., & Beltran, P. (2018) · KiltHub Repository · doi:10.1184/r1/6555020 · Cited by 228
Deformable Shape Completion with Graph Convolutional Autoencoders
Litany, O., Bronstein, A., Bronstein, M., & Makadia, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00202 · Cited by 226
DeepWrinkles: Accurate and Realistic Clothing Modeling
Lähner, Z., Cremers, D., & Tung, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_41 · Cited by 225
Towards Multi-Pose Guided Virtual Try-On Network
Dong, H., Liang, X., Shen, X., Wang, B., Lai, H., Zhu, J., Hu, Z., & Yin, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00912 · Cited by 213
Learning‐Based Animation of Clothing for Virtual Try‐On
Santesteban, I., Otaduy, M. A., & Casas, D. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13643 · Cited by 189
Multi-View Image Generation from a Single-View
Zhao, B., Wu, X., Cheng, Z.-Q., Liu, H., Jie, Z., & Feng, J. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240536 · Cited by 189
Data‐Driven Estimation of Cloth Simulation Models
Miguel, E., Bradley, D., Thomaszewski, B., Bickel, B., Matusik, W., Otaduy, M. Á., & Marschner, S. R. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03031.x · Cited by 169
VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation
Yu, R., Wang, X., & Xie, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01061 · Cited by 168
Physics-Inspired Garment Recovery from a Single-View Image
Yang, S., Pan, Z., Amert, T., Wang, K., Yu, L., Berg, T. L., & Lin, M. C. (2018) · ACM Transactions on Graphics · doi:10.1145/3026479 · Cited by 164
FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On
Dong, H., Liang, X., Shen, X., Wu, B., Chen, B.-C., & Yin, J. P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00125 · Cited by 163
Photo Wake-Up: 3D Character Animation From a Single Photo
Weng, C.-Y., Curless, B., & Kemelmacher-Shlizerman, I. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00606 · Cited by 160
Data-driven elastic models for cloth: modeling and measurement
Wang, H., O'Brien, J. F., & Ramamoorthi, R. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964966 · Cited by 159
GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping
Gündoğdu, E., Constantin, V., Seifoddini, A., Dang, M., Salzmann, M., & Fua, P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00883 · Cited by 159
Anisotropic elastoplasticity for cloth, knit and hair frictional contact
Jiang, C., Gast, T. F., & Teran, J. M. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073623 · Cited by 157
Learning to Transfer Texture From Clothing Images to 3D Humans
Mir, A., Alldieck, T., & Pons‐Moll, G. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00705 · Cited by 151
Self-citationLearning a shared shape space for multimodal garment design
Wang, T. Y., Ceylan, D., Popović, J., & Mitra, N. J. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275074 · Cited by 147
Example-based wrinkle synthesis for clothing animation
Wang, H., Hecht, F., Ramamoorthi, R., & O’Brien, J. F. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778844 · Cited by 141
Shysheya, A., Zakharov, E., Aliev, K.-A., Bashirov, R., Burkov, E., Iskakov, K., Ivakhnenko, A., Malkov, Y. A., Pasechnik, I., Ulyanov, D., et al. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00249 · Cited by 121
Stable spaces for real-time clothing
de Aguiar, E., Sigal, L., Treuille, A., & Hodgins, J. K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778843 · Cited by 120
SimulCap : Single-View Human Performance Capture With Cloth Simulation
Yu, T., Zheng, Z., Zhong, Y., Zhao, J., Dai, Q., Pons‐Moll, G., & Liu, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00565 · Cited by 118
Self-citation4D video textures for interactive character appearance
Casas, D., Volino, M., Collomosse, J., & Hilton, A. (2014) · Computer graphics forum (Print) · doi:10.1111/cgf.12296 · Cited by 110
SwapNet: Image Based Garment Transfer
Raj, A., Sangkloy, P., Chang, H., Hays, J. H., Ceylan, D., & Lu, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_41 · Cited by 108
Zanfir, M., Popa, A.-I., Zanfir, A., & Sminchisescu, C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00565 · Cited by 102
Physics-inspired upsampling for cloth simulation in games
Kavan, L., Gerszewski, D., Bargteil, A. W., & Sloan, P. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964988 · Cited by 101
Near-exhaustive precomputation of secondary cloth effects
Kim, D., Koh, W., Narain, R., Fatahalian, K., Treuille, A., & O’Brien, J. F. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462020 · Cited by 93
Fashion++: Minimal Edits for Outfit Improvement
Hsiao, W.-L., Katsman, I., Wu, C.-Y., Parikh, D., & Grauman, K. L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00515 · Cited by 93
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866161 · Cited by 89
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866161 · Cited by 89
Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H., Kautz, J., & Theobalt, C. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964927 · Cited by 88
Analyzing Clothing Layer Deformation Statistics of 3D Human Motions
Yang, J., Franco, J.-S., Hétroy, F., & Wuhrer, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_15 · Cited by 68
Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H., Kautz, J., & Theobalt, C. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964927 · Cited by 58
A Layered Model of Human Body and Garment Deformation
Neophytou, A., & Hilton, A. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.52 · Cited by 56
A Pixel‐Based Framework for Data‐Driven Clothing
Jin, N., Zhu, Y., Geng, Z., & Fedkiw, R. P. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14108 · Cited by 52
DeepWrinkles: Accurate and Realistic Clothing ModelingPreprint
Lähner, Z., Cremers, D., & Tung, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03417 · Cited by 51
Real-time dynamic wrinkling of coarse animated cloth
Gillette, R., Peters, C., Vining, N., Edwards, E., & Sheffer, A. (2015) · ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) · doi:10.1145/2786784.2786789 · Cited by 42
A perceptual control space for garment simulation
Sigal, L., Mahler, M., Diaz, S., McIntosh, K., Carter, E. J., Richards, T. J., & Hodgins, J. K. (2015) · ACM Transactions on Graphics · doi:10.1145/2766971 · Cited by 38
Example-based wrinkle synthesis for clothing animation
Wang, H., Hecht, F., Ramamoorthi, R., & O’Brien, J. F. (2010) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1833349.1778844 · Cited by 36
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion
Chibane, J., Alldieck, T., & Pons-Moll, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00700 · Cited by 509
Self-citationVITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization
Choi, S., Park, S., Lee, M., & Choo, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01391 · Cited by 312
BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion
Black, M. J., Patel, P., Tesch, J., & Yang, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00843 · Cited by 148
“Several methods drape clothing on the 3D body to create datasets for learning 3D clothing deformations [12,27,61,75,85].”
BackgroundMethodMesh-based Dynamics with Occlusion Reasoning for Cloth Manipulation
Huang, Z., Lin, X., & Held, D. (2022) · Robotics: Science and Systems XVIII · doi:10.15607/rss.2022.xviii.011 · Cited by 39
Metadata
- Authors
- Patel, C., Liao, Z., & Pons-Moll, G.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 7363-7373
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3011319948
- Cited by
- 301
- References
- 61
- FWCI
- 40.52
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.