The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
ClothCap: seamless 4D clothing capture and retargeting
Open accessAbstract
Designing and simulating realistic clothing is challenging. Previous methods addressing the capture of clothing from 3D scans have been limited to single garments and simple motions, lack detail, or require specialized texture patterns. Here we address the problem of capturing regular clothing on fully dressed people in motion. People typically wear multiple pieces of clothing at a time. To estimate the shape of such clothing, track it over time, and render it believably, each garment must be segmented from the others and the body. Our ClothCap approach uses a new multi-part 3D model of clothed bodies, automatically segments each piece of clothing, estimates the minimally clothed body shape and pose under the clothing, and tracks the 3D deformations of the clothing over time. We estimate the garments and their motion from 4D scans; that is, high-resolution 3D scans of the subject in motion at 60 fps. ClothCap is able to capture a clothed person in motion, extract their clothing, and retarget the clothing to new body shapes; this provides a step towards virtual try-on.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Self-citationInternational Journal of Computer Vision
(2013) · International Journal of Computer Vision · doi:10.1007/11263.1573-1405 · Cited by 2,340
Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., & Seidel, H.-P. (2004) · Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing · doi:10.1145/1057432.1057456 · Cited by 1,154
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951
Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation
Johnson, S., & Everingham, M. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.12 · Cited by 819
Articulated mesh animation from multi-view silhouettes
Vlasic, D., Baran, I., Matusik, W., & Popović, J. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360696 · Cited by 610
High-quality streamable free-viewpoint video
Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., & Sullivan, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766945 · Cited by 573
Unite the People: Closing the Loop Between 3D and 2D Human Representations
Lassner, C., Romero, J., Kiefel, M., Bogo, F., Black, M. J., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.500 · Cited by 541
Self-citationPerformance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Fusion4D: real-time performance capture of challenging scenes
Dou, M., Khamis, S., Degtyarev, Y., Davidson, P., Fanello, S. R., Kowdle, A., Escolano, S. O., Rhemann, C., Kim, D., Taylor, J., et al. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925969 · Cited by 500
Dynamic FAUST: Registering Human Bodies in Motion
Bogo, F., Romero, J., Pons-Moll, G., & Black, M. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.591 · Cited by 358
Self-citationProceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation - SCA '04
(2004) · Computer animation and simulation · doi:10.1145/1028523 · Cited by 345
Motion capture using joint skeleton tracking and surface estimation
Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H.-P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206755 · Cited by 344
Dyna: a model of dynamic human shape in motion
Pons-Moll, G., Romero, J., Mahmood, N., & Black, M. J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766993 · Cited by 323
Self-citationVolumeDeform: Real-Time Volumetric Non-rigid Reconstruction
Innmann, M., Zollhöfer, M., Nießner, M., Theobalt, C., & Stamminger, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_22 · Cited by 308
Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs
von Marcard, T., Rosenhahn, B., Black, M. J., & Pons-Moll, G. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13131 · Cited by 304
Self-citationGuan, P., Reiss, L., Hirshberg, D. A., Weiss, A., & Black, M. J. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185531 · Cited by 299
Self-citationDetailed, Accurate, Human Shape Estimation from Clothed 3D Scan Sequences
Zhang, C., Pujades, S., Black, M., & Pons-Moll, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.582 · Cited by 295
Self-citationRobinette, K. M., Blackwell, S., Daanen, H., Boehmer, M., & Fleming, S. (2002) · doi:10.21236/ada406704 · Cited by 260
Differential Representations for Mesh Processing
Sorkine, O. (2006) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2006.00999.x · Cited by 253
Human Parsing with Contextualized Convolutional Neural Network
Liang, X., Xu, C., Shen, X., Yang, J., Liu, S., Tang, J., Lin, L., & Yan, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.163 · Cited by 245
Jain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866174 · Cited by 219
The Naked Truth: Estimating Body Shape Under Clothing
Bălan, A. O., & Black, M. J. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_2 · Cited by 176
Self-citationBradley, D., Popa, T., Sheffer, A., Heidrich, W., & Boubekeur, T. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360698 · Cited by 176
Human Pose Estimation from Video and IMUs
Marcard, T. V., Pons-Moll, G., & Rosenhahn, B. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2522398 · Cited by 163
Self-citationEstimating cloth simulation parameters from video
Bhat, K. S., Twigg, C. D., Hodgins, J. K., Khosla, P. K., Popović, Z., & Seitz, S. M. (2003) · KiltHub Repository · doi:10.5555/846276.846282 · Cited by 160
Data-driven elastic models for cloth: modeling and measurement
Wang, H., O'Brien, J. F., & Ramamoorthi, R. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964966 · Cited by 159
Capturing and animating occluded cloth
White, R., Crane, K., & Forsyth, D. A. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276420 · Cited by 156
Example-based wrinkle synthesis for clothing animation
Wang, H., Hecht, F., Ramamoorthi, R., & O’Brien, J. F. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778844 · Cited by 141
Data‐Driven Estimation of Cloth Simulation Models
Miguel, E., Bradley, D., Bernhard Thomaszewski, A., Bickel, B., Matusik, W., Otaduy, M. Á., & Marschner, S. R. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03031.x · Cited by 123
Estimating the Material Properties of Fabric from Video
Bouman, K. L., Xiao, B., Battaglia, P., & Freeman, W. T. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.455 · Cited by 123
Layered image motion with explicit occlusions, temporal consistency, and depth ordering
Sun, D., Sudderth, E. B., & Black, M. J. (2010) · Cited by 116
Self-citationData-driven physics for human soft tissue animation
Kim, M., Pons‐Moll, G., Pujades, S., Bang, S., Kim, J., Black, M. J., & Lee, S. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073685 · Cited by 116
Self-citationStable spaces for real-time clothing
de Aguiar, E., Sigal, L., Treuille, A., & Hodgins, J. K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778843 · Cited by 111
Estimating body shape of dressed humans
Hasler, N., Stoll, C., Rosenhahn, B., et al. (2009) · Computers & Graphics · doi:10.1016/j.cag.2009.03.026 · Cited by 104
Capturing and animating occluded cloth
White, R., Crane, K., & Forsyth, D. A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276420 · Cited by 103
DeepGarment : 3D Garment Shape Estimation from a Single Image
Daněřek, R., Dibra, E., Öztireli, C., Ziegler, R., & Groß, M. H. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13125 · Cited by 100
Garment modeling with a depth camera
Chen, X., Zhou, B., Lu, F., Wang, L., Bi, L., & Tan, P. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818059 · Cited by 94
4D video textures for interactive character appearance
Casas, D., Volino, M., Collomosse, J. P., & Hilton, A. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12296 · Cited by 92
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866161 · Cited by 89
Physics-inspired upsampling for cloth simulation in games
Kavan, L., Gerszewski, D., Bargteil, A. W., et al. (2011) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1964921.1964988 · Cited by 88
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866161 · Cited by 88
Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H., Kautz, J., & Theobalt, C. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964927 · Cited by 88
Estimation of Human Body Shape in Motion with Wide Clothing
Yang, J., Franco, J.-S., Hétroy, F., & Wuhrer, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46493-0_27 · Cited by 85
Near-exhaustive precomputation of secondary cloth effects
Kim, D., Koh, W., Narain, R., Fatahalian, K., Treuille, A., & O’Brien, J. F. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462020 · Cited by 82
Body talk: crowdshaping realistic 3D avatars with words
Streuber, S., Quirós-Ramírez, M. A., Hill, M. Q., Hahn, C. A., Zuffi, S., O’Toole, A. J., & Black, M. J. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925981 · Cited by 75
Self-citationJain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866174 · Cited by 75
Physics-inspired upsampling for cloth simulation in games
Kavan, L., Gerszewski, D., Bargteil, A. W., et al. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964988 · Cited by 74
Body Parts Dependent Joint Regressors for Human Pose Estimation in Still Images
Dantone, M., Gall, J., Leistner, C., & Van Gool, L. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2318702 · Cited by 73
Virtual Fitting by Single-Shot Body Shape Estimation
Sekine, M., Sugita, K., Perbet, F., Stenger, B., & Nishiyama, M. (2014) · International Conference on 3D Body Scanning Technologies (3DBST) · doi:10.15221/14.406 · Cited by 69
Metric Regression Forests for Correspondence Estimation
Pons‐Moll, G., Taylor, J., Shotton, J., Hertzmann, A., & Fitzgibbon, A. W. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0818-9 · Cited by 59
Self-citationXu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H., Kautz, J., & Theobalt, C. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964927 · Cited by 58
A Layered Model of Human Body and Garment Deformation
Neophytou, A., & Hilton, A. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.52 · Cited by 56
Estimation of human body shape and posture under clothing
Wuhrer, S., Pishchulin, L., Brunton, A., Shu, C., & Lang, J. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.06.012 · Cited by 52
Real-time dynamic wrinkling of coarse animated cloth
Gillette, R., Peters, C., Vining, N., Edwards, E., & Sheffer, A. (2015) · ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) · doi:10.1145/2786784.2786789 · Cited by 42
Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture
Huang, P. F., Tejera, M., Collomosse, J. P., & Hilton, A. (2015) · ACM Transactions on Graphics · doi:10.1145/2699643 · Cited by 39
A perceptual control space for garment simulation
Sigal, L., Mahler, M., Diaz, S., McIntosh, K., Carter, E. J., Richards, T. J., & Hodgins, J. K. (2015) · ACM Transactions on Graphics · doi:10.1145/2766971 · Cited by 38
Capturing Dynamic Textured Surfaces of Moving Targets
Wang, R., Wei, L., Vouga, E., Huang, Q., Ceylan, D., Medioni, G., & Li, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_17 · Cited by 38
Garment Replacement in Monocular Video Sequences
Rogge, L., Klose, F., Stengel, M., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2634212 · Cited by 37
Animation Control of Surface Motion Capture
Tejera, M., Casas, D., & Hilton, A. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2260328 · Cited by 14
Efficient Multi-view Performance Capture of Fine-Scale Surface Detail
Robertini, N., de Aguiar, E., Helten, T., & Theobalt, C. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.46 · Cited by 8
Cited by
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00239 · Cited by 1,228
Recovering Accurate 3D Human Pose in the Wild Using IMUs and a Moving Camera
von Marcard, T., Henschel, R., Black, M. J., Rosenhahn, B., & Pons-Moll, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_37 · Cited by 1,058
Self-citationVITON: An Image-Based Virtual Try-on Network
Han, X., Wu, Z., Wu, Z., Yu, R., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00787 · Cited by 652
Shift-Net: Image Inpainting via Deep Feature Rearrangement
Yan, Z., Li, X., Li, M., Zuo, W., & Shan, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_1 · Cited by 511
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
Joo, H., Simon, T., & Sheikh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00868 · Cited by 509
Metadata
- Authors
- Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-15
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2737762407
- Cited by
- 495
- References
- 61
- FWCI
- 37.75
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.