The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Detailed, Accurate, Human Shape Estimation from Clothed 3D Scan Sequences
Open accessAbstract
We address the problem of estimating human pose and body shape from 3D scans over time. Reliable estimation of 3D body shape is necessary for many applications including virtual try-on, health monitoring, and avatar creation for virtual reality. Scanning bodies in minimal clothing, however, presents a practical barrier to these applications. We address this problem by estimating body shape under clothing from a sequence of 3D scans. Previous methods that have exploited body models produce smooth shapes lacking personalized details. We contribute a new approach to recover a personalized shape of the person. The estimated shape deviates from a parametric model to fit the 3D scans. We demonstrate the method using high quality 4D data as well as sequences of visual hulls extracted from multi-view images. We also make available BUFF, a new 4D dataset that enables quantitative evaluation (http://buff.is.tue.mpg.de). Our method outperforms the state of the art in both pose estimation and shape estimation, qualitatively and quantitatively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5 · Cited by 9,008
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Self-citationWei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., & Black, M. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_34 · Cited by 1,498
Self-citationSCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951
3-D model-based tracking of humans in action: a multi-view approach
Gavrila, D. M., & Davis, L. S. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517056 · Cited by 702
Holoportation: Virtual 3D Teleportation in Real-time
Orts-Escolano, S., Rhemann, C., Fanello, S., Chang, W., Kowdle, A., Degtyarev, Y., Kim, D., Davidson, P. L., Khamis, S., Dou, M., et al. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984517 · Cited by 662
Unite the People: Closing the Loop Between 3D and 2D Human Representations
Lassner, C., Romero, J., Kiefel, M., Bogo, F., Black, M. J., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.500 · Cited by 541
Self-citationPerformance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Fusion4D: real-time performance capture of challenging scenes
Dou, M., Khamis, S., Degtyarev, Y., Davidson, P., Fanello, S. R., Kowdle, A., Escolano, S. O., Rhemann, C., Kim, D., Taylor, J., et al. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925969 · Cited by 500
ClothCap: seamless 4D clothing capture and retargeting
Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073711 · Cited by 495
Self-citationSCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073207 · Cited by 410
Real-time non-rigid reconstruction using an RGB-D camera
Zollhöfer, M., Nießner, M., Izadi, S., Rehmann, C., Zach, C., Fisher, M., Wu, C., Fitzgibbon, A., Loop, C., Theobalt, C., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601165 · Cited by 405
Sigal, L., Bhatia, S., Roth, S., Black, M. J., & Isard, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315063 · Cited by 391
Self-citationA Statistical Model of Human Pose and Body Shape
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., & Seidel, H. ‐. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01373.x · Cited by 390
Dyna: a model of dynamic human shape in motion
Pons-Moll, G., Romero, J., Mahmood, N., & Black, M. J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766993 · Cited by 323
Self-citationDetailed Human Shape and Pose from Images
Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., & Haussecker, H. W. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383340 · Cited by 308
Self-citationHome 3D body scans from noisy image and range data
Weiss, A., Hirshberg, D., & Black, M. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126465 · Cited by 306
Self-citationSparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs
von Marcard, T., Rosenhahn, B., Black, M. J., & Pons-Moll, G. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13131 · Cited by 304
Self-citationOptimization and Filtering for Human Motion Capture: A Multi-Layer Framework
Gall, J., Rosenhahn, B., Brox, T., & Seidel, H.-P. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0173-1 · Cited by 229
Jain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866174 · Cited by 219
Fast articulated motion tracking using a sums of Gaussians body model
Stoll, C., Hasler, N., Gall, J., Seidel, H.-P., & Theobalt, C. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126338 · Cited by 211
Building statistical shape spaces for 3D human modeling
Pishchulin, L., Wuhrer, S., Helten, T., Theobalt, C., & Schiele, B. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.018 · Cited by 210
Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences
Bogo, F., Black, M. J., Loper, M., & Romero, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.265 · Cited by 200
Self-citationThe Naked Truth: Estimating Body Shape Under Clothing
Bălan, A. O., & Black, M. J. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_2 · Cited by 176
Self-citationReal-Time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera
Ye, M., & Yang, R. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.301 · Cited by 164
Human Pose Estimation from Video and IMUs
Marcard, T. V., Pons-Moll, G., & Rosenhahn, B. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2522398 · Cited by 163
Self-citationThe stitched puppet: A graphical model of 3D human shape and pose
Zuffi, S., & Black, M. J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298976 · Cited by 136
Self-citationArticulated soft objects for video-based body modeling
Plankers, R., & Fua, P. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937545 · Cited by 118
Estimating body shape of dressed humans
Hasler, N., Stoll, C., Rosenhahn, B., et al. (2009) · Computers & Graphics · doi:10.1016/j.cag.2009.03.026 · Cited by 104
Data-driven modeling of skin and muscle deformation
Park, S. I., & Hodgins, J. K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360695 · Cited by 102
General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues
Rhodin, H., Robertini, N., Casas, D., Richardt, C., Seidel, H., & Theobalt, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_31 · Cited by 98
Personalization and Evaluation of a Real-Time Depth-Based Full Body Tracker
Helten, T., Baak, A., Bharaj, G., Müller, M., Seidel, H., & Theobalt, C. (2013) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2013.44 · Cited by 97
Tensor-Based Human Body Modeling
Chen, Y., Liu, Z., & Zhang, Z. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.21 · Cited by 95
Quality Dynamic Human Body Modeling Using a Single Low-Cost Depth Camera
Zhang, Q., Fu, B., Ye, M., & Yang, R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.92 · Cited by 93
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866161 · Cited by 89
Video-based reconstruction of animatable human characters
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866161 · Cited by 88
Estimation of Human Body Shape in Motion with Wide Clothing
Yang, J., Franco, J.-S., Hétroy, F., & Wuhrer, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46493-0_27 · Cited by 85
A Layered Model of Human Body and Garment Deformation
Neophytou, A., & Hilton, A. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.52 · Cited by 56
Metric Regression Forests for Correspondence Estimation
Pons‐Moll, G., Taylor, J., Shotton, J., Hertzmann, A., & Fitzgibbon, A. W. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0818-9 · Cited by 53
Self-citationEstimation of human body shape and posture under clothing
Wuhrer, S., Pishchulin, L., Brunton, A., Shu, C., & Lang, J. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.06.012 · Cited by 52
Pons‐Moll, G., & Rosenhahn, B. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_9 · Cited by 50
Self-citationA 2D Human Body Model Dressed in Eigen Clothing
Guan, P., Freifeld, O., & Black, M. J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_21 · Cited by 46
Self-citationSparse Inertial PoserPreprint
von MarcardT., RosenhahnB., BlackM., J., & Pons-MollG. (2017) · arXiv (Cornell University) · Cited by 42
Shape from Selfies: Human Body Shape Estimation Using CCA Regression Forests
Dibra, E., Öztireli, C., Ziegler, R., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46493-0_6 · Cited by 39
3D Body Shapes Estimation from Dressed‐Human Silhouettes
Song, D., Tong, R., Chang, J. M., Yang, X., Tang, M. A., & Zhang, J. (2016) · Computer Graphics Forum · doi:10.1111/cgf.13012 · Cited by 32
Cited by
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00239 · Cited by 1,228
Recovering Accurate 3D Human Pose in the Wild Using IMUs and a Moving Camera
von Marcard, T., Henschel, R., Black, M. J., Rosenhahn, B., & Pons-Moll, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_37 · Cited by 1,058
Self-citationPIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
Saito, S., Simon, T., Saragih, J., & Joo, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00016 · Cited by 793
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
Joo, H., Simon, T., & Sheikh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00868 · Cited by 509
Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion
Chibane, J., Alldieck, T., & Pons-Moll, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00700 · Cited by 509
Self-citation
Metadata
- Authors
- Zhang, C., Pujades, S., Black, M., & Pons-Moll, G.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 5484-5493
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2596210417
- Cited by
- 295
- References
- 50
- FWCI
- 43.43
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.