The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Dynamic FAUST: Registering Human Bodies in Motion
Abstract
While the ready availability of 3D scan data has influenced research throughout computer vision, less attention has focused on 4D data, that is 3D scans of moving non-rigid objects, captured over time. To be useful for vision research, such 4D scans need to be registered, or aligned, to a common topology. Consequently, extending mesh registration methods to 4D is important. Unfortunately, no ground-truth datasets are available for quantitative evaluation and comparison of 4D registration methods. To address this we create a novel dataset of high-resolution 4D scans of human subjects in motion, captured at 60 fps. We propose a new mesh registration method that uses both 3D geometry and texture information to register all scans in a sequence to a common reference topology. The approach exploits consistency in texture over both short and long time intervals and deals with temporal offsets between shape and texture capture. We show how using geometry alone results in significant errors in alignment when the motions are fast and non-rigid. We evaluate the accuracy of our registration and provide a dataset of 40,000 raw and aligned meshes. Dynamic FAUST extends the popular FAUST dataset to dynamic 4D data, and is available for research purposes at http://dfaust.is.tue.mpg.de.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5 · Cited by 9,008
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Self-citationSCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
DeepFlow: Large Displacement Optical Flow with Deep Matching
Weinzaepfel, P., Revaud, J., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.175 · Cited by 997
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951
Numerical Geometry of Non-Rigid Shapes
Bronstein, A. M., Bronstein, M. M., & Kimmel, R. (2009) · Monographs in Computer Science · doi:10.1007/978-0-387-73301-2 · Cited by 734
FAUST: Dataset and Evaluation for 3D Mesh Registration
Bogo, F., Romero, J., Loper, M., & Black, M. J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.491 · Cited by 689
Self-citationArticulated mesh animation from multi-view silhouettes
Vlasic, D., Baran, I., Matusik, W., & Popović, J. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360696 · Cited by 610
High-quality streamable free-viewpoint video
Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., & Sullivan, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766945 · Cited by 573
Performance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Surface Capture for Performance-Based Animation
Starck, J., & Hilton, A. (2007) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2007.68 · Cited by 452
OpenDR: An Approximate Differentiable Renderer
Loper, M. M., & Black, M. J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_11 · Cited by 441
Self-citationReal-time non-rigid reconstruction using an RGB-D camera
Zollhöfer, M., Nießner, M., Izadi, S., Rehmann, C., Zach, C., Fisher, M., Wu, C., Fitzgibbon, A., Loop, C., Theobalt, C., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601165 · Cited by 405
A Statistical Model of Human Pose and Body Shape
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., & Seidel, H. ‐. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01373.x · Cited by 390
Motion capture using joint skeleton tracking and surface estimation
Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H.-P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206755 · Cited by 344
Robust single-view geometry and motion reconstruction
Li, H., Adams, B., Guibas, L. J., & Pauly, M. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618521 · Cited by 334
Dyna: a model of dynamic human shape in motion
Pons-Moll, G., Romero, J., Mahmood, N., & Black, M. J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766993 · Cited by 323
Self-citationThe CAESAR project: a 3-D surface anthropometry survey
Robinette, K. M., Daanen, H., & Paquet, E. (2003) · Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062) · doi:10.1109/im.1999.805368 · Cited by 294
Model-Based 3D Hand Pose Estimation from Monocular Video
de La Gorce, M., Fleet, D. J., & Paragios, N. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.33 · Cited by 268
High-quality passive facial performance capture using anchor frames
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., & Gross, M. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964970 · Cited by 238
High-quality passive facial performance capture using anchor frames
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., & Gross, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964970 · Cited by 223
Real-time high-fidelity facial performance capture
Cao, C., Bradley, D., Zhou, K., & Beeler, T. (2015) · ACM Transactions on Graphics · doi:10.1145/2766943 · Cited by 217
Boscaini, D., Masci, J., Melzi, S., Bronstein, M. M., Castellani, U., & Vandergheynst, P. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12693 · Cited by 207
Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences
Bogo, F., Black, M. J., Loper, M., & Romero, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.265 · Cited by 200
Self-citationDense Human Body Correspondences Using Convolutional Networks
Wei, L., Huang, Q., Ceylan, D., Vouga, E., & Li, H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.171 · Cited by 185
Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape
Hirshberg, D. A., Loper, M., Rachlin, E., & Black, M. J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_18 · Cited by 173
Self-citationModel-based multiple view reconstruction of people
Starck, & Hilton, A. (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238446 · Cited by 146
3D scanning deformable objects with a single RGBD sensor
Dou, M., Taylor, J., Fuchs, H., Fitzgibbon, A. W., & Izadi, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298647 · Cited by 141
The stitched puppet: A graphical model of 3D human shape and pose
Zuffi, S., & Black, M. J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298976 · Cited by 136
Self-citationReal-Time Facial Segmentation and Performance Capture from RGB Input
Saito, S., Li, T., & Li, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_15 · Cited by 127
Probabilistic Deformable Surface Tracking from Multiple Videos
Cagniart, C., Boyer, E., & Ilić, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_24 · Cited by 118
Robust Nonrigid Registration by Convex Optimization
Chen, Q., & Koltun, V. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.236 · Cited by 94
Global Non-rigid Alignment of Surface Sequences
Budd, C. J., Huang, P. F., Klaudiny, M., & Hilton, A. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0553-4 · Cited by 75
Dense correspondence finding for parametrization-free animation reconstruction from video
Ahmed, N., Theobalt, C., Rössl, C., Thrun, S., & Seidel, H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587758 · Cited by 75
Metric Regression Forests for Correspondence Estimation
Pons‐Moll, G., Taylor, J., Shotton, J., Hertzmann, A., & Fitzgibbon, A. W. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0818-9 · Cited by 53
Self-citationHuman motion synthesis from 3D video
Huang, P. F., Hilton, A., & Starck, J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206626 · Cited by 52
Dynamic surface matching by geodesic mapping for 3D animation transfer
Tung, T., & Matsuyama, T. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539806 · Cited by 50
Shape‐from‐Operator: Recovering Shapes from Intrinsic Operators
Boscaini, D., Eynard, D., Kourounis, D., & Bronstein, M. M. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12558 · Cited by 47
Drift-free tracking of rigid and articulated objects
Gall, J., Rosenhahn, B., & Seidel, H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587558 · Cited by 45
4D parametric motion graphs for interactive animation
Casas, D., Tejera, M., Guillemaut, J., & Hilton, A. (2012) · ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D) · doi:10.1145/2159616.2159633 · Cited by 40
Motion graphs for unstructured textured meshes
Prada, F., Kazhdan, M., Chuang, M., Collet, A., & Hoppe, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925967 · Cited by 40
Spatio-temporal motion tracking with unsynchronized cameras
Elhayek, A., Stoll, C., Hasler, N., et al. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247886 · Cited by 39
Global temporal registration of multiple non-rigid surface sequences
Huang, P., Budd, C., & Hilton, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995438 · Cited by 36
Capturing Dynamic Textured Surfaces of Moving Targets
Wang, R., Wei, L., Vouga, E., Huang, Q., Ceylan, D., Medioni, G., & Li, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_17 · Cited by 36
Efficient Globally Optimal 2D-to-3D Deformable Shape Matching
Lähner, Z., Rodolà, E., Schmidt, F. R., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.240 · Cited by 33
Eigen Appearance Maps of Dynamic Shapes
Boukhayma, A., Tsiminaki, V., Franco, J.-S., & Boyer, E. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_14 · Cited by 13
Cited by
Video Based Reconstruction of 3D People Models
Alldieck, T., Magnor, M., Xu, W., Theobalt, C., & Pons-Moll, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00875 · Cited by 468
Self-citationMonocular human pose estimation: A survey of deep learning-based methods
Chen, Y., Tian, Y., & He, M. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102897 · Cited by 441
SAL: Sign Agnostic Learning of Shapes From Raw Data
Atzmon, M., & Lipman, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00264 · Cited by 433
MotionBERT: A Unified Perspective on Learning Human Motion Representations
Zhu, W., Ma, X., Liu, Z., Liu, L., Wu, W., & Wang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01385 · Cited by 348
Metadata
- Authors
- Bogo, F., Romero, J., Pons-Moll, G., & Black, M. J.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 5573-5582
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2746892480
- Cited by
- 358
- References
- 48
- FWCI
- 43.43
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.