The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Motion capture using joint skeleton tracking and surface estimation
Abstract
This paper proposes a method for capturing the performance of a human or an animal from a multi-view video sequence. Given an articulated template model and silhouettes from a multi-view image sequence, our approach recovers not only the movement of the skeleton, but also the possibly non-rigid temporal deformation of the 3D surface. While large scale deformations or fast movements are captured by the skeleton pose and approximate surface skinning, true small scale deformations or non-rigid garment motion are captured by fitting the surface to the silhouette. We further propose a novel optimization scheme for skeleton-based pose estimation that exploits the skeleton's tree structure to split the optimization problem into a local one and a lower dimensional global one. We show on various sequences that our approach can capture the 3D motion of animals and humans accurately even in the case of rapid movements and wide apparel like skirts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Synthesis and evaluation of linear motion transitions
Wang, J., & Bodenheimer, B. (2008) · ACM Transactions on Graphics · doi:10.1145/1330511.1330512 · Cited by 1,534
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Sigal, L., Balan, A. O., & Black, M. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0273-6 · Cited by 1,164
3-D model-based tracking of humans in action: a multi-view approach
Gavrila, D. M., & Davis, L. S. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517056 · Cited by 702
Articulated mesh animation from multi-view silhouettes
Vlasic, D., Baran, I., Matusik, W., & Popović, J. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360696 · Cited by 610
On Linear Variational Surface Deformation Methods
Botsch, M., & Sorkine, O. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.1054 · Cited by 582
Performance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Self-citationAutomatic rigging and animation of 3D characters
Baran, I., & Popović, J. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276467 · Cited by 495 · cited 1×
“Thereafter, weights ρ i,k are automatically computed for each V i which describe the association of V i with each bone k [5].”
MethodAutomatic rigging and animation of 3D characters
Baran, I., & Popović, J. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276467 · Cited by 455
Articulated Body Motion Capture by Stochastic Search
Deutscher, J., & Reid, I. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000043757.18370.9c · Cited by 412
Geometric skinning with approximate dual quaternion blending
Kavan, L., Collins, S., Žára, J., & O'Sullivan, C. (2008) · ACM Transactions on Graphics · doi:10.1145/1409625.1409627 · Cited by 385
HumanEva: Synchronized video and Motion Capture Dataset for Evaluation of Articulated Human Motion
Sigal, L., Bălan, A. O., & Black, M. J. (2006) · Cited by 356
Corazza, S., Mündermann, L., Chaudhari, A. M., Demattio, T., Cobelli, C., & Andriacchi, T. P. (2006) · Annals of Biomedical Engineering · doi:10.1007/s10439-006-9122-8 · Cited by 325
Detailed Human Shape and Pose from Images
Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., & Haussecker, H. W. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383340 · Cited by 308
Estimating Articulated Human Motion With Covariance Scaled Sampling
Sminchisescu, C., & Triggs, B. (2003) · The International Journal of Robotics Research · doi:10.1177/027836403128965132 · Cited by 244
Optimization and Filtering for Human Motion Capture: A Multi-Layer Framework
Gall, J., Rosenhahn, B., Brox, T., & Seidel, H.-P. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0173-1 · Cited by 229
Self-citationTwist Based Acquisition and Tracking of Animal and Human Kinematics
Bregler, C., Malik, J., & Pullen, K. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011203.00237.9b · Cited by 197
The Naked Truth: Estimating Body Shape Under Clothing
Bălan, A. O., & Black, M. J. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_2 · Cited by 176
Articulated soft objects for multiview shape and motion capture
Plankers, R., & Fua, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227995 · Cited by 158
Model-based multiple view reconstruction of people
Starck, & Hilton, A. (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238446 · Cited by 146
Cheung, K.-M., Baker, S., & Takeo Kanade, A. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6879-4 · Cited by 140
Marker-less Deformable Mesh Tracking for Human Shape and Motion Capture
de Aguiar, E., Theobalt, C., Stoll, C., & Seidel, H. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383296 · Cited by 106
Self-citationBallan, L., & Cortelazzo, G. M. (2008) · Cited by 85
Temporal Surface Tracking Using Mesh Evolution
Varanasi, K., Zaharescu, A., Boyer, E., & Horaud, R. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_3 · Cited by 81
Real-time tracking of highly articulated structures in the presence of noisy measurements
Drummond, T. W., & Cipolla, R. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937642 · Cited by 71
Interacting and Annealing Particle Filters: Mathematics and a Recipe for Applications
Gall, J., Potthoff, J., Schnörr, C., Rosenhahn, B., & Seidel, H. (2007) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-007-0007-8 · Cited by 49
Self-citation
Cited by
Expressive Body Capture: 3D Hands, Face, and Body From a Single Image
Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A., Tzionas, D., & Black, M. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01123 · Cited by 1,781
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00239 · Cited by 1,228
Peng, S., Zhang, Y., Xu, Y., Wang, Q., Shuai, Q., Bao, H., & Zhou, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00894 · Cited by 626
A Survey on Shape Correspondence
van Kaick, O., Zhang, H., Hamarneh, G., & Cohen‐Or, D. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01884.x · Cited by 606
High-quality streamable free-viewpoint video
Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., & Sullivan, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766945 · Cited by 573
Metadata
- Authors
- Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H.-P.
- Venue
- 2009 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2009-06
- Pages
- 1746-1753
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2110434318
- Cited by
- 344
- References
- 28
- FWCI
- 17.17
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.