The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
MoSh: motion and shape capture from sparse markers
Open accessAbstract
Marker-based motion capture (mocap) is widely criticized as producing lifeless animations. We argue that important information about body surface motion is present in standard marker sets but is lost in extracting a skeleton. We demonstrate a new approach called MoSh (Motion and Shape capture), that automatically extracts this detail from mocap data. MoSh estimates body shape and pose together using sparse marker data by exploiting a parametric model of the human body. In contrast to previous work, MoSh solves for the marker locations relative to the body and estimates accurate body shape directly from the markers without the use of 3D scans; this effectively turns a mocap system into an approximate body scanner. MoSh is able to capture soft tissue motions directly from markers by allowing body shape to vary over time. We evaluate the effect of different marker sets on pose and shape accuracy and propose a new sparse marker set for capturing soft-tissue motion. We illustrate MoSh by recovering body shape, pose, and soft-tissue motion from archival mocap data and using this to produce animations with subtlety and realism. We also show soft-tissue motion retargeting to new characters and show how to magnify the 3D deformations of soft tissue to create animations with appealing exaggerations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, Second Edition
Griewank, A., & Walther, A. (2008) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717761 · Cited by 1,529
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Eulerian video magnification for revealing subtle changes in the world
Wu, H.-Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., & Freeman, W. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185561 · Cited by 1,357
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882311 · Cited by 913
Phase-based video motion processing
Wadhwa, N., Rubinstein, M., Durand, F., & Freeman, W. T. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461966 · Cited by 853
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882311 · Cited by 723
FAUST: Dataset and Evaluation for 3D Mesh Registration
Bogo, F., Romero, J., Loper, M., & Black, M. J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.491 · Cited by 689
Self-citationPerformance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Surface Capture for Performance-Based Animation
Starck, J., & Hilton, A. (2007) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2007.68 · Cited by 452
Robinette, K. M., Blackwell, S., Daanen, H., Boehmer, M., & Fleming, S. (2002) · doi:10.21236/ada406704 · Cited by 260
Jain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866174 · Cited by 219
Capturing and animating skin deformation in human motion
Park, S. I., & Hodgins, J. K. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141970 · Cited by 202
Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape
Hirshberg, D. A., Loper, M., Rachlin, E., & Black, M. J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_18 · Cited by 173
Self-citationSampling-based contact-rich motion control
Liu, L., Yin, K., van de Panne, M., Shao, T., & Xu, W. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778865 · Cited by 161
Sparse localized deformation components
Neumann, T., Varanasi, K., Wenger, S., Wacker, M., Magnor, M. A., & Theobalt, C. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508417 · Cited by 157
Markerless Motion Capture of Multiple Characters Using Multiview Image Segmentation
Liu, Y., Gall, J., Stoll, C., Dai, Q., Seidel, H., & Theobalt, C. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.47 · Cited by 136
Marker-less Deformable Mesh Tracking for Human Shape and Motion Capture
de Aguiar, E., Theobalt, C., Stoll, C., & Seidel, H. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383296 · Cited by 106
Data-driven modeling of skin and muscle deformation
Park, S. I., & Hodgins, J. K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360695 · Cited by 103
Jain, A., Thormählen, T., Seidel, H., & Theobalt, C. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866174 · Cited by 75
Tsoli, A., Mahmood, N., & Black, M. J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601225 · Cited by 46
Self-citationCapture and Statistical Modeling of Arm‐Muscle Deformations
Neumann, T., Varanasi, K., Hasler, N., Wacker, M., Magnor, M. A., & Theobalt, C. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12048 · Cited by 44
Human attributes from 3D pose tracking
Livne, M., Sigal, L., Troje, N. F., & Fleet, D. J. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.01.003 · Cited by 27
Videoshop: A new framework for spatio-temporal video editing in gradient domain
Wang, H., Xu, N., Raskar, R., & Ahuja, N. (2006) · Graphical Models · doi:10.1016/j.gmod.2006.06.002 · Cited by 24
Truong, D.-T., Chow, Y.-Y., & Fang, A. C. (2007) · Pacific Conference on Computer Graphics and Applications · doi:10.1109/pg.2007.58 · Cited by 11
A Data‐driven Segmentation for the Shoulder Complex
Hong, Q. Y., Park, S. I., & Hodgins, J. K. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01623.x · Cited by 10
XX Brazilian Symposium on Computer Graphics and Image Processing-TOC
(2007) · Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI) · doi:10.1109/sibgrapi.2007.6 · Cited by 3
Research works printed but not linked: 5
- de Aguiar E., Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 1--8.
- 10.5555/1455489 · doi:10.5555/1455489
- 10.5555/1338439.1338550 · doi:10.5555/1338439.1338550
- 10.1109/TVCG.2013.80 · doi:10.1109/tvcg.2013.80
- Nocedal J. and Wright S. J. 2006. Numerical Optimization 2nd ed. Springer New York. Nocedal J. and Wright S. J. 2006. Numerical Optimization 2nd ed. Springer New York.
Cited by
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Self-citationEnd-to-End Recovery of Human Shape and Pose
Kanazawa, A., Black, M. J., Jacobs, D. W., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00744 · Cited by 1,870
Self-citationExpressive Body Capture: 3D Hands, Face, and Body From a Single Image
Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A., Tzionas, D., & Black, M. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01123 · Cited by 1,781
Self-citationKeep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., & Black, M. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_34 · Cited by 1,498
Self-citationAMASS: Archive of Motion Capture As Surface Shapes
Mahmood, N., Ghorbani, N., Troje, N. F., Pons-Moll, G., & Black, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00554 · Cited by 1,323
Self-citation
Metadata
- Authors
- Loper, M., Mahmood, N., & Black, M. J.
- Venue
- ACM Transactions on Graphics
- Published
- 2014-11-19
- Volume
- 33
- Issue
- 6
- Pages
- 1-13
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2122633688
- Cited by
- 344
- References
- 26
- FWCI
- 16.00
- Type
- journal article
- Language
- en
- Open access
- bronze
- Funders
- National Science Foundation (EIA-0196217)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.