The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Performance capture from sparse multi-view video
Abstract
This paper proposes a new marker-less approach to capturing human performances from multi-view video. Our algorithm can jointly reconstruct spatio-temporally coherent geometry, motion and textural surface appearance of actors that perform complex and rapid moves. Furthermore, since our algorithm is purely meshbased and makes as few as possible prior assumptions about the type of subject being tracked, it can even capture performances of people wearing wide apparel, such as a dancer wearing a skirt. To serve this purpose our method efficiently and effectively combines the power of surface- and volume-based shape deformation techniques with a new mesh-based analysis-through-synthesis framework. This framework extracts motion constraints from video and makes the laser-scan of the tracked subject mimic the recorded performance. Also small-scale time-varying shape detail is recovered by applying model-guided multi-view stereo to refine the model surface. Our method delivers captured performance data at high level of detail, is highly versatile, and is applicable to many complex types of scenes that could not be handled by alternative marker-based or marker-free recording techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
A Limited Memory Algorithm for Bound Constrained Optimization
Byrd, R. H., Lu, P., Nocedal, J., & Zhu, C. (1995) · SIAM Journal on Scientific Computing · doi:10.1137/0916069 · Cited by 6,221
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Poisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
High-quality video view interpolation using a layered representation
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015766 · Cited by 1,385
A spectral technique for correspondence problems using pairwise constraints
Leordeanu, M., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.20 · Cited by 1,222
Deformation transfer for triangle meshes
Sumner, R. W., & Popović, J. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015736 · Cited by 1,052
High performance imaging using large camera arrays
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073259 · Cited by 1,042
Matusik, W., Buehler, C., Raskar, R., Gortler, S. J., & McMillan, L. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344951 · Cited by 890
Vision-based human motion analysis: An overview
Poppe, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.016 · Cited by 835
As-Rigid-As-Possible Surface Modeling
Sorkine‐Hornung, O., & Alexa, M. (2007) · doi:10.2312/sgp/sgp07/109-116 · Cited by 778
Virtualized reality: constructing virtual worlds from real scenes
Kanade, T., Rander, P., & Narayanan, P. J. (1997) · IEEE Multimedia · doi:10.1109/93.580394 · Cited by 624
On Linear Variational Surface Deformation Methods
Botsch, M., & Sorkine, O. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.1054 · Cited by 582
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H.-P. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882309 · Cited by 482
Self-citationSurface Capture for Performance-Based Animation
Starck, J., & Hilton, A. (2007) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2007.68 · Cited by 452
Müller, M., Dorsey, J., McMillan, L., Jagnow, R., & Cutler, B. (2002) · Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation · doi:10.1145/545261.545269 · Cited by 438
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H.-P. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882309 · Cited by 403
Self-citationDetailed Human Shape and Pose from Images
Balan, A. O., Sigal, L., Black, M. J., Davis, J. E., & Haussecker, H. W. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383340 · Cited by 308
Goesele, M., Curless, B., & Seitz, S. M. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.199 · Cited by 308
Articulated body deformation from range scan data
Allen, B., Curless, B., & Popović, Z. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566626 · Cited by 269
Deformation transfer for triangle meshes
Sumner, R. W., & Popović, J. (2004) · ACM SIGGRAPH 2004 Papers · doi:10.1145/1186562.1015736 · Cited by 203
Capturing and animating skin deformation in human motion
Park, S. I., & Hodgins, J. K. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141970 · Cited by 202
Articulated body deformation from range scan data
Allen, B., Curless, B., & Popović, Z. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566626 · Cited by 179
blue-c: a spatially immersive display and 3D video portal for telepresence
Gross, M., Würmlin, S., Naef, M., Lamboray, E., Spagno, C., Kunz, A., Koller-Meier, E., Svoboda, T., Van Gool, L., Lang, S., et al. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882350 · Cited by 164
Capturing and animating occluded cloth
White, R., Crane, K., & Forsyth, D. A. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276420 · Cited by 156
Multi-scale capture of facial geometry and motion
Bickel, B., Botsch, M., Angst, R., Matusik, W., Otaduy, M. Á., Pfister, H., & Groß, M. H. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276419 · Cited by 145
Adaptive Space Deformations Based on Rigid Cells
Botsch, M., Pauly, M. V., Wicke, M., & Groß, M. H. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01056.x · Cited by 141
Automatic Conversion of Mesh Animations into Skeleton‐based Animations
de Aguiar, E., Theobalt, C., Thrun, S., & Seidel, H. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01136.x · Cited by 134
Self-citationImage-based spatio-temporal modeling and view interpolation of dynamic events
Vedula, S., Baker, S., & Takeo Kanade, A. (2005) · ACM Transactions on Graphics · doi:10.1145/1061347.1061351 · Cited by 123
Continuous capture of skin deformation
Sand, P., McMillan, L., & Popović, J. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882310 · Cited by 108
Scalable 3D video of dynamic scenes
Waschbüsch, M., Würmlin, S., Cotting, D., Sadlo, F., & Groß, M. H. (2005) · The Visual Computer · doi:10.1007/s00371-005-0346-7 · Cited by 107
Marker-less Deformable Mesh Tracking for Human Shape and Motion Capture
de Aguiar, E., Theobalt, C., Stoll, C., & Seidel, H. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383296 · Cited by 106
Self-citationCapturing and animating occluded cloth
White, R., Crane, K., & Forsyth, D. A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276420 · Cited by 103
Reconstruction of deforming geometry from time-varying point clouds
Wand, M., Jenke, P., Qi-xing Huang, A., Bokeloh, M., Guibas, L. J., & Schilling, A. (2007) · doi:10.5555/1281991.1281998 · Cited by 102
Mitra, N. J., Flöry, S., Ovsjanikov, M., Gelfand, N., Guibas, L. J., & Pottmann, H. (2007) · doi:10.5555/1281991.1282015 · Cited by 101
Garment Motion Capture Using Color‐Coded Patterns
Scholz, V., Stich, T., Keckeisen, M., et al. (2005) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2005.00869.x · Cited by 97
Gradient domain editing of deforming mesh sequences
Xu, W., Zhou, K., Yu, Y., Tan, Q., Peng, Q., & Guo, B. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276482 · Cited by 71
Continuous capture of skin deformation
Sand, P., McMillan, L., & Popović, J. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882310 · Cited by 71
Marker-Less 3D Feature Tracking for Mesh-Based Human Motion Capture
de Aguiar, E., Theobalt, C., Stoll, C., & Seidel, H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-75703-0_1 · Cited by 18
Self-citationUnifying measured point sequences of deforming objects
Shinya, M. (2004) · International Symposium on 3D Data Processing, Visualization and Transmission · doi:10.1109/tdpvt.2004.1335411 · Cited by 12
Cited by
Peng, S., Zhang, Y., Xu, Y., Wang, Q., Shuai, Q., Bao, H., & Zhou, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00894 · Cited by 626
A Survey on Shape Correspondence
van Kaick, O., Zhang, H., Hamarneh, G., & Cohen‐Or, D. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01884.x · Cited by 606
High-quality streamable free-viewpoint video
Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., & Sullivan, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766945 · Cited by 573
Panoptic Studio: A Massively Multiview System for Social Motion Capture
Joo, H., Liu, H., Tan, L., Gui, L., Nabbe, B., Matthews, I., Kanade, T., Nobuhara, S., & Sheikh, Y. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.381 · Cited by 546
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
Joo, H., Simon, T., & Sheikh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00868 · Cited by 509
Metadata
- Authors
- de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S.
- Venue
- ACM Transactions on Graphics
- Published
- 2008-08
- Volume
- 27
- Issue
- 3
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2109752307
- Cited by
- 535
- References
- 40
- FWCI
- 50.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.