The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data
Abstract
We present a new technique for reconstructing a single shape and its nonrigid motion from 3D scanning data. Our algorithm takes a set of time-varying unstructured sample points that capture partial views of a deforming object as input and reconstructs a single shape and a deformation field that fit the data. This representation yields dense correspondences for the whole sequence, as well as a completed 3D shape in every frame. In addition, the algorithm automatically removes spatial and temporal noise artifacts and outliers from the raw input data. Unlike previous methods, the algorithm does not require any shape template but computes a fitting shape automatically from the input data. Our reconstruction framework is based upon a novel topology-aware adaptive subspace deformation technique that allows handling long sequences with complex geometry efficiently. The algorithm accesses data in multiple sequential passes, so that long sequences can be streamed from hard disk, not being limited by main memory. We apply the technique to several benchmark datasets, significantly increasing the complexity of the data that can be handled efficiently in comparison to previous work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“[6] that can register 4D surfaces and produce an urshape template”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [6]
In the citing paper
“To alleviate it, [2], [6], [32] reduce the DoF explicitly by computing local transformations with respect to clusters or nodes, and most non-rigid registration methods use regularization to further constrain the solutions.”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [6]
In the citing paper
“[6], [28], [79] constructs a template, an urshape, by accumulating and filling in missing data from other scans in the same sequence.They have been used extensively in non-rigid registration to constrain dense correspondences [23], [29], [32], [34], [80].This works for objects with well defined forms, such as the human face and body.”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [6]
In the citing paper
“Yet, given only two surfaces and a high-dimensional deformation model (like [6], [32]), the solution can only be regularized by other prior knowledge-mostly in the form of regularizations to ensure smoothness.”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [6]
Citations
Cites
A Method for Registration of 3-D Shapes
Besl, P., & Mckay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 22,163
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2017) · doi:10.1109/cvpr35066.2017 · Cited by 7,284
An Introduction to the Conjugate Gradient Method Without the Agonizing Pain
Shewchuk, J. R. (1994) · Cited by 2,193
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990916 · Cited by 1,884
Terzopoulos, D., Platt, J. C., Barr, A. H., & Fleischer, K. (1987) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/37401.37427 · Cited by 1,716
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
High-quality video view interpolation using a layered representation
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S. A. J., & Szeliski, R. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015766 · Cited by 1,386
Nonlinear Programming: Analysis and Methods
Avriel, M. (1976) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,339
Nonlinear Programming Analysis and Methods
Rodin, E. Y. (1977) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(77)90071-2 · Cited by 1,300
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882311 · Cited by 913
The space of human body shapes
Allen, B., Curless, B., & Popović, Z. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882311 · Cited by 725
Zwicker, M., Pfister, H., van Baar, J., & Groß, M. H. (2001) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/383259.383300 · Cited by 674
On Linear Variational Surface Deformation Methods
Botsch, M., & Sorkine, O. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.1054 · Cited by 593
Performance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Self-citationZhang, L., Snavely, N., Curless, B., & Seitz, S. M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015759 · Cited by 493
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882309 · Cited by 485
Self-citationEmbedded deformation for shape manipulation
Sumner, R. W., Schmid, J., & Pauly, M. V. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276478 · Cited by 459
A Computational Framework for Segmentation and Grouping
(2000) · Elsevier eBooks · doi:10.1016/b978-0-444-50353-4.x5000-8 · Cited by 415
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186822.1073207 · Cited by 410
Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans
Li, H., Sumner, R. W., & Pauly, M. V. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01282.x · Cited by 401
Point based animation of elastic, plastic and melting objects
M�ller, M., Keiser, R., Nealen, A., Pauly, M. V., Groß, M. H., & Alexa, M. (2004) · Computer animation and simulation · doi:10.1145/1028523.1028542 · Cited by 388
High-quality video view interpolation using a layered representation
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004) · ACM SIGGRAPH 2004 Papers · doi:10.1145/1186562.1015766 · Cited by 367
Large mesh deformation using the volumetric graph Laplacian
Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., & Shum, H. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073219 · Cited by 316
Spacetime stereo: shape recovery for dynamic scenes
Zhang, L., Curless, B., & Seitz, S. M. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211492 · Cited by 294
Fast 3D Scanning with Automatic Motion Compensation
Weise, T., Leibe, B., & Gool, L. V. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383291 · Cited by 290
Non‐Rigid Registration Under Isometric Deformations
Huang, Q., Adams, B., Wicke, M., & Guibas, L. J. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01285.x · Cited by 279
Self-citationArticulated body deformation from range scan data
Allen, B., Curless, B., & Popović, Z. (2002) · ACM SIGGRAPH Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) · doi:10.1145/566570.566626 · Cited by 272
Spacetime stereo: a unifying framework for depth from triangulation
Davis, J., Neh, D., Ramamoorthi, R., & Rusinkiewicz, S. M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.37 · Cited by 271
Sumner, R. W., Zwicker, M., Gotsman, C., & Popović, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073218 · Cited by 266
Subspace gradient domain mesh deformation
Huang, J., Shi, X., Liu, X., Zhou, K., Wei, L., Teng, S., Bao, H., Guo, B., & Shum, H. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142003 · Cited by 264
Classification and Overview of Meshfree Methods
Fries, T., & Matthies, H. G. (2004) · Digitale Bibliothek Braunschweig (Verbundzentrale Göttingen (VZG)) · doi:10.24355/dbbs.084-200511080100-465 · Cited by 250
The ACM SIGGRAPH / Eurographics Symposium on Computer Animation
(2021) · doi:10.1145/3475946 · Cited by 249
Meshless animation of fracturing solids
Pauly, M. V., Keiser, R., Adams, B., Dutré, P., Groß, M. H., & Guibas, L. J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073296 · Cited by 208
Self-citationCapturing and animating skin deformation in human motion
Park, S. I., & Hodgins, J. K. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141970 · Cited by 202
The Correlated Correspondence Algorithm for Unsupervised Registration of Nonrigid Surfaces
Anguelov, D., Srinivasan, P., Pang, H.-C., Koller, D., Thrun, S., & Davis, J. (2004) · Cited by 197
PriMo : coupled prisms for intuitive surface modeling
Botsch, M., Pauly, M. V., Groß, M. H., & Kobbelt, L. P. (2006) · Cited by 178
Adaptive Space Deformations Based on Rigid Cells
Botsch, M., Pauly, M. V., Wicke, M., & Groß, M. H. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01056.x · Cited by 125
Zhang, L., Snavely, N., Curless, B., & Seitz, S. M. (2004) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186562.1015759 · Cited by 123
A fast multigrid algorithm for mesh deformation
Shi, L., Yu, Y., Bell, N., & Feng, W.-W. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142001 · Cited by 116
Carceroni, R. L., & Kutulakos, K. N. (2002) · International Journal of Computer Vision · doi:10.1023/a:1020145606604 · Cited by 115
Articulated Object Reconstruction and Markerless Motion Capture from Depth Video
Pekelny, Y., & Gotsman, C. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01137.x · Cited by 114
Pyramid Coordinates for Morphing and Deformation
Sheffer, A., & Kraevoy, V. (2004) · Cited by 110
Continuous capture of skin deformation
Sand, P., McMillan, L., & Popović, J. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882310 · Cited by 108
Automatic Registration for Articulated Shapes
Chang, W., & Zwicker, M. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01286.x · Cited by 107
Dual Laplacian editing for meshes
Au, O. K., Tai, C., Liu, L., & Fu, H. (2006) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2006.47 · Cited by 105
Reconstruction of deforming geometry from time-varying point clouds
Wand, M., Jenke, P., Qi-xing Huang, A., Bokeloh, M., Guibas, L. J., & Schilling, A. (2007) · doi:10.5555/1281991.1281998 · Cited by 102
Self-citationMitra, N. J., Flöry, S., Ovsjanikov, M., Gelfand, N., Guibas, L. J., & Pottmann, H. (2007) · doi:10.5555/1281991.1282015 · Cited by 101
Self-citationReconstructing Animated Meshes from Time‐Varying Point Clouds
Süßmuth, J., Winter, M., & Greiner, G. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01287.x · Cited by 81
Würmlin, S., Lamboray, E., Staadt, O., & Groß, M. H. (2003) · Pacific Conference on Computer Graphics and Applications · doi:10.1109/pccga.2002.1167876 · Cited by 79
Shi, X., Zhou, K., Tong, Y., Desbrun, M., Bao, H., & Guo, B. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276479 · Cited by 77
Temporal Surface Tracking Using Mesh Evolution
Varanasi, K., Zaharescu, A., Boyer, E., & Horaud, R. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_3 · Cited by 77
Dense correspondence finding for parametrization-free animation reconstruction from video
Ahmed, N., Theobalt, C., Rössl, C., Thrun, S., & Seidel, H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587758 · Cited by 75
Self-citationSpace-time surface reconstruction using incompressible flow
Sharf, A., Alcantara, D. A., Lewiner, T., Greif, C., Sheffer, A., Amenta, N., & Cohen‐Or, D. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409063 · Cited by 73
Continuous capture of skin deformation
Sand, P., McMillan, L., & Popović, J. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882310 · Cited by 71
Gradient domain editing of deforming mesh sequences
Xu, W., Zhou, K., Yu, Y., Tan, Q., Peng, Q., & Guo, B. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276482 · Cited by 69
Proceedings of the Vision Modeling and Visualization Conference 2001
Ertl, T., Girod, B., Niemann, H., & Seidel, H. (2001) · Cited by 64
Self-citationSpherical matching for temporal correspondence of non-rigid surfaces
Starck, J., & Hilton, A. (2005) · doi:10.1109/iccv.2005.229 · Cited by 47
Meshless Modeling of Deformable Shapes and their Motion
Adams, B., Ovsjanikov, M., Wand, M., Seidel, H., & Guibas, L. J. (2008) · PubMed · doi:10.2312/sca/sca08/077-086 · Cited by 38
Self-citationPhysically Based Deformable Models in Computer Graphics
Nealen, A., Müller, M., Keiser, R., Boxerman, E., & Carlson, M. (2005) · doi:10.2312/egst.20051045 · Cited by 33
Bayesian Surface Reconstruction via Iterative Scan Alignment to an Optimized Prototype
Huang, Q., Adams, B., & Wand, M. D. (2007) · Max Planck Institute for Plasma Physics · doi:10.2312/sgp/sgp07/213-223 · Cited by 26
Self-citationExtracting Animated Meshes with Adaptive Motion Estimation.
Anuar, N., & Guskov, I. (2004) · Vision Modeling and Visualization · Cited by 24
High-resolution three-dimensional sensing of fast deforming objects
Fong, P. W. L., & Buron, F. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545602 · Cited by 20
Image-Based Motion Compensation for Structured Light Scanning of Dynamic Surfaces
Gumhold, S., & König, S. (2008) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dagsemproc.07171.3 · Cited by 5
Cited by
Sorted by citations
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951
Industry 4.0 technologies and their applications in fighting COVID-19 pandemic
Javaid, M., Haleem, A., Vaishya, R., Bahl, S., Suman, R., & Vaish, A. (2020) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2020.04.032 · Cited by 758
Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid
Tam, G. K. L., Cheng, Z.-Q., Lai, Y.-K., Langbein, F. C., Liu, Y., Marshall, D., Martin, R. R., Sun, X.-F., & Rosin, P. L. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.310 · Cited by 679
“Template DC, D [6], [23], [28], [34]”
BackgroundMethodInfluentialA Survey on Shape Correspondence
van Kaick, O. M., Zhang, H., Hamarneh, G., & Cohen‐Or, D. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01884.x · Cited by 606
High-quality streamable free-viewpoint video
Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A. G., & Sullivan, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766945 · Cited by 577
Metadata
- Authors
- Wand, M., Adams, B., Ovsjanikov, M., Berner, A., Bokeloh, M., Jenke, P., Guibas, L., Seidel, H.-P., & Schilling, A.
- Affiliations
- Max Planck Institute for Informatics (DE)
- Stanford University (US)
- University of Tübingen (DE)
- Venue
- ACM Transactions on Graphics
- Published
- 2009-04
- Volume
- 28
- Issue
- 2
- Pages
- 1-15
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2065270678
- Cited by
- 136
- References
- 64
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 5 · 2020: 4 · 2019: 6 · 2018: 15 · 2017: 6 · 2016: 12 · 2015: 10 · 2014: 14 · 2013: 15 · 2012: 14
- FWCI
- 11.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Graphics (publishedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency (HR0011-05-1-0007)
- National Science Foundation (ITR 0205671FRG 0354543)
- National Institutes of Health (GM -072970)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- deformation field estimation, 3D scanning, unstructured point clouds, shape fitting, noise and outlier removal, dense correspondence, real-time 3D scanning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review