Efficient groupwise non-rigid registration of textured surfaces
Abstract
Advances in 3D imaging have recently made 3D surface scanners, capable of capturing textured surfaces at video rate, affordable and common in computer vision. This is a relatively new source of data, the potential of which has not yet been fully exploited as the problem of non-rigid registration of surfaces is difficult. While registration based on shape alone has been an active research area for some time, the problem of registering surfaces based on texture information has not been addressed in a principled way. We propose a novel, efficient and reliable, fully automatic method for performing groupwise non-rigid registration of textured surfaces, such as those obtained with 3D scanners. We demonstrate the robustness of our approach on 3D scans of human faces, including the notoriously difficult case of inter-subject registration. We show how our method can be used to build high-quality 3D models of appearance fully automatically.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
As has been found in medical imaging, registration utilizing heterogeneous information (e.g. geometry and texture [41], [120]) may give higher accuracy.
“As has been found in medical imaging, registration utilizing heterogeneous information (e.g.geometry and texture [41], [120]) may give higher accuracy.”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [120]
The minimum description length criterion is well-known for determining the best model from data; it has been used in image registration [119], face (texture and depth) registration [120] and medical data registration [121] in computer vision, but is relatively little used in computer graphics and shape analysis.
“In information theory, the minimum description length criterion is well-known for determining the best model from data; it has been used in image registration [119], face (texture and depth) registration [120] and medical data registration [121] in computer vision, but is relatively little used in computer graphics and shape analysis.”
From Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid (2013) · cites this paper as [120]
Cites
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695 · see citing works
Computing geodesic paths on manifolds
Kimmel, R., & Sethian, J. A. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.15.8431 · Cited by 1,067 · see citing works
An Overview of the Simultaneous Perturbation Method for Efficient Optimization
Spall, J. C. (1998) · doi:10.26144/yqez-2q90 · Cited by 444 · see citing works
Surface feature detection and description with applications to mesh matching
Zaharescu, A., Boyer, E., Varanasi, K., & Horaud, R. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206748 · Cited by 416 · see citing works
Expression-Invariant 3D Face Recognition
Bronstein, A. M., Bronstein, M. M., & Kimmel, R. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44887-x_8 · Cited by 272 · see citing works
Texture mapping using surface flattening via multidimensional scaling
Zigelman, G., Kimmel, R., & Kiryati, N. (2002) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.998671 · Cited by 262 · see citing works
Geodesic Remeshing Using Front Propagation
Peyré, G., & Cohen, L. D. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-6859-3 · Cited by 190 · see citing works
Dense non-rigid surface registration using high-order graph matching
Zeng, Y., Wang, C., Wang, Y., Gu, X. D., Samaras, D., & Nikos Paragios, A. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540189 · Cited by 151 · see citing works
Statistical Models of Shape: Optimisation and Evaluation
Davies, R. H., Twining, C., & Taylor, C. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 114 · see citing works
Groupwise Diffeomorphic Non-rigid Registration for Automatic Model Building
Cootes, T. F., Marsland, S., Twining, C., Smith, K., & Taylor, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24673-2_26 · Cited by 100 · see citing works
Global Random Optimization by Simultaneous Perturbation Stochastic Approximation
Maryak, J. L., & Chin, D. C. (2008) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.917738 · Cited by 84 · see citing works
Bending invariant representations for surfaces
Elad, A., & Kimmel, R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990472 · Cited by 83 · see citing works
Groupwise Construction of Appearance Models using Piece-wise Affine Deformations
Cootes, T. F., Twining, C., Petrovic, V. S., Schestowitz, R. S., & Taylor, C. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.88 · Cited by 73 · see citing works
Computing Accurate Correspondences across Groups of Images
Cootes, T. F., Twining, C. J., Petrovic, V. S., Babalola, K. O., & Taylor, C. J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.193 · Cited by 70 · see citing works
Elastic Matching Using a Deformation Sphere
Lötjönen, J. M. P., & Mäkelä, T. O. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45468-3_65 · Cited by 33 · see citing works
Groupwise surface correspondence by optimization: Representation and regularization
Davies, R. H., Twining, C., & Taylor, C. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.03.009 · Cited by 26 · see citing works
An efficient stochastic approach to groupwise non-rigid image registration
Sidorov, K. A., Richmond, S., & Marshall, D. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206516 · Cited by 22 · see citing works
Self-citationAutomatic non-rigid registration of 3D dynamic data for facial expression synthesis and transfer
Wang, S., Gu, X. D., & Qin, H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587791 · Cited by 21 · see citing works
Sidorov, K. A. (2010) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 5 · see citing works
Self-citationBending invariant meshes and application to groupwise correspondences
Wuhrer, S., Shu, C., Boisvert, J., et al. (2009) · doi:10.1109/iccvw.2009.5457674 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid
Tam, G. K. L., Cheng, Z.-Q., Lai, Y.-K., Langbein, F. C., Liu, Y., Marshall, D., Martin, R. R., Sun, X.-F., & Rosin, P. L. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.310 · Cited by 679 · see citing works
Self-citation
- Authors
- Sidorov, K. A., Richmond, S., & Marshall, D.
- Affiliations
- Cardiff University (GB)
- Venue
- CVPR 2011
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 2401-2408
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2052504501
- Cited by
- 22
- References
- 20
- Citations by year
- 2022: 2 · 2021: 1 · 2019: 1 · 2018: 5 · 2016: 1 · 2015: 1 · 2014: 1 · 2013: 3 · 2012: 7
- FWCI
- 6.43
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Topics
- Physical Sciences › Engineering › Computational Mechanics › 3D Shape Modeling and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- groupwise registration, non-rigid registration, textured surfaces, 3D surface scanning, 3D face scans, inter-subject registration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review