TILT: Transform Invariant Low-Rank Textures
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
In this paper, we propose a new tool to efficiently extract a class of “low-rank textures” in a 3D scene from user-specified windows in 2D images despite significant corruptions and warping. The low-rank textures capture geometrically meaningful structures in an image, which encompass conventional local features such as edges and corners as well as many kinds of regular, symmetric patterns ubiquitous in urban environments and man-made objects. Our approach to finding these low-rank textures leverages the recent breakthroughs in convex optimization that enable robust recovery of a high-dimensional low-rank matrix despite gross sparse errors. In the case of planar regions with significant affine or projective deformation, our method can accurately recover both the intrinsic low-rank texture and the unknown transformation, and hence both the geometry and appearance of the associated planar region in 3D. Extensive experimental results demonstrate that this new technique works effectively for many regular and near-regular patterns or objects that are approximately low-rank, such as symmetrical patterns, building facades, printed text, and human faces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 2×
“The detected points or regions typically represent parts of the image that have distinctive geometric or statistical properties such as Canny edges (Canny, 1986), Harris corners (Harris and Stephens, 1988), and textons (Leung and Malik, 2001).”
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 2×
“The detected points or regions typically represent parts of the image that have distinctive geometric or statistical properties such as Canny edges (Canny, 1986), Harris corners (Harris and Stephens, 1988), and textons (Leung and Malik, 2001).”
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
Self-citationA performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723 · cited 1×
“In the past two decades, numerous “invariant” features and descriptors have been proposed, studied, compared, and combined in the literature (see (Mikolajczyk and Schmid, 2005; Winder and Brown, 2007) and references therein).”
A Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
Exact Matrix Completion via Convex Optimization
Candès, E. J., & Recht, B. (2009) · Foundations of Computational Mathematics · doi:10.1007/s10208-009-9045-5 · Cited by 4,877
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization
Recht, B., Fazel, M., & Parrilo, P. A. (2010) · SIAM Review · doi:10.1137/070697835 · Cited by 3,471
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Lucas-Kanade 20 Years On: A Unifying Framework
Baker, S., & Matthews, I. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011205.11775.fd · Cited by 3,155
Eckstein, J., & Bertsekas, D. P. (1992) · Mathematical Programming · doi:10.1007/bf01581204 · Cited by 2,791
A dual algorithm for the solution of nonlinear variational problems via finite element approximation
Gabay, D., & Mercier, B. (1976) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(76)90003-1 · Cited by 2,514
Kuybeda, O., Frank, G. A., Bartesaghi, A., Borgnia, M., Subramaniam, S., & Sapiro, G. (2013) · Journal of Structural Biology · doi:10.1016/j.jsb.2012.10.010 · Cited by 2,162
The Power of Convex Relaxation: Near-Optimal Matrix Completion
Candes, E. J., & Tao, T. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2044061 · Cited by 2,060
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 2×
“The detected points or regions typically represent parts of the image that have distinctive geometric or statistical properties such as Canny edges (Canny, 1986), Harris corners (Harris and Stephens, 1988), and textons (Leung and Malik, 2001).”
ASIFT: A New Framework for Fully Affine Invariant Image Comparison
Morel, J.-M., & Yu, G. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080732730 · Cited by 1,468
Glowinski, R., & Marroco, A. (1975) · Revue française d'automatique, informatique, recherche opérationnelle. Analyse numérique · doi:10.1051/m2an/197509r200411 · Cited by 1,105
Toh, K.-C., & Yun, S. (2009) · National University of Singapore · Cited by 955
Ma, Y., Soatto, S., Košecká, J., & Sastry, S. S. (2004) · Interdisciplinary Applied Mathematics · doi:10.1007/978-0-387-21779-6 · Cited by 893
Self-citationRASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images
Peng, Y., Ganesh, A., Wright, J., Xu, W., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.282 · Cited by 817
Self-citationRank-Sparsity Incoherence for Matrix Decomposition
Chandrasekaran, V., Sanghavi, S., Parrilo, P. A., & Willsky, A. S. (2011) · SIAM Journal on Optimization · doi:10.1137/090761793 · Cited by 686
Templates for convex cone problems with applications to sparse signal recovery
Becker, S. R., Candès, E. J., & Grant, M. C. (2011) · Mathematical Programming Computation · doi:10.1007/s12532-011-0029-5 · Cited by 608
Recovering Low-Rank and Sparse Components of Matrices from Incomplete and Noisy Observations
Tao, M., & Yuan, X. (2011) · SIAM Journal on Optimization · doi:10.1137/100781894 · Cited by 453
Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming
He, B., Tao, M., & Yuan, X. (2012) · SIAM Journal on Optimization · doi:10.1137/110822347 · Cited by 360
Learning Local Image Descriptors
Winder, S. A. J., & Brown, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382971 · Cited by 339
Pacific Journal of Optimization
(2023) · Pacific Journal of Optimization · doi:10.61208/pjo · Cited by 325
Classification of rotated and scaled textured images using Gaussian Markov random field models
Cohen, F. S., Fan, Z., & Patel, M. A. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.67648 · Cited by 299
Rotation-invariant texture classification using a complete space-frequency model
Haley, G. M., & Manjunath, B. S. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.743859 · Cited by 222
Do, M. N., & Vetterli, M. (2002) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2002.802019 · Cited by 212
Fast algorithms for recovering a corrupted low-rank matrix
Ganesh, A., Lin, Z., Wright, J., Wu, L., Chen, M., & Ma, Y. (2009) · 2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP) · doi:10.1109/camsap.2009.5413299 · Cited by 211
Self-citationChen, J.-L., & Kundu, A. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.273730 · Cited by 182
Direct computation of shape cues using scale-adapted spatial derivative operators
Gårding, J., & Tony Lindeberg, C. (1996) · International Journal of Computer Vision · doi:10.1007/bf00058750 · Cited by 138
Detecting and matching repeated patterns for automatic geo-tagging in urban environments
Schindler, G., Krishnamurthy, P., Lublinerman, R., et al. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587461 · Cited by 124
Rotation invariant texture recognition using a steerable pyramid
Greenspan, H. K., Belongie, S., Goodman, R. M., & Perona, P. (2002) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1994.576896 · Cited by 111
Camera calibration with lens distortion from low-rank textures
Zhang, Z., Matsushita, Y., & Ma, Y. (2011) · doi:10.1109/cvpr.2011.5995548 · Cited by 105
Self-citationExtraction, matching, and pose recovery based on dominant rectangular structures
Košecká, J., & Zhang, W. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.04.005 · Cited by 102
Wu, W.-R. (1998) · IEEE Transactions on Image Processing · doi:10.1109/tip.1998.661004 · Cited by 99
Wu, W.-R., & Wei, S.-C. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.536891 · Cited by 93
Transformed component analysis: joint estimation of spatial transformations and image components
Frey, B. J., & Jojić, N. (1999) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1999.790415 · Cited by 78
Diwekar, U. M. (2003) · Applied optimization · doi:10.1007/978-1-4757-3745-5_3 · Cited by 75
Performance evaluation of state-of-the-art discrete symmetry detection algorithms
Park, M., Lee, S., Chen, P., et al. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587824 · Cited by 73
Texture synthesis and nonparametric resampling of random fields
Levina, E., & Bickel, P. J. (2006) · The Annals of Statistics · doi:10.1214/009053606000000588 · Cited by 70
Symmetry-based 3-D reconstruction from perspective images
Yang, A. Y., Huang, K., Rao, S., Hong, W., & Ma, Y. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.01.004 · Cited by 43
Self-citationOn the set of images modulo viewpoint and contrast changes
Sundaramoorthi, G., Petersen, P., Varadarajan, V. S., & Soatto, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206704 · Cited by 41
Holistic 3D reconstruction of urban structures from low-rank textures
Mobahi, H., Zhou, Z., Yang, A. Y., & Ma, Y. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130297 · Cited by 38
Self-citationTEXTURE SYNTHESIS AND NONPARAMETRIC RESAMPLING OF RANDOM FIELDS
Levina, E., & Bickel, P. J. (2008) · Cited by 37
Translation-Symmetry-Based Perceptual Grouping with Applications to Urban Scenes
Park, M., Brocklehurst, K., Collins, R. T., & Liu, Y. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19318-7_26 · Cited by 36
Rotation invariant texture classification using covariance
Madiraju, S., & Liu, C.-C. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1994.413652 · Cited by 20
Texture discrimination by projective invariants
Chang, S., Davis, L. S., DUNN, S. M., Eklundh, J., & Rosenfeld, A. (1987) · Pattern Recognition Letters · doi:10.1016/0167-8655(87)90075-4 · Cited by 20
Using moment invariants to analyze 3-D color textures
Kondepudy, R. V., & Healey, G. E. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1994.413531 · Cited by 4
Cited by
Weighted Nuclear Norm Minimization with Application to Image Denoising
Gu, S., Zhang, L., Zuo, W., & Feng, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.366 · Cited by 2,316
RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images
Peng, Y., Ganesh, A., Wright, J., Xu, W., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.282 · Cited by 817
Self-citationWeighted Nuclear Norm Minimization and Its Applications to Low Level Vision
Gu, S., Xie, Q., Meng, D., Zuo, W., Feng, X., & Zhang, L. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0930-5 · Cited by 816
Robust Scene Text Recognition with Automatic Rectification
Shi, B., Wang, X., Lyu, P., Yao, C., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.452 · Cited by 693
Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification
Yang, M., Zhang, L., Feng, X., & Zhang, D. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0722-8 · Cited by 489
Metadata
- Authors
- Zhang, Z., Ganesh, A., Liang, X., & Ma, Y.
- Venue
- International Journal of Computer Vision
- Published
- 2012-01-12
- Volume
- 99
- Issue
- 1
- Pages
- 1-24
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2906621894
- Cited by
- 277
- References
- 51
- FWCI
- 40.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.