The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
A Statistical Approach to Material Classification Using Image Patch Exemplars
Abstract
In this paper, we investigate material classification from single images obtained under unknown viewpoint and illumination. It is demonstrated that materials can be classified using the joint distribution of intensity values over extremely compact neighborhoods (starting from as small as 3 \times 3 pixels square) and that this can outperform classification using filter banks with large support. It is also shown that the performance of filter banks is inferior to that of image patches with equivalent neighborhoods. We develop novel texton-based representations which are suited to modeling this joint neighborhood distribution for Markov random fields. The representations are learned from training images and then used to classify novel images (with unknown viewpoint and lighting) into texture classes. Three such representations are proposed and their performance is assessed and compared to that of filter banks. The power of the method is demonstrated by classifying 2,806 images of all 61 materials present in the Columbia-Utrecht database. The classification performance surpasses that of recent state-of-the-art filter bank-based classifiers such as Leung and Malik (IJCV 01), Cula and Dana (IJCV 04), and Varma and Zisserman (IJCV 05). We also benchmark performance by classifying all of the textures present in the UIUC, Microsoft Textile, and San Francisco outdoor data sets. We conclude with discussions on why features based on compact neighborhoods can correctly discriminate between textures with large global structure and why the performance of filter banks is not superior to that of the source image patches from which they were derived.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Abe, S. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0285-4 · Cited by 3,721
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322753616 · Cited by 3,502
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss
Domingos, P., & Pazzani, M. (1997) · Machine Learning · doi:10.1023/a:1007413511361 · Cited by 3,101
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Feature detection with automatic scale selection
Lindeberg, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008045108935 · Cited by 2,541
Textons, the elements of texture perception, and their interactions
Julesz, B. (1981) · Nature · doi:10.1038/290091a0 · Cited by 1,703 · cited 1×
“Early interest in the texture classification problem focused on the pre-attentive discrimination of texture patterns in binary images [1], [24], [25], [36].”
BackgroundMarkov Random Field Modeling in Image Analysis
Li, S. Z. (2001) · Computer Science Workbench · doi:10.1007/978-4-431-67044-5 · Cited by 1,533
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 8×
“In this section, we describe the Columbia-Utrecht (CUReT) database [10] and its level of difficulty for single image classification.”
BackgroundMethodResultInfluentialMarkov Random Field Texture Models
Cross, G. R., & Jain, A. K. (1983) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1983.4767341 · Cited by 1,414
Filtering for texture classification: a comparative study
Randen, T., & Husoy, J. H. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.761261 · Cited by 1,397
Reflectance and texture of real-world surfaces
Dana, K. J., van Ginneken, B., Nayar, S. K., & Koenderink, J. J. (1999) · ACM Transactions on Graphics · doi:10.1145/300776.300778 · Cited by 1,324
Pattern Recognition and Machine Learning
(1971) · Springer eBooks · doi:10.1007/978-1-4615-7566-5 · Cited by 1,144
A Statistical Approach to Texture Classification from Single Images
Varma, M., & Zisserman, A. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-4635-4 · Cited by 1,142
Self-citationA sparse texture representation using local affine regions
Lazebnik, S., Schmid, C., & Ponce, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.151 · Cited by 1,123
Contour and Texture Analysis for Image Segmentation
Malik, J., Belongie, S., Leung, T., & Shi, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011174803800 · Cited by 1,089
Preattentive texture discrimination with early vision mechanisms
Malik, J., & Perona, P. (1990) · Journal of the Optical Society of America A · doi:10.1364/josaa.7.000923 · Cited by 960
Texture classification: are filter banks necessary?
Varma, M., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211534 · Cited by 421
Self-citationMean shift based clustering in high dimensions: a texture classification example
Georgescu, Shimshoni, & Meer (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238382 · Cited by 412
Dimensionality Reduction via Sparse Support Vector Machines
Bi, J., Bennett, K. P., Embrechts, M. J., Breneman, C. M., Song, M., Guyon, I., & Elisseeff, A. (2003) · Cited by 407
Constructing models for content-based image retrieval
Schmid, C. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990922 · Cited by 367
Julesz, B., Gilbert, E. N., Shepp, L. A., & Frisch, H. L. (1973) · Perception · doi:10.1068/p020391 · Cited by 354
Recognition with local features: the kernel recipe
Wallraven, Caputo, & Graf (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238351 · Cited by 347
Transformation Invariance in Pattern Recognition – Tangent Distance and Tangent Propagation
Simard, P. Y., LeCun, Y. A., Denker, J. S., & Victorri, B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_17 · Cited by 341
On the Significance of Real-World Conditions for Material Classification
Hayman, E., Caputo, B., Fritz, M., & Eklundh, J.-O. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_21 · Cited by 335
Early vision and texture perception
Bergen, J. R., & Adelson, E. H. (1988) · Nature · doi:10.1038/333363a0 · Cited by 334
Class-specific material categorisation
Caputo, B., Hayman, E., & Mallikarjuna, P. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.54 · Cited by 286
Tieu, K., & Viola, P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000004830.93820.78 · Cited by 280
Near-regular texture analysis and manipulation
Liu, Y., Lin, W.-C., & Hays, J. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015731 · Cited by 260
Local linear transforms for texture measurements
Unser, M. (1986) · Signal Processing · doi:10.1016/0165-1684(86)90095-2 · Cited by 256
Learning texture discrimination masks
Jain, A. K., & Karu, K. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.481543 · Cited by 194
Discovering Texture Regularity as a Higher-Order Correspondence Problem
Hays, J., Leordeanu, M., Efros, A. A., & Liu, Y. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744047_40 · Cited by 183
3D Texture Recognition Using Bidirectional Feature Histograms
Cula, O. G., & Dana, K. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000020670.05764.55 · Cited by 167
Locally Invariant Fractal Features for Statistical Texture Classification
Varma, M., & Garg, R. D. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408876 · Cited by 150
Self-citationTransformation invariance in pattern recognition: Tangent distance and propagation
Simard, P. Y., LeCun, Y., Denker, J. S., & Victorri, B. (2000) · International Journal of Imaging Systems and Technology · doi:10.1002/1098-1098(2000)11:3<181::aid-ima1003>3.0.co;2-e · Cited by 150
Fowlkes, C. C., Martin, D., & Malik, J. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211452 · Cited by 131
Novel cluster-based probability model for texture synthesis, classification, and compression
Kris Popat, A., & Picard, R. W. (1993) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.157992 · Cited by 116
Rotation invariant texture recognition using a steerable pyramid
Greenspan, H. K., Belongie, S., Goodman, R. M., & Perona, P. (2002) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1994.576896 · Cited by 105
Rotation-invariant texture classification using modified Gabor filters
Haley, G. M., & Manjunath, B. S. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1995.529696 · Cited by 90
Geometric Methods for Feature Extraction and Dimensional Reduction
Burges, C. J. C. (2006) · Springer eBooks · doi:10.1007/0-387-25465-x_4 · Cited by 88
Statistical cues for domain specific image segmentation with performance analysis
Konishi, S., & Yuille, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855809 · Cited by 81
Quantitative Evaluation of Near Regular Texture Synthesis Algorithms
Lin, W., Hays, J. H., Wu, C., Liu, Y., & Kwatra, V. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.233 · Cited by 68
Unifying statistical texture classification frameworks
Varma, M., & Zisserman, A. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.03.012 · Cited by 67
Self-citationWeakly Supervised Learning of Visual Models and Its Application to Content-Based Retrieval
Schmid, C. (2003) · International Journal of Computer Vision · doi:10.1023/b:visi.0000004829.38247.b0 · Cited by 50
A Compact Model for Viewpoint Dependent Texture Synthesis
Zalesny, A., & Gool, L. V. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45296-6_9 · Cited by 47
Patch-Based Texture Edges and Segmentation
Wolf, L., Huang, X., Martin, I., & Metaxas, D. (2006) · Lecture notes in computer science · doi:10.1007/11744047_37 · Cited by 39
Computational models for texture analysis and texture synthesis
Garber, D. D. (2015) · University of Southern California Digital Library · doi:10.25549/usctheses-c29-408900 · Cited by 35
Statistical Estimation of Histogram Variation for Texture Classification
Broadhurst, R. E. (2005) · Cited by 35
Computational Models for Texture Analysis and Synthesis
Garber, D. D. (1981) · doi:10.21236/ada102470 · Cited by 28
Cited by
A Completed Modeling of Local Binary Pattern Operator for Texture Classification
Guo, Z., Zhang, L., & Zhang, D. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2044957 · Cited by 2,115
Invariant Scattering Convolution Networks
Bruna, J., & Mallat, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.230 · Cited by 1,633
PCANet: A Simple Deep Learning Baseline for Image Classification?
Chan, T.-H., Jia, K., Gao, S., Lu, J., Zeng, Z., & Ma, Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2475625 · Cited by 1,362
Enhanced Performance of Brain Tumor Classification via Tumor Region Augmentation and Partition
Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., Wang, Z., & Feng, Q. (2015) · PLOS ONE · doi:10.1371/journal.pone.0140381 · Cited by 879
“(cid:129) Local features: The next step is to extract local features within the ROI, such as scale-invariant feature transform (SIFT) descriptor [20] and raw patch [21].”
BackgroundTexture Feature Extraction Methods: A Survey
Humeau-Heurtier, A. (2019) · IEEE Access · doi:10.1109/access.2018.2890743 · Cited by 521
Metadata
- Authors
- Varma, M., & Zisserman, A.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2009-11
- Volume
- 31
- Issue
- 11
- Pages
- 2032-2047
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2152548630
- Cited by
- 607
- References
- 57
- FWCI
- 39.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.