The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling
Open accessAbstract
This article presents a statistical theory for texture modeling. This theory combines filtering theory and Markov random field modeling through the maximum entropy principle, and interprets and clarifies many previous concepts and methods for texture analysis and synthesis from a unified point of view. Our theory characterizes the ensemble of images I with the same texture appearance by a probability distribution f(I) on a random field, and the objective of texture modeling is to make inference about f(I), given a set of observed texture examples.In our theory, texture modeling consists of two steps. (1) A set of filters is selected from a general filter bank to capture features of the texture, these filters are applied to observed texture images, and the histograms of the filtered images are extracted. These histograms are estimates of the marginal distributions of f( I). This step is called feature extraction. (2) The maximum entropy principle is employed to derive a distribution p(I), which is restricted to have the same marginal distributions as those in (1). This p(I) is considered as an estimate of f( I). This step is called feature fusion. A stepwise algorithm is proposed to choose filters from a general filter bank. The resulting model, called FRAME (Filters, Random fields And Maximum Entropy), is a Markov random field (MRF) model, but with a much enriched vocabulary and hence much stronger descriptive ability than the previous MRF models used for texture modeling. Gibbs sampler is adopted to synthesize texture images by drawing typical samples from p(I), thus the model is verified by seeing whether the synthesized texture images have similar visual appearances to the texture images being modeled. Experiments on a variety of 1D and 2D textures are described to illustrate our theory and to show the performance of our algorithms. These experiments demonstrate that many textures which are previously considered as from different categories can be modeled and synthesized in a common framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Daubechies, I. (1992) · doi:10.1137/1.9781611970104 · Cited by 15,979
Daubechies, I., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 15,631
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
Spatial Interaction and the Statistical Analysis of Lattice Systems
Besag, J. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00999.x · Cited by 6,067
Statistical and structural approaches to texture
Haralick, R. M. (1979) · Proceedings of the IEEE · doi:10.1109/proc.1979.11328 · Cited by 5,759
Габор, Д. (1946) · Journal of the IEE · Cited by 5,036
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Cited by
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Random Walks for Image Segmentation
Grady, L. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.233 · Cited by 2,624
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806
Statistical Color Models with Application to Skin Detection
Jones, M. J., & Rehg, J. M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013200319198 · Cited by 1,542
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498
Fast texture synthesis using tree-structured vector quantization
Wei, L.-Y., & Levoy, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.345009 · Cited by 1,356
Artificial Intelligence: A New Synthesis
(1998) · Elsevier eBooks · doi:10.1016/c2009-0-27773-7 · Cited by 1,163
Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance
Do, M. N., & Vetterli, M. (2002) · IEEE Transactions on Image Processing · doi:10.1109/83.982822 · Cited by 1,147
Fields of Experts: A Framework for Learning Image Priors
Roth, S., & Black, M. J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.160 · Cited by 1,039
Cremers, D., Rousson, M., & Deriche, R. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-8711-1 · Cited by 1,006
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Image Quality Assessment: Unifying Structure and Texture Similarity
Ding, K., Ma, K., Wang, S., & Simoncelli, E. P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045810 · Cited by 952
Peripheral vision and pattern recognition: A review
Strasburger, H., Rentschler, I., & Jüttner, M. (2011) · Journal of Vision · doi:10.1167/11.5.13 · Cited by 943
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
(2008) · Cited by 838
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation
Paragios, N., & Deriche, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014080923068 · Cited by 754
Solving inverse problems using data-driven models
Arridge, S., Maass, P., Öktem, O., & Schönlieb, C.-B. (2019) · Acta Numerica · doi:10.1017/s0962492919000059 · Cited by 686
Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing
Vese, L. A., & Osher, S. J. (2003) · Journal of Scientific Computing · doi:10.1023/a:1025384832106 · Cited by 660
Real-time texture synthesis by patch-based sampling
Liang, L., Liu, C., Xu, Y.-Q., Guo, B., & Shum, H.-Y. (2001) · ACM Transactions on Graphics · doi:10.1145/501786.501787 · Cited by 655
Image Decomposition and Restoration Using Total Variation Minimization and the H1
Osher, S., Solé, A., & Vese, L. (2003) · Multiscale Modeling & Simulation · doi:10.1137/s1540345902416247 · Cited by 613
Generative Image Modeling Using Style and Structure Adversarial Networks
Wang, X., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_20 · Cited by 574
Multiresolution sampling procedure for analysis and synthesis of texture images
De Bonet, J. S. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258882 · Cited by 570
Image segmentation by data-driven markov chain monte carlo
Tu, Z., & Zhu, S.-C. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000239 · Cited by 565
Self-citationTexture Networks: Feed-forward Synthesis of Textures and Stylized Images
Ulyanov, D., Lebedev, V., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.03417 · Cited by 531
Image compression via joint statistical characterization in the wavelet domain
Buccigrossi, R. W., & Simoncelli, E. P. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.806616 · Cited by 523
StyleBank: An Explicit Representation for Neural Image Style Transfer
Chen, D., Yuan, L., Liao, J., Yu, N., & Hua, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.296 · Cited by 502
A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques
Xie, X. (2008) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.268 · Cited by 500
Visualizing Deep Convolutional Neural Networks Using Natural Pre-images
Mahendran, A., & Vedaldi, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0911-8 · Cited by 496
Statistics of natural images and models
Huang, J., & Mumford, D. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.786990 · Cited by 495
Self-citationStatistical color models with application to skin detection
Jones, M. J., & Rehg, J. M. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.786951 · Cited by 491
Automatic Estimation and Removal of Noise from a Single Image
Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1176 · Cited by 486
Efficient Multilevel Brain Tumor Segmentation With Integrated Bayesian Model Classification
Corso, J. J., Sharon, E., Dube, S., El-Saden, S., Sinha, U., & Yuille, A. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.912817 · Cited by 441
Bostanabad, R., Zhang, Y., Li, X., Kearney, T., Brinson, L. C., Apley, D. W., Liu, W. K., & Chen, W. (2018) · Progress in Materials Science · doi:10.1016/j.pmatsci.2018.01.005 · Cited by 434
Reduced-reference image quality assessment using a wavelet-domain natural image statistic model
Wang, Z., & Simoncelli, E. P. (2005) · SPIE Proceedings · doi:10.1117/12.597306 · Cited by 438
Optimal Spatial Adaptation for Patch-Based Image Denoising
Kervrann, C., & Boulanger, J. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.877529 · Cited by 431
Texture classification: are filter banks necessary?
Varma, M., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211534 · Cited by 421
Face Hallucination: Theory and Practice
Liu, C., Shum, H.-Y., & Freeman, W. T. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0029-5 · Cited by 398
Sigal, L., Bhatia, S., Roth, S., Black, M. J., & Isard, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315063 · Cited by 391
From BoW to CNN: Two Decades of Texture Representation for Texture Classification
Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., & Pietikäinen, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1125-z · Cited by 375
Minimizing Nonsubmodular Functions with Graph Cuts-A Review
Kolmogorov, V., & Rother, C. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1031 · Cited by 362
A probabilistic exclusion principle for tracking multiple objects
MacCormick, J., & Blake, A. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791275 · Cited by 357
Depth estimation from image structure
Torralba, A., & Oliva, A. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033214 · Cited by 343
Support vector machines for texture classification
Kim, K. I., Jung, K., Park, S. H., & Kim, H. J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1046177 · Cited by 343
Prior learning and Gibbs reaction-diffusion
Zhu, S. C., & Mumford, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.632983 · Cited by 319
Self-citationDirectional multiresolution image representations
Do, M. N. (2002) · doi:10.5075/epfl-thesis-2500 · Cited by 312
I2T: Image Parsing to Text Description
Yao, B. Z., Yang, X., Lin, L., Lee, M. W., & Zhu, S.-C. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050411 · Cited by 310
Self-citationViewpoint Invariant Texture Description Using Fractal Analysis
Xu, Y., Ji, H., & Fermüller, C. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0220-6 · Cited by 297
Content based image retrieval using motif cooccurrence matrix
Jhanwar, N., Chaudhuri, S., Seetharaman, G., & Zavidovique, B. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.03.026 · Cited by 295
Wang, Z., Wu, G., Sheikh, H. R., Simoncelli, E. P., Yang, E.-H., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864165 · Cited by 293
Texture Classification from Random Features
Liu, L., & Fieguth, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.145 · Cited by 289
Learning generative texture models with extended Fields-of-Experts
Heess, N., Williams, C. K. I., & Hinton, G. E. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.115 · Cited by 275
Statistical models for images: compression, restoration and synthesis
Simoncelli, E. P. (2002) · Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136) · doi:10.1109/acssc.1997.680530 · Cited by 270
Detecting hidden messages using higher-order statistical models
Farid, H. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1040098 · Cited by 268
A Probabilistic Exclusion Principle for Tracking Multiple Objects
MacCormick, J., & Blake, A. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008122218374 · Cited by 267
Occlusion Models for Natural Images: A Statistical Study of a Scale-Invariant Dead Leaves Model
Lee, A. B., Mumford, D., & Huang, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011109015675 · Cited by 229
Self-citationWang, Z., & Simoncelli, E. P. (2008) · Journal of Vision · doi:10.1167/8.12.8 · Cited by 138
“…" , in which the model is used to randomly create a texture with statistics matching a reference texture, and a human subject then judges the similarity of the two textures (e.g., Faugeras & Pratt, 1980; Gagalowicz, 1981; Heeger & Bergen 1995; Zhu et al., 1998; Portilla & Simoncelli, 2000).”
MethodTraining an Active Random Field for Real-Time Image Denoising
Barbu, A. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2028254 · Cited by 105
“A convolutional approach is also taken in the FRAME model for texture modeling [47].”
MethodOn the spatial statistics of optical flow
Roth, S., & Black, M. J. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.180 · Cited by 95
Statistical Modeling of Photographic Images
Simoncelli, E. P. (2005) · Handbook of Image and Video Processing · doi:10.1016/b978-012119792-6/50089-9 · Cited by 93
Metadata
- Authors
- Zhu, S. C., Wu, Y., & Mumford, D.
- Venue
- International Journal of Computer Vision
- Published
- 1998-03
- Volume
- 27
- Issue
- 2
- Pages
- 107-126
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2150920547
- Cited by
- 652
- References
- 31
- FWCI
- 28.39
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.