The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Prior learning and Gibbs reaction-diffusion
Open accessAbstract
This article addresses two important themes in early visual computation: it presents a novel theory for learning the universal statistics of natural images, and, it proposes a general framework of designing reaction-diffusion equations for image processing. We studied the statistics of natural images including the scale invariant properties, then generic prior models were learned to duplicate the observed statistics, based on minimax entropy theory. The resulting Gibbs distributions have potentials of the form U(I; /spl Lambda/, S)=/spl Sigma//sub /spl alpha/=1//sup k//spl Sigma//sub x,y//spl lambda//sup (/spl alpha/)/((F/sup (/spl alpha/)/*I)(x,y)) with S={F/sup (1)/, F/sup (2)/,...,F/sup (K)/} being a set of filters and /spl Lambda/={/spl lambda//sup (1)/(),/spl lambda//sup (2)/(),...,/spl lambda//sup (K)/()} the potential functions. The learned Gibbs distributions confirm and improve the form of existing prior models such as line-process, but, in contrast to all previous models, inverted potentials were found to be necessary. We find that the partial differential equations given by gradient descent on U(I; /spl Lambda/, S) are essentially reaction-diffusion equations, where the usual energy terms produce anisotropic diffusion, while the inverted energy terms produce reaction associated with pattern formation, enhancing preferred image features. We illustrate how these models can be used for texture pattern rendering, denoising, image enhancement, and clutter removal by careful choice of both prior and data models of this type, incorporating the appropriate features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Scale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
The chemical basis of morphogenesis
Turing, A. M. (1952) · Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences · doi:10.1098/rstb.1952.0012 · Cited by 11,733 · cited 2×
“Furthermore, our prior learning method provides a novel framework for designing reaction-diffusion equations based on the observed images in a given application, without modeling the physical or chemical processes as people did before [33].”
BackgroundMethodSolutions of Ill-Posed Problems.
Bell, J. B., Tikhonov, A. N., & Arsenin, V. Y. (1978) · Mathematics of Computation · doi:10.2307/2006360 · Cited by 8,101
Optimal approximations by piecewise smooth functions and associated variational problems
Mumford, D., & Shah, J. (1989) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160420503 · Cited by 5,208
Self-citationГабор, Д. (1946) · Journal of the IEE · Cited by 5,036
The renormalization group: Critical phenomena and the Kondo problem
Wilson, K. G. (1975) · Reviews of Modern Physics · doi:10.1103/revmodphys.47.773 · Cited by 4,522
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,252
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Cited by
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Multi-Stage Progressive Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01458 · Cited by 2,095
Sparse Representation for Color Image Restoration
Mairal, J., Elad, M., & Sapiro, G. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.911828 · Cited by 1,716
Learning a variational network for reconstruction of accelerated MRI data
Hammernik, K., Klatzer, T., Kobler, E., Recht, M. P., Sodickson, D. K., Pock, T., & Knoll, F. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26977 · Cited by 1,713
Statistical Color Models with Application to Skin Detection
Jones, M. J., & Rehg, J. M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013200319198 · Cited by 1,542
Freeman, W. T., Pasztor, E. C., & Carmichael, O. T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026501619075 · Cited by 1,459
Chen, Y., & Pock, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2596743 · Cited by 1,344
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269
Blind deconvolution using a normalized sparsity measure
Krishnan, D., Tay, T., & Fergus, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995521 · Cited by 1,119
Fields of Experts: A Framework for Learning Image Priors
Roth, S., & Black, M. J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.160 · Cited by 1,039
Nontexture Inpainting by Curvature-Driven Diffusions
Chan, T. F., & Shen, J. (2001) · Journal of Visual Communication and Image Representation · doi:10.1006/jvci.2001.0487 · Cited by 932
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
Automatic Estimation and Removal of Noise from a Single Image
Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1176 · Cited by 486
On Advances in Statistical Modeling of Natural Images
Srivastava, A., Lee, A. B., Simoncelli, E. P., & Zhu, S.-C. (2003) · Journal of Mathematical Imaging and Vision · doi:10.1023/a:1021889010444 · Cited by 485
Self-citationRestoring an Image Taken through a Window Covered with Dirt or Rain
Eigen, D., Krishnan, D., & Fergus, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.84 · Cited by 454
Minimax Entropy Principle and Its Application to Texture Modeling
Zhu, S. C., Wu, Y. N., & Mumford, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1627 · Cited by 420
Self-citationImage Denoising Via Learned Dictionaries and Sparse representation
Elad, M., & Aharon, M. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.142 · Cited by 378
Internal statistics of a single natural image
Zontak, M., & Irani, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995401 · Cited by 375
“, [16, 13, 15]) impose parametric distribution on natural image responses to local filters.”
BackgroundMinimizing Nonsubmodular Functions with Graph Cuts-A Review
Kolmogorov, V., & Rother, C. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1031 · Cited by 362
Freeman, W. T., & Pasztor, E. C. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790414 · Cited by 345
Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement
Sun, J., Sun, J., Xu, Z., & Shum, H.-Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2095871 · Cited by 341
Statistical edge detection: learning and evaluating edge cues
Konishi, S., Yuille, A. L., Coughlan, J. M., & Zhu, S. C. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1159946 · Cited by 338
Self-citationOn learning optimized reaction diffusion processes for effective image restoration
Chen, Y., Yu, W., & Pock, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299163 · Cited by 323
Sparse Modeling for Image and Vision Processing
Mairal, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781680830095 · Cited by 322
Space and time in visual context
Schwartz, O., Hsu, A., & Dayan, P. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2155 · Cited by 309
Iterative kernel principal component analysis for image modeling
Kwa, Franz, M. O., & Scholkopf, B. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.181 · Cited by 306
Diffusion Snakes: Introducing Statistical Shape Knowledge into the Mumford-Shah Functional
Cremers, D., Tischhäuser, F., Weickert, J., & Schnörr, C. (2002) · International Journal of Computer Vision · doi:10.1023/a:1020826424915 · Cited by 306
What makes a good model of natural images?
Weiss, Y., & Freeman, W. T. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383092 · Cited by 300
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Pan, X., Zhan, X., Dai, B., Lin, D., Loy, C. C., & Luo, P. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115428 · Cited by 277
Learning generative texture models with extended Fields-of-Experts
Heess, N., Williams, C. K. I., & Hinton, G. E. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.115 · Cited by 275
On deep generative models with applications to recognition
Ranzato, M., Susskind, J., Mnih, V., & Hinton, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995710 · Cited by 237
Occlusion Models for Natural Images: A Statistical Study of a Scale-Invariant Dead Leaves Model
Lee, A. B., Mumford, D., & Huang, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011109015675 · Cited by 229
Self-citationBayesian Modelling of Visual Perception
Mamassian, P., Landy, M., & Maloney, L. T. (2002) · Probabilistic Models of the Brain · doi:10.7551/mitpress/5583.003.0005 · Cited by 210
On the spatial statistics of optical flow
Roth, S., & Black, M. J. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.180 · Cited by 95
How Well Do Filter-Based MRFs Model Natural Images?
Gao, Q., & Roth, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-32717-9_7 · Cited by 22
Metadata
- Authors
- Zhu, S. C., & Mumford, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1997
- Volume
- 19
- Issue
- 11
- Pages
- 1236-1250
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2149396346
- Cited by
- 319
- References
- 40
- FWCI
- 16.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.