The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Inpainting and Zooming Using Sparse Representations
Open accessAbstract
Representing the image to be inpainted in an appropriate sparse representation dictionary, and combining elements from Bayesian statistics and modern harmonic analysis, we introduce an expectation maximization (EM) algorithm for image inpainting and interpolation. From a statistical point of view, the inpainting/interpolation can be viewed as an estimation problem with missing data. Toward this goal, we propose the idea of using the EM mechanism in a Bayesian framework, where a sparsity promoting prior penalty is imposed on the reconstructed coefficients. The EM framework gives a principled way to establish formally the idea that missing samples can be recovered/interpolated based on sparse representations. We first introduce an easy and efficient sparse-representation-based iterative algorithm for image inpainting. Additionally, we derive its theoretical convergence properties. Compared to its competitors, this algorithm allows a high degree of flexibility to recover different structural components in the image (piecewise smooth, curvilinear, texture, etc.). We also suggest some guidelines to automatically tune the regularization parameter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Donoho, D. L. (2004) · Cited by 16,703
Candes, E. J., Romberg, J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.862083 · Cited by 15,639
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
Candes, E. J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.885507 · Cited by 6,839
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Region Filling and Object Removal by Exemplar-Based Image Inpainting
Criminisi, A., Perez, P., & Toyama, K. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.833105 · Cited by 3,258 · cited 2×
“[28] also proposed a fill-in image completion method which bears similarities with [ 27 ], although the fill-in step was differently approached.”
BackgroundResultTexture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
Donoho, D. L., & Elad, M. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0437847100 · Cited by 2,898
Signal Recovery by Proximal Forward-Backward Splitting
Combettes, P. L., & Wajs, V. R. (2005) · Multiscale Modeling & Simulation · doi:10.1137/050626090 · Cited by 2,678
Fast Discrete Curvelet Transforms
Candès, E., Demanet, L., Donoho, D., & Ying, L. (2006) · Multiscale Modeling & Simulation · doi:10.1137/05064182x · Cited by 2,573
Weak convergence of the sequence of successive approximations for nonexpansive mappings
Opial, Z. (1967) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1967-11761-0 · Cited by 2,340
The curvelet transform for image denoising
Starck, J.-L., Candes, E. J., & Donoho, D. L. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.1014998 · Cited by 2,253
Self-citationConvergence of a Block Coordinate Descent Method for Nondifferentiable Minimization
Tseng, P. (2001) · Journal of Optimization Theory and Applications · doi:10.1023/a:1017501703105 · Cited by 1,989
Mathematical Statistics: Basic Ideas and Selected Topics.
Wachter, K. W., Bickel, P. J., & Doksum, K. A. (1979) · Journal of the American Statistical Association · doi:10.2307/2286373 · Cited by 1,886
Maximum likelihood estimation via the ECM algorithm: A general framework
MENG, X.-L., & RUBIN, D. B. (1993) · Biometrika · doi:10.1093/biomet/80.2.267 · Cited by 1,861
Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges
Candès, E. J., & Donoho, D. L. (2000) · Cited by 1,330
Mathematical Models for Local Nontexture Inpaintings
Shen, J., & Chan, T. F. (2002) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139900368844 · Cited by 1,195
Simultaneous structure and texture image inpainting
Bertalmio, M., Vese, L., Sapiro, G., & Osher, S. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.815261 · Cited by 1,079
Navier-stokes, fluid dynamics, and image and video inpainting
Bertalmio, M., Bertozzi, A. L., & Sapiro, G. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990497 · Cited by 1,042
Image decomposition via the combination of sparse representations and a variational approach
Starck, J.-L., Elad, M., & Donoho, D. L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.852206 · Cited by 987
Self-citationFilling-in by joint interpolation of vector fields and gray levels
Ballester, C., Bertalmio, M., Caselles, V., Sapiro, G., & Verdera, J. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.935036 · Cited by 962
Sparse representations in unions of bases
Gribonval, R., & Nielsen, M. (2003) · IEEE Transactions on Information Theory · doi:10.1109/tit.2003.820031 · Cited by 960
Extensions of compressed sensing
Tsaig, Y., & Donoho, D. L. (2006) · Signal Processing · doi:10.1016/j.sigpro.2005.05.029 · Cited by 947
Nontexture Inpainting by Curvature-Driven Diffusions
Chan, T. F., & Shen, J. (2001) · Journal of Visual Communication and Image Representation · doi:10.1006/jvci.2001.0487 · Cited by 932
Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods
Chan, T. F., & Shen, J. (. (2005) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717877 · Cited by 915
Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)
Elad, M., Starck, J.-L., Querre, P., & Donoho, D. L. (2005) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2005.03.005 · Cited by 904
Self-citationRidgelets: a key to higher-dimensional intermittency?
Candès, E. J., & Donoho, D. L. (1999) · Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.1999.0444 · Cited by 893
A generalized uncertainty principle and sparse representation in pairs of bases
Elad, M., & Bruckstein, A. M. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.801410 · Cited by 673
Vector-valued image regularization with PDEs: a common framework for different applications
Tschumperle, D., & Deriche, R. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.87 · Cited by 671
Euler's Elastica and Curvature-Based Inpainting
Shen, J., Kang, S. H., & Chan, T. F. (2003) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139901390088 · Cited by 609
WaveLab and Reproducible Research
Buckheit, J. B., & Donoho, D. L. (1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7_5 · Cited by 537
Level lines based disocclusion
Masnou, S., & Morel, J.-M. (2002) · Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269) · doi:10.1109/icip.1998.999016 · Cited by 535
Regularization of Wavelet Approximations
Antoniadis, A., & Fan, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208942 · Cited by 498
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882267 · Cited by 492
Deterministic annealing EM algorithm
Ueda, N., & Nakano, R. (1998) · Neural Networks · doi:10.1016/s0893-6080(97)00133-0 · Cited by 469
Image Processing and Data Analysis, The Multiscale Approach
Seymour, L., Starck, J. L., Murtagh, F., & Bijaoui, A. (1999) · Journal of the American Statistical Association · doi:10.2307/2669962 · Cited by 467
Self-citationRedundant Multiscale Transforms and Their Application for Morphological Component Separation
Starck, J.-L., Elad, M., & Donoho, D. (2004) · Advances in Imaging and Electron Physics · doi:10.1016/s1076-5670(04)32006-9 · Cited by 443
Self-citationInpainting of Binary Images Using the Cahn–Hilliard Equation
Bertozzi, A. L., Esedoglu, S., & Gillette, A. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.887728 · Cited by 438
Digital inpainting based on the Mumford–Shah–Euler image model
ESEDOGLU, S., & SHEN, J. (2002) · European Journal of Applied Mathematics · doi:10.1017/s0956792502004904 · Cited by 418
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882267 · Cited by 343
An axiomatic approach to image interpolation
Caselles, V., Morel, J.-M., & Sbert, C. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661188 · Cited by 341
Local Strong Homogeneity of a Regularized Estimator
Nikolova, M. (2000) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139997327794 · Cited by 291
Why Simple Shrinkage Is Still Relevant for Redundant Representations?
Elad, M. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.885522 · Cited by 291
Rane, S. D., Sapiro, G., & Bertalmio, M. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.804264 · Cited by 220
Fast Image Inpainting Based on Coherence Transport
Bornemann, F., & März, T. (2007) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-007-0017-6 · Cited by 218
Non-texture inpainting by curvature-driven diffusions (CDD)
Chan, T. F.-C., & Shen, J. (2001) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 217
Elad, M., Matalon, B., & Zibulevsky, M. (2007) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2007.02.002 · Cited by 201
Image repairing: robust image synthesis by adaptive ND tensor voting
Jia, J., & Tang, C.-K. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211414 · Cited by 197
Guleryuz, O. G. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863057 · Cited by 193
Nikolova, M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040619582 · Cited by 178
Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising
Sardy, S., Bruce, A. G., & Tseng, P. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474885 · Cited by 171
Guleryuz, O. G. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863055 · Cited by 140
On the Rate of Convergence of the ECM Algorithm
Meng, X. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325371 · Cited by 117
A variational model for filling-in gray level and color images
Ballester, C., Caselles, V., Verdera, J., et al. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937493 · Cited by 65
Superresolution image reconstruction using fast inpainting algorithms
Chan, T. F.-C., Ng, M. K., Yau, A. C., & Yip, A. M. (2007) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2006.09.005 · Cited by 56
Regularization of Wavelets Approximations
Antoniadis, A., & Fan, J. (2011) · eScholarship (California Digital Library) · Cited by 49
Oriented texture completion by AM-FM reaction-diffusion
Acton, S. T., Mukherjee, D. P., Havlicek, J., & Bovik, A. C. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.923285 · Cited by 44
Cited by
A Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
Split Bregman Methods and Frame Based Image Restoration
Cai, J.-F., Osher, S., & Shen, Z. (2010) · Multiscale Modeling & Simulation · doi:10.1137/090753504 · Cited by 670
Yu, G., Sapiro, G., & Mallat, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176743 · Cited by 561
Image Inpainting by Patch Propagation Using Patch Sparsity
Xu, Z., & Sun, J. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042098 · Cited by 518
MAT: Mask-Aware Transformer for Large Hole Image Inpainting
Li, W., Lin, Z., Zhou, K., Qi, L., Wang, Y., & Jia, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01049 · Cited by 449
Metadata
- Authors
- Fadili, M. J., Starck, J.-L., & Murtagh, F.
- Venue
- The Computer Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-02-19
- Volume
- 52
- Issue
- 1
- Pages
- 64-79
- ISSN
- 0010-4620 (ISSN-L)
- 1460-2067
- OpenAlex
- W2108454251
- Cited by
- 333
- References
- 62
- FWCI
- 23.56
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.