The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
Open accessAbstract
Many material and biological samples in scientific imaging are characterized by nonlocal repeating structures. These are studied using scanning electron microscopy and electron tomography. Sparse sampling of individual pixels in a two-dimensional image acquisition geometry, or sparse sampling of projection images with large tilt increments in a tomography experiment, can enable high speed data acquisition and minimize sample damage caused by the electron beam. In this paper, we present an algorithm for electron tomographic reconstruction and sparse image interpolation that exploits the nonlocal redundancy in images. We adapt a framework, termed plug-and-play priors, to solve these imaging problems in a regularized inversion setting. The power of the plug-and-play approach is that it allows a wide array of modern denoising algorithms to be used as a “prior model” for tomography and image interpolation. We also present sufficient mathematical conditions that ensure convergence of the plug-and-play approach, and we use these insights to design a new nonlocal means denoising algorithm. Finally, we demonstrate that the algorithm produces higher quality reconstructions on both simulated and real electron microscope data, along with improved convergence properties compared to other methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
A Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Eckstein, J., & Bertsekas, D. P. (1992) · Mathematical Programming · doi:10.1007/bf01581204 · Cited by 2,791
A dual algorithm for the solution of nonlinear variational problems via finite element approximation
Gabay, D., & Mercier, B. (1976) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(76)90003-1 · Cited by 2,514
A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064 · cited 1×
“The solution to equation (1) may be computed using a variety of optimization methods, such as the alternating direction method of multipliers (ADMM), the fast iterative shrinkage thresholding algorithm (FISTA) [52], the two-step iterative shrinkage thresholding (TwIST) [53], or sparse reconstruction by separable appro…”
MethodSparse Reconstruction by Separable Approximation
Wright, S. J., Nowak, R. D., & Figueiredo, M. A. T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016892 · Cited by 1,854
Non-local sparse models for image restoration
Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459452 · Cited by 1,666
Proximité et dualité dans un espace hilbertien
Moreau, J. J. (1965) · Bulletin de la Société mathématique de France · doi:10.24033/bsmf.1625 · Cited by 1,462
Nonlocal Operators with Applications to Image Processing
Gilboa, G., & Osher, S. (2009) · Multiscale Modeling & Simulation · doi:10.1137/070698592 · Cited by 1,423
An Introduction to Harmonic Analysis
Katznelson, Y. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165372 · Cited by 1,366
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
Plug-and-Play priors for model based reconstruction
Venkatakrishnan, S. V., Bouman, C. A., & Wohlberg, B. (2013) · 2013 IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6737048 · Cited by 1,178 · cited 3×
“In this paper, we extend our plug-and-play framework of [40], [48] to present a robust algorithm for tomographic reconstruction and sparse image interpolation that exploits the non-local redundancies in microscope images.”
Self-citationA three‐dimensional statistical approach to improved image quality for multislice helical CT
Thibault, J., Sauer, K. D., Bouman, C. A., & Hsieh, J. (2007) · Medical Physics · doi:10.1118/1.2789499 · Cited by 937
Self-citationPlug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)
Elad, M., Starck, J.-L., Querre, P., & Donoho, D. L. (2005) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2005.03.005 · Cited by 904
Perron, O. (1907) · Mathematische Annalen · doi:10.1007/bf01449896 · Cited by 886
A generalized Gaussian image model for edge-preserving MAP estimation
Bouman, C., & Sauer, K. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.236536 · Cited by 884
Self-citationElectron tomography and holography in materials science
Midgley, P. A., & Dunin-Borkowski, R. E. (2009) · Nature Materials · doi:10.1038/nmat2406 · Cited by 883
BM3D Frames and Variational Image Deblurring
Danielyan, A., Katkovnik, V., & Egiazarian, K. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176954 · Cited by 611
Image Inpainting : Overview and Recent Advances
Guillemot, C., & Le Meur, O. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2273004 · Cited by 608
A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical
Milanfar, P. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.2179329 · Cited by 605
Three-Dimensional Structure of Herpes Simplex Virus from Cryo-Electron Tomography
Grünewald, K., Desai, P., Winkler, D. C., Heymann, J. B., Belnap, D. M., Baumeister, W., & Steven, A. C. (2003) · Science · doi:10.1126/science.1090284 · Cited by 586
Image restoration by sparse 3D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2008) · SPIE Proceedings · doi:10.1117/12.766355 · Cited by 461
Ghadimi, E., Teixeira, A., Shames, I., & Johansson, M. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2354892 · Cited by 437
Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling
Dong, W., Zhang, L., Lukac, R., & Shi, G. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2231086 · Cited by 362
FlexISP: a flexible camera image processing framework
Heide, F., Steinberger, M., Tsai, Y.-T., Rouf, M., Pająk, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661260 · Cited by 298
Patch-Based Near-Optimal Image Denoising
Chatterjee, P., & Milanfar, P. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2172799 · Cited by 296
Fast gradient-based methods for Bayesian reconstruction of transmission and emission PET images
Mumcuoglu, E. U., Leahy, R., Cherry, S. R., & Zhou, Z. (1994) · IEEE Transactions on Medical Imaging · doi:10.1109/42.363099 · Cited by 282
An ADMM Algorithm for a Class of Total Variation Regularized Estimation Problems
Wahlberg, B., Boyd, S., Annergren, M., & Wang, Y. (2012) · IFAC Proceedings Volumes · doi:10.3182/20120711-3-be-2027.00310 · Cited by 256
Non-local Regularization of Inverse Problems
Peyré, G., Bougleux, S., & Cohen, L. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88690-7_5 · Cited by 249
Introduction to Conventional Transmission Electron Microscopy
Graef, M. D. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511615092 · Cited by 240
Talebi, H., & Milanfar, P. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293425 · Cited by 200
Compressive Sensing by Learning a Gaussian Mixture Model From Measurements
Yang, J., Liao, X., Yuan, X., Llull, P., Brady, D. J., Sapiro, G., & Carin, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2365720 · Cited by 197
A nonlocal-means approach to exemplar-based inpainting
Wong, A., & Orchard, J. (2008) · 2008 15th IEEE International Conference on Image Processing · doi:10.1109/icip.2008.4712326 · Cited by 184
Stevens, A., Yang, H., Carin, L., Arslan, I., & Browning, N. D. (2014) · Microscopy · doi:10.1093/jmicro/dft042 · Cited by 158
Nonlocal Prior Bayesian Tomographic Reconstruction
Chen, Y., Ma, J., Feng, Q., Luo, L., Shi, P., & Chen, W. (2007) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-007-0042-5 · Cited by 131
Electron tomography in life science
Bárcena, M., & Koster, A. J. (2009) · Seminars in Cell and Developmental Biology · doi:10.1016/j.semcdb.2009.07.008 · Cited by 100
Symmetrizing Smoothing Filters
Milanfar, P. (2013) · SIAM Journal on Imaging Sciences · doi:10.1137/120875843 · Cited by 91
Image restoration and reconstruction using variable splitting and class-adapted image priors
Teodoro, A. M., Bioucas‐Dias, J. M., & Figueiredo, M. A. T. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7533014 · Cited by 81
Nonlocal Regularization of Inverse Problems: A Unified Variational Framework
Yang, Z., & Jacob, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2216278 · Cited by 74
Venkatakrishnan, S. V., Drummy, L. F., Jackson, M., Graef, M. D., Simmons, J. P., & Bouman, C. A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2277784 · Cited by 70
Self-citationZnO Nanorod−Thermoplastic Polyurethane Nanocomposites: Morphology and Shape Memory Performance
Koerner, H., Kelley, J., George, J., Drummy, L. F., Mirau, P. A., Bell, N. S., Hsu, J. W. P., & Vaia, R. A. (2009) · Macromolecules · doi:10.1021/ma901671v · Cited by 53
Self-citationHusarik, D. B., Marin, D., Samei, E., Richard, S., Chen, B., Jaffe, T. A., Bashir, M. R., & Nelson, R. C. (2012) · Investigative Radiology · doi:10.1097/rli.0b013e318251eafd · Cited by 53
Model-Based Iterative Reconstruction for Bright-Field Electron Tomography
Venkatakrishnan, S. V., Drummy, L. F., Jackson, M., Graef, M. D., Simmons, J. P., & Bouman, C. A. (2015) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2014.2371751 · Cited by 53
Self-citationA Universal Variational Framework for Sparsity-Based Image Inpainting
Li, F., & Zeng, T. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2346030 · Cited by 41
Cited by
Learning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction
Gupta, H., Jin, K. H., Nguyen, H. Q., McCann, M. T., & Unser, M. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2832656 · Cited by 380
A Plug-and-Play Priors Approach for Solving Nonlinear Imaging Inverse Problems
Kamilov, U. S., Mansour, H., & Wohlberg, B. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2763583 · Cited by 264
Self-citationPlug-and-Play Methods for Magnetic Resonance Imaging: Using Denoisers for Image Recovery
Ahmad, R., Bouman, C. A., Buzzard, G. T., Chan, S., Liu, S., Reehorst, E. T., & Schniter, P. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2949470 · Cited by 261
Self-citation
Metadata
- Authors
- Sreehari, S., Venkatakrishnan, S. V., Wohlberg, B., Buzzard, G. T., Drummy, L. F., Simmons, J. P., & Bouman, C. A.
- Venue
- IEEE Transactions on Computational Imaging
- Published
- 2016-12
- Volume
- 2
- Issue
- 4
- Pages
- 408-423
- ISSN
- 2333-9403 (ISSN-L)
- 2334-0118
- 2573-0436
- OpenAlex
- W2296055064
- Cited by
- 300
- References
- 50
- FWCI
- 14.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.