The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms
Abstract
We propose a powerful video filtering algorithm that exploits temporal and spatial redundancy characterizing natural video sequences. The algorithm implements the paradigm of nonlocal grouping and collaborative filtering, where a higher dimensional transform-domain representation of the observations is leveraged to enforce sparsity, and thus regularize the data: 3-D spatiotemporal volumes are constructed by tracking blocks along trajectories defined by the motion vectors. Mutually similar volumes are then grouped together by stacking them along an additional fourth dimension, thus producing a 4-D structure, termed group, where different types of data correlation exist along the different dimensions: local correlation along the two dimensions of the blocks, temporal correlation along the motion trajectories, and nonlocal spatial correlation (i.e., self-similarity) along the fourth dimension of the group. Collaborative filtering is then realized by transforming each group through a decorrelating 4-D separable transform and then by shrinkage and inverse transformation. In this way, the collaborative filtering provides estimates for each volume stacked in the group, which are then returned and adaptively aggregated to their original positions in the video. The proposed filtering procedure addresses several video processing applications, such as denoising, deblocking, and enhancement of both grayscale and color data. Experimental results prove the effectiveness of our method in terms of both subjective and objective visual quality, and show that it outperforms the state of the art in video denoising.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Self-citationOverview of the H.264/AVC video coding standard
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815165 · Cited by 8,184
Convergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
Lagarias, J. C., Reeds, J. A., Wright, M. H., & Wright, P. E. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496303470 · Cited by 7,447
A Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
Rate-constrained coder control and comparison of video coding standards
Wiegand, T., Schwarz, H., Joch, A., Kossentini, F., & Sullivan, G. J. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815168 · Cited by 3,146
Image enhancement via adaptive unsharp masking
Polesel, A., Ramponi, G., & Mathews, V. J. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.826787 · Cited by 782
Nonlocal Image and Movie Denoising
Buades, A., Coll, B., & Morel, J.-M. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0052-1 · Cited by 769
Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images
Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.891788 · Cited by 725
Self-citationMotion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Seshadrinathan, K., & Bovik, A. C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2034992 · Cited by 708 · cited 3×
“TERMS OF PSNR (dB) AND MOVIE INDEX [46] (THE LOWER THE”
BackgroundMethodInfluentialTransform coefficient histogram-based image enhancement algorithms using contrast entropy
Agaian, S. S., Silver, B., & Panetta, K. A. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888338 · Cited by 575
The MPEG-4 video standard verification model
Sikora, T. (1997) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.554415 · Cited by 571
Image restoration by sparse 3D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2008) · SPIE Proceedings · doi:10.1117/12.766355 · Cited by 461
Self-citationDabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · 2007 IEEE International Conference on Image Processing · doi:10.1109/icip.2007.4378954 · Cited by 458
Self-citationBlind measurement of blocking artifacts in images
Wang, Z., Bovik, A. C., & Evan, B. L. (2002) · Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101) · doi:10.1109/icip.2000.899622 · Cited by 413
Video Denoising By Sparse 3D Transform-Domain Collaborative Filtering
Dabov, K., Foi, A., & Egiazarian, K. (2007) · doi:10.5281/zenodo.40233 · Cited by 373
Self-citationFrom Local Kernel to Nonlocal Multiple-Model Image Denoising
Katkovnik, V., Foi, A., Egiazarian, K., & Astola, J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0272-7 · Cited by 353
Self-citationImage Sequence Denoising via Sparse and Redundant Representations
Protter, M., & Elad, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2008065 · Cited by 323
Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts
Chen, T., Wu, H. R., & Qiu, B. (2001) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.920189 · Cited by 171
Aghagolzadeh, S., & Ersoy, O. K. (1992) · Optical Engineering · doi:10.1117/12.56095 · Cited by 112
Content based video matching using spatiotemporal volumes
Basharat, A., Zhai, Y., & Shah, M. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.016 · Cited by 94
Weighted overcomplete denoising
Guleryuz, O. G. (2004) · doi:10.1109/acssc.2003.1292330 · Cited by 51
Patch-Based Video Processing: A Variational Bayesian Approach
Li, X., & Zheng, Y. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005805 · Cited by 51
Artifacts in alpha-rooting of images
McClellan, J. H. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1980.1170896 · Cited by 36
Image upsampling via spatially adaptive block-matching filtering
Danielyan, A., Foi, A., Katkovnik, V. Y., et al. (2008) · Cited by 14
Self-citationRethinking Artificial Intelligence
Howard, N. (2015) · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/icci-cc.2015.7259423 · Cited by 8
Subband adaptive regularization method for removing blocking effect
Hong, S.-W., Chan, Y., & Siu, W.-C. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1995.537531 · Cited by 8
Cited by
Rank Minimization for Snapshot Compressive Imaging
Liu, Y., Yuan, X., Suo, J., Brady, D. J., & Dai, Q. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873587 · Cited by 466
Burst Denoising with Kernel Prediction Networks
Mildenhall, B., Barron, J. T., Chen, J., Sharlet, D., Ng, R., & Carroll, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00265 · Cited by 404
Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations
Zhuang, L., & Bioucas-Dias, J. M. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2796570 · Cited by 363
Bao, W., Lai, W.-S., Zhang, X., Gao, Z., & Yang, M.-H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2941941 · Cited by 362
Chen, C., Chen, Q., Do, M., & Koltun, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00328 · Cited by 282
Metadata
- Authors
- Maggioni, M., Boracchi, G., Foi, A., & Egiazarian, K.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2012-09
- Volume
- 21
- Issue
- 9
- Pages
- 3952-3966
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1965221572
- Cited by
- 388
- References
- 27
- FWCI
- 12.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.