The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
On Bayesian Adaptive Video Super Resolution
Abstract
Although multiframe super resolution has been extensively studied in past decades, super resolving real-world video sequences still remains challenging. In existing systems, either the motion models are oversimplified or important factors such as blur kernel and noise level are assumed to be known. Such models cannot capture the intrinsic characteristics that may differ from one sequence to another. In this paper, we propose a Bayesian approach to adaptive video super resolution via simultaneously estimating underlying motion, blur kernel, and noise level while reconstructing the original high-resolution frames. As a result, our system not only produces very promising super resolution results outperforming the state of the art, but also adapts to a variety of noise levels and blur kernels. To further analyze the effect of noise and blur kernel, we perform a two-step analysis using the Cramer-Rao bounds. We study how blur kernel and noise influence motion estimation with aliasing signals, how noise affects super resolution with perfect motion, and finally how blur kernel and noise influence super resolution with unknown motion. Our analysis results confirm empirical observations, in particular that an intermediate size blur kernel achieves the optimal image reconstruction results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Horn, B. K. P., & Schunck, B. G. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90024-2 · Cited by 10,312
Fundamentals of statistical signal processing: Estimation theory
Prasad, K. V. (1994) · Control Engineering Practice · doi:10.1016/0967-0661(94)90195-3 · Cited by 7,902
Discrete-time Signal Processing
Williamson, D. (1999) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0541-1 · Cited by 4,858
Super-resolution image reconstruction: a technical overview
Park, S. C., Park, M. K., & Kang, M. G. (2003) · IEEE Signal Processing Magazine · doi:10.1109/msp.2003.1203207 · Cited by 3,282
High Accuracy Optical Flow Estimation Based on a Theory for Warping
Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_3 · Cited by 2,570
Improving resolution by image registration
Irani, M., & Peleg, S. (1991) · CVGIP: Graphical Models and Image Processing · doi:10.1016/1049-9652(91)90045-l · Cited by 1,929
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141956 · Cited by 1,815
Secrets of optical flow estimation and their principles
Sun, D., Roth, S., & Black, M. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539939 · Cited by 1,389
Self-citationLarge Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Kundur, D., & Hatzinakos, D. (1996) · IEEE Signal Processing Magazine · doi:10.1109/79.489268 · Cited by 1,275
Understanding and evaluating blind deconvolution algorithms
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206815 · Cited by 1,208
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
Representing moving images with layers
Wang, J. Y. A., & Adelson, E. H. (1994) · IEEE Transactions on Image Processing · doi:10.1109/83.334981 · Cited by 1,090
Image and depth from a conventional camera with a coded aperture
Levin, A., Fergus, R., Durand, F., & Freeman, W. T. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276464 · Cited by 1,023
Image and depth from a conventional camera with a coded aperture
Levin, A., Fergus, R., Durand, F., & Freeman, W. T. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276464 · Cited by 980
Extraction of high-resolution frames from video sequences
Schultz, R. R., & Stevenson, R. L. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.503915 · Cited by 978
Multiframe image restoration and registration
Tsai, R. (1984) · Medical Entomology and Zoology · Cited by 870
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
Joint MAP registration and high-resolution image estimation using a sequence of undersampled images
Hardie, R. C., Barnard, K. J., & Armstrong, E. E. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.650116 · Cited by 826
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
Self-citationPSF estimation using sharp edge prediction
Joshi, N., Szeliski, R., & Kriegman, D. J. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587834 · Cited by 563
Motion Detail Preserving Optical Flow Estimation
Xu, L., Jia, J., & Matsushita, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.236 · Cited by 493
Non-uniform Deblurring for Shaken Images
Whyte, O., Sivic, J., Zisserman, A., & Ponce, J. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0502-7 · Cited by 490
Automatic Estimation and Removal of Noise from a Single Image
Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1176 · Cited by 486
Self-citationFundamental limits of reconstruction-based superresolution algorithms under local translation
Lin, Z., & Shum, H.-Y. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1261081 · Cited by 426
Shan, Q., Li, Z., Jia, J., & Tang, C.-K. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409106 · Cited by 363
Super-Resolution Without Explicit Subpixel Motion Estimation
Takeda, H., Milanfar, P., Protter, M., & Elad, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2023703 · Cited by 302
A Bayesian approach to adaptive video super resolution
Liu, C., & Sun, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995614 · Cited by 246
Self-citationSpectral analysis for non-linear systems, Part I: Parametric non-linear spectral analysis
Billings, S. A., & Tsang, K. M. (1989) · Mechanical Systems and Signal Processing · doi:10.1016/0888-3270(89)90041-1 · Cited by 201
A High-Quality Video Denoising Algorithm Based on Reliable Motion Estimation
Liu, C., & Freeman, W. T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_51 · Cited by 173
Self-citationStatistical performance analysis of super-resolution
Robinson, D., & Milanfar, P. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.871079 · Cited by 120
Simultaneous super-resolution and blind deconvolution
Šroubek, F., Cristóbal, G., & Flusser, J. (2008) · Journal of Physics Conference Series · doi:10.1088/1742-6596/124/1/012048 · Cited by 41
Super-Resolution Without Dense Flow
Su, H. Y., Wu, Y. N., & Zhou, J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2173204 · Cited by 24
Nguyen, N., Golub, G. H., & Milanfar, P. (2003) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.1999.831908 · Cited by 19
High-Order Markov Random Fields for Low-Level Vision
Roth, S. (2007) · TUbilio (Technical University of Darmstadt) · Cited by 7
Non-causal Temporal Prior for Video Deblocking
Sun, D., & Liu, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_37 · Cited by 6
Self-citation
Cited by
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data
Wang, X., Xie, L., Dong, C., & Shan, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00217 · Cited by 1,684
Video Enhancement with Task-Oriented Flow
Xue, T., Chen, B., Wu, J., Wei, D., & Freeman, W. T. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-01144-2 · Cited by 1,393
Edvr: video restoration with enhanced deformable convolutional networks
Wang, X., Chan, K. C. K., Yu, K., Dong, C., & Loy, C. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00247 · Cited by 1,272
Designing a Practical Degradation Model for Deep Blind Image Super-Resolution
Zhang, K., Liang, J., Van Gool, L., & Timofte, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00475 · Cited by 760
Video Super-Resolution With Convolutional Neural Networks
Kappeler, A., Yoo, S., Dai, Q., & Katsaggelos, A. K. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2532323 · Cited by 647
Metadata
- Authors
- Liu, C., & Sun, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-02
- Volume
- 36
- Issue
- 2
- Pages
- 346-360
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2010981316
- Cited by
- 526
- References
- 37
- FWCI
- 15.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.