The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Extraction of high-resolution frames from video sequences
Abstract
The human visual system appears to be capable of temporally integrating information in a video sequence in such a way that the perceived spatial resolution of a sequence appears much higher than the spatial resolution of an individual frame. While the mechanisms in the human visual system that do this are unknown, the effect is not too surprising given that temporally adjacent frames in a video sequence contain slightly different, but unique, information. This paper addresses the use of both the spatial and temporal information present in a short image sequence to create a single high-resolution video frame. A novel observation model based on motion compensated subsampling is proposed for a video sequence. Since the reconstruction problem is ill-posed, Bayesian restoration with a discontinuity-preserving prior image model is used to extract a high-resolution video still given a short low-resolution sequence. Estimates computed from a low-resolution image sequence containing a subpixel camera pan show dramatic visual and quantitative improvements over bilinear, cubic B-spline, and Bayesian single frame interpolations. Visual and quantitative improvements are also shown for an image sequence containing objects moving with independent trajectories. Finally, the video frame extraction algorithm is used for the motion-compensated scan conversion of interlaced video data, with a visual comparison to the resolution enhancement obtained from progressively scanned frames.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fundamentals of digital image processing
Jain, A. K. (1988) · Cited by 7,111
Fundamentals of digital image processing
(1989) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(89)90041-8 · Cited by 4,677
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.415 · Cited by 4,388
Cubic convolution interpolation for digital image processing
Keys, R. (1981) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1981.1163711 · Cited by 3,255
Improving resolution by image registration
Irani, M., & Peleg, S. (1991) · CVGIP: Graphical Models and Image Processing · doi:10.1016/1049-9652(91)90045-l · Cited by 1,929
Cubic splines for image interpolation and digital filtering
Hou, H., & Andrews, H. (1978) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1978.1163154 · Cited by 1,270
Multi-frame image restoration and registration
Huang, T. S. (1984) · Medical Entomology and Zoology · Cited by 976
Multiframe image restoration and registration
Tsai, R. (1984) · Medical Entomology and Zoology · Cited by 870
Comparison of Interpolating Methods for Image Resampling
Parker, J. A., Kenyon, R. V., & Troxel, D. E. (1983) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1983.4307610 · Cited by 829
Musmann, H. G., Pirsch, P., & Grallert, H.-J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13183 · Cited by 736
Cited by
Super-resolution image reconstruction: a technical overview
Park, S. C., Park, M. K., & Kang, M. G. (2003) · IEEE Signal Processing Magazine · doi:10.1109/msp.2003.1203207 · Cited by 3,282
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
Image super-resolution using gradient profile prior
Sun, J., Xu, Z., & Shum, H.-Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587659 · Cited by 916
Joint MAP registration and high-resolution image estimation using a sequence of undersampled images
Hardie, R. C., Barnard, K. J., & Armstrong, E. E. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.650116 · Cited by 826
Generalizing the Nonlocal-Means to Super-Resolution Reconstruction
Protter, M., Elad, M., Takeda, H., & Milanfar, P. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2008067 · Cited by 707
Super-resolution: a comprehensive survey
Nasrollahi, K., & Moeslund, T. B. (2014) · Machine Vision and Applications · doi:10.1007/s00138-014-0623-4 · Cited by 684
(2000) · doi:10.1109/afgr.2000.840616 · Cited by 634
On Bayesian Adaptive Video Super Resolution
Liu, C., & Sun, D. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.127 · Cited by 526
Coded exposure photography: motion deblurring using fluttered shutter
Raskar, R., Agrawal, A., & Tumblin, J. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141957 · Cited by 485
Hallucinating Face by Eigentransformation
Wang, X., & Tang, X. (2005) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2005.848171 · Cited by 482
Elad, M., & Hel-Or, Y. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.935034 · Cited by 456
Fundamental limits of reconstruction-based superresolution algorithms under local translation
Lin, Z., & Shum, H.-Y. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1261081 · Cited by 426
A computationally efficient superresolution image reconstruction algorithm
Nguyen, N., Milanfar, P., & Golub, G. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.913592 · Cited by 404
Shan, Q., Li, Z., Jia, J., & Tang, C.-K. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409106 · Cited by 363
A super-resolution reconstruction algorithm for surveillance images
Zhang, L., Zhang, H., Shen, H., & Li, P. (2010) · Signal Processing · doi:10.1016/j.sigpro.2009.09.002 · Cited by 351
Super-resolution from image sequences-a review
Borman, S., & Stevenson, R. L. (2002) · 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268) · doi:10.1109/mwscas.1998.759509 · Cited by 347
Self-citationForward-and-backward diffusion processes for adaptive image enhancement and denoising
Gilboa, G., Sochen, N., & Zeevi, Y. Y. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.800883 · Cited by 346
Barnard, K. J. (1998) · Optical Engineering · doi:10.1117/1.601623 · Cited by 324
Eigenface-domain super-resolution for face recognition
Gunturk, B. K., Batur, A. U., Altunbasak, Y., Hayes, M. H., & Mersereau, R. M. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.811513 · Cited by 323
Zomet, A., Rav-Acha, A., & Peleg, S. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990535 · Cited by 285
A survey on super-resolution imaging
Tian, J., & Ma, K.-K. (2011) · Signal, Image and Video Processing · doi:10.1007/s11760-010-0204-6 · Cited by 281
Li, W., & Hsu, C.-Y. (2022) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi11070385 · Cited by 147
Unified Blind Method for Multi-Image Super-Resolution and Single/Multi-Image Blur Deconvolution
Faramarzi, E., Rajan, D., & Christensen, M. P. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2237915 · Cited by 93
“To optimize a cost function with the HMRF prior, in [7] the gradient projection method, and in [31] the damped Newton method are employed.”
MethodFace Recognition at a Distance
Peng, Y. (2018) · doi:10.3990/1.9789036547116
Metadata
- Authors
- Schultz, R. R., & Stevenson, R. L.
- Venue
- IEEE Transactions on Image Processing
- Published
- 1996-06
- Volume
- 5
- Issue
- 6
- Pages
- 996-1011
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2138714160
- Cited by
- 978
- References
- 19
- FWCI
- 14.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.