The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Extraction of high-resolution frames from video sequences
Abstract
The human visual system appears to be capable of temporally integrating information in a video sequence in such a way that the perceived spatial resolution of a sequence appears much higher than the spatial resolution of an individual frame. While the mechanisms in the human visual system that do this are unknown, the effect is not too surprising given that temporally adjacent frames in a video sequence contain slightly different, but unique, information. This paper addresses the use of both the spatial and temporal information present in a short image sequence to create a single high-resolution video frame. A novel observation model based on motion compensated subsampling is proposed for a video sequence. Since the reconstruction problem is ill-posed, Bayesian restoration with a discontinuity-preserving prior image model is used to extract a high-resolution video still given a short low-resolution sequence. Estimates computed from a low-resolution image sequence containing a subpixel camera pan show dramatic visual and quantitative improvements over bilinear, cubic B-spline, and Bayesian single frame interpolations. Visual and quantitative improvements are also shown for an image sequence containing objects moving with independent trajectories. Finally, the video frame extraction algorithm is used for the motion-compensated scan conversion of interlaced video data, with a visual comparison to the resolution enhancement obtained from progressively scanned frames.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fundamentals of digital image processing
Jain, A. K. (1988) · Cited by 7,111
Fundamentals of digital image processing
(1989) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(89)90041-8 · Cited by 4,677
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.415 · Cited by 4,388
Cubic convolution interpolation for digital image processing
Keys, R. (1981) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1981.1163711 · Cited by 3,255
Improving resolution by image registration
Irani, M., & Peleg, S. (1991) · CVGIP: Graphical Models and Image Processing · doi:10.1016/1049-9652(91)90045-l · Cited by 1,929
Cubic splines for image interpolation and digital filtering
Hou, H., & Andrews, H. (1978) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1978.1163154 · Cited by 1,270
Multi-frame image restoration and registration
Huang, T. S. (1984) · Medical Entomology and Zoology · Cited by 976
Multiframe image restoration and registration
Tsai, R. (1984) · Medical Entomology and Zoology · Cited by 870
Comparison of Interpolating Methods for Image Resampling
Parker, J. A., Kenyon, R. V., & Troxel, D. E. (1983) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1983.4307610 · Cited by 829
Musmann, H. G., Pirsch, P., & Grallert, H.-J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13183 · Cited by 736
High-resolution image recovery from image-plane arrays, using convex projections
Stark, H., & Oskoui, P. (1989) · Journal of the Optical Society of America A · doi:10.1364/josaa.6.001715 · Cited by 734
Recursive reconstruction of high resolution image from noisy undersampled multiframes
Kim, S. P., Bose, N. K., & Valenzuela, H. M. (1990) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.56062 · Cited by 556
A Bayesian approach to image expansion for improved definition
Schultz, R. R., & Stevenson, R. L. (1994) · IEEE Transactions on Image Processing · doi:10.1109/83.287017 · Cited by 535
Self-citationFast B-spline transforms for continuous image representation and interpolation
Unser, M. A., Aldroubi, A., & Eden, M. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.75515 · Cited by 528
Tekalp, A. M., Ozkan, M. K., & Sezan, M. I. (1992) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1992.226249 · Cited by 352
Recursive regularization filters: design, properties, and applications
Unser, M., Aldroubi, A., & Eden, M. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.75514 · Cited by 193
Regularization of discontinuous flow fields
Shulman, D., & Herve, J.-Y. (2003) · IEEE Workshop on Visual Motion · doi:10.1109/wvm.1989.47097 · Cited by 95
Patti, A. J., Sezan, M. I., & Tekalp, A. M. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1994.413332 · Cited by 93
Discontinuity preserving regularization of inverse visual problems
Stevenson, R. L., Schmitz, B. E., & Delp, E. J. (1994) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.278994 · Cited by 90
Self-citation
Cited by
Super-resolution image reconstruction: a technical overview
Park, S. C., Park, M. K., & Kang, M. G. (2003) · IEEE Signal Processing Magazine · doi:10.1109/msp.2003.1203207 · Cited by 3,282
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
Image super-resolution using gradient profile prior
Sun, J., Xu, Z., & Shum, H.-Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587659 · Cited by 916
Joint MAP registration and high-resolution image estimation using a sequence of undersampled images
Hardie, R. C., Barnard, K. J., & Armstrong, E. E. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.650116 · Cited by 826
Metadata
- Authors
- Schultz, R. R., & Stevenson, R. L.
- Venue
- IEEE Transactions on Image Processing
- Published
- 1996-06
- Volume
- 5
- Issue
- 6
- Pages
- 996-1011
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2138714160
- Cited by
- 978
- References
- 19
- FWCI
- 14.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.