The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Compact representations of videos through dominant and multiple motion estimation
Open accessAbstract
An explosion of on-line image and video data in digital form is already well underway. With the exponential rise in interactive information exploration and dissemination through the World-Wide Web (WWW), the major inhibitors of rapid access to on-line video data are costs and management of capture and storage, lack of real-time delivery, and nonavailability of content-based intelligent search and indexing techniques. The solutions for capture, storage, and delivery may be on the horizon or a little beyond. However, even with rapid delivery, the lack of efficient authoring and querying tools for visual content-based indexing may still inhibit as widespread a use of video information as that of text and traditional tabular data is currently. In order to be able to nonlinearly browse and index into videos through visual content, it is necessary to develop authoring tools that can automatically separate moving objects and significant components of the scene, and represent these in a compact form. Given that video data comes in torrents-almost a megabyte every 30th of a second-it will be highly inefficient to search for objects and scenes in every frame of a video. In this paper, we present techniques to automatically derive compact representations of scenes and objects from the motion information. Image motion is a significant cue in videos for the separation of scenes into their significant components and for the separation of moving objects. Motion analysis is useful in capturing the visual content of videos for indexing and browsing in two different ways. First, separation of the static scene from moving objects can be accomplished by employing dominant 2D/3D motion estimation methods. Alternatively, if the goal is to be able to represent the fixed scene too as a composition of significant structures and objects, then simultaneous multiple motion methods might be more appropriate. In either case, view-based summarized representations of the scene can be created by video compositing/mosaicing based on the estimated motions. We present robust algorithms for both kinds of representations: 1) dominant motion estimation based techniques which exploit a fairly common occurrence in videos that a mostly fixed background (scene) is imaged with or without independently moving objects, and 2) simultaneous multiple motion estimation and representation of motion video using layered representations. Ample examples of the representations achieved by each method are included in the paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust Regression and Outlier Detection
Piepel, G. F. (1989) · Technometrics · doi:10.1080/00401706.1989.10488524 · Cited by 6,144
Robust Regression and Outlier Detection
Rousseeuw, P. J., & Leroy, A. M. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/0471725382 · Cited by 5,609
Robust Statistics: The Approach Based on Influence Functions
Ruppert, D. (1987) · Technometrics · doi:10.2307/1269782 · Cited by 3,880
Query by image and video content: the QBIC system
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., et al. (1995) · Computer · doi:10.1109/2.410146 · Cited by 3,060
Self-citationMixture models : inference and applications to clustering
McLachlan, G. J., & Basford, K. E. (1988) · M. Dekker eBooks · Cited by 2,094
Seber, G. A. F., & Wild, C. J. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725315 · Cited by 1,962
QBIC project: querying images by content, using color, texture, and shape:
Niblack, C. W., Barber, R., Equitz, W., Flickner, M. D., Glasman, E. H., Petkovic, D., Yanker, P., Faloutsos, C., & Taubin, G. (1993) · SPIE Proceedings · doi:10.1117/12.143648 · Cited by 1,747
A Universal Prior for Integers and Estimation by Minimum Description Length
Rissanen, J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346150 · Cited by 1,672
Hierarchical model-based motion estimation
Bergen, J. R., Anandan, P., Hanna, K. J., & Hingorani, R. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_27 · Cited by 1,154
Photobook: tools for content-based manipulation of image databases:
Pentland, A. P., Picard, R. W., & Scarloff, S. (1994) · SPIE Proceedings · doi:10.1117/12.171786 · Cited by 879
Adiv, G. (1985) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1985.4767678 · Cited by 800
Constructing simple stable descriptions for image partitioning
Leclerc, Y. G. (1989) · International Journal of Computer Vision · doi:10.1007/bf00054839 · Cited by 520
Estimation of Parameters for a Mixture of Normal Distributions
Hasselblad, V. (1966) · Technometrics · doi:10.1080/00401706.1966.10490375 · Cited by 492
Mixture Models: Inference and Applications to Clustering.
Hand, D. J., McLachlan, G. J., & Basford, K. E. (1989) · Applied Statistics · doi:10.2307/2348072 · Cited by 392
Image mosaicing for tele-reality applications
Szeliski, R. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341287 · Cited by 369
Euclidean reconstruction from uncalibrated views
Hartley, R. I. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-58240-1_13 · Cited by 352
Mosaic based representations of video sequences and their applications
Irani, M., Anandan, P., & Hsu, S. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466883 · Cited by 296
Layered representation for motion analysis
Wang, J. Y. A., & Adelson, E. H. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341105 · Cited by 273
Ayer, S. K., & Sawhney, H. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466859 · Cited by 257
Self-citationMixture models for optical flow computation
Jepson, A., & Black, M. J. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341161 · Cited by 222
Virtual bellows: constructing high quality stills from video
Mann, S., & Picard, R. W. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413336 · Cited by 202
Hierarchical Model-Based Motion Estimation
Anandan, P., Bergen, J. R., Hanna, K. J., & Hingorani, R. (1993) · Motion Analysis and Image Sequence Processing · doi:10.1007/978-1-4615-3236-1_1 · Cited by 193
Detecting and tracking multiple moving objects using temporal integration
Irani, M., Rousso, B., & Peleg, S. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_33 · Cited by 182
Teodosio, L. A., & Bender, W. R. (1993) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/166266.166270 · Cited by 174
Direct recovery of shape from multiple views: a parallax based approach
Kumar, R., Anandan, P., & Hanna, K. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576402 · Cited by 163
Cooperative robust estimation using layers of support
Darrell, T., & Pentland, A. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.391395 · Cited by 126
Model-based 2D&3D dominant motion estimation for mosaicing and video representation
Sawhney, H., Ayer, S. K., & Gorkani, M. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466886 · Cited by 116
Self-citationVideoMAP and VideoSpaceIcon: tools for anatomizing video content
Tonomura, Y., Akutsu, A., Otsuji, K., & Sadakata, T. (1993) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/169059.169117 · Cited by 106
Direct methods for visual scene reconstruction
Szeliski, R., & Kang, S. B. (2002) · doi:10.1109/wvrs.1995.476849 · Cited by 102
Direct multi-resolution estimation of ego-motion and structure from motion
Hanna, K. (2002) · IEEE Workshop on Motion and Video Computing · doi:10.1109/wvm.1991.212812 · Cited by 83
Segmentation of moving objects by robust motion parameter estimation over multiple frames
Ayer, S. K., Schroeter, P., & Bigün, J. (1994) · Lecture notes in computer science · doi:10.1007/bfb0028364 · Cited by 68
Self-citationAccurate computation of optical flow by using layered motion representations
Hsu, S., Anandan, P., & Peleg, B. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576427 · Cited by 57
Recovery of Egomotion and Segmentation of Independent Object Motion Using the EM Algorithm
MacLean, W. J., Jepson, A. D., & Frecker, R. C. (1994) · British Machine Vision Conference (BMVC) · doi:10.5244/c.8.17 · Cited by 56
Li, G. (2006) · Wiley series in probability and statistics · doi:10.1002/9781118150702.ch8 · Cited by 43
Cited by
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169
Image Alignment and Stitching: A Tutorial
Szeliski, R. (2007) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000009 · Cited by 1,593
Image Segmentation in Video Sequences: A Probabilistic Approach
Friedman, N., & Russell, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.1539 · Cited by 833
A survey of appearance models in visual object tracking
Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705
Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures
Chan, A. B., & Vasconcelos, N. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70738 · Cited by 459
Metadata
- Authors
- Sawhney, H. S., & Ayer, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1996
- Volume
- 18
- Issue
- 8
- Pages
- 814-830
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2119444142
- Cited by
- 304
- References
- 34
- FWCI
- 21.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.