The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Story-Driven Summarization for Egocentric Video
Abstract
We present a video summarization approach that discovers the story of an egocentric video. Given a long input video, our method selects a short chain of video sub shots depicting the essential events. Inspired by work in text analysis that links news articles over time, we define a random-walk based metric of influence between sub shots that reflects how visual objects contribute to the progression of events. Using this influence metric, we define an objective for the optimal k-subs hot summary. Whereas traditional methods optimize a summary's diversity or representative ness, ours explicitly accounts for how one sub-event "leads to" another-which, critically, captures event connectivity beyond simple object co-occurrence. As a result, our summaries provide a better sense of story. We apply our approach to over 12 hours of daily activity video taken from 23 unique camera wearers, and systematically evaluate its quality compared to multiple baselines with 34 human subjects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Representing shape with a spatial pyramid kernel
Bosch, A., Zisserman, A., & Munoz, X. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282340 · Cited by 1,399
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
Alexe, B., Deselaers, T., & Ferrari, V. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540226 · Cited by 776
Discovering important people and objects for egocentric video summarization
Lee, Y. J., Ghosh, J., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247820 · Cited by 658
Self-citationDetecting activities of daily living in first-person camera views
Pirsiavash, H., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248010 · Cited by 649
The blur effect: perception and estimation with a new no-reference perceptual blur metric
Crete, F., Dolmiere, T., Ladret, P., & Nicolas, M. (2007) · SPIE Proceedings · doi:10.1117/12.702790 · Cited by 609
Learning to Recognize Daily Actions Using Gaze
Fathi, A., Li, Y., & Rehg, J. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_23 · Cited by 385
Understanding egocentric activities
Fathi, A., Farhadi, A., & Rehg, J. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126269 · Cited by 384
Social interactions: A first-person perspective
Fathi, A., Hodgins, J. K., & Rehg, J. M. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247805 · Cited by 288
Fast unsupervised ego-action learning for first-person sports videos
Kitani, K. M., Okabe, T., Sato, Y., & Sugimoto, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995406 · Cited by 220
Temporal segmentation and activity classification from first-person sensing
Spriggs, E. H., De La Torre, F., & Hebert, M. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204354 · Cited by 219
Connecting the dots between news articles
Shahaf, D., & Guestrin, C. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835884 · Cited by 189
Figure-ground segmentation improves handled object recognition in egocentric video
Ren, X., & Gu, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540074 · Cited by 163
Automatic video summarization by graph modeling
Ngo, C., Ma, Y., & Zhang, H.-J. (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238320 · Cited by 140
Schematic storyboarding for video visualization and editing
Goldman, D. B., Curless, B., Salesin, D., & Seitz, S. M. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1179352.1141967 · Cited by 138
A Hierarchical Visual Model for Video Object Summarization
Liu, D., Hua, G., & Chen, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.31 · Cited by 122
Novelty detection from an ego-centric perspective
Aghazadeh, O., Sullivan, J., & Carlsson, S. (2011) · doi:10.1109/cvpr.2011.5995731 · Cited by 61
Video summarization from spatio-temporal features
Laganière, R., Bacco, R., Hocevar, A., Lambert, P., Païs, G., & Ionescu, B. E. (2008) · ACM TRECVid Video Summarization Workshop (TVS) · doi:10.1145/1463563.1463590 · Cited by 60
Investigating keyframe selection methods in the novel domain of passively captured visual lifelogs
Doherty, A., Byrne, D., Smeaton, A. F., Jones, G. J. F., & Hughes, M. M. (2008) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1386352.1386389 · Cited by 55
Structural epitome: a way to summarize one’s visual experience
Jojić, N., Perina, A., & Murino, V. (2010) · neural information processing systems · Cited by 39
Creating map-based storyboards for browsing tour videos
Pongnumkul, S., Wang, J., & Cohen, M. (2008) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1449715.1449720 · Cited by 29
Event-Driven Video Abstraction and Visualization
Nam, J., & Tewfik, A. H. (2002) · Multimedia Tools and Applications · doi:10.1023/a:1013241718521 · Cited by 24
Cited by
Creating Summaries from User Videos
Gygli, M., Grabner, H., Riemenschneider, H., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_33 · Cited by 752
Video Summarization with Long Short-Term Memory
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_47 · Cited by 739
Self-citationTVSum: Summarizing web videos using titles
Song, Y., Vallmitjana, J., Stent, A., & Jaimes, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299154 · Cited by 623
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01842 · Cited by 630
Self-citationCategory-Specific Video Summarization
Potapov, D., Douze, M., Harchaoui, Z., & Schmid, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_35 · Cited by 481
Metadata
- Authors
- Lu, Z., & Grauman, K.
- Venue
- 2013 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2013-06
- Pages
- 2714-2721
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2120645068
- Cited by
- 491
- References
- 22
- FWCI
- 35.84
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.