The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Video summarization by learning submodular mixtures of objectives
Open accessAbstract
We present a novel method for summarizing raw, casually captured videos. The objective is to create a short summary that still conveys the story. It should thus be both, interesting and representative for the input video. Previous methods often used simplified assumptions and only optimized for one of these goals. Alternatively, they used handdefined objectives that were optimized sequentially by making consecutive hard decisions. This limits their use to a particular setting. Instead, we introduce a new method that (i) uses a supervised approach in order to learn the importance of global characteristics of a summary and (ii) jointly optimizes for multiple objectives and thus creates summaries that posses multiple properties of a good summary. Experiments on two challenging and very diverse datasets demonstrate the effectiveness of our method, where we outperform or match current state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2004) · Cited by 9,718
An analysis of approximations for maximizing submodular set functions—I
Nemhauser, G. L., Wolsey, L. A., & Fisher, M. L. (1978) · Mathematical Programming · doi:10.1007/bf01588971 · Cited by 4,412
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Cost-effective outbreak detection in networks
Leskovec, J., Krause, A., Guestrin, C., Faloutsos, C., VanBriesen, J., & Glance, N. (2007) · Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1281192.1281239 · Cited by 2,502
The use of MMR, diversity-based reranking for reordering documents and producing summaries
Carbonell, J., & Goldstein, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291025 · Cited by 2,329
The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries
Carbonell, J., & Goldstein, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130369 · Cited by 2,156
A Class of Submodular Functions for Document Summarization
Lin, H. Z., & Bilmes, J. (2011) · Cited by 960
Video abstraction: A systematic review and classification
Truong, B. T., & Venkatesh, S. (2007) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/1198302.1198305 · Cited by 833
Creating Summaries from User Videos
Gygli, M., Grabner, H., Riemenschneider, H., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_33 · Cited by 752
Self-citationSubmodular Function Maximization
Krause, A., & Golovin, D. (2014) · Tractability · doi:10.1017/cbo9781139177801.004 · Cited by 751
Discovering important people and objects for egocentric video summarization
Lee, Y. J., Ghosh, J., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247820 · Cited by 658
TVSum: Summarizing web videos using titles
Song, Y., Vallmitjana, J., Stent, A., & Jaimes, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299154 · Cited by 623
Story-Driven Summarization for Egocentric Video
Lu, Z., & Grauman, K. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.350 · Cited by 491
Category-Specific Video Summarization
Potapov, D., Douze, M., Harchaoui, Z., & Schmid, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_35 · Cited by 481
Accelerated greedy algorithms for maximizing submodular set functions
Minoux, M. (2005) · Springer eBooks · doi:10.1007/bfb0006528 · Cited by 411
Diverse Sequential Subset Selection for Supervised Video Summarization
Gong, B., Chao, W., Grauman, K., et al. (2014) · Cited by 397
Multi-document Summarization via Budgeted Maximization of Submodular Functions
Lin, H. Z., & Bilmes, J. (2010) · Cited by 354
Khosla, A., Das Sarma, A., & Hamid, R. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2567996 · Cited by 343
Scene Summarization for Online Image Collections
Simon, I., Snavely, N., & Seitz, S. M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408863 · Cited by 339
Large-Scale Video Summarization Using Web-Image Priors
Khosla, A., Hamid, R., Lin, C.-J., & Sundaresan, N. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.348 · Cited by 283
Quasi Real-Time Summarization for Consumer Videos
Zhao, B., & Xing, E. P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.322 · Cited by 246
First-person hyper-lapse videos
Kopf, J., Cohen, M. F., & Szeliski, R. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601195 · Cited by 191
Ranking Domain-Specific Highlights by Analyzing Edited Videos
Sun, M., Farhadi, A., & Seitz, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_51 · Cited by 180
Gygli, M., Grabner, H., Riemenschneider, H., Nater, F., & Gool, L. V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.205 · Cited by 180
Self-citationSchematic storyboarding for video visualization and editing
Goldman, D. B., Curless, B., Salesin, D., & Seitz, S. M. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141967 · Cited by 178
Joint Summarization of Large-Scale Collections of Web Images and Videos for Storyline Reconstruction
Kim, G., Sigal, L., & Xing, E. P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.538 · Cited by 166
Temporal Segmentation of Egocentric Videos
Poleg, Y., Arora, C., & Peleg, B. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.325 · Cited by 156
Automatic editing of footage from multiple social cameras
Arev, I., Park, H. S., Sheikh, Y. A., Hodgins, J. K., & Shamir, A. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601198 · Cited by 144
Schematic storyboarding for video visualization and editing
Goldman, D. B., Curless, B., Salesin, D., & Seitz, S. M. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1179352.1141967 · Cited by 138
Learning Mixtures of Submodular Functions for Image Collection Summarization
Tschiatschek, S., Iyer, R., Wei, H., & Bilmes, J. (2014) · Cited by 129
Learning Mixtures of Submodular Shells with Application to Document SummarizationPreprint
Lin, H. Z., & Bilmes, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1210.4871 · Cited by 101
Budgeted Nonparametric Learning from Data Streams
Krause, A., & Gomes, R. G. (2010) · International Conference on Machine Learning · Cited by 89
Tractability: Practical Approaches to Hard Problems
Bordeaux, L., Hamadi, Y., Kohli, P., et al. (2014) · CERN Document Server (European Organization for Nuclear Research) · Cited by 87
Graph-based submodular selection for extractive summarization
Lin, H. Z., Bilmes, J., & Xie, S. (2009) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2009.5373486 · Cited by 76
Visual interestingness in image sequences
Gräbner, H., Nater, F., Druey, M. D., & Gool, L. V. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502109 · Cited by 65
Learning mixtures of submodular shells with application to document summarization
Lin, H. Z., & Bilmes, J. (2012) · Cited by 60
Salient Montages from Unconstrained Videos
Sun, M., Farhadi, A., Taskar, B., & Seitz, S. M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_31 · Cited by 43
First-person hyperlapse videos
Kopf, J. (2025) · doi:10.57702/wvwapfns · Cited by 40
Video summarization via transferrable structured learning
Li, L., Zhou, K., Xue, G.-R., et al. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963448 · Cited by 36
Cited by
Dense-Captioning Events in Videos
Krishna, R., Hata, K., Ren, F., Fei-Fei, L., & Niebles, J. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.83 · Cited by 1,251
Localizing Moments in Video with Natural Language
Hendricks, L. A., Wang, O., Shechtman, E., Sivic, J., Darrell, T., & Russell, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.618 · Cited by 958
Video Summarization with Long Short-Term Memory
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_47 · Cited by 739
Unsupervised Video Summarization with Adversarial LSTM Networks
Mahasseni, B., Lam, M., & Todorovic, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.318 · Cited by 607
Zhou, K., Qiao, Y., & Xiang, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12255 · Cited by 473
Metadata
- Authors
- Gygli, M., Grabner, H., & Van Gool, L.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3090-3098
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1904325426
- Cited by
- 397
- References
- 39
- FWCI
- 17.32
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.