The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
TVSum: Summarizing web videos using titles
Abstract
Video summarization is a challenging problem in part because knowing which part of a video is important requires prior knowledge about its main topic. We present TVSum, an unsupervised video summarization framework that uses title-based image search results to find visually important shots. We observe that a video title is often carefully chosen to be maximally descriptive of its main topic, and hence images related to the title can serve as a proxy for important visual concepts of the main topic. However, because titles are free-formed, unconstrained, and often written ambiguously, images searched using the title can contain noise (images irrelevant to video content) and variance (images of different topics). To deal with this challenge, we developed a novel co-archetypal analysis technique that learns canonical visual concepts shared between video and images, but not in either alone, by finding a joint-factorial representation of two data sets. We introduce a new benchmark dataset, TVSum50, that contains 50 videos and their shot-level importance scores annotated via crowdsourcing. Experimental results on two datasets, SumMe and TVSum50, suggest our approach produces superior quality summaries compared to several recently proposed approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518
Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization
Tseng, P. (2001) · Journal of Optimization Theory and Applications · doi:10.1023/a:1017501703105 · Cited by 1,989
State-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817
Representing shape with a spatial pyramid kernel
Bosch, A., Zisserman, A., & Munoz, X. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282340 · Cited by 1,399
Image Classification using Random Forests and Ferns
Bosch, A., Zisserman, A., & Munoz, X. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409066 · Cited by 1,244
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
A Survey of Automatic Query Expansion in Information Retrieval
Carpineto, C., & Romano, G. (2012) · ACM Computing Surveys · doi:10.1145/2071389.2071390 · Cited by 1,109
Agreement, the F-Measure, and Reliability in Information Retrieval
Hripcsak, G. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1733 · Cited by 949
Video abstraction: A systematic review and classification
Truong, B. T., & Venkatesh, S. (2007) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/1198302.1198305 · Cited by 833
Creating Summaries from User Videos
Gygli, M., Grabner, H., Riemenschneider, H., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_33 · Cited by 752
Discovering important people and objects for egocentric video summarization
Lee, Y. J., Ghosh, J., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247820 · Cited by 658
A user attention model for video summarization
Ma, Y.-F., Lu, L., Zhang, H.-J., & Li, M. (2002) · Proceedings of the tenth ACM international conference on Multimedia · doi:10.1145/641007.641116 · Cited by 551
Cutler, A., & Breiman, L. (1994) · Technometrics · doi:10.1080/00401706.1994.10485840 · Cited by 551
Adaptive key frame extraction using unsupervised clustering
Zhuang, Y., Rui, Y., Huang, T. S., & Mehrotra, S. (2002) · Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269) · doi:10.1109/icip.1998.723655 · Cited by 505
Story-Driven Summarization for Egocentric Video
Lu, Z., & Grauman, K. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.350 · Cited by 491
Category-Specific Video Summarization
Potapov, D., Douze, M., Harchaoui, Z., & Schmid, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_35 · Cited by 481
Learning latent temporal structure for complex event detection
Tang, K., Fei-Fei, L., & Koller, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247808 · Cited by 355
Multiple Change-Point Estimation With a Total Variation Penalty
Harchaoui, Z., & Lévy-Leduc, C. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09181 · Cited by 311
Towards Scalable Summarization of Consumer Videos Via Sparse Dictionary Selection
Cong, Y., Yuan, J., & Luo, J. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2166951 · Cited by 294
Video shot boundary detection: Seven years of TRECVid activity
Smeaton, A. F., Over, P. L., & Doherty, A. (2009) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.03.011 · Cited by 287
Large-Scale Video Summarization Using Web-Image Priors
Khosla, A., Hamid, R., Lin, C.-J., & Sundaresan, N. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.348 · Cited by 283
Learning Everything about Anything: Webly-Supervised Visual Concept Learning
Divvala, S. K., Farhadi, A., & Guestrin, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.412 · Cited by 267
Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification
Wang, M., Hong, R., Li, G., Zha, Z.-J., Yan, S., & Chua, T.-S. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2185041 · Cited by 263
Selection Bias and Covariate Imbalances in Randomized Clinical Trials
Berger, V. W. (2005) · Wiley eBooks · doi:10.1002/0470863641 · Cited by 255
Quasi Real-Time Summarization for Consumer Videos
Zhao, B., & Xing, E. P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.322 · Cited by 246
Image tag refinement towards low-rank, content-tag prior and error sparsity
Zhu, G., Yan, S., & Ma, Y. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874028 · Cited by 243
Duan, L., Xu, D., & Chang, S.-F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247819 · Cited by 193
The group fused Lasso for multiple change-point detectionPreprint
Kevin Bleakley, A., & Vert, J. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1106.4199 · Cited by 189
Ranking Domain-Specific Highlights by Analyzing Edited Videos
Sun, M., Farhadi, A., & Seitz, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_51 · Cited by 180
Gygli, M., Grabner, H., Riemenschneider, H., Nater, F., & Gool, L. V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.205 · Cited by 180
Joint Summarization of Large-Scale Collections of Web Images and Videos for Storyline Reconstruction
Kim, G., Sigal, L., & Xing, E. P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.538 · Cited by 166
Visual Semantic Search: Retrieving Videos via Complex Textual Queries
Lin, D., Fidler, S., Kong, C., & Urtasun, R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.340 · Cited by 138
A Hierarchical Visual Model for Video Object Summarization
Liu, D., Hua, G., & Chen, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.31 · Cited by 122
Fast and Robust Archetypal Analysis for Representation Learning
Chen, Y., Mairal, J., & Harchaoui, Z. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.192 · Cited by 93
Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis
Peng, W., Chu, W.-T., Chang, C.-H., Chou, C.-N., Huang, W., Chang, W.-Y., & Hung, Y. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2131638 · Cited by 87
Temporal causality for the analysis of visual events
Prabhakar, K., Oh, S., Wang, P., Abowd, G. D., & Rehg, J. M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539871 · Cited by 66
Event-Driven Semantic Concept Discovery by Exploiting Weakly Tagged Internet Images
Chen, J., Cui, Y., Ye, G., Liu, D., & Chang, S. (2014) · International Conference on Multimedia Retrieval · doi:10.1145/2578726.2578729 · Cited by 66
A Sentence Is Worth a Thousand Pixels
Fidler, S., Sharma, A., & Urtasun, R. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.260 · Cited by 40
Video summarization via transferrable structured learning
Li, L., Zhou, K., Xue, G.-R., et al. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963448 · Cited by 36
Mixed image-keyword query adaptive hashing over multilabel images
Liu, X., Mu, Y., Lang, B., & Chang, S. (2014) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2540990 · Cited by 26
Cited by
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Dense-Captioning Events in Videos
Krishna, R., Hata, K., Ren, F., Fei-Fei, L., & Niebles, J. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.83 · Cited by 1,251
Localizing Moments in Video with Natural Language
Hendricks, L. A., Wang, O., Shechtman, E., Sivic, J., Darrell, T., & Russell, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.618 · Cited by 958
Video Summarization with Long Short-Term Memory
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_47 · Cited by 739
Unsupervised Video Summarization with Adversarial LSTM Networks
Mahasseni, B., Lam, M., & Todorovic, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.318 · Cited by 607
Metadata
- Authors
- Song, Y., Vallmitjana, J., Stent, A., & Jaimes, A.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 5179-5187
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1924343884
- Cited by
- 623
- References
- 44
- FWCI
- 15.80
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.