The DOI matches its Crossref record; 137 of the 137 references it cites were found in a registry or an index.
Video Summarization Using Deep Neural Networks: A Survey
Open accessAbstract
Video summarization technologies aim to create a concise and complete synopsis by selecting the most informative parts of the video content. Several approaches have been developed over the last couple of decades, and the current state of the art is represented by methods that rely on modern deep neural network architectures. This work focuses on the recent advances in the area and provides a comprehensive survey of the existing deep-learning-based methods for generic video summarization. After presenting the motivation behind the development of technologies for video summarization, we formulate the video summarization task and discuss the main characteristics of a typical deep-learning-based analysis pipeline. Then, we suggest a taxonomy of the existing algorithms and provide a systematic review of the relevant literature that shows the evolution of the deep-learning-based video summarization technologies and leads to suggestions for future developments. We then report on protocols for the objective evaluation of video summarization algorithms, and we compare the performance of several deep-learning-based approaches. Based on the outcomes of these comparisons, as well as some documented considerations about the amount of annotated data and the suitability of evaluation protocols, we indicate potential future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_2 · Cited by 3,958
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Salakhutdinov, R., & Hinton, G. E. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 1,890
Restricted Boltzmann machines for collaborative filtering
Salakhutdinov, R., Mnih, A., & Hinton, G. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273596 · Cited by 1,885
A survey of deep learning techniques for autonomous driving
Grigorescu, S., Trasnea, B., Cocias, T., & Macesanu, G. (2020) · Journal of Field Robotics · doi:10.1002/rob.21918 · Cited by 1,809
A survey on deep learning and its applications
Dong, S., Wang, P., & Abbas, K. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100379 · Cited by 1,800
Graph Signal Processing: Overview, Challenges, and Applications
Ortega, A., Frossard, P., Kovačević, J., Moura, J. M. F., & Vandergheynst, P. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2820126 · Cited by 1,787
A Survey on Deep Learning for Named Entity Recognition
Li, J., Sun, A., Han, J., & Li, C. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2981314 · Cited by 1,567
A Survey on Deep Learning: Algorithms, Techniques, and Applications
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2019) · ACM Computing Surveys · doi:10.1145/3234150 · Cited by 1,403
Sirinukunwattana, K., Raza, S. E. A., Tsang, Y.-W., Snead, D. R. J., Cree, I. A., & Rajpoot, N. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2525803 · Cited by 1,224
(1993) · Cited by 1,173
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN
Li, S., Li, W., Cook, C., Zhu, C., & Gao, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00572 · Cited by 972
Video abstraction: A systematic review and classification
Truong, B. T., & Venkatesh, S. (2007) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/1198302.1198305 · Cited by 833
A survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821
THE TREATMENT OF TIES IN RANKING PROBLEMS
KENDALL, M. G. (1945) · Biometrika · doi:10.1093/biomet/33.3.239 · Cited by 809
Creating Summaries from User Videos
Gygli, M., Grabner, H., Riemenschneider, H., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_33 · Cited by 752
Natarajan, N., Dhillon, I. S., Ravikumar, P., & Tewari, A. (2013) · Cited by 740
Video Summarization with Long Short-Term Memory
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_47 · Cited by 739
VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method
de Avila, S. E. F., Lopes, A. P. B., da Luz, A., & de Albuquerque Araújo, A. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.08.004 · Cited by 679
TVSum: Summarizing web videos using titles
Song, Y., Vallmitjana, J., Stent, A., & Jaimes, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299154 · Cited by 623
Unsupervised Video Summarization with Adversarial LSTM Networks
Mahasseni, B., Lam, M., & Todorovic, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.318 · Cited by 607
A Survey on Visual Content-Based Video Indexing and Retrieval
Hu, W., Xie, N., Li, L., Zeng, X., & Maybank, S. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2109710 · Cited by 585
Understanding intermediate layers using linear classifier probes
Alain, G., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1610.01644 · Cited by 581
Learning task-dependent distributed representations by backpropagation through structure
Goller, C., & Kuchler, A. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.548916 · Cited by 581
Determinantal Point Processes for Machine Learning
Kulesza, A. (2012) · now publishers, Inc. eBooks · doi:10.1561/9781601986290 · Cited by 493
Category-Specific Video Summarization
Potapov, D., Douze, M., Harchaoui, Z., & Schmid, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_35 · Cited by 481
Zhou, K., Qiao, Y., & Xiang, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12255 · Cited by 473
CRC Standard Probability and Statistics Tables and Formulae
Zwillinger, D., & Kokoska, S. (1999) · CRC Press eBooks · doi:10.1201/9780367802417 · Cited by 463
Video summarization by learning submodular mixtures of objectives
Gygli, M., Grabner, H., & Van Gool, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298928 · Cited by 397
Diverse Sequential Subset Selection for Supervised Video Summarization
Gong, B., Chao, W., Grauman, K., et al. (2014) · Cited by 397
Bouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Video Summarization With Attention-Based Encoder–Decoder Networks
Ji, Z., Xiong, K., Pang, Y., & Li, X. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2904996 · Cited by 392
Video Summarization Using Fully Convolutional Sequence Networks
Rochan, M., Ye, L., & Wang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_22 · Cited by 287
Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention
Evangelopoulos, G., Zlatintsi, A., Potamianos, A., Maragos, P., Rapantzikos, K., Skoumas, G., & Avrithis, Y. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2267205 · Cited by 263
Graph Spectral Image Processing
Cheung, G., Magli, E., Tanaka, Y., & Ng, M. K. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2799702 · Cited by 251
Deep Learning Algorithms for Cybersecurity Applications: A Technological and Status Review
Dixit, P., & Silakari, S. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2020.100317 · Cited by 241
HSA-RNN: Hierarchical Structure-Adaptive RNN for Video Summarization
Zhao, B., Li, X., & Lu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00773 · Cited by 237
Summary Transfer: Exemplar-Based Subset Selection for Video Summarization
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.120 · Cited by 220
A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis
Zhang, L., Wang, M., Liu, M., & Zhang, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00779 · Cited by 220
Summarizing Videos with Attention
Fajtl, J., Sokeh, H. S., Argyriou, V., Monekosso, D., & Remagnino, P. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-21074-8_4 · Cited by 213
Hierarchical Recurrent Neural Network for Video Summarization
Zhao, B., Li, X., & Lu, X. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123328 · Cited by 200
Sampling Signals on Graphs: From Theory to Applications
Tanaka, Y., Eldar, Y. C., Ortega, A., & Cheung, G. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.3016908 · Cited by 200
Video Summarization by Learning From Unpaired Data
Rochan, M., & Wang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00809 · Cited by 181
Video summarization via minimum sparse reconstruction
Mei, S., Guan, G., Wang, Z., Wan, S., He, M., & Dagan Feng, D. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.08.002 · Cited by 180
MSMO: Multimodal Summarization with Multimodal Output
Zhu, J., Li, H., Liu, T., Zhou, Y., Zhang, J., & Zong, C. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1448 · Cited by 179
Denoising Adversarial Autoencoders
Creswell, A., & Bharath, A. A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852738 · Cited by 172
Lightweight Probabilistic Deep Networks
Gast, J., & Roth, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00355 · Cited by 169
A Novel Key-Frames Selection Framework for Comprehensive Video Summarization
Huang, C., & Wang, H. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2890899 · Cited by 169
Li, Y., Lee, S.-H., Yeh, C., et al. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1621451 · Cited by 168
Few-Shot Named Entity Recognition via Meta-Learning
Li, J., Chiu, B., Feng, S., & Wang, H. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3038670 · Cited by 165
MoNet: Deep Motion Exploitation for Video Object Segmentation
Xiao, H., Feng, J., Lin, G., Liu, Y., & Zhang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00125 · Cited by 164
Exploring global diverse attention via pairwise temporal relation for video summarization
Li, P., Ye, Q., Zhang, L., Yuan, L., Xu, X., & Shao, L. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107677 · Cited by 159
Multimodal Abstractive Summarization for How2 Videos
Palaskar, S., Libovický, J., Gella, S., & Metze, F. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1659 · Cited by 152
Cycle-SUM: Cycle-Consistent Adversarial LSTM Networks for Unsupervised Video Summarization
Yuan, L., Tay, F. E., Li, P., Zhou, L. P., & Feng, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019143 · Cited by 151
Building DNN acoustic models for large vocabulary speech recognition
Maas, A. L., Qi, P., Xie, Z., Hannun, A., Lengerich, C. T., Jurafsky, D. S., & Ng, A. Y. (2016) · Computer Speech & Language · doi:10.1016/j.csl.2016.06.007 · Cited by 147
Video Summarization via Semantic Attended Networks
Wei, H., Ni, B., Yan, Y., Yu, H., Yang, X., & Yao, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11297 · Cited by 138
Understanding Deep Features with Computer-Generated Imagery
Aubry, M., & Russell, B. C. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.329 · Cited by 137
Query-Focused Extractive Video Summarization
Sharghi, A., Gong, B., & Shah, M. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_1 · Cited by 132
Video Summarization Using Deep Semantic Features
Otani, M., Nakashima, Y., Rahtu, E., Heikkilä, J., & Yokoya, N. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54193-8_23 · Cited by 131
Apostolidis, E., Adamantidou, E., Metsai, A. I., Mezaris, V., & Patras, I. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3037883 · Cited by 129
Self-citationA General Framework for Edited Video and Raw Video Summarization
Li, X., Zhao, B., & Lu, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2695887 · Cited by 128
Multi-modal Summarization for Asynchronous Collection of Text, Image, Audio and Video
Li, H., Zhu, J., Ma, C., Zhang, J., & Zong, C.-Q. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1114 · Cited by 127
Balanced Self-Paced Learning for Generative Adversarial Clustering Network
Dizaji, K. G., Wang, X., Deng, C. D., & Huang, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00452 · Cited by 127
Weakly Supervised Summarization of Web Videos
Panda, R., Das, A., Wu, Z., Ernst, J., & Roy–Chowdhury, A. K. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.395 · Cited by 119
Enhancing Video Summarization via Vision-Language Embedding
Plummer, B. A., Brown, M., & Lazebnik, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.118 · Cited by 114
Summarization of Egocentric Videos: A Comprehensive Survey
del Molino, A. G., Tan, C., Lim, J., & Tan, A. (2016) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2016.2623480 · Cited by 111
Unsupervised Video Summarization with Attentive Conditional Generative Adversarial Networks
He, X., Yang, H., Song, T., Zhang, Z., Xue, Z., Ma, R., Robertson, N. M., & Guan, H. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351056 · Cited by 107
Query-adaptive Video Summarization via Quality-aware Relevance Estimation
Vasudevan, A. B., Gygli, M., Volokitin, A., & Gool, L. V. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123297 · Cited by 104
Weakly-Supervised Video Summarization Using Variational Encoder-Decoder and Web Prior
Cai, S., Zuo, W., Davis, L. S., & Zhang, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_12 · Cited by 101
Graph Moving Object Segmentation
Giraldo, J. H., Javed, S., & Bouwmans, T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3042093 · Cited by 101
Unsupervised object-level video summarization with online motion auto-encoder
Zhang, Y., Liang, X., Zhang, D., Tan, M. H., & Xing, E. P. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.07.030 · Cited by 97
TTH-RNN: Tensor-Train Hierarchical Recurrent Neural Network for Video Summarization
Zhao, B., Li, X., & Lu, X. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.2979573 · Cited by 94
Video Summarization by Learning Deep Side Semantic Embedding
Yuan, Y., Mei, T., Cui, P., & Zhu, W. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2771247 · Cited by 92
Robustness of Conditional GANs to Noisy LabelsPreprint
Thekumparampil, K. K., Khetan, A., Lin, Z., & Oh, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03205 · Cited by 91
Graph Spectral Image Processing
(2021) · Wiley eBooks · doi:10.1002/9781119850830 · Cited by 90
(2018) · Neural Information Processing Systems · Cited by 89
Unsupervised Video Summarization via Attention-Driven Adversarial Learning
Apostolidis, E., Adamantidou, E., Metsai, A. I., Mezaris, V., & Patras, I. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-37731-1_40 · Cited by 88
Self-citationAttentive and Adversarial Learning for Video Summarization
Fu, T.-J., Tai, S.-H., & Chen, H.-T. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00173 · Cited by 87
Action Parsing-Driven Video Summarization Based on Reinforcement Learning
Lei, J., Luan, Q., Song, X., Liu, X., Tao, D., & Song, M. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2860797 · Cited by 85
Property-Constrained Dual Learning for Video Summarization
Zhao, B., Li, X., & Lu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2951680 · Cited by 81
Title Generation for User Generated Videos
Zeng, K.-H., Chen, T.-H., Niebles, J. C., & Sun, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_38 · Cited by 79
Global-and-Local Relative Position Embedding for Unsupervised Video Summarization
Jung, Y., Cho, D., Woo, S., & Kweon, I. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_11 · Cited by 78
Deep attentive and semantic preserving video summarization
Ji, Z., Fang, J., Pang, Y., & Shao, L. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.04.132 · Cited by 69
Video Summarization Via Actionness Ranking
Elfeki, M., & Borji, A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00085 · Cited by 68
Survey of Compressed Domain Video Summarization Techniques
Basavarajaiah, M., & Sharma, P. (2019) · ACM Computing Surveys · doi:10.1145/3355398 · Cited by 64
Apostolidis, E., Metsai, A. I., Adamantidou, E., Mezaris, V., & Patras, I. (2019) · International Workshop on AI for Smart TV Content Production, Access and Delivery (AI4TV) · doi:10.1145/3347449.3357482 · Cited by 64
Self-citationExtractive Video Summarizer with Memory Augmented Neural Networks
Feng, L., Li, Z., Kuang, Z., & Zhang, W. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240651 · Cited by 60
Image Difficulty Curriculum for Generative Adversarial Networks (CuGAN)
Soviany, P., Ardei, C., Ionescu, R. T., & Leordeanu, M. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093408 · Cited by 60
Stacked Memory Network for Video Summarization
Wang, J., Wang, W., Wang, Z., Wang, L., Feng, D., & Tan, T. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350992 · Cited by 60
Query-controllable Video Summarization
Huang, J.-H., & Worring, M. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390695 · Cited by 59
Spatiotemporal Modeling for Video Summarization Using Convolutional Recurrent Neural Network
Yuan, Y., Li, H., & Wang, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2916989 · Cited by 58
Dynamic Background Learning through Deep Auto-encoder Networks
Xu, P., Ye, M., Li, X., Liu, Q., Yang, Y., & Ding, J. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654914 · Cited by 52
Video Summarisation by Classification with Deep Reinforcement LearningPreprint
Zhou, K., Xiang, T., & Cavallaro, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03089 · Cited by 45
Zhang, Y., Kampffmeyer, M., Zhao, X., & Tan, M. H. (2019) · ACM Turing Celebration Conference - China (ACM TURC) · doi:10.1145/3321408.3322622 · Cited by 44
A Top-Down Approach for Video Summarization
Guan, G., Wang, Z., Mei, S., Ott, M., He, M., & Feng, D. D. (2014) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2632267 · Cited by 42
Video Highlight Prediction Using Audience Chat Reactions
Fu, C.-Y., Lee, J., Bansal, M., & Berg, A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1102 · Cited by 42
A New Method for Static Video Summarization Using Local Descriptors and Video Temporal Segmentation
Cahuina, E. J. Y. C., & Cámara-Chávez, G. (2013) · doi:10.1109/sibgrapi.2013.39 · Cited by 41
Vivekraj, V. K., Sen, D., & Raman, B. (2019) · ACM Computing Surveys · doi:10.1145/3347712 · Cited by 41
On-Line Adaptative Curriculum Learning for GANs
Doan, T., Monteiro, J., Albuquerque, I., Mazoure, B., Durand, A., Pineau, J., & Hjelm, R. D. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v33i01.33013470 · Cited by 40
Active Video Summarization: Customized Summaries via On-line Interaction with the User
del Molino, A. G., Boix, X., Lim, J., & Tan, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11234 · Cited by 39
Video Summarization Via Multiview Representative Selection
Meng, J., Wang, S., Wang, H., Yuan, J., & Tan, Y. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2789332 · Cited by 39
Online Video Summarization: Predicting Future to Better Summarize Present
Lal, S., Duggal, S., & Indu, S. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00056 · Cited by 38
Deep Reinforcement Learning for Query-Conditioned Video Summarization
Zhang, Y., Kampffmeyer, M., Zhao, X., & Tan, M. H. (2019) · Applied Sciences · doi:10.3390/app9040750 · Cited by 37
Video Summarization with LSTM and Deep Attention Models
Lebron, L., & Koblents, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05716-9_6 · Cited by 35
A Deep Architecture for Multimodal Summarization of Soccer Games
Sanabria, M., Sherly, Precioso, F., & Menguy, T. (2019) · ACM International Workshop on Multimedia Content Analysis in Sports (MMSports) · doi:10.1145/3347318.3355524 · Cited by 35
A video summarization approach based on the emulation of bottom-up mechanisms of visual attention
Jacob, H. G., Pádua, F. L. C., Lacerda, A. M., et al. (2017) · Journal of Intelligent Information Systems · doi:10.1007/s10844-016-0441-4 · Cited by 32
Ultrasound Video Summarization Using Deep Reinforcement Learning
Liu, T., Meng, Q., Vlontzos, A., Tan, J., Rueckert, D., & Kainz, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59716-0_46 · Cited by 32
Advances in Video Summarization and Skimming
Jiang, R., Sadka, A. H., & Crookes, D. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-02900-4_2 · Cited by 31
Summarizing First-Person Videos from Third Persons’ Points of Views
Ho, H.-I., Chiu, W.-C., & Wang, Y.-C. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_5 · Cited by 30
Spatiotemporal Modeling and Label Distribution Learning for Video Summarization
Chu, W.-T., & Liu, Y.-H. (2019) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2019.8901741 · Cited by 29
Query-Conditioned Three-Player Adversarial Network for Video SummarizationPreprint
Zhang, Y., Kampffmeyer, M., Liang, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06677 · Cited by 28
Yalınız, G., & İkizler-Cinbiş, N. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10293-x · Cited by 27
Koutras, P., Zlatintsi, A., Iosif, E., Katsamanis, A., Maragos, P. A., & Potamianos, A. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351630 · Cited by 24
Category driven deep recurrent neural network for video summarization
Song, X., Chen, K., Lei, J., Sun, L., Wang, Z., Xie, L., & Song, M. (2016) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2016.7574720 · Cited by 23
Adaptive Multi-Compositionality for Recursive Neural Network Models
Li, D., Wei, F., Xu, K., Liu, S., & Zhou, M. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2509257 · Cited by 21
A Critical View of Global Optimality in Deep LearningPreprint
Yun, C., Sra, S., & Jadbabaie, A. (2018) · arXiv (Cornell University) · Cited by 21
Video Skimming: Taxonomy and Comprehensive SurveyPreprint
Vivekraj, V. K., Sen, D., & Raman, B. (2019) · arXiv (Cornell University) · Cited by 20
Cited by
A survey of multimodal learning: Methods, applications, and future
Yuan, Y., Li, Z., & Zhao, B. (2025) · ACM Computing Surveys · doi:10.1145/3713070 · Cited by 90
Learning to summarize and answer questions about a virtual robot’s past actions
DeChant, C., Akinola, I., & Bauer, D. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10134-4 · Cited by 14
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3
“Video understanding refers to tasks re-lated to video analysis such as recognition of entities and actions within videos and video content summarization [311, 312, 313, 314].”
Perceptual Robust Hashing for Video Copy Detection with Unsupervised Learning
Zhao, G., Qin, C., Luo, X., Zhang, X., & Chang, C.-C. (2023) · Proceedings of the 2023 ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3577163.3595110 · Cited by 1
Metadata
- Authors
- Apostolidis, E., Adamantidou, E., Metsai, A. I., Mezaris, V., & Patras, I.
- Venue
- Proceedings of the IEEE
- Published
- 2021-11
- Volume
- 109
- Issue
- 11
- Pages
- 1838-1863
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W3121886007
- Cited by
- 350
- References
- 137
- FWCI
- 18.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.