The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs
Open accessAbstract
We address temporal action localization in untrimmed long videos. This is important because videos in real applications are usually unconstrained and contain multiple action instances plus video content of background scenes or other activities. To address this challenging issue, we exploit the effectiveness of deep networks in temporal action localization via three segment-based 3D ConvNets: (1) a proposal network identifies candidate segments in a long video that may contain actions, (2) a classification network learns one-vs-all action classification model to serve as initialization for the localization network, and (3) a localization network fine-tunes the learned classification network to localize each action instance. We propose a novel loss function for the localization network to explicitly consider temporal overlap and achieve high temporal localization accuracy. In the end, only the proposal network and the localization network are used during prediction. On two largescale benchmarks, our approach achieves significantly superior performances compared with other state-of-the-art systems: mAP increases from 1.7% to 7.4% on MEXaction2 and increases from 15.0% to 19.0% on THUMOS 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Objects2action: Classifying and Localizing Actions without Any Video Example
Jain, M., Gemert, J. C. V., Mensink, T., & Snoek, C. G. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.521 · Cited by 142
Research works printed but not linked: 38
- 10.1109/CVPR.2011.5995407 · DOI · Paper page
- van gemert, 2015, Apt: Action localization proposals from dense trajectories, BMVC
- 10.1109/ICCV.2015.375 · DOI
- simonyan, 2015, Very deep convolutional networks for large-scale image recognition, International Conference on Learning Representations
- simonyan, 2014, Two-stream convolutional networks for action recognition in videos, NIPS
- 10.1145/2733373.2806226 · DOI
- stoian, 2015, Fast action localization in large scale video archives, TCSVT
- soomro, 2012, UCF101: A dataset of 101 human actions classes from videos in the wild, CRCV-TR-12–01
- 10.1109/CVPR.2014.100 · DOI
- 10.1109/CVPR.2015.7298599 · DOI
- 10.1109/TPAMI.2012.59 · DOI · Paper page
- 10.1145/2647868.2654889 · DOI · Paper page
- jiang, 2014, THUMOS Challenge Action Recognition with A Large Number of Classes
- 10.1016/j.cviu.2012.09.008 · DOI
- karaman, 2014, Fast saliency based pooling of fisher encoded dense trajectories, ECCV THUMOS Workshop
- 10.1007/978-3-642-35749-7_17 · DOI
- 10.1109/CVPR.2011.5995646 · DOI
- oneata, 2014, The lear submission at thumos 2014, ECCV THUMOS Workshop
- cheng, 2015, Advances in human action recognition A Survey
- 10.1109/ICCV.2015.193 · DOI
- 10.1109/TPAMI.2013.65 · DOI
- 10.1109/CVPR.2015.7298676 · DOI · Paper page
- 10.1109/CVPR.2014.81 · DOI · Paper page
- 10.1145/1922649.1922653 · DOI · Paper page
- gorban, 2015, THUMOS Challenge Action Recognition with A Large Number of Classes
- 2015, Mexaction2
- yuan, 2015, Adsc submission at thumos challenge 2015, CVPR THUMOS Workshop
- 10.1109/CVPR.2015.7298735 · DOI
- lai, 2014, Recognizing complex events in videos by learning key static-dynamic evidences, ECCV
- 10.1109/ICCV.2015.285 · DOI
- 10.1016/j.cviu.2010.10.002 · DOI · Paper page
- lan, 2015, Beyond gaussian pyramid: Multi-skip feature stacking for action recognition, CVPR
- wang, 2014, Action recognition and detection by combining motion and appearance features, ECCV THUMOS Workshop
- 10.1109/CVPR.2014.288 · DOI
- 10.1109/CVPR.2015.7298789 · DOI · Paper page
- 10.1109/CVPR.2014.326 · DOI
- 10.1109/ICCV.2015.362 · DOI · Paper page
- 10.1109/ICCV.2013.228 · DOI · Paper page
Cited by
Temporal Action Detection with Structured Segment Networks
Zhao, Y., Xiong, Y., Wang, L., Wu, Z., Tang, X., & Lin, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.317 · Cited by 892
Singh, K. K., & Lee, Y. J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.381 · Cited by 724
MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation
Farha, Y. A., & Gall, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00369 · Cited by 673
“The first stage is to generate proposals, and then classify and refine the boundaries of these proposals in the second stage [32], [33], [34], [35], [36], [37], [38], [39], [40].”
BackgroundBMN: Boundary-Matching Network for Temporal Action Proposal Generation
Lin, T., Liu, X., Li, X., Ding, E., & Wen, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00399 · Cited by 694
End-to-End Dense Video Captioning with Masked Transformer
Zhou, L., Zhou, Y., Corso, J. J., Socher, R., & Xiong, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00911 · Cited by 605
Metadata
- Authors
- Shou, Z., Wang, D., & Chang, S.-F.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 1049-1058
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964214371
- Cited by
- 968
- References
- 8
- FWCI
- 33.48
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.