Completeness Modeling and Context Separation for Weakly Supervised Temporal Action Localization
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Temporal action localization is crucial for understanding untrimmed videos. In this work, we first identify two underexplored problems posed by the weak supervision for temporal action localization, namely action completeness modeling and action-context separation. Then by presenting a novel network architecture and its training strategy, the two problems are explicitly looked into. Specifically, to model the completeness of actions, we propose a multi-branch neural network in which branches are enforced to discover distinctive action parts. Complete actions can be therefore localized by fusing activations from different branches. And to separate action instances from their surrounding context, we generate hard negative data for training using the prior that motionless video clips are unlikely to be actions. Experiments performed on datasets THUMOS'14 and ActivityNet show that our framework outperforms state-of-the-art methods. In particular, the average mAP on ActivityNet v1.2 is significantly improved from 18.0% to 22.4%. Our code will be released soon.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · cited 1×
“In recent years, various deep networks have been proposed, such as two-stream networks [40, 46], LSTM [12], 3D ConvNets [41], I3D [7], and others [23, 44, 53].”
BackgroundAction Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
ActivityNet: A large-scale video benchmark for human activity understanding
Heilbron, F. C., Escorcia, V., Ghanem, B., & Niebles, J. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298698 · Cited by 2,578
Temporal Convolutional Networks for Action Segmentation and Detection
Lea, C., Flynn, M. D., Vidal, R., Reiter, A., & Hager, G. D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.113 · Cited by 2,238 · cited 1×
“Other works on spatial-temporal action detection [17] and video temporal segmentation [27] are beyond our scope.”
BackgroundA Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743 · cited 1×
“Diversity Loss was initially introduced for text embedding [32] to extract different aspects of a sentence.”
BackgroundA Duality Based Approach for Realtime TV-L 1 Optical Flow
Zach, C., Pock, T., & Bischof, H. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74936-3_22 · Cited by 1,658 · cited 1×
“Concretely, for each video in the training set, we compute its optical flow using the TV-L1 algorithm [50] and average the intensity in every frame.”
Method
Research works printed but not linked: 39
- 10.1109/CVPR.2016.119 · DOI · Paper page
- 10.1007/978-3-030-01270-0_10 · DOI · Paper page
- 10.1109/CVPR.2018.00706 · DOI · Paper page
- 10.1007/978-3-030-01225-0_1 · DOI · Paper page
- 10.1145/3123266.3123343 · DOI · Paper page
- 10.1109/CVPR.2017.155 · DOI · Paper page
- paul, 2018, WTALC: Weakly-supervised temporal activity localization and classification, the European Conference on Computer Vision (ECCV)
- paszke, 2017, Automatic differentiation in PyTorch, NIPS-W
- 10.1109/ICCV.2013.228 · DOI · Paper page
- lee, 2012, Discovering important people and objects for egocentric video summarization, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1346
- li, 2018, Diversity regularized spatiotemporal attention for videobased person re-identification, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 10.1007/978-3-030-03398-9 · doi:10.1007/978-3-030-03398-9
- 10.1007/978-3-030-01240-3_16 · DOI
- 10.1145/1922649.1922653 · DOI · Paper page
- hou, 2017, Real-time temporal action localization in untrimmed videos by subaction discovery, Proceedings of the British Machine Vision Conference (BMVC), 2, 7
- kang, 2016, Review of action recognition and detection methods, arXiv preprint arXiv 1610 09756
- 10.1016/j.cviu.2016.10.018 · DOI · Paper page
- 10.1007/s11263-005-1838-7 · DOI · Paper page
- zhou, 2004, Multi-instance learning: A survey Department of Computer Science & Technology, Nanjing University, Tech Rep
- zhou, 2018, Temporal relational reasoning in videos, the European Conference on Computer Vision (ECCV)
- 10.1145/3240508.3240511 · DOI
- simonyan, 2014, Two-stream convolutional networks for action recognition in videos, Advances in Neural Information Processing Systems (NIPS), 568
- 10.1109/CVPR.2015.7298878 · DOI · Paper page
- 10.1109/ICCV.2009.5459279 · DOI · Paper page
- 10.1007/978-3-319-46487-9_52 · DOI
- gao, 2017, Cascaded boundary regression for temporal action detection, Proceedings of the British Machine Vision Conference (BMVC)
- gao, 2014, JHU-ISI gesture and skill assessment working set (JIGSAWS): A surgical activity dataset for human motion modeling, MICCAI Workshop M2CAI, 3, 3
- 10.1109/CVPR.2015.7298676 · DOI · Paper page
- goodfellow, 2014, Generative adversarial nets, Advances in Neural Information Processing Systems (NIPS), 2672
- 10.1016/j.imavis.2017.01.010 · DOI · Paper page
- 10.1109/FG.2017.150 · DOI · Paper page
- 10.1109/CVPR.2017.338 · DOI
- 10.1109/CVPR.2018.00124 · DOI · Paper page
- 10.1109/CVPR.2017.342 · DOI
- 10.1109/ICCV.2017.610 · DOI · Paper page
- wang, 2016, Temporal segment networks: Towards good practices for deep action recognition, the European Conference on Computer Vision (ECCV), 20
- 10.1109/CVPR.2017.678 · DOI · Paper page
- 10.1109/ICCV.2017.617 · DOI · Paper page
- 10.1007/s00371-012-0752-6 · DOI · Paper page
- 10.1109/CVPR.2018.00155 · DOI · Paper page
Cited by
ActionFormer: Localizing Moments of Actions with Transformers
Zhang, C.-L., Wu, J., & Li, Y. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19772-7_29 · Cited by 435
Rescaling egocentric vision: Collection, pipeline and challenges for epic-kitchens-100
Damen, D., Doughty, H., Farinella, G. M., Furnari, A., Kazakos, E., Ma, J., Moltisanti, D., Munro, J., Perrett, T., Price, W., et al. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-021-01531-2 · Cited by 400
End-to-End Temporal Action Detection With Transformer
Liu, X., Wang, Q., Hu, Y., Tang, X., Zhang, S., Bai, S., & Bai, X. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3195321 · Cited by 282
Metadata
- Authors
- Liu, D., Jiang, T., & Wang, Y.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1298-1307
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2948229620
- Cited by
- 247
- References
- 15
- FWCI
- 12.82
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Completeness Modeling and Context Separation for Weakly Supervised Temporal Action Localization. https://app.cochat.ai/papers/10.1109/cvpr.2019.00139
- The paper
- Liu, D., Jiang, T., & Wang, Y. (2019). Completeness Modeling and Context Separation for Weakly Supervised Temporal Action Localization. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr.2019.00139
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.