The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
R-C3D: Region Convolutional 3D Network for Temporal Activity Detection
Open accessAbstract
We address the problem of activity detection in continuous, untrimmed video streams. This is a difficult task that requires extracting meaningful spatio-temporal features to capture activities, accurately localizing the start and end times of each activity. We introduce a new model, Region Convolutional 3D Network (R-C3D), which encodes the video streams using a three-dimensional fully convolutional network, then generates candidate temporal regions containing activities, and finally classifies selected regions into specific activities. Computation is saved due to the sharing of convolutional features between the proposal and the classification pipelines. The entire model is trained end-to-end with jointly optimized localization and classification losses. R-C3D is faster than existing methods (569 frames per second on a single Titan X Maxwell GPU) and achieves state-of-the-art results on THUMOS'14. We further demonstrate that our model is a general activity detection framework that does not rely on assumptions about particular dataset properties by evaluating our approach on ActivityNet and Charades. Our code is available at http://ai.bu.edu/r-c3d/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
ActivityNet: A large-scale video benchmark for human activity understanding
Heilbron, F. C., Escorcia, V., Ghanem, B., & Niebles, J. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298698 · Cited by 2,578
End-to-End Learning of Action Detection from Frame Glimpses in Videos
Yeung, S., Russakovsky, O., Mori, G., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.293 · Cited by 585
A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection
Singh, B., Marks, T. K., Jones, M., Tuzel, O., & Shao, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.216 · Cited by 461 · cited 4×
“Alternative activity detection approaches [4, 17, 18, 29, 39] use a recurrent neural network (RNN) to encode a sequence of frame or video chunk features ( e.g. VGG [28], C3D [32]) and predict the activity label at each time step.”
MethodInfluentialTemporal Action Detection Using a Statistical Language Model
Richard, A., & Gall, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.341 · Cited by 215 · cited 1×
“The framework proposed in [22] explores the uses of a language model and an activity length model for detection.”
Method
Research works printed but not linked: 32
- 10.1109/ICCV.2015.362 · DOI · Paper page
- szegedy, 2013, Deep Neural Networks for Object Detection, Neural Information Processing Systems, 2553
- singh, 2016, Untrimmed video classification for activity detection submission to activitynet challenge
- wang, 2014, Action Recognition and Detection's by Combining Motion and Appearance Features, ECCV THUMOS Workshop
- 10.1109/CVPR.2017.678 · DOI · Paper page
- wang, 2016, Actionness Estimation using Hybrid's Fully Convolutional Networks, IEEE Conference on Computer Vision and Pattern Recognition, 2708
- wang, 2014, Video Action Detection with Relational Dynamic-Poselets, European Conference on Computer Vision, 565
- 10.1109/CVPR.2016.211 · DOI · Paper page
- 10.1109/CVPR.2015.7298735 · DOI
- 10.1109/TPAMI.2012.59 · DOI · Paper page
- jiang, 2014, THUMOS Challenge Action Recognition with A Large Number of Classes
- karaman, 2014, Fast Saliency Based Pooling of Fisher Encoded Dense Trajectories, ECCV THUMOS Workshop
- 10.1109/CVPR.2008.4587756 · DOI
- liu, 2016, SSD: Single Shot MultiBox Detector, European Conference on Computer Vision, 21
- 10.1109/CVPR.2016.214 · DOI · Paper page
- montes, 2016, Temporal activity detection in untrimmed videos with recurrent neural networks
- ng, 2015, Beyond Short Snippets: Deep Networks for Video Classification, IEEE Conference on Computer Vision and Pattern Recognition, 4694
- simonyan, 2015, Very Deep Convolutional Networks for Large-scale Image Recognition, IEEE Conference on Learning Representations
- 10.1007/978-3-319-46487-9_47 · DOI · Paper page
- simonyan, 2014, Two-stream Convolutional Networks for Action Recognition in Videos, Neural Information Processing Systems, 568
- dai, 2016, R-FCN: Object Detection via Region-based Fully Convolutional Networks, Neural Information Processing Systems, 379
- girshick fast r-cn, 2015, IEEE International Conference on Computer Vision, 1440
- 10.1109/CVPR.2014.81 · DOI · Paper page
- 10.1109/TPAMI.2011.231 · DOI · Paper page
- 2016, ActivitNet Large Scale Activity Recognition Challenge
- oneata, 2014, The LEAR submission at Thumos 2014, ECCV THUMOS Workshop
- 10.1109/TIP.2016.2548242 · DOI
- 10.1109/CVPR.2016.119 · DOI · Paper page
- 10.1109/CVPR.2016.337 · DOI
- 10.1109/CVPR.2017.155 · DOI · Paper page
- 10.1007/978-3-319-46448-0_31 · DOI · Paper page
- sigurdsson, 0, Asynchronous temporal fields for action recognition
Cited by
MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation
Farha, Y. A., & Gall, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00369 · Cited by 673
“The first stage is to generate proposals, and then classify and refine the boundaries of these proposals in the second stage [32], [33], [34], [35], [36], [37], [38], [39], [40].”
BackgroundGaussian Temporal Awareness Networks for Action Localization
Long, F., Yao, T., Qiu, Z., Tian, X., Luo, J., & Mei, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00043 · Cited by 380
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368
MS-TCN++: Multi-Stage Temporal Convolutional Network for Action Segmentation
Li, S., Farha, Y. A., Liu, Y., Cheng, M.-M., & Gall, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3021756 · Cited by 349
“The first stage is to generate proposals, and then classify and refine the boundaries of these proposals in the second stage [32], [33], [34], [35], [36], [37], [38], [39], [40].”
BackgroundTemporal Deformable Residual Networks for Action Segmentation in Videos
Lei, P., & Todorovic, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00705 · Cited by 202
Metadata
- Authors
- Xu, H., Das, A., & Saenko, K.
- Venue
- 2017 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 5794-5803
- OpenAlex
- W2963247196
- Cited by
- 783
- References
- 12
- FWCI
- 24.83
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
