The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Encouraging LSTMs to Anticipate Actions Very Early
Open accessAbstract
In contrast to the widely studied problem of recognizing an action given a complete sequence, action anticipation aims to identify the action from only partially available videos. As such, it is therefore key to the success of computer vision applications requiring to react as early as possible, such as autonomous navigation. In this paper, we propose a new action anticipation method that achieves high prediction accuracy even in the presence of a very small percentage of a video sequence. To this end, we develop a multi-stage LSTM architecture that leverages context-aware and action-aware features, and introduce a novel loss function that encourages the model to predict the correct class as early as possible. Our experiments on standard benchmark datasets evidence the benefits of our approach; We outperform the state-of-the-art action anticipation methods for early prediction by a relative increase in accuracy of 22.0% on JHMDB-21, 14.0% on UT-Interaction and 49.9% on UCF-101.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
Action recognition with trajectory-pooled deep-convolutional descriptors
Wang, L., Qiao, Y., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299059 · Cited by 1,194 · cited 2×
“To overcome this, some methods localize the feature extraction process by exploiting dense trajectories [39, 38, 9] or optical flow [18].”
MethodResultP-CNN: Pose-Based CNN Features for Action Recognition
Cheron, G., Laptev, I., & Schmid, C. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.368 · Cited by 633
A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection
Singh, B., Marks, T. K., Jones, M., Tuzel, O., & Shao, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.216 · Cited by 461 · cited 1×
“While great progress has been made to recognize actions from complete sequences [16, 38, 7, 9, 30, 41, 31, 10, 2] in the past decade, action anticipation [25, 26, 24, 45, 32, 33, 21], which aims to predict the observed action as early as possible, has become a popular research problem only recently.”
BackgroundRecurrent Neural Networks for driver activity anticipation via sensory-fusion architecture
Jain, A., Singh, A., Koppula, H. S., Soh, S., & Saxena, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487478 · Cited by 271 · cited 8×
“The importance of this result is exemplified by research showing that a large proportion of vehicle accidents are due to mistakes/misinterpretations of the scene in the immediate time leading up to the crash [11, 23].”
BackgroundMethodResultInfluentialThe influence of passengers on the risk of the driver causing a car collision in Spain
Rueda-Domingo, T., Lardelli-Claret, P., Luna-del-Castillo, J. D. D., Jiménez-Moleón, J. J., Garcı́a-Martı́n, M., & Bueno-Cavanillas, A. (2004) · Accident Analysis & Prevention · doi:10.1016/s0001-4575(03)00043-5 · Cited by 96
Research works printed but not linked: 40
- 10.1109/CVPR.2016.290 · DOI
- soomro, 2016, Online localization and prediction of actions and interactions
- 10.1109/CVPR.2016.216 · DOI · Paper page
- 10.1109/CVPR.2016.18 · DOI · Paper page
- van den bergh, 2013, Online video seeds for temporal window objectness, Proceedings of the IEEE International Conference on Computer Vision, 377
- soomro, 2012, Ucf101 A Dataset of 101 Human Actions Classes from Videos in the Wild
- fernando, 2016, Rank pooling for action recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence
- 10.1109/CVPR.2016.296 · DOI
- 10.1109/CVPR.2014.100 · DOI · Paper page
- 10.1109/ICCV.2013.396 · DOI · Paper page
- kong, 2014, A discriminative model with multiple temporal scales for action prediction, European Conference on Computer Vision, 596
- 10.1007/s11263-005-1838-7 · DOI · Paper page
- laviers, 0, Improving offensive performance through opponent modeling, Proc AAAI Conf Artif Intell Interactive Digit Entertain, 58
- 10.1109/CVPR.2016.215 · DOI
- lin, 2013, Network in Network
- simonyan, 2014, Two-stream convolutional networks for action recognition in videos, Advances in neural information processing systems, 568
- saleh, 2016, Built-in foreground/background prior for weakly-supervised semantic segmentation, European Conference on Computer Vision, 413
- 10.1109/CVPR.2014.101 · DOI
- 10.1109/CVPR.2016.387 · DOI
- simonyan, 2014, Very Deep Convolutional Networks for Large-scale Image Recognition
- chollet, 2015, Keras
- 10.1109/CVPR.2016.213 · DOI · Paper page
- 10.1109/CVPR.2015.7298878 · DOI · Paper page
- 10.1109/CVPR.2016.331 · DOI · Paper page
- 10.1109/CVPR.2016.212 · DOI
- 10.1109/CVPR.2015.7299067 · DOI · Paper page
- zeiler, 2014, Visualizing and understanding convolutional networks, European Conference on Computer Vision, 818
- liu, 2016, Spatio-temporal lstm with trust gates for 3d human action recognition, European Conference on Computer Vision, 816
- 10.1145/2393347.2396380 · doi:10.1145/2393347.2396380
- 10.1109/CVPR.2016.319 · DOI · Paper page
- oneata, 2014, Spatiotemporal object detection proposals, European Conference on Computer Vision, 737
- 10.1145/2502081.2502103 · DOI
- 10.1109/CVPR.2016.214 · DOI · Paper page
- 10.1109/CVPR.2016.291 · DOI · Paper page
- ryoo, 2010, An overview of contest on semantic description of human activities (sdha) 2010, Recognizing Patterns in Signals Speech Images and Videos, 270, 10.1007/978-3-642-17711-8_28 · DOI · Paper page
- wang, 2016, Temporal segment networks: towards good practices for deep action recognition, European Conference on Computer Vision, 20
- 10.1109/CVPR.2015.7298735 · DOI · Paper page
- 10.1109/ICCV.2009.5459361 · DOI · Paper page
- wu, 2015, Deep image Scaling up image recognition, 7
- 10.1109/ICCV.2011.6126349 · DOI · Paper page
Cited by
RGB-D-based human motion recognition with deep learning: A survey
Wang, P., Li, W., Ogunbona, P., Wan, J., & Escalera, S. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.04.007 · Cited by 402
Furnari, A., & Farinella, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00635 · Cited by 182
“Additionally, tasks such as action anticipation [18, 32, 58] and early action recognition [2, 9, 39] pose a series of key challenges from a computational perspective.”
BackgroundMethodInfluential
Metadata
- Authors
- Aliakbarian, M. S., Saleh, F. S., Salzmann, M., Fernando, B., Petersson, L., & Andersson, L.
- Venue
- 2017 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 280-289
- OpenAlex
- W2605300166
- Cited by
- 167
- References
- 8
- FWCI
- 5.66
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Encouraging LSTMs to Anticipate Actions Very Early. https://app.cochat.ai/papers/10.1109/iccv.2017.39
- The paper
- Aliakbarian, M. S., Saleh, F. S., Salzmann, M., Fernando, B., Petersson, L., & Andersson, L. (2017). Encouraging LSTMs to Anticipate Actions Very Early. 2017 IEEE International Conference on Computer Vision (ICCV). https://doi.org/10.1109/iccv.2017.39
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.