The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Anticipative Video Transformer
Open accessAbstract
We propose Anticipative Video Transformer (AVT), an end-to-end attention-based video modeling architecture that attends to the previously observed video in order to anticipate future actions. We train the model jointly to predict the next action in a video sequence, while also learning frame feature encoders that are predictive of successive future frames’ features. Compared to existing temporal aggregation strategies, AVT has the advantage of both maintaining the sequential progression of observed actions while still capturing long-range dependencies—both critical for the anticipation task. Through extensive experiments, we show that AVT obtains the best reported performance on four popular action anticipation benchmarks: EpicKitchens-55, EpicKitchens-100, EGTEA Gaze+, and 50-Salads; and it wins first place in the EpicKitchens-100 CVPR’21 challenge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Research works printed but not linked: 63
- huang, 2014, Action-reaction: Fore-casting the dynamics of human interaction, ECCV
- 10.1109/CVPR.2017.337 · DOI · Paper page
- girdhar, 2020, CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning, ICLRE
- girdhar, 2017, Attentional pooling for action recognition, NeurIPS
- han, 2020, Memory-augmented dense predictive coding for video representation learning, ECCV
- 10.1109/ICCVW.2019.00186 · DOI · Paper page
- gu, 2021, Transaction: Icl-sjtu submission to epic-kitchens action anticipation challenge 2021, CVPR Workshop
- 10.1109/CVPR.2019.00033 · DOI
- 10.1109/CVPR.2019.01232 · DOI · Paper page
- girdhar, 2021, Anticipative Video Transformer @ EPIC-Kitchens Action Anticipation Challenge 2021, CVPR Workshop
- furnari, 2018, Leveraging uncertainty to rethink loss functions and evaluation measures for egocentric action anticipation, ECCV workshop
- furnari, 2020, Rolling-unrolling lstms for action anticipation from first-person video, TPAMI
- 10.1109/ICCV48922.2021.01595 · DOI · Paper page
- 10.5244/C.31.92 · DOI · Paper page
- 10.1109/CVPRW53098.2021.00254 · DOI
- 10.1109/ICCV.2019.00566 · DOI
- 10.1109/CVPR.2018.00817 · DOI · Paper page
- liu, 2018, Future frame prediction for anomaly detection–a new base-line, CVPR
- liu, 2020, Forecasting human object interaction: Joint prediction of motor attention and actions in first person video, ECCV
- liu, 2019, Non-local recurrent network for image restoration, NeurIPS
- li, 2018, In the eye of beholder: Joint learning of gaze and actions in first person video, ECCV
- 10.1007/978-3-030-58539-6_17 · DOI
- 10.1109/ICCV.2015.166 · DOI · Paper page
- 10.1109/ICCV.2017.73 · DOI · Paper page
- bertasius, 2020, Cobe: Contextualized object embeddings from narrated instructional video, NeurIPS
- 10.1109/CVPR42600.2020.00976 · DOI · Paper page
- 10.1109/CVPR.2017.743 · DOI · Paper page
- kitani, 2012, Activity forecasting, ECCV
- korbar, 2018, Co-operative learning of audio and video models from self-supervised synchronization, NeurIPS
- 10.1109/CVPR.2016.418 · DOI
- kim, 2019, Self-supervised video representation learning with space-time cubic puzzles, Proceedings of the AAAI Conference on Artificial Intelligence, 33, 8545, 10.1609/aaai.v33i01.33018545 · DOI · Paper page
- 10.1109/ICCV.2017.399 · DOI
- ren, 2015, Faster r-cnn: Towards real-time object detection with region proposal networks, NeurIPS
- sener, 2020, Temporal aggregate representations for long-range video under-standing, ECCV
- rodriguez, 2018, Action anticipation by predicting future dynamic images, ECCV workshop
- shi, 2018, Action anticipation with rbf kernelized feature mapping rnn, ECCV
- 10.1109/ICCV48922.2021.00797 · DOI
- 10.1007/978-3-030-01240-3_36 · DOI
- miech, 2017, Learnable pooling with context gating for video classification, CVPR Workshop
- 10.1109/CVPR.2016.214 · DOI · Paper page
- 10.1109/CVPRW.2019.00351 · DOI
- 10.1109/CVPR42600.2020.00024 · DOI
- piaget, 1935, La naissance de l’intelligence chez l’enfant, 216
- 10.1109/CVPR.2018.00560 · DOI · Paper page
- radford, 2018, Improving language understanding by generative pre-training
- 10.1109/CVPR.2019.00037 · DOI · Paper page
- 10.1109/CVPR.2018.00840 · DOI · Paper page
- 10.18653/v1/P19-1176 · DOI · Paper page
- wang, 2016, Temporal segment networks: Towards good practices for deep action recognition, ECCV
- 10.1109/CVPR.2016.18 · DOI · Paper page
- yamamuro, 2021, Submission to epic-kitchens action anticipation challenge 2021, CVPR Workshop
- 10.1109/TIP.2020.3040521 · DOI
- xie, 2018, Rethinking spatiotemporal feature learning for video understanding, ECCV
- 10.1109/WACV.2018.00173 · DOI
- 10.1109/TPAMI.2021.3055233 · DOI
- soomro, 2012, UCF101: A dataset of 101 human actions classes from videos in the wild, CRCV-TR-12-01
- dosovitskiy, 2021, An image is worth 16x16 words: Transformers for image recognition at scale, ICLRE
- 10.1109/ICCV.2019.00756 · DOI · Paper page
- simonyan, 2014, Two-stream convolutional networks for action recognition in videos, NeurIPS
- vaswani, 2017, Attention is all you need, NeurIPS
- touvron, 2021, Training data-efficient image transformers and distillation through attention, ICML
- 10.1109/ICCV.2019.00565 · DOI · Paper page
- 10.1109/CVPR.2018.00675 · DOI · Paper page
Cited by
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01842 · Cited by 630
Self-citationExpanding Language-Image Pretrained Models for General Video Recognition
Ni, B., Peng, H., Chen, M., Zhang, S., Meng, G., Fu, J., Xiang, S., & Ling, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19772-7_1 · Cited by 326
Affordances from Human Videos as a Versatile Representation for Robotics
Bahl, S., Mendonca, R., Chen, L., Jain, U., & Pathak, D. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01324 · Cited by 119
“Similarly, in action anticipation and human motion forecasting, high-level semantic or low level actions are predicted using visual history [1, 11,19,22,31–33,37,40,46–48,55,58,72,75,100,119,120].”
Background
Metadata
- Authors
- Girdhar, R., & Grauman, K.
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 13485-13495
- OpenAlex
- W3169738033
- Cited by
- 211
- References
- 37
- FWCI
- 12.30
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Anticipative Video Transformer. https://app.cochat.ai/papers/10.1109/iccv48922.2021.01325
- The paper
- Girdhar, R., & Grauman, K. (2021). Anticipative Video Transformer. 2021 IEEE/CVF International Conference on Computer Vision (ICCV). https://doi.org/10.1109/iccv48922.2021.01325
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.