AIM: Adapting Image Models for Efficient Video Action Recognition
Open accessThe DOI matches its OpenAlex record; 18 of the 18 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
A Closer Look at Spatiotemporal Convolutions for Action Recognition
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., & Paluri, M. (2017) · arXiv · doi:10.48550/arxiv.1711.11248 · Cited by 3,664 · cited 1×
“A paradigm shift from using convolutional networks (Carreira & Zis-serman, 2017; Tran et al., 2018; Yang et al., 2021; Lin et al., 2019; Feichtenhofer et al., 2019) to transformers has been observed for video action recognition.”
MethodRandom Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617
RandAugment: Practical automated data augmentation with a reduced search space
Cubuk, E. D., Zoph, B., Shlens, J., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1909.13719 · Cited by 3,223
ViViT: A Video Vision Transformer
Arnab, A., Dehghani, M., Heigold, G., Sun, C., Lucic, M., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00676 · Cited by 2,767 · cited 4×
“However, adding new temporal modules, either temporal attention (Bertasius et al., 2021; Zhang et al., 2021b) or temporal encoder/decoder (Arnab et al., 2021; Lin et al., 2022), will introduce sizable number of extra tunable parameters.”
BackgroundMethodInfluentialRevisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E. H., Feng, J., & Yan, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00060 · Cited by 2,415 · cited 1×
“ViT (Dosovitskiy et al., 2020) and its variants (Liu et al., 2021; Wang et al., 2021b; Yuan et al., 2021a; Dong et al., 2022) have been proposed to achieve state-of-the-art performance on image recognition.”
BackgroundParameter-efficient transfer learning for NLP
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019) · arXiv · doi:10.48550/arxiv.1902.00751 · Cited by 2,270
Jia, M., Tang, L., Chen, B.-C., Cardie, C., Belongie, S., Hariharan, B., & Lim, S.-N. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19827-4_41 · Cited by 1,965
An Empirical Study of Training Self-Supervised Vision Transformers
Chen, X., Xie, S., & He, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00950 · Cited by 1,648 · cited 1×
“To alleviate the labeling cost, self-supervised learning methods (Chen et al., 2021; Bao et al., 2021; Zhou et al., 2021; He et al., 2022b; Xie et al., 2022) are introduced to learn effective representations from unlabeled data.”
MethodZhai, X., Kolesnikov, A., Houlsby, N., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01179 · Cited by 891
Masked Feature Prediction for Self-Supervised Visual Pre-Training
Wei, C., Fan, H., Xie, S., Wu, C.-Y., Yuille, A., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01426 · Cited by 587
Florence: A New Foundation Model for Computer Vision
Yuan, L., Chen, D., Chen, Y.-L., Codella, N., Dai, X., Gao, J., Hu, H., Huang, X., Li, B., Li, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.11432 · Cited by 389 · cited 2×
“Recently, large foundation models (Radford et al., 2021; Yuan et al., 2021b; Tong et al., 2022; Jia et al., 2021; Wang et al., 2022b) can even demonstrate remarkable few-/zero-shot performance given their learned superior visual representations.”
BackgroundMasked Autoencoders As Spatiotemporal Learners
Feichtenhofer, C., Fan, H., Li, Y., & He, K. (2022) · arXiv · doi:10.48550/arxiv.2205.09113 · Cited by 345
BEVT: BERT Pretraining of Video Transformers
Wang, R., Chen, D., Wu, Z., Chen, Y., Dai, X., Liu, M., Jiang, Y.-G., Zhou, L., & Yuan, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01432 · Cited by 234
Frozen CLIP Models are Efficient Video Learners
Lin, Z., Geng, S., Zhang, R., Gao, P., de Melo, G., Wang, X., Dai, J., Qiao, Y., & Li, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19833-5_23 · Cited by 213
Exploring Visual Prompts for Adapting Large-Scale Models
Bahng, H., Jahanian, A., Sankaranarayanan, S., & Isola, P. (2022) · arXiv · doi:10.48550/arxiv.2203.17274 · Cited by 129
VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning
Tan, H., Lei, J., Wolf, T., & Bansal, M. (2021) · arXiv · doi:10.48550/arxiv.2106.11250 · Cited by 35 · cited 1×
“Another direction is to directly pre-train a video model in a self-supervised manner (Kuang et al., 2021; Feichtenhofer et al., 2022; Zolfaghari et al., 2021; Tan et al., 2021).”
Background
Cited by
3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation
Gong, S., Zhong, Y., Ma, W., Li, J., Wang, Z., Zhang, J., Heng, P.-A., & Dou, Q. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103324 · Cited by 156
“Existing methods adapting the 2D pre-trained models for 3D applications usually process the images in a slice-wise manner and then use an additional spatial adaptor or temporal modules to fuse the 2D information [18].”
BackgroundMethodPromise: Prompt-Driven 3D Medical Image Segmentation Using Pretrained Image Foundation Models
Li, H., Liu, H., Hu, D., Wang, J., & Oguz, I. (2024) · 2024 IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635207 · Cited by 29
“Other models use adapters; this approach has proven effective for adapting a pretrained model from 2D images to 3D (2D+time) videos [6, 9], and it has subsequently been utilized in 3D medical image segmentation [10] with the use of adapters in the pretrained transformer block [7].”
BackgroundMethodMotion-driven adaptive frame selection strategy for video action recognition
Ding, H., Guo, C., Sun, J., Jiang, X., Shi, H., & Li, J. (2025) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-025-00675-2 · Cited by 9
Motion-driven Adaptive Frame Selection Strategy for Video Action Recognition
Ding, H., Guo, C., Sun, J., Jiang, X., Shi, H., & Li, J. (2025) · doi:10.21203/rs.3.rs-5495634/v1 · Cited by 9
The potential of vision-language models for content moderation of children’s videos
Ahmed, S. H., Hu, S., & Sukthankar, G. (2023) · 2023 International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla58977.2023.00186 · Cited by 4
“3) AIM-CLIP [22] AIM leverages the CLIP model’s video encoders through fully trainable lightweight blocks called adapters .”
Method
Metadata
- Authors
- Yang, T., Zhu, Y., Xie, Y., Zhang, A., Chen, C., & Li, M.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2023-02-06
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2302.03024
- OpenAlex
- W4319453767
- Cited by
- 59
- References
- 18
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.