Cited by 63Domain Adaptation and Few-Shot LearningHuman Pose and Action RecognitionHand Gesture Recognition Systems

A Pairwise Attentive Adversarial Spatiotemporal Network for Cross-Domain Few-Shot Action Recognition-R2

Gao, Zan, Guo, Leming, Guan, Weili, Liu, An-An, Ren, Tongwei, Chen, Shengyong·2021·IEEE Transactions on Image Processing

Abstract

Action recognition is a popular research topic in the computer vision and machine learning domains. Although many action recognition methods have been proposed, only a few researchers have focused on cross-domain few-shot action recognition, which must often be performed in real security surveillance. Since the problems of action recognition, domain adaptation, and few-shot learning need to be simultaneously solved, the cross-domain few-shot action recognition task is a challenging problem. To solve these issues, in this work, we develop a novel end-to-end pairwise attentive adversarial spatiotemporal network (PASTN) to perform the cross-domain few-shot action recognition task, in which spatiotemporal information acquisition, few-shot learning, and video domain adaptation are realised in a unified framework. Specifically, the Resnet-50 network is selected as the backbone of the PASTN, and a 3D convolution block is embedded in the top layer of the 2D CNN (ResNet-50) to capture the spatiotemporal representations. Moreover, a novel attentive adversarial network architecture is designed to align the spatiotemporal dynamics actions with higher domain discrepancies. In addition, the pairwise margin discrimination loss is designed for the pairwise network architecture to improve the discrimination of the learned domain-invariant spatiotemporal feature. The results of extensive experiments performed on three public benchmarks of the cross-domain action recognition datasets, including SDAI Action I, SDAI Action II and UCF50-OlympicSport, demonstrate that the proposed PASTN can significantly outperform the state-of-the-art cross-domain action recognition methods in terms of both the accuracy and computational time. Even when only two labelled training samples per category are considered in the office1 scenario of the SDAI Action I dataset, the accuracy of the PASTN is improved by 6.1%, 10.9%, 16.8%, and 14% compared to that of the $TA^{3}N$ , TemporalPooling, I3D, and P3D methods, respectively.

Integrity signals

Registry

Crossref · 10.1109/tip.2020.3038372

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

3 of the 67 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Gao, Z., Guo, L., Guan, W., Liu, A.-A., Ren, T., & Chen, S.
Affiliations
  • Qilu University of Technology (CN)
  • Tianjin University of Technology (CN)
  • Monash University (AU)
  • Tianjin University (CN)
  • Nanjing University (CN)
Venue
IEEE Transactions on Image Processing
Published
2021
Volume
30
Pages
767-782
ISSN
  • 1057-7149 (ISSN-L)
  • 1941-0042
OpenAlex
W3107322323
Cited by
63
References
67
Citations by year
2026: 3 · 2025: 6 · 2024: 7 · 2023: 13 · 2022: 16 · 2021: 18
FWCI
4.62
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Image Processing (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (61872270, 62020106004)
  • Young Creative Team in universities of Shandong Province (2020KJN012)
  • Jinan 20 projects in universities (2018GXRC014)
  • Tianjin New Generation Artificial Intelligence Major Program (18ZXZNGX00150, 19ZXZNGX00110)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
Keywords
spatiotemporal feature learning, adversarial training, 3D convolution, ResNet50 backbone, security monitoring, domain-invariant features

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review