PreprintCited by 55Gait Recognition and AnalysisHuman Pose and Action RecognitionBiometric Identification and Security

Associated Spatio-Temporal Capsule Network for Gait Recognition

Open access
Zhao, Aite, Dong, Junyu, Li, Jianbo, Qi, Lin, Zhou, Huiyu·2021·arXiv

Abstract

It is a challenging task to identify a person based on her/his gait patterns. State-of-the-art approaches rely on the analysis of temporal or spatial characteristics of gait, and gait recognition is usually performed on single modality data (such as images, skeleton joint coordinates, or force signals). Evidence has shown that using multi-modality data is more conducive to gait research. Therefore, we here establish an automated learning system, with an associated spatio-temporal capsule network (ASTCapsNet) trained on multi-sensor datasets, to analyze multimodal information for gait recognition. Specifically, we first design a low-level feature extractor and a high-level feature extractor for spatio-temporal feature extraction of gait with a novel recurrent memory unit and a relationship layer. Subsequently, a Bayesian model is employed for the decision-making of class labels. Extensive experiments on several public datasets (normal and abnormal gait) validate the effectiveness of the proposed ASTCapsNet, compared against several state-of-the-art methods.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2101.02458

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Zhao et al. introduced ASTCapsNet, trained on multi-sensor datasets, showing that multi-modality data is more conducive to gait recognition.

    “Finally, Zhao et al. [134] introduced an automated learning system called Associated SpatioTemporal Capsule Network (ASTCapsNet). The model was trained over multi-sensor datasets to show that multi-modality data is more conducive to gait recognition.”

    From Gait Recognition Based on Deep Learning: A Survey (2023) · cites this paper as [134]

    The Abstract says the authors introduced ASTCapsNet, trained on multi-sensor datasets, and states that multimodality is conducive to gait research. But the Discussion says the model recognizes gait from different sources without considering relationships between modalities; the reported experiments do not establish that multimodal data outperforms single-modality data for gait recognition. The copy provides section labels but no page numbers. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Y. Zhao, Z. Jin, G. J. Qi, H. Lu, and X. S. Hua, An Adversarial Approach to Hard Triplet Generation. Springer, Cham, 2018.

Cited by

Sorted by citations

Authors
Zhao, A., Dong, J., Li, J., Qi, L., & Zhou, H.
Affiliations
  • Qingdao University (CN)
  • Ocean University of China (CN)
  • University of Leicester (GB)
Venue
arXiv
Publisher
arXiv
Published
2021
Volume
24
Pages
846-860
ISSN
1520-9210 (ISSN-L)
OpenAlex
W3129630843
Cited by
55
References
44
Citations by year
2026: 5 · 2025: 5 · 2024: 8 · 2023: 18 · 2022: 15 · 2021: 4
FWCI
3.42
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Multimedia (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (61802216)
  • China Postdoctoral Science Foundation (2018M642613)
  • Natural Science Foundation of Shandong Province (ZR2020MF060)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
Keywords
gait recognition, multimodal fusion, multi-sensor data, Bayesian decision making, gait disturbance, personal identification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review